2024-02-09T07:39:39.688 INFO:root:teuthology version: 0.0.1.dev256+gd9fdb22 2024-02-09T07:39:39.688 DEBUG:teuthology.run:Teuthology command: teuthology --name yuriw-2024-02-09_00:15:46-rados-wip-yuri2-testing-2024-02-08-0727-distro-default-smithi --owner scheduled_yuriw@teuthology --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} --archive /home/teuthworker/archive/yuriw-2024-02-09_00:15:46-rados-wip-yuri2-testing-2024-02-08-0727-distro-default-smithi/7553275 --verbose -- /home/teuthworker/archive/yuriw-2024-02-09_00:15:46-rados-wip-yuri2-testing-2024-02-08-0727-distro-default-smithi/7553275/orig.config.yaml 2024-02-09T07:39:39.730 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-09T07:39:39.817 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2024-02-09_00:15:46-rados-wip-yuri2-testing-2024-02-08-0727-distro-default-smithi/7553275 branch: wip-yuri2-testing-2024-02-08-0727 description: rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} email: yweinste@redhat.com first_in_suite: false job_id: '7553275' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yuriw-2024-02-09_00:15:46-rados-wip-yuri2-testing-2024-02-08-0727-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-yuri2-testing-2024-02-08-0727 ceph: conf: client: debug monc: 20 debug ms: 1 debug objecter: 20 debug rados: 20 global: mon client directed command retry: 5 mon election default strategy: 1 ms inject socket failures: 5000 ms type: async osd heartbeat grace: 80 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osd crush smoke test: false mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub interval: 300 mon warn on pool no app: false paxos service trim min: 10 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true bluestore zero block detection: true debug bluefs: 1 debug bluestore: 1 debug monc: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd class default list: '*' osd class load list: '*' osd client watch timeout: 120 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd fast shutdown: false osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - reached quota - overall HEALTH_ - \(CACHE_POOL_NO_HIT_SET\) - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(SLOW_OPS\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(OBJECT_MISPLACED\) - slow request - overall HEALTH_ - \(PG_ - \(MON_DOWN\) - \(SLOW_OPS\) - slow request sha1: 0089f33ec7e39da1a9e0f281bf62a5b44e1951f6 valgrind: mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes osd: - --tool=memcheck ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: debuginfo: true flavor: default sha1: 0089f33ec7e39da1a9e0f281bf62a5b44e1951f6 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri2-testing-2024-02-08-0727 sha1: 0089f33ec7e39da1a9e0f281bf62a5b44e1951f6 owner: scheduled_yuriw@teuthology priority: 71 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 5695 sha1: 0089f33ec7e39da1a9e0f281bf62a5b44e1951f6 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-yuri2-testing-2024-02-08-0727 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_0089f33ec7e39da1a9e0f281bf62a5b44e1951f6/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 0089f33ec7e39da1a9e0f281bf62a5b44e1951f6 targets: smithi062.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAhTwqhJJJycTelWYyHioxLcOZaijtvo91ZWyeIZH2roP0Z5mXpO5wFEEzVJusAXqkxtvan3OatqrN/S3EgMnlM= smithi103.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHC5JilHHP1xcqOPDFLRQETYuFAlpEWmBmSeVD1yvz/xk66Zegel9L9JuyOngn02Xa2iak8K3yFMbjcDp7OW4KA= tasks: - install: null - ceph: null - workunit: clients: client.0: - rados/test.sh env: ALLOW_TIMEOUTS: '1' timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: d9fdb2209e15b39d9f061fd85399f352ce0f0894 timestamp: 2024-02-09_00:15:46 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-02-09T07:39:39.818 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_0089f33ec7e39da1a9e0f281bf62a5b44e1951f6/qa; will attempt to use it 2024-02-09T07:39:39.818 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_0089f33ec7e39da1a9e0f281bf62a5b44e1951f6/qa/tasks 2024-02-09T07:39:39.818 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-02-09T07:39:39.820 INFO:teuthology.task.internal:Checking packages... 2024-02-09T07:39:39.854 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '0089f33ec7e39da1a9e0f281bf62a5b44e1951f6' 2024-02-09T07:39:39.854 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-09T07:39:39.854 INFO:teuthology.packaging:ref: None 2024-02-09T07:39:39.854 INFO:teuthology.packaging:tag: None 2024-02-09T07:39:39.854 INFO:teuthology.packaging:branch: wip-yuri2-testing-2024-02-08-0727 2024-02-09T07:39:39.854 INFO:teuthology.packaging:sha1: 0089f33ec7e39da1a9e0f281bf62a5b44e1951f6 2024-02-09T07:39:39.854 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-yuri2-testing-2024-02-08-0727 2024-02-09T07:39:40.186 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1310.g0089f33e 2024-02-09T07:39:40.188 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-02-09T07:39:40.200 INFO:teuthology.task.internal:no buildpackages task found 2024-02-09T07:39:40.201 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-02-09T07:39:40.239 INFO:teuthology.task.internal:Saving configuration 2024-02-09T07:39:40.254 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-02-09T07:39:40.303 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-09T07:39:40.328 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-09_00:15:46-rados-wip-yuri2-testing-2024-02-08-0727-distro-default-smithi/7553275', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-09 07:34:09.163873', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAhTwqhJJJycTelWYyHioxLcOZaijtvo91ZWyeIZH2roP0Z5mXpO5wFEEzVJusAXqkxtvan3OatqrN/S3EgMnlM='} 2024-02-09T07:39:40.352 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi103.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-09_00:15:46-rados-wip-yuri2-testing-2024-02-08-0727-distro-default-smithi/7553275', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-09 07:34:09.165090', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHC5JilHHP1xcqOPDFLRQETYuFAlpEWmBmSeVD1yvz/xk66Zegel9L9JuyOngn02Xa2iak8K3yFMbjcDp7OW4KA='} 2024-02-09T07:39:40.353 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-02-09T07:39:40.360 INFO:teuthology.task.internal:roles: ubuntu@smithi062.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-02-09T07:39:40.360 INFO:teuthology.task.internal:roles: ubuntu@smithi103.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-02-09T07:39:40.361 INFO:teuthology.run_tasks:Running task console_log... 2024-02-09T07:39:40.452 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1ae762df70>, signals=[15]) 2024-02-09T07:39:40.453 INFO:teuthology.run_tasks:Running task internal.connect... 2024-02-09T07:39:40.461 INFO:teuthology.task.internal:Opening connections... 2024-02-09T07:39:40.461 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi062.front.sepia.ceph.com 2024-02-09T07:39:40.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T07:39:40.568 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi103.front.sepia.ceph.com 2024-02-09T07:39:40.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T07:39:40.655 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-02-09T07:39:40.662 DEBUG:teuthology.orchestra.run.smithi062:> uname -m 2024-02-09T07:39:40.680 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64 2024-02-09T07:39:40.680 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2024-02-09T07:39:40.741 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Stream" 2024-02-09T07:39:40.741 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="9" 2024-02-09T07:39:40.741 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos" 2024-02-09T07:39:40.741 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora" 2024-02-09T07:39:40.741 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="9" 2024-02-09T07:39:40.741 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el9" 2024-02-09T07:39:40.742 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-09T07:39:40.742 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31" 2024-02-09T07:39:40.742 INFO:teuthology.orchestra.run.smithi062.stdout:LOGO="fedora-logo-icon" 2024-02-09T07:39:40.742 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-09T07:39:40.742 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://centos.org/" 2024-02-09T07:39:40.742 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-09T07:39:40.742 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-09T07:39:40.742 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-09T07:39:40.743 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2024-02-09T07:39:40.767 DEBUG:teuthology.orchestra.run.smithi103:> uname -m 2024-02-09T07:39:40.785 INFO:teuthology.orchestra.run.smithi103.stdout:x86_64 2024-02-09T07:39:40.785 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2024-02-09T07:39:40.843 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="CentOS Stream" 2024-02-09T07:39:40.843 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="9" 2024-02-09T07:39:40.843 INFO:teuthology.orchestra.run.smithi103.stdout:ID="centos" 2024-02-09T07:39:40.843 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="rhel fedora" 2024-02-09T07:39:40.843 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="9" 2024-02-09T07:39:40.843 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el9" 2024-02-09T07:39:40.844 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-09T07:39:40.844 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31" 2024-02-09T07:39:40.844 INFO:teuthology.orchestra.run.smithi103.stdout:LOGO="fedora-logo-icon" 2024-02-09T07:39:40.844 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-09T07:39:40.844 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://centos.org/" 2024-02-09T07:39:40.844 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-09T07:39:40.844 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-09T07:39:40.844 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-09T07:39:40.844 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2024-02-09T07:39:40.875 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-02-09T07:39:40.887 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-02-09T07:39:40.922 INFO:teuthology.task.internal:Checking for old test directory... 2024-02-09T07:39:40.922 DEBUG:teuthology.orchestra.run.smithi062:> test '!' -e /home/ubuntu/cephtest 2024-02-09T07:39:40.925 DEBUG:teuthology.orchestra.run.smithi103:> test '!' -e /home/ubuntu/cephtest 2024-02-09T07:39:40.941 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-02-09T07:39:40.947 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-02-09T07:39:40.947 DEBUG:teuthology.orchestra.run.smithi062:> test -z $(ls -A /var/lib/ceph) 2024-02-09T07:39:40.983 DEBUG:teuthology.orchestra.run.smithi103:> test -z $(ls -A /var/lib/ceph) 2024-02-09T07:39:41.088 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-02-09T07:39:41.143 INFO:teuthology.run_tasks:Running task kernel... 2024-02-09T07:39:41.158 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-02-09T07:39:41.158 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-02-09T07:39:41.158 DEBUG:teuthology.orchestra.run.smithi062:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-09T07:39:41.159 DEBUG:teuthology.orchestra.run.smithi103:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-09T07:39:41.175 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-09T07:39:41.176 DEBUG:teuthology.orchestra.run.smithi103:> uname -r 2024-02-09T07:39:41.176 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-09T07:39:41.177 DEBUG:teuthology.orchestra.run.smithi062:> uname -r 2024-02-09T07:39:41.231 INFO:teuthology.orchestra.run.smithi103.stdout:5.14.0-361.el9.x86_64 2024-02-09T07:39:41.231 INFO:teuthology.task.kernel:Running kernel on smithi103: 5.14.0-361.el9.x86_64 2024-02-09T07:39:41.231 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum install -y kernel 2024-02-09T07:39:41.234 INFO:teuthology.orchestra.run.smithi062.stdout:5.14.0-361.el9.x86_64 2024-02-09T07:39:41.234 INFO:teuthology.task.kernel:Running kernel on smithi062: 5.14.0-361.el9.x86_64 2024-02-09T07:39:41.234 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum install -y kernel 2024-02-09T07:39:43.480 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS-9 - AppStream 15 MB/s | 8.0 MB 00:00 2024-02-09T07:39:43.514 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS-9 - AppStream 14 MB/s | 8.0 MB 00:00 2024-02-09T07:39:45.123 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS-9 - BaseOS 8.5 MB/s | 2.5 MB 00:00 2024-02-09T07:39:45.265 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS-9 - BaseOS 5.6 MB/s | 2.5 MB 00:00 2024-02-09T07:39:46.104 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.0 MB 00:00 2024-02-09T07:39:58.680 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - BaseOS 632 kB/s | 8.0 MB 00:12 2024-02-09T07:40:00.630 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - AppStream 22 MB/s | 19 MB 00:00 2024-02-09T07:40:05.489 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - CRB 4.5 MB/s | 5.9 MB 00:01 2024-02-09T07:40:18.781 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - Extras packages 1.2 kB/s | 15 kB 00:12 2024-02-09T07:40:20.382 INFO:teuthology.orchestra.run.smithi103.stdout:Extra Packages for Enterprise Linux 14 MB/s | 20 MB 00:01 2024-02-09T07:40:25.302 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - AppStream 505 kB/s | 19 MB 00:38 2024-02-09T07:40:25.407 INFO:teuthology.orchestra.run.smithi103.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2024-02-09T07:40:27.616 INFO:teuthology.orchestra.run.smithi103.stderr:Modular dependency problems: 2024-02-09T07:40:27.616 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T07:40:27.616 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 1: conflicting requests 2024-02-09T07:40:27.616 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.616 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 2: conflicting requests 2024-02-09T07:40:27.616 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.616 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 3: conflicting requests 2024-02-09T07:40:27.616 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.617 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 4: conflicting requests 2024-02-09T07:40:27.617 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.617 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 5: conflicting requests 2024-02-09T07:40:27.617 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.617 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 6: conflicting requests 2024-02-09T07:40:27.617 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.617 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 7: conflicting requests 2024-02-09T07:40:27.617 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.617 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 8: conflicting requests 2024-02-09T07:40:27.617 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.617 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 9: conflicting requests 2024-02-09T07:40:27.617 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.617 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 10: conflicting requests 2024-02-09T07:40:27.617 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.617 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 11: conflicting requests 2024-02-09T07:40:27.618 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.618 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 12: conflicting requests 2024-02-09T07:40:27.618 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.618 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 13: conflicting requests 2024-02-09T07:40:27.618 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.618 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 14: conflicting requests 2024-02-09T07:40:27.618 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.618 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 15: conflicting requests 2024-02-09T07:40:27.618 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.618 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 16: conflicting requests 2024-02-09T07:40:27.618 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.618 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 17: conflicting requests 2024-02-09T07:40:27.618 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.619 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 18: conflicting requests 2024-02-09T07:40:27.619 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.619 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 19: conflicting requests 2024-02-09T07:40:27.619 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.619 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 20: conflicting requests 2024-02-09T07:40:27.619 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.619 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 21: conflicting requests 2024-02-09T07:40:27.619 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.619 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 22: conflicting requests 2024-02-09T07:40:27.619 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.619 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 23: conflicting requests 2024-02-09T07:40:27.619 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.619 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 24: conflicting requests 2024-02-09T07:40:27.620 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.620 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 25: conflicting requests 2024-02-09T07:40:27.620 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.620 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 26: conflicting requests 2024-02-09T07:40:27.620 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.620 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 27: conflicting requests 2024-02-09T07:40:27.620 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.620 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 28: conflicting requests 2024-02-09T07:40:27.620 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.621 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 29: conflicting requests 2024-02-09T07:40:27.621 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.621 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 30: conflicting requests 2024-02-09T07:40:27.621 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.621 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 31: conflicting requests 2024-02-09T07:40:27.621 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.621 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 32: conflicting requests 2024-02-09T07:40:27.621 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.621 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 33: conflicting requests 2024-02-09T07:40:27.621 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.621 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 34: conflicting requests 2024-02-09T07:40:27.621 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.621 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 35: conflicting requests 2024-02-09T07:40:27.621 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.622 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 36: conflicting requests 2024-02-09T07:40:27.622 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.622 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 37: conflicting requests 2024-02-09T07:40:27.622 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.622 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.622 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.622 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:40:27.622 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.622 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.622 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.622 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.622 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 39: conflicting requests 2024-02-09T07:40:27.622 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.623 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.623 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.623 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.623 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.623 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.623 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:40:27.623 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.623 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.623 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.623 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.623 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:40:27.623 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.623 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.624 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.624 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.624 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:40:27.624 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.624 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.624 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.624 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.624 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:40:27.624 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.624 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.624 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.624 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.624 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:40:27.624 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.624 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.625 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.625 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.625 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:40:27.625 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.625 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.625 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:40:27.625 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:40:28.023 INFO:teuthology.orchestra.run.smithi103.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-02-09T07:40:28.023 INFO:teuthology.orchestra.run.smithi103.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-02-09T07:40:28.118 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-02-09T07:40:28.125 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:40:28.125 INFO:teuthology.orchestra.run.smithi103.stdout: Package Architecture Version Repository Size 2024-02-09T07:40:28.125 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:40:28.125 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-02-09T07:40:28.126 INFO:teuthology.orchestra.run.smithi103.stdout: kernel x86_64 5.14.0-412.el9 baseos 6.0 M 2024-02-09T07:40:28.126 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-02-09T07:40:28.126 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-core x86_64 5.14.0-412.el9 baseos 21 M 2024-02-09T07:40:28.126 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-modules x86_64 5.14.0-412.el9 baseos 39 M 2024-02-09T07:40:28.126 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-modules-core x86_64 5.14.0-412.el9 baseos 33 M 2024-02-09T07:40:28.126 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:40:28.126 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-02-09T07:40:28.126 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:40:28.126 INFO:teuthology.orchestra.run.smithi103.stdout:Install 4 Packages 2024-02-09T07:40:28.126 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:40:28.127 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 99 M 2024-02-09T07:40:28.127 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 122 M 2024-02-09T07:40:28.127 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-02-09T07:40:29.776 INFO:teuthology.orchestra.run.smithi103.stdout:(1/4): kernel-5.14.0-412.el9.x86_64.rpm 3.7 MB/s | 6.0 MB 00:01 2024-02-09T07:40:30.292 INFO:teuthology.orchestra.run.smithi103.stdout:(2/4): kernel-core-5.14.0-412.el9.x86_64.rpm 9.8 MB/s | 21 MB 00:02 2024-02-09T07:40:31.043 INFO:teuthology.orchestra.run.smithi103.stdout:(3/4): kernel-modules-5.14.0-412.el9.x86_64.rpm 14 MB/s | 39 MB 00:02 2024-02-09T07:40:33.201 INFO:teuthology.orchestra.run.smithi103.stdout:(4/4): kernel-modules-core-5.14.0-412.el9.x86_6 9.7 MB/s | 33 MB 00:03 2024-02-09T07:40:33.201 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:40:33.201 INFO:teuthology.orchestra.run.smithi103.stdout:Total 20 MB/s | 99 MB 00:05 2024-02-09T07:40:34.090 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-02-09T07:40:34.506 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-02-09T07:40:34.506 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-02-09T07:40:36.151 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-02-09T07:40:36.151 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-02-09T07:40:38.879 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-02-09T07:40:39.538 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : kernel-modules-core-5.14.0-412.el9.x86_64 1/4 2024-02-09T07:40:39.679 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : kernel-core-5.14.0-412.el9.x86_64 2/4 2024-02-09T07:40:39.851 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - CRB 563 kB/s | 5.9 MB 00:10 2024-02-09T07:40:42.439 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-core-5.14.0-412.el9.x86_64 2/4 2024-02-09T07:40:42.624 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : kernel-modules-5.14.0-412.el9.x86_64 3/4 2024-02-09T07:40:47.349 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-modules-5.14.0-412.el9.x86_64 3/4 2024-02-09T07:40:47.576 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : kernel-5.14.0-412.el9.x86_64 4/4 2024-02-09T07:40:52.328 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-modules-core-5.14.0-412.el9.x86_64 4/4 2024-02-09T07:41:21.476 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-core-5.14.0-412.el9.x86_64 4/4 2024-02-09T07:41:21.476 INFO:teuthology.orchestra.run.smithi103.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-02-09T07:41:21.477 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:41:21.562 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-modules-5.14.0-412.el9.x86_64 4/4 2024-02-09T07:41:22.004 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-5.14.0-412.el9.x86_64 4/4 2024-02-09T07:41:22.004 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : kernel-5.14.0-412.el9.x86_64 1/4 2024-02-09T07:41:22.004 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : kernel-core-5.14.0-412.el9.x86_64 2/4 2024-02-09T07:41:22.004 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : kernel-modules-5.14.0-412.el9.x86_64 3/4 2024-02-09T07:41:22.449 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : kernel-modules-core-5.14.0-412.el9.x86_64 4/4 2024-02-09T07:41:22.449 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:41:22.449 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-02-09T07:41:22.449 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-5.14.0-412.el9.x86_64 2024-02-09T07:41:22.449 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-core-5.14.0-412.el9.x86_64 2024-02-09T07:41:22.450 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-modules-5.14.0-412.el9.x86_64 2024-02-09T07:41:22.450 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-modules-core-5.14.0-412.el9.x86_64 2024-02-09T07:41:22.450 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:41:22.450 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-02-09T07:41:22.963 DEBUG:teuthology.orchestra.run.smithi103:> rpm -q kernel | sort -rV | head -n 1 2024-02-09T07:41:23.111 INFO:teuthology.orchestra.run.smithi103.stdout:kernel-5.14.0-412.el9.x86_64 2024-02-09T07:41:23.111 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-412.el9.x86_64 2024-02-09T07:41:23.112 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-412.el9.x86_64 2024-02-09T07:41:23.112 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-09T07:41:23.112 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-09T07:41:23.112 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-02-09T07:41:23.112 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi103.front.sepia.ceph.com, path=None, version=distro) 2024-02-09T07:41:23.112 DEBUG:teuthology.orchestra.run.smithi103:> rpm -q kernel | sort -rV | head -n 1 2024-02-09T07:41:23.235 INFO:teuthology.orchestra.run.smithi103.stdout:kernel-5.14.0-412.el9.x86_64 2024-02-09T07:41:23.235 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-412.el9.x86_64 2024-02-09T07:41:23.235 DEBUG:teuthology.orchestra.run.smithi103:> sudo rpm -qi grub2-tools 2024-02-09T07:41:23.275 INFO:teuthology.orchestra.run.smithi103.stdout:Name : grub2-tools 2024-02-09T07:41:23.275 INFO:teuthology.orchestra.run.smithi103.stdout:Epoch : 1 2024-02-09T07:41:23.275 INFO:teuthology.orchestra.run.smithi103.stdout:Version : 2.06 2024-02-09T07:41:23.275 INFO:teuthology.orchestra.run.smithi103.stdout:Release : 68.el9 2024-02-09T07:41:23.276 INFO:teuthology.orchestra.run.smithi103.stdout:Architecture: x86_64 2024-02-09T07:41:23.276 INFO:teuthology.orchestra.run.smithi103.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-02-09T07:41:23.276 INFO:teuthology.orchestra.run.smithi103.stdout:Group : Unspecified 2024-02-09T07:41:23.276 INFO:teuthology.orchestra.run.smithi103.stdout:Size : 8264254 2024-02-09T07:41:23.276 INFO:teuthology.orchestra.run.smithi103.stdout:License : GPLv3+ 2024-02-09T07:41:23.276 INFO:teuthology.orchestra.run.smithi103.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-02-09T07:41:23.276 INFO:teuthology.orchestra.run.smithi103.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-02-09T07:41:23.276 INFO:teuthology.orchestra.run.smithi103.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-02-09T07:41:23.276 INFO:teuthology.orchestra.run.smithi103.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-02-09T07:41:23.276 INFO:teuthology.orchestra.run.smithi103.stdout:Packager : builder@centos.org 2024-02-09T07:41:23.276 INFO:teuthology.orchestra.run.smithi103.stdout:Vendor : CentOS 2024-02-09T07:41:23.276 INFO:teuthology.orchestra.run.smithi103.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-09T07:41:23.276 INFO:teuthology.orchestra.run.smithi103.stdout:Summary : Support tools for GRUB. 2024-02-09T07:41:23.276 INFO:teuthology.orchestra.run.smithi103.stdout:Description : 2024-02-09T07:41:23.277 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:41:23.277 INFO:teuthology.orchestra.run.smithi103.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-09T07:41:23.277 INFO:teuthology.orchestra.run.smithi103.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-09T07:41:23.277 INFO:teuthology.orchestra.run.smithi103.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-09T07:41:23.277 INFO:teuthology.orchestra.run.smithi103.stdout:hardware devices. 2024-02-09T07:41:23.277 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:41:23.277 INFO:teuthology.orchestra.run.smithi103.stdout:This subpackage provides tools for support of all platforms. 2024-02-09T07:41:23.278 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-09T07:41:23.278 INFO:teuthology.task.kernel:Updating grub on smithi103 to boot 5.14.0-412.el9.x86_64 2024-02-09T07:41:23.278 DEBUG:teuthology.orchestra.run.smithi103:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-09T07:41:23.854 INFO:teuthology.orchestra.run.smithi103.stderr:Generating grub configuration file ... 2024-02-09T07:41:25.276 INFO:teuthology.orchestra.run.smithi103.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-02-09T07:41:25.310 INFO:teuthology.orchestra.run.smithi103.stderr:done 2024-02-09T07:41:25.313 DEBUG:teuthology.orchestra.run.smithi103:> mktemp 2024-02-09T07:41:25.329 INFO:teuthology.orchestra.run.smithi103.stdout:/tmp/tmp.y2lo17U0e8 2024-02-09T07:41:25.330 DEBUG:teuthology.orchestra.run.smithi103:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.y2lo17U0e8 2024-02-09T07:41:25.398 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 0666 /tmp/tmp.y2lo17U0e8 2024-02-09T07:41:25.542 DEBUG:teuthology.orchestra.remote:smithi103:/tmp/tmp.y2lo17U0e8 is 6KB 2024-02-09T07:41:25.591 DEBUG:teuthology.orchestra.run.smithi103:> rm -fr /tmp/tmp.y2lo17U0e8 2024-02-09T07:41:25.605 DEBUG:teuthology.orchestra.run.smithi103:> sudo /bin/ls /boot/loader/entries || true 2024-02-09T07:41:25.670 INFO:teuthology.orchestra.run.smithi103.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-02-09T07:41:25.670 INFO:teuthology.orchestra.run.smithi103.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-02-09T07:41:25.671 INFO:teuthology.orchestra.run.smithi103.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-02-09T07:41:25.671 INFO:teuthology.orchestra.run.smithi103.stdout:15949e3c88704300882482eddfd7baae-5.14.0-412.el9.x86_64.conf 2024-02-09T07:41:25.672 DEBUG:teuthology.orchestra.run.smithi103:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-412.el9.x86_64 2024-02-09T07:41:25.825 DEBUG:teuthology.orchestra.run.smithi103:> sudo shutdown -r now 2024-02-09T07:41:45.511 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - Extras packages 236 B/s | 15 kB 01:04 2024-02-09T07:41:47.356 INFO:teuthology.orchestra.run.smithi062.stdout:Extra Packages for Enterprise Linux 12 MB/s | 20 MB 00:01 2024-02-09T07:41:52.421 INFO:teuthology.orchestra.run.smithi062.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-02-09T07:41:54.721 INFO:teuthology.orchestra.run.smithi062.stderr:Modular dependency problems: 2024-02-09T07:41:54.722 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T07:41:54.722 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 1: conflicting requests 2024-02-09T07:41:54.722 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.722 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 2: conflicting requests 2024-02-09T07:41:54.722 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.722 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 3: conflicting requests 2024-02-09T07:41:54.722 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.722 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 4: conflicting requests 2024-02-09T07:41:54.722 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.722 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 5: conflicting requests 2024-02-09T07:41:54.723 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.723 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 6: conflicting requests 2024-02-09T07:41:54.723 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.723 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 7: conflicting requests 2024-02-09T07:41:54.723 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.723 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 8: conflicting requests 2024-02-09T07:41:54.723 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.723 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 9: conflicting requests 2024-02-09T07:41:54.723 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.723 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 10: conflicting requests 2024-02-09T07:41:54.723 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.723 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 11: conflicting requests 2024-02-09T07:41:54.723 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.723 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 12: conflicting requests 2024-02-09T07:41:54.724 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.724 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 13: conflicting requests 2024-02-09T07:41:54.724 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.724 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 14: conflicting requests 2024-02-09T07:41:54.724 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.724 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 15: conflicting requests 2024-02-09T07:41:54.724 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.724 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 16: conflicting requests 2024-02-09T07:41:54.724 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.724 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 17: conflicting requests 2024-02-09T07:41:54.724 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.724 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 18: conflicting requests 2024-02-09T07:41:54.724 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.725 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 19: conflicting requests 2024-02-09T07:41:54.725 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.725 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 20: conflicting requests 2024-02-09T07:41:54.725 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.725 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 21: conflicting requests 2024-02-09T07:41:54.725 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.725 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 22: conflicting requests 2024-02-09T07:41:54.725 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.725 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 23: conflicting requests 2024-02-09T07:41:54.725 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.725 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 24: conflicting requests 2024-02-09T07:41:54.725 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.726 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 25: conflicting requests 2024-02-09T07:41:54.726 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.726 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 26: conflicting requests 2024-02-09T07:41:54.726 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.726 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 27: conflicting requests 2024-02-09T07:41:54.726 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.726 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 28: conflicting requests 2024-02-09T07:41:54.726 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.726 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 29: conflicting requests 2024-02-09T07:41:54.726 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.727 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 30: conflicting requests 2024-02-09T07:41:54.727 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.727 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 31: conflicting requests 2024-02-09T07:41:54.727 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.727 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 32: conflicting requests 2024-02-09T07:41:54.727 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.727 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 33: conflicting requests 2024-02-09T07:41:54.727 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.727 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 34: conflicting requests 2024-02-09T07:41:54.728 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.728 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 35: conflicting requests 2024-02-09T07:41:54.728 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.728 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 36: conflicting requests 2024-02-09T07:41:54.728 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.728 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 37: conflicting requests 2024-02-09T07:41:54.728 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.728 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.728 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.728 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:41:54.728 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.728 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.728 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.728 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.729 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 39: conflicting requests 2024-02-09T07:41:54.729 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.729 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.729 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.729 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.729 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.729 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.729 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:41:54.729 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.729 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.729 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.729 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.729 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:41:54.729 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.730 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.730 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.730 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.730 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:41:54.730 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.730 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.730 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.730 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.730 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:41:54.730 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.730 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.730 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.730 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.730 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:41:54.731 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.731 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.731 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.731 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.731 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:41:54.731 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.731 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.731 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:41:54.731 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:41:55.144 INFO:teuthology.orchestra.run.smithi062.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-02-09T07:41:55.144 INFO:teuthology.orchestra.run.smithi062.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-02-09T07:41:55.264 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-02-09T07:41:55.269 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:41:55.269 INFO:teuthology.orchestra.run.smithi062.stdout: Package Architecture Version Repository Size 2024-02-09T07:41:55.269 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:41:55.269 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-02-09T07:41:55.269 INFO:teuthology.orchestra.run.smithi062.stdout: kernel x86_64 5.14.0-412.el9 baseos 6.0 M 2024-02-09T07:41:55.269 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-02-09T07:41:55.269 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-core x86_64 5.14.0-412.el9 baseos 21 M 2024-02-09T07:41:55.269 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-modules x86_64 5.14.0-412.el9 baseos 39 M 2024-02-09T07:41:55.270 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-modules-core x86_64 5.14.0-412.el9 baseos 33 M 2024-02-09T07:41:55.270 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:41:55.270 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-02-09T07:41:55.270 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:41:55.270 INFO:teuthology.orchestra.run.smithi062.stdout:Install 4 Packages 2024-02-09T07:41:55.270 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:41:55.271 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 99 M 2024-02-09T07:41:55.271 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 122 M 2024-02-09T07:41:55.271 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-02-09T07:41:55.828 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-02-09T07:41:55.829 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-02-09T07:41:55.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T07:41:55.988 INFO:teuthology.orchestra.run.smithi062.stdout:(1/4): kernel-5.14.0-412.el9.x86_64.rpm 10 MB/s | 6.0 MB 00:00 2024-02-09T07:41:56.681 INFO:teuthology.orchestra.run.smithi062.stdout:(2/4): kernel-core-5.14.0-412.el9.x86_64.rpm 16 MB/s | 21 MB 00:01 2024-02-09T07:41:57.456 INFO:teuthology.orchestra.run.smithi062.stdout:(3/4): kernel-modules-5.14.0-412.el9.x86_64.rpm 19 MB/s | 39 MB 00:02 2024-02-09T07:41:57.889 INFO:teuthology.orchestra.run.smithi062.stdout:(4/4): kernel-modules-core-5.14.0-412.el9.x86_6 18 MB/s | 33 MB 00:01 2024-02-09T07:41:57.890 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:41:57.890 INFO:teuthology.orchestra.run.smithi062.stdout:Total 38 MB/s | 99 MB 00:02 2024-02-09T07:41:58.810 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-02-09T07:41:59.264 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-02-09T07:41:59.264 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-02-09T07:42:00.653 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-02-09T07:42:00.654 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-02-09T07:42:03.512 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-02-09T07:42:04.201 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : kernel-modules-core-5.14.0-412.el9.x86_64 1/4 2024-02-09T07:42:04.339 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : kernel-core-5.14.0-412.el9.x86_64 2/4 2024-02-09T07:42:07.248 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-core-5.14.0-412.el9.x86_64 2/4 2024-02-09T07:42:07.433 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : kernel-modules-5.14.0-412.el9.x86_64 3/4 2024-02-09T07:42:12.500 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-modules-5.14.0-412.el9.x86_64 3/4 2024-02-09T07:42:12.619 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : kernel-5.14.0-412.el9.x86_64 4/4 2024-02-09T07:42:17.734 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-modules-core-5.14.0-412.el9.x86_64 4/4 2024-02-09T07:42:30.460 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-02-09T07:42:39.461 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-02-09T07:42:39.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T07:42:48.500 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-core-5.14.0-412.el9.x86_64 4/4 2024-02-09T07:42:48.501 INFO:teuthology.orchestra.run.smithi062.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-02-09T07:42:48.501 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:42:48.589 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-modules-5.14.0-412.el9.x86_64 4/4 2024-02-09T07:42:49.052 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-5.14.0-412.el9.x86_64 4/4 2024-02-09T07:42:49.052 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : kernel-5.14.0-412.el9.x86_64 1/4 2024-02-09T07:42:49.052 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : kernel-core-5.14.0-412.el9.x86_64 2/4 2024-02-09T07:42:49.052 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : kernel-modules-5.14.0-412.el9.x86_64 3/4 2024-02-09T07:42:49.515 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : kernel-modules-core-5.14.0-412.el9.x86_64 4/4 2024-02-09T07:42:49.515 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:42:49.515 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-02-09T07:42:49.515 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-5.14.0-412.el9.x86_64 2024-02-09T07:42:49.515 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-core-5.14.0-412.el9.x86_64 2024-02-09T07:42:49.515 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-modules-5.14.0-412.el9.x86_64 2024-02-09T07:42:49.516 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-modules-core-5.14.0-412.el9.x86_64 2024-02-09T07:42:49.516 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:42:49.516 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-02-09T07:42:50.084 DEBUG:teuthology.orchestra.run.smithi062:> rpm -q kernel | sort -rV | head -n 1 2024-02-09T07:42:50.233 INFO:teuthology.orchestra.run.smithi062.stdout:kernel-5.14.0-412.el9.x86_64 2024-02-09T07:42:50.233 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-412.el9.x86_64 2024-02-09T07:42:50.233 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-412.el9.x86_64 2024-02-09T07:42:50.234 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-09T07:42:50.234 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-09T07:42:50.234 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-02-09T07:42:50.234 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi062.front.sepia.ceph.com, path=None, version=distro) 2024-02-09T07:42:50.234 DEBUG:teuthology.orchestra.run.smithi062:> rpm -q kernel | sort -rV | head -n 1 2024-02-09T07:42:50.361 INFO:teuthology.orchestra.run.smithi062.stdout:kernel-5.14.0-412.el9.x86_64 2024-02-09T07:42:50.361 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-412.el9.x86_64 2024-02-09T07:42:50.361 DEBUG:teuthology.orchestra.run.smithi062:> sudo rpm -qi grub2-tools 2024-02-09T07:42:50.407 INFO:teuthology.orchestra.run.smithi062.stdout:Name : grub2-tools 2024-02-09T07:42:50.407 INFO:teuthology.orchestra.run.smithi062.stdout:Epoch : 1 2024-02-09T07:42:50.407 INFO:teuthology.orchestra.run.smithi062.stdout:Version : 2.06 2024-02-09T07:42:50.407 INFO:teuthology.orchestra.run.smithi062.stdout:Release : 68.el9 2024-02-09T07:42:50.407 INFO:teuthology.orchestra.run.smithi062.stdout:Architecture: x86_64 2024-02-09T07:42:50.408 INFO:teuthology.orchestra.run.smithi062.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-02-09T07:42:50.408 INFO:teuthology.orchestra.run.smithi062.stdout:Group : Unspecified 2024-02-09T07:42:50.408 INFO:teuthology.orchestra.run.smithi062.stdout:Size : 8264254 2024-02-09T07:42:50.408 INFO:teuthology.orchestra.run.smithi062.stdout:License : GPLv3+ 2024-02-09T07:42:50.408 INFO:teuthology.orchestra.run.smithi062.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-02-09T07:42:50.408 INFO:teuthology.orchestra.run.smithi062.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-02-09T07:42:50.408 INFO:teuthology.orchestra.run.smithi062.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-02-09T07:42:50.408 INFO:teuthology.orchestra.run.smithi062.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-02-09T07:42:50.408 INFO:teuthology.orchestra.run.smithi062.stdout:Packager : builder@centos.org 2024-02-09T07:42:50.408 INFO:teuthology.orchestra.run.smithi062.stdout:Vendor : CentOS 2024-02-09T07:42:50.408 INFO:teuthology.orchestra.run.smithi062.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-09T07:42:50.408 INFO:teuthology.orchestra.run.smithi062.stdout:Summary : Support tools for GRUB. 2024-02-09T07:42:50.408 INFO:teuthology.orchestra.run.smithi062.stdout:Description : 2024-02-09T07:42:50.409 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:42:50.409 INFO:teuthology.orchestra.run.smithi062.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-09T07:42:50.409 INFO:teuthology.orchestra.run.smithi062.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-09T07:42:50.409 INFO:teuthology.orchestra.run.smithi062.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-09T07:42:50.409 INFO:teuthology.orchestra.run.smithi062.stdout:hardware devices. 2024-02-09T07:42:50.409 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:42:50.409 INFO:teuthology.orchestra.run.smithi062.stdout:This subpackage provides tools for support of all platforms. 2024-02-09T07:42:50.410 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-09T07:42:50.410 INFO:teuthology.task.kernel:Updating grub on smithi062 to boot 5.14.0-412.el9.x86_64 2024-02-09T07:42:50.410 DEBUG:teuthology.orchestra.run.smithi062:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-09T07:42:51.003 INFO:teuthology.orchestra.run.smithi062.stderr:Generating grub configuration file ... 2024-02-09T07:42:52.503 INFO:teuthology.orchestra.run.smithi062.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-02-09T07:42:52.530 INFO:teuthology.orchestra.run.smithi062.stderr:done 2024-02-09T07:42:52.532 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2024-02-09T07:42:52.547 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.8RgUHNJNzE 2024-02-09T07:42:52.547 DEBUG:teuthology.orchestra.run.smithi062:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.8RgUHNJNzE 2024-02-09T07:42:52.626 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.8RgUHNJNzE 2024-02-09T07:42:52.769 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.8RgUHNJNzE is 6KB 2024-02-09T07:42:52.789 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.8RgUHNJNzE 2024-02-09T07:42:52.803 DEBUG:teuthology.orchestra.run.smithi062:> sudo /bin/ls /boot/loader/entries || true 2024-02-09T07:42:52.872 INFO:teuthology.orchestra.run.smithi062.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-02-09T07:42:52.872 INFO:teuthology.orchestra.run.smithi062.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-02-09T07:42:52.872 INFO:teuthology.orchestra.run.smithi062.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-02-09T07:42:52.872 INFO:teuthology.orchestra.run.smithi062.stdout:15949e3c88704300882482eddfd7baae-5.14.0-412.el9.x86_64.conf 2024-02-09T07:42:52.873 DEBUG:teuthology.orchestra.run.smithi062:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-412.el9.x86_64 2024-02-09T07:42:53.030 DEBUG:teuthology.orchestra.run.smithi062:> sudo shutdown -r now 2024-02-09T07:42:57.852 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-02-09T07:43:09.864 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-02-09T07:43:09.865 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T07:43:12.924 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-02-09T07:43:23.040 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-02-09T07:43:23.040 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-02-09T07:43:23.041 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T07:43:27.928 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-02-09T07:43:27.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T07:43:28.247 DEBUG:teuthology.orchestra.run.smithi103:> true 2024-02-09T07:43:28.659 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-02-09T07:43:28.659 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-412.el9.x86_64"... 2024-02-09T07:43:28.659 DEBUG:teuthology.orchestra.run.smithi103:> uname -r 2024-02-09T07:43:28.675 INFO:teuthology.orchestra.run.smithi103.stdout:5.14.0-412.el9.x86_64 2024-02-09T07:43:28.675 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-412.el9.x86_64 vs 5.14.0-412.el9.x86_64 2024-02-09T07:43:28.675 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-09T07:43:28.675 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-09T07:43:29.676 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-02-09T07:43:29.676 DEBUG:teuthology.orchestra.run.smithi103:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-09T07:43:29.748 INFO:teuthology.orchestra.run.smithi103.stdout:ttyS1 2024-02-09T07:43:29.791 DEBUG:teuthology.parallel:result is None 2024-02-09T07:43:41.372 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.62 2024-02-09T07:43:50.373 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-02-09T07:43:50.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T07:43:53.436 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.62 2024-02-09T07:44:05.437 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-02-09T07:44:05.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T07:44:37.301 DEBUG:teuthology.orchestra.run.smithi062:> true 2024-02-09T07:44:37.710 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-02-09T07:44:37.710 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-412.el9.x86_64"... 2024-02-09T07:44:37.711 DEBUG:teuthology.orchestra.run.smithi062:> uname -r 2024-02-09T07:44:37.724 INFO:teuthology.orchestra.run.smithi062.stdout:5.14.0-412.el9.x86_64 2024-02-09T07:44:37.724 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-412.el9.x86_64 vs 5.14.0-412.el9.x86_64 2024-02-09T07:44:37.724 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-09T07:44:37.724 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-09T07:44:38.725 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-02-09T07:44:38.726 DEBUG:teuthology.orchestra.run.smithi062:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-09T07:44:38.800 INFO:teuthology.orchestra.run.smithi062.stdout:ttyS1 2024-02-09T07:44:38.849 DEBUG:teuthology.parallel:result is None 2024-02-09T07:44:38.850 INFO:teuthology.run_tasks:Running task internal.base... 2024-02-09T07:44:38.863 INFO:teuthology.task.internal:Creating test directory... 2024-02-09T07:44:38.864 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-09T07:44:38.866 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-09T07:44:38.885 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-02-09T07:44:38.898 INFO:teuthology.run_tasks:Running task internal.archive... 2024-02-09T07:44:38.948 INFO:teuthology.task.internal:Creating archive directory... 2024-02-09T07:44:38.948 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-09T07:44:38.950 DEBUG:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-09T07:44:38.984 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-02-09T07:44:38.998 INFO:teuthology.task.internal:Enabling coredump saving... 2024-02-09T07:44:38.998 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-09T07:44:39.010 DEBUG:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-09T07:44:39.037 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-09T07:44:39.050 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-09T07:44:39.057 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-09T07:44:39.071 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-09T07:44:39.073 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-02-09T07:44:39.080 INFO:teuthology.task.internal:Configuring sudo... 2024-02-09T07:44:39.080 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-09T07:44:39.098 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-09T07:44:39.143 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-02-09T07:44:39.225 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-02-09T07:44:39.226 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-09T07:44:39.228 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-09T07:44:39.244 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-09T07:44:39.322 DEBUG:teuthology.orchestra.run.smithi062:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-09T07:44:39.369 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-09T07:44:39.456 DEBUG:teuthology.orchestra.run.smithi062:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-09T07:44:39.499 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-02-09T07:44:39.499 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-09T07:44:39.570 DEBUG:teuthology.orchestra.run.smithi103:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-09T07:44:39.618 DEBUG:teuthology.orchestra.run.smithi103:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-09T07:44:39.668 DEBUG:teuthology.orchestra.run.smithi103:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-09T07:44:39.750 DEBUG:teuthology.orchestra.run.smithi103:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-09T07:44:39.797 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-02-09T07:44:39.798 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-09T07:44:39.867 DEBUG:teuthology.orchestra.run.smithi062:> sudo service rsyslog restart 2024-02-09T07:44:39.870 DEBUG:teuthology.orchestra.run.smithi103:> sudo service rsyslog restart 2024-02-09T07:44:39.914 INFO:teuthology.orchestra.run.smithi062.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-09T07:44:39.967 INFO:teuthology.orchestra.run.smithi103.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-09T07:44:40.241 INFO:teuthology.run_tasks:Running task internal.timer... 2024-02-09T07:44:40.249 INFO:teuthology.task.internal:Starting timer... 2024-02-09T07:44:40.250 INFO:teuthology.run_tasks:Running task pcp... 2024-02-09T07:44:40.302 INFO:teuthology.run_tasks:Running task selinux... 2024-02-09T07:44:40.350 DEBUG:teuthology.orchestra.run.smithi062:> sudo service auditd rotate 2024-02-09T07:44:40.422 INFO:teuthology.orchestra.run.smithi062.stdout:Rotating logs: 2024-02-09T07:44:40.424 DEBUG:teuthology.orchestra.run.smithi103:> sudo service auditd rotate 2024-02-09T07:44:40.468 INFO:teuthology.orchestra.run.smithi103.stdout:Rotating logs: 2024-02-09T07:44:40.470 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-02-09T07:44:40.470 DEBUG:teuthology.orchestra.run.smithi062:> /usr/sbin/getenforce 2024-02-09T07:44:40.493 INFO:teuthology.orchestra.run.smithi062.stdout:Permissive 2024-02-09T07:44:40.493 DEBUG:teuthology.orchestra.run.smithi103:> /usr/sbin/getenforce 2024-02-09T07:44:40.533 INFO:teuthology.orchestra.run.smithi103.stdout:Permissive 2024-02-09T07:44:40.534 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi062.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi103.front.sepia.ceph.com': 'permissive'} 2024-02-09T07:44:40.534 DEBUG:teuthology.orchestra.run.smithi062:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-09T07:44:40.563 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-09T07:44:40.563 DEBUG:teuthology.orchestra.run.smithi103:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-09T07:44:40.602 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-09T07:44:40.603 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-02-09T07:44:40.603 DEBUG:teuthology.orchestra.run.smithi062:> sudo /usr/sbin/setenforce permissive 2024-02-09T07:44:40.636 DEBUG:teuthology.orchestra.run.smithi103:> sudo /usr/sbin/setenforce permissive 2024-02-09T07:44:40.676 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-02-09T07:44:40.685 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-02-09T07:44:40.702 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-02-09T07:44:40.703 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi062.front.sepia.ceph.com,smithi103.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-02-09T07:49:32.946 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi062.front.sepia.ceph.com'), Remote(name='ubuntu@smithi103.front.sepia.ceph.com')] 2024-02-09T07:49:32.947 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-02-09T07:49:32.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T07:49:33.038 DEBUG:teuthology.orchestra.run.smithi062:> true 2024-02-09T07:49:33.121 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-02-09T07:49:33.122 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-02-09T07:49:33.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T07:49:33.212 DEBUG:teuthology.orchestra.run.smithi103:> true 2024-02-09T07:49:33.255 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-02-09T07:49:33.256 INFO:teuthology.run_tasks:Running task clock... 2024-02-09T07:49:33.267 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-02-09T07:49:33.267 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-09T07:49:33.268 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-09T07:49:33.270 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-09T07:49:33.270 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-09T07:49:33.298 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-09T07:49:33.314 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-09T07:49:33.329 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-09T07:49:33.343 INFO:teuthology.orchestra.run.smithi062.stderr:sudo: ntpd: command not found 2024-02-09T07:49:33.345 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-09T07:49:33.356 INFO:teuthology.orchestra.run.smithi062.stdout:506 Cannot talk to daemon 2024-02-09T07:49:33.373 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-09T07:49:33.375 INFO:teuthology.orchestra.run.smithi103.stderr:sudo: ntpd: command not found 2024-02-09T07:49:33.389 INFO:teuthology.orchestra.run.smithi103.stdout:506 Cannot talk to daemon 2024-02-09T07:49:33.389 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-09T07:49:33.405 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-09T07:49:33.422 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-09T07:49:33.438 INFO:teuthology.orchestra.run.smithi062.stderr:bash: line 1: ntpq: command not found 2024-02-09T07:49:33.441 INFO:teuthology.orchestra.run.smithi062.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-09T07:49:33.441 INFO:teuthology.orchestra.run.smithi062.stdout:=============================================================================== 2024-02-09T07:49:33.441 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-09T07:49:33.442 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-09T07:49:33.442 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-09T07:49:33.442 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-09T07:49:33.479 INFO:teuthology.orchestra.run.smithi103.stderr:bash: line 1: ntpq: command not found 2024-02-09T07:49:33.483 INFO:teuthology.orchestra.run.smithi103.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-09T07:49:33.483 INFO:teuthology.orchestra.run.smithi103.stdout:=============================================================================== 2024-02-09T07:49:33.483 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-09T07:49:33.483 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-09T07:49:33.483 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-09T07:49:33.483 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-09T07:49:33.484 INFO:teuthology.run_tasks:Running task install... 2024-02-09T07:49:33.492 DEBUG:teuthology.task.install:project ceph 2024-02-09T07:49:33.492 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '0089f33ec7e39da1a9e0f281bf62a5b44e1951f6'}} 2024-02-09T07:49:33.492 DEBUG:teuthology.task.install:config {'debuginfo': True, 'flavor': 'default', 'sha1': '0089f33ec7e39da1a9e0f281bf62a5b44e1951f6'} 2024-02-09T07:49:33.492 INFO:teuthology.task.install:Using flavor: default 2024-02-09T07:49:33.499 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2024-02-09T07:49:33.499 INFO:teuthology.task.install:extra packages: [] 2024-02-09T07:49:33.500 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0089f33ec7e39da1a9e0f281bf62a5b44e1951f6', 'tag': None, 'wait_for_package': False} 2024-02-09T07:49:33.500 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=0089f33ec7e39da1a9e0f281bf62a5b44e1951f6 2024-02-09T07:49:33.503 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0089f33ec7e39da1a9e0f281bf62a5b44e1951f6', 'tag': None, 'wait_for_package': False} 2024-02-09T07:49:33.503 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=0089f33ec7e39da1a9e0f281bf62a5b44e1951f6 2024-02-09T07:49:33.730 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-08-0727/0089f33ec7e39da1a9e0f281bf62a5b44e1951f6/centos/9/flavors/default/ 2024-02-09T07:49:33.730 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1310.g0089f33e 2024-02-09T07:49:33.735 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-08-0727/0089f33ec7e39da1a9e0f281bf62a5b44e1951f6/centos/9/flavors/default/ 2024-02-09T07:49:33.735 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1310.g0089f33e 2024-02-09T07:49:33.900 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-08-0727/0089f33ec7e39da1a9e0f281bf62a5b44e1951f6/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-08-0727/0089f33ec7e39da1a9e0f281bf62a5b44e1951f6/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-08-0727/0089f33ec7e39da1a9e0f281bf62a5b44e1951f6/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-09T07:49:33.900 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-02-09T07:49:33.901 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-09T07:49:33.907 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-08-0727/0089f33ec7e39da1a9e0f281bf62a5b44e1951f6/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-08-0727/0089f33ec7e39da1a9e0f281bf62a5b44e1951f6/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-02-08-0727/0089f33ec7e39da1a9e0f281bf62a5b44e1951f6/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-09T07:49:33.907 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-02-09T07:49:33.908 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-09T07:49:33.929 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2024-02-09T07:49:33.929 DEBUG:teuthology.orchestra.run.smithi062:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/0089f33ec7e39da1a9e0f281bf62a5b44e1951f6/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-09T07:49:33.936 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2024-02-09T07:49:33.936 DEBUG:teuthology.orchestra.run.smithi103:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/0089f33ec7e39da1a9e0f281bf62a5b44e1951f6/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-09T07:49:33.997 DEBUG:teuthology.orchestra.run.smithi062:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-09T07:49:34.004 DEBUG:teuthology.orchestra.run.smithi103:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-09T07:49:34.079 DEBUG:teuthology.orchestra.run.smithi062:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-09T07:49:34.085 DEBUG:teuthology.orchestra.run.smithi103:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-09T07:49:34.146 INFO:teuthology.orchestra.run.smithi062.stdout:check_obsoletes = 1 2024-02-09T07:49:34.148 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum clean all 2024-02-09T07:49:34.151 INFO:teuthology.orchestra.run.smithi103.stdout:check_obsoletes = 1 2024-02-09T07:49:34.155 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum clean all 2024-02-09T07:49:34.395 INFO:teuthology.orchestra.run.smithi062.stdout:74 files removed 2024-02-09T07:49:34.396 INFO:teuthology.orchestra.run.smithi103.stdout:74 files removed 2024-02-09T07:49:34.422 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-radosgw 2024-02-09T07:49:34.423 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-radosgw 2024-02-09T07:49:35.242 INFO:teuthology.orchestra.run.smithi062.stdout:ceph packages for x86_64 162 kB/s | 80 kB 00:00 2024-02-09T07:49:35.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph packages for x86_64 160 kB/s | 80 kB 00:00 2024-02-09T07:49:35.860 INFO:teuthology.orchestra.run.smithi062.stdout:ceph noarch packages 18 kB/s | 10 kB 00:00 2024-02-09T07:49:35.860 INFO:teuthology.orchestra.run.smithi103.stdout:ceph noarch packages 18 kB/s | 10 kB 00:00 2024-02-09T07:49:36.452 INFO:teuthology.orchestra.run.smithi062.stdout:ceph source packages 3.4 kB/s | 1.9 kB 00:00 2024-02-09T07:49:36.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph source packages 3.4 kB/s | 1.9 kB 00:00 2024-02-09T07:49:36.913 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS-9 - AppStream 19 MB/s | 8.0 MB 00:00 2024-02-09T07:49:36.980 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS-9 - AppStream 16 MB/s | 8.0 MB 00:00 2024-02-09T07:49:38.505 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS-9 - BaseOS 9.1 MB/s | 2.5 MB 00:00 2024-02-09T07:49:38.630 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS-9 - BaseOS 8.1 MB/s | 2.5 MB 00:00 2024-02-09T07:49:39.446 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.0 MB 00:00 2024-02-09T07:49:40.845 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - BaseOS 4.6 MB/s | 8.0 MB 00:01 2024-02-09T07:49:41.439 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - AppStream 21 MB/s | 19 MB 00:00 2024-02-09T07:49:42.646 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - AppStream 29 MB/s | 19 MB 00:00 2024-02-09T07:49:46.889 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - CRB 9.8 MB/s | 5.9 MB 00:00 2024-02-09T07:49:46.931 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - CRB 3.0 MB/s | 5.9 MB 00:01 2024-02-09T07:49:48.256 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - Extras packages 83 kB/s | 15 kB 00:00 2024-02-09T07:49:48.515 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - Extras packages 66 kB/s | 15 kB 00:00 2024-02-09T07:49:49.499 INFO:teuthology.orchestra.run.smithi062.stdout:Extra Packages for Enterprise Linux 19 MB/s | 20 MB 00:01 2024-02-09T07:49:50.442 INFO:teuthology.orchestra.run.smithi103.stdout:Extra Packages for Enterprise Linux 11 MB/s | 20 MB 00:01 2024-02-09T07:49:54.610 INFO:teuthology.orchestra.run.smithi062.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-02-09T07:49:55.400 INFO:teuthology.orchestra.run.smithi103.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-02-09T07:49:57.251 INFO:teuthology.orchestra.run.smithi062.stderr:Modular dependency problems: 2024-02-09T07:49:57.252 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T07:49:57.252 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 1: conflicting requests 2024-02-09T07:49:57.252 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.252 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 2: conflicting requests 2024-02-09T07:49:57.252 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.252 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 3: conflicting requests 2024-02-09T07:49:57.252 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.252 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 4: conflicting requests 2024-02-09T07:49:57.252 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.253 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 5: conflicting requests 2024-02-09T07:49:57.253 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.253 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 6: conflicting requests 2024-02-09T07:49:57.253 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.253 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 7: conflicting requests 2024-02-09T07:49:57.253 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.253 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 8: conflicting requests 2024-02-09T07:49:57.253 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.253 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 9: conflicting requests 2024-02-09T07:49:57.253 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.253 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 10: conflicting requests 2024-02-09T07:49:57.253 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.253 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 11: conflicting requests 2024-02-09T07:49:57.253 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.254 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 12: conflicting requests 2024-02-09T07:49:57.254 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.254 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 13: conflicting requests 2024-02-09T07:49:57.254 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.254 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 14: conflicting requests 2024-02-09T07:49:57.254 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.254 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 15: conflicting requests 2024-02-09T07:49:57.254 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.254 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 16: conflicting requests 2024-02-09T07:49:57.254 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.254 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 17: conflicting requests 2024-02-09T07:49:57.254 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.254 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 18: conflicting requests 2024-02-09T07:49:57.255 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.255 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 19: conflicting requests 2024-02-09T07:49:57.255 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.255 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 20: conflicting requests 2024-02-09T07:49:57.255 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.255 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 21: conflicting requests 2024-02-09T07:49:57.255 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.255 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 22: conflicting requests 2024-02-09T07:49:57.255 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.255 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 23: conflicting requests 2024-02-09T07:49:57.255 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.255 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 24: conflicting requests 2024-02-09T07:49:57.255 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.256 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 25: conflicting requests 2024-02-09T07:49:57.256 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.256 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 26: conflicting requests 2024-02-09T07:49:57.256 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.256 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 27: conflicting requests 2024-02-09T07:49:57.256 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.256 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 28: conflicting requests 2024-02-09T07:49:57.256 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.256 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 29: conflicting requests 2024-02-09T07:49:57.256 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.256 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 30: conflicting requests 2024-02-09T07:49:57.256 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.256 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 31: conflicting requests 2024-02-09T07:49:57.257 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.257 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 32: conflicting requests 2024-02-09T07:49:57.257 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.257 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 33: conflicting requests 2024-02-09T07:49:57.257 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.257 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 34: conflicting requests 2024-02-09T07:49:57.257 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.257 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 35: conflicting requests 2024-02-09T07:49:57.257 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.257 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 36: conflicting requests 2024-02-09T07:49:57.257 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.257 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 37: conflicting requests 2024-02-09T07:49:57.257 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.257 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.258 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.258 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:49:57.258 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.258 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.258 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.258 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.258 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 39: conflicting requests 2024-02-09T07:49:57.258 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.258 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.258 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.258 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.258 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.259 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.259 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:49:57.259 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.259 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.259 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.259 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.259 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:49:57.259 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.259 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.259 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.259 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.259 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:49:57.259 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.259 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.260 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.260 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.260 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:49:57.260 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.260 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.260 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.260 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.260 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:49:57.260 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.261 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.261 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.261 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.261 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:49:57.261 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.261 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.261 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.261 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.829 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-02-09T07:49:57.839 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:49:57.840 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-02-09T07:49:57.840 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:49:57.840 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-02-09T07:49:57.840 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-radosgw x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 9.7 M 2024-02-09T07:49:57.840 INFO:teuthology.orchestra.run.smithi062.stdout:Upgrading: 2024-02-09T07:49:57.840 INFO:teuthology.orchestra.run.smithi062.stdout: librados2 x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 3.4 M 2024-02-09T07:49:57.840 INFO:teuthology.orchestra.run.smithi062.stdout: librbd1 x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 3.1 M 2024-02-09T07:49:57.840 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-02-09T07:49:57.840 INFO:teuthology.orchestra.run.smithi062.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-02-09T07:49:57.840 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-base x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 5.1 M 2024-02-09T07:49:57.840 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-common x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 20 M 2024-02-09T07:49:57.840 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-selinux x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 25 k 2024-02-09T07:49:57.841 INFO:teuthology.orchestra.run.smithi062.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-09T07:49:57.841 INFO:teuthology.orchestra.run.smithi062.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-02-09T07:49:57.841 INFO:teuthology.orchestra.run.smithi062.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-02-09T07:49:57.841 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs2 x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 743 k 2024-02-09T07:49:57.841 INFO:teuthology.orchestra.run.smithi062.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-09T07:49:57.841 INFO:teuthology.orchestra.run.smithi062.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-02-09T07:49:57.841 INFO:teuthology.orchestra.run.smithi062.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-02-09T07:49:57.841 INFO:teuthology.orchestra.run.smithi062.stdout: libradosstriper1 x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 499 k 2024-02-09T07:49:57.841 INFO:teuthology.orchestra.run.smithi062.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-02-09T07:49:57.841 INFO:teuthology.orchestra.run.smithi062.stdout: librgw2 x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 5.1 M 2024-02-09T07:49:57.841 INFO:teuthology.orchestra.run.smithi062.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-09T07:49:57.841 INFO:teuthology.orchestra.run.smithi062.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-02-09T07:49:57.841 INFO:teuthology.orchestra.run.smithi062.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-02-09T07:49:57.841 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-argparse x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 45 k 2024-02-09T07:49:57.841 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-common x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 131 k 2024-02-09T07:49:57.842 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cephfs x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 162 k 2024-02-09T07:49:57.842 INFO:teuthology.orchestra.run.smithi062.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-02-09T07:49:57.842 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rados x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 321 k 2024-02-09T07:49:57.842 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rbd x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 297 k 2024-02-09T07:49:57.842 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rgw x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 99 k 2024-02-09T07:49:57.842 INFO:teuthology.orchestra.run.smithi062.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-02-09T07:49:57.842 INFO:teuthology.orchestra.run.smithi062.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-09T07:49:57.842 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:49:57.842 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-02-09T07:49:57.842 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:49:57.842 INFO:teuthology.orchestra.run.smithi062.stdout:Install 27 Packages 2024-02-09T07:49:57.842 INFO:teuthology.orchestra.run.smithi062.stdout:Upgrade 2 Packages 2024-02-09T07:49:57.842 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:49:57.843 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 57 M 2024-02-09T07:49:57.843 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-02-09T07:49:57.929 INFO:teuthology.orchestra.run.smithi103.stderr:Modular dependency problems: 2024-02-09T07:49:57.929 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T07:49:57.929 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 1: conflicting requests 2024-02-09T07:49:57.929 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.929 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 2: conflicting requests 2024-02-09T07:49:57.929 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.929 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 3: conflicting requests 2024-02-09T07:49:57.929 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.929 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 4: conflicting requests 2024-02-09T07:49:57.930 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.930 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 5: conflicting requests 2024-02-09T07:49:57.930 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.930 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 6: conflicting requests 2024-02-09T07:49:57.930 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.930 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 7: conflicting requests 2024-02-09T07:49:57.930 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.930 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 8: conflicting requests 2024-02-09T07:49:57.930 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.930 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 9: conflicting requests 2024-02-09T07:49:57.930 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.930 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 10: conflicting requests 2024-02-09T07:49:57.930 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.930 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 11: conflicting requests 2024-02-09T07:49:57.931 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.931 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 12: conflicting requests 2024-02-09T07:49:57.931 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.931 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 13: conflicting requests 2024-02-09T07:49:57.931 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.931 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 14: conflicting requests 2024-02-09T07:49:57.931 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.931 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 15: conflicting requests 2024-02-09T07:49:57.931 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.931 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 16: conflicting requests 2024-02-09T07:49:57.931 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.931 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 17: conflicting requests 2024-02-09T07:49:57.931 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.931 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 18: conflicting requests 2024-02-09T07:49:57.932 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.932 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 19: conflicting requests 2024-02-09T07:49:57.932 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.932 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 20: conflicting requests 2024-02-09T07:49:57.932 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.932 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 21: conflicting requests 2024-02-09T07:49:57.932 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.932 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 22: conflicting requests 2024-02-09T07:49:57.932 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.932 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 23: conflicting requests 2024-02-09T07:49:57.932 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.932 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 24: conflicting requests 2024-02-09T07:49:57.932 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.932 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 25: conflicting requests 2024-02-09T07:49:57.933 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.933 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 26: conflicting requests 2024-02-09T07:49:57.933 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.933 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 27: conflicting requests 2024-02-09T07:49:57.933 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.933 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 28: conflicting requests 2024-02-09T07:49:57.933 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.933 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 29: conflicting requests 2024-02-09T07:49:57.933 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.933 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 30: conflicting requests 2024-02-09T07:49:57.933 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.933 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 31: conflicting requests 2024-02-09T07:49:57.933 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.933 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 32: conflicting requests 2024-02-09T07:49:57.934 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.934 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 33: conflicting requests 2024-02-09T07:49:57.934 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.934 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 34: conflicting requests 2024-02-09T07:49:57.934 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.934 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 35: conflicting requests 2024-02-09T07:49:57.934 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.934 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 36: conflicting requests 2024-02-09T07:49:57.934 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.934 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 37: conflicting requests 2024-02-09T07:49:57.934 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.934 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.934 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.934 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:49:57.935 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.935 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.935 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.935 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.935 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 39: conflicting requests 2024-02-09T07:49:57.935 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.935 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.935 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.936 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.936 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.936 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.936 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:49:57.936 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.936 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.936 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.936 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.936 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:49:57.936 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.936 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.936 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.936 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.937 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:49:57.937 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.937 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.937 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.937 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.937 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:49:57.937 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.937 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.937 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.937 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.937 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:49:57.937 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.937 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.937 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.938 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.938 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:49:57.938 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.938 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.938 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:49:57.938 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:49:58.440 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-02-09T07:49:58.452 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:49:58.452 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-02-09T07:49:58.452 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:49:58.452 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-02-09T07:49:58.452 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-radosgw x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 9.7 M 2024-02-09T07:49:58.452 INFO:teuthology.orchestra.run.smithi103.stdout:Upgrading: 2024-02-09T07:49:58.452 INFO:teuthology.orchestra.run.smithi103.stdout: librados2 x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 3.4 M 2024-02-09T07:49:58.453 INFO:teuthology.orchestra.run.smithi103.stdout: librbd1 x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 3.1 M 2024-02-09T07:49:58.453 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-02-09T07:49:58.453 INFO:teuthology.orchestra.run.smithi103.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-02-09T07:49:58.453 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-base x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 5.1 M 2024-02-09T07:49:58.453 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-common x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 20 M 2024-02-09T07:49:58.453 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-selinux x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 25 k 2024-02-09T07:49:58.453 INFO:teuthology.orchestra.run.smithi103.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-09T07:49:58.453 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-02-09T07:49:58.453 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-02-09T07:49:58.453 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs2 x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 743 k 2024-02-09T07:49:58.453 INFO:teuthology.orchestra.run.smithi103.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-09T07:49:58.453 INFO:teuthology.orchestra.run.smithi103.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-02-09T07:49:58.453 INFO:teuthology.orchestra.run.smithi103.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-02-09T07:49:58.453 INFO:teuthology.orchestra.run.smithi103.stdout: libradosstriper1 x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 499 k 2024-02-09T07:49:58.454 INFO:teuthology.orchestra.run.smithi103.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-02-09T07:49:58.454 INFO:teuthology.orchestra.run.smithi103.stdout: librgw2 x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 5.1 M 2024-02-09T07:49:58.454 INFO:teuthology.orchestra.run.smithi103.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-09T07:49:58.454 INFO:teuthology.orchestra.run.smithi103.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-02-09T07:49:58.454 INFO:teuthology.orchestra.run.smithi103.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-02-09T07:49:58.454 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-argparse x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 45 k 2024-02-09T07:49:58.454 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-common x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 131 k 2024-02-09T07:49:58.454 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cephfs x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 162 k 2024-02-09T07:49:58.454 INFO:teuthology.orchestra.run.smithi103.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-02-09T07:49:58.454 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rados x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 321 k 2024-02-09T07:49:58.454 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rbd x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 297 k 2024-02-09T07:49:58.454 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rgw x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 99 k 2024-02-09T07:49:58.454 INFO:teuthology.orchestra.run.smithi103.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-02-09T07:49:58.454 INFO:teuthology.orchestra.run.smithi103.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-09T07:49:58.455 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:49:58.455 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-02-09T07:49:58.455 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:49:58.455 INFO:teuthology.orchestra.run.smithi103.stdout:Install 27 Packages 2024-02-09T07:49:58.455 INFO:teuthology.orchestra.run.smithi103.stdout:Upgrade 2 Packages 2024-02-09T07:49:58.455 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:49:58.455 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 57 M 2024-02-09T07:49:58.455 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-02-09T07:50:00.718 INFO:teuthology.orchestra.run.smithi103.stdout:(1/29): ceph-base-19.0.0-1310.g0089f33e.el9.x86 2.4 MB/s | 5.1 MB 00:02 2024-02-09T07:50:00.809 INFO:teuthology.orchestra.run.smithi103.stdout:(2/29): ceph-selinux-19.0.0-1310.g0089f33e.el9. 275 kB/s | 25 kB 00:00 2024-02-09T07:50:01.035 INFO:teuthology.orchestra.run.smithi103.stdout:(3/29): libcephfs2-19.0.0-1310.g0089f33e.el9.x8 3.2 MB/s | 743 kB 00:00 2024-02-09T07:50:01.193 INFO:teuthology.orchestra.run.smithi103.stdout:(4/29): libradosstriper1-19.0.0-1310.g0089f33e. 3.1 MB/s | 499 kB 00:00 2024-02-09T07:50:02.328 INFO:teuthology.orchestra.run.smithi062.stdout:(1/29): ceph-radosgw-19.0.0-1310.g0089f33e.el9. 2.4 MB/s | 9.7 MB 00:04 2024-02-09T07:50:02.411 INFO:teuthology.orchestra.run.smithi062.stdout:(2/29): ceph-selinux-19.0.0-1310.g0089f33e.el9. 303 kB/s | 25 kB 00:00 2024-02-09T07:50:02.452 INFO:teuthology.orchestra.run.smithi103.stdout:(5/29): librgw2-19.0.0-1310.g0089f33e.el9.x86_6 4.1 MB/s | 5.1 MB 00:01 2024-02-09T07:50:02.488 INFO:teuthology.orchestra.run.smithi062.stdout:(3/29): ceph-base-19.0.0-1310.g0089f33e.el9.x86 1.2 MB/s | 5.1 MB 00:04 2024-02-09T07:50:02.552 INFO:teuthology.orchestra.run.smithi103.stdout:(6/29): python3-ceph-argparse-19.0.0-1310.g0089 453 kB/s | 45 kB 00:00 2024-02-09T07:50:02.645 INFO:teuthology.orchestra.run.smithi103.stdout:(7/29): python3-ceph-common-19.0.0-1310.g0089f3 1.4 MB/s | 131 kB 00:00 2024-02-09T07:50:02.712 INFO:teuthology.orchestra.run.smithi062.stdout:(4/29): libcephfs2-19.0.0-1310.g0089f33e.el9.x8 2.4 MB/s | 743 kB 00:00 2024-02-09T07:50:02.736 INFO:teuthology.orchestra.run.smithi103.stdout:(8/29): python3-cephfs-19.0.0-1310.g0089f33e.el 1.7 MB/s | 162 kB 00:00 2024-02-09T07:50:02.828 INFO:teuthology.orchestra.run.smithi103.stdout:(9/29): python3-rados-19.0.0-1310.g0089f33e.el9 3.4 MB/s | 321 kB 00:00 2024-02-09T07:50:02.879 INFO:teuthology.orchestra.run.smithi062.stdout:(5/29): libradosstriper1-19.0.0-1310.g0089f33e. 1.2 MB/s | 499 kB 00:00 2024-02-09T07:50:02.904 INFO:teuthology.orchestra.run.smithi103.stdout:(10/29): python3-rbd-19.0.0-1310.g0089f33e.el9. 3.9 MB/s | 297 kB 00:00 2024-02-09T07:50:02.970 INFO:teuthology.orchestra.run.smithi103.stdout:(11/29): python3-rgw-19.0.0-1310.g0089f33e.el9. 1.5 MB/s | 99 kB 00:00 2024-02-09T07:50:03.079 INFO:teuthology.orchestra.run.smithi062.stdout:(6/29): ceph-common-19.0.0-1310.g0089f33e.el9.x 4.1 MB/s | 20 MB 00:04 2024-02-09T07:50:03.104 INFO:teuthology.orchestra.run.smithi062.stdout:(7/29): python3-ceph-argparse-19.0.0-1310.g0089 200 kB/s | 45 kB 00:00 2024-02-09T07:50:03.146 INFO:teuthology.orchestra.run.smithi062.stdout:(8/29): python3-ceph-common-19.0.0-1310.g0089f3 1.9 MB/s | 131 kB 00:00 2024-02-09T07:50:03.204 INFO:teuthology.orchestra.run.smithi062.stdout:(9/29): python3-cephfs-19.0.0-1310.g0089f33e.el 1.6 MB/s | 162 kB 00:00 2024-02-09T07:50:03.230 INFO:teuthology.orchestra.run.smithi062.stdout:(10/29): python3-rados-19.0.0-1310.g0089f33e.el 3.8 MB/s | 321 kB 00:00 2024-02-09T07:50:03.288 INFO:teuthology.orchestra.run.smithi062.stdout:(11/29): python3-rgw-19.0.0-1310.g0089f33e.el9. 1.7 MB/s | 99 kB 00:00 2024-02-09T07:50:03.355 INFO:teuthology.orchestra.run.smithi062.stdout:(12/29): python3-rbd-19.0.0-1310.g0089f33e.el9. 1.9 MB/s | 297 kB 00:00 2024-02-09T07:50:03.756 INFO:teuthology.orchestra.run.smithi062.stdout:(13/29): librgw2-19.0.0-1310.g0089f33e.el9.x86_ 4.9 MB/s | 5.1 MB 00:01 2024-02-09T07:50:03.789 INFO:teuthology.orchestra.run.smithi062.stdout:(14/29): boost-program-options-1.75.0-8.el9.x86 213 kB/s | 107 kB 00:00 2024-02-09T07:50:03.870 INFO:teuthology.orchestra.run.smithi103.stdout:(12/29): ceph-radosgw-19.0.0-1310.g0089f33e.el9 1.9 MB/s | 9.7 MB 00:05 2024-02-09T07:50:03.873 INFO:teuthology.orchestra.run.smithi062.stdout:(15/29): libpmemobj-1.12.1-1.el9.x86_64.rpm 310 kB/s | 160 kB 00:00 2024-02-09T07:50:04.090 INFO:teuthology.orchestra.run.smithi062.stdout:(16/29): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.3 MB/s | 292 kB 00:00 2024-02-09T07:50:04.115 INFO:teuthology.orchestra.run.smithi062.stdout:(17/29): librdkafka-1.6.1-102.el9.x86_64.rpm 2.0 MB/s | 662 kB 00:00 2024-02-09T07:50:04.207 INFO:teuthology.orchestra.run.smithi062.stdout:(18/29): librabbitmq-0.11.0-7.el9.x86_64.rpm 100 kB/s | 45 kB 00:00 2024-02-09T07:50:04.236 INFO:teuthology.orchestra.run.smithi062.stdout:(19/29): python3-prettytable-0.7.2-27.el9.noarc 297 kB/s | 42 kB 00:00 2024-02-09T07:50:04.416 INFO:teuthology.orchestra.run.smithi062.stdout:(20/29): libarrow-doc-9.0.0-10.el9.noarch.rpm 143 kB/s | 26 kB 00:00 2024-02-09T07:50:04.458 INFO:teuthology.orchestra.run.smithi062.stdout:(21/29): gperftools-libs-2.9.1-2.el9.x86_64.rpm 902 kB/s | 309 kB 00:00 2024-02-09T07:50:04.483 INFO:teuthology.orchestra.run.smithi062.stdout:(22/29): liboath-2.6.7-2.el9.x86_64.rpm 726 kB/s | 49 kB 00:00 2024-02-09T07:50:04.525 INFO:teuthology.orchestra.run.smithi062.stdout:(23/29): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-02-09T07:50:04.609 INFO:teuthology.orchestra.run.smithi062.stdout:(24/29): parquet-libs-9.0.0-10.el9.x86_64.rpm 6.5 MB/s | 838 kB 00:00 2024-02-09T07:50:04.634 INFO:teuthology.orchestra.run.smithi062.stdout:(25/29): re2-20211101-3.el9.x86_64.rpm 1.7 MB/s | 192 kB 00:00 2024-02-09T07:50:04.743 INFO:teuthology.orchestra.run.smithi062.stdout:(26/29): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-02-09T07:50:04.801 INFO:teuthology.orchestra.run.smithi062.stdout:(27/29): libarrow-9.0.0-10.el9.x86_64.rpm 7.4 MB/s | 4.4 MB 00:00 2024-02-09T07:50:04.905 INFO:teuthology.orchestra.run.smithi103.stdout:[MIRROR] boost-program-options-1.75.0-8.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for https://mirrors.ocf.berkeley.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/boost-program-options-1.75.0-8.el9.x86_64.rpm [Failed to connect to mirrors.ocf.berkeley.edu port 443: No route to host] 2024-02-09T07:50:05.296 INFO:teuthology.orchestra.run.smithi103.stdout:(13/29): ceph-common-19.0.0-1310.g0089f33e.el9. 3.0 MB/s | 20 MB 00:06 2024-02-09T07:50:05.310 INFO:teuthology.orchestra.run.smithi062.stdout:(28/29): librbd1-19.0.0-1310.g0089f33e.el9.x86_ 5.5 MB/s | 3.1 MB 00:00 2024-02-09T07:50:06.052 INFO:teuthology.orchestra.run.smithi062.stdout:(29/29): librados2-19.0.0-1310.g0089f33e.el9.x8 2.4 MB/s | 3.4 MB 00:01 2024-02-09T07:50:06.056 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:50:06.056 INFO:teuthology.orchestra.run.smithi062.stdout:Total 7.0 MB/s | 57 MB 00:08 2024-02-09T07:50:06.129 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-02-09T07:50:06.168 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-02-09T07:50:06.168 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-02-09T07:50:06.658 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-02-09T07:50:06.658 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-02-09T07:50:08.014 INFO:teuthology.orchestra.run.smithi103.stdout:[MIRROR] boost-program-options-1.75.0-8.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirrors.ocf.berkeley.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/boost-program-options-1.75.0-8.el9.x86_64.rpm [Failed to connect to mirrors.ocf.berkeley.edu port 80: No route to host] 2024-02-09T07:50:08.146 INFO:teuthology.orchestra.run.smithi103.stdout:(14/29): boost-program-options-1.75.0-8.el9.x86 21 kB/s | 107 kB 00:05 2024-02-09T07:50:08.299 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-02-09T07:50:08.386 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/31 2024-02-09T07:50:08.415 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/31 2024-02-09T07:50:08.466 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/31 2024-02-09T07:50:08.556 INFO:teuthology.orchestra.run.smithi103.stdout:[MIRROR] librabbitmq-0.11.0-7.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for https://mirrors.ocf.berkeley.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/librabbitmq-0.11.0-7.el9.x86_64.rpm [Failed to connect to mirrors.ocf.berkeley.edu port 443: No route to host] 2024-02-09T07:50:08.858 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/31 2024-02-09T07:50:08.889 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : librados2-2:19.0.0-1310.g0089f33e.el9.x86_64 5/31 2024-02-09T07:50:08.979 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librados2-2:19.0.0-1310.g0089f33e.el9.x86_64 5/31 2024-02-09T07:50:09.071 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rados-2:19.0.0-1310.g0089f33e.el9.x86_64 6/31 2024-02-09T07:50:09.091 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libcephfs2-2:19.0.0-1310.g0089f33e.el9.x86_64 7/31 2024-02-09T07:50:09.137 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libcephfs2-2:19.0.0-1310.g0089f33e.el9.x86_64 7/31 2024-02-09T07:50:09.166 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/31 2024-02-09T07:50:09.201 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-ceph-argparse-2:19.0.0-1310.g0089f33e.el9. 9/31 2024-02-09T07:50:09.271 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cephfs-2:19.0.0-1310.g0089f33e.el9.x86_64 10/31 2024-02-09T07:50:09.294 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libradosstriper1-2:19.0.0-1310.g0089f33e.el9.x86_6 11/31 2024-02-09T07:50:09.342 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1310.g0089f33e.el9.x86_6 11/31 2024-02-09T07:50:09.452 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/31 2024-02-09T07:50:09.484 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 13/31 2024-02-09T07:50:09.524 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/31 2024-02-09T07:50:09.559 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/31 2024-02-09T07:50:09.586 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 16/31 2024-02-09T07:50:09.619 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 17/31 2024-02-09T07:50:09.944 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 18/31 2024-02-09T07:50:09.975 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : librbd1-2:19.0.0-1310.g0089f33e.el9.x86_64 19/31 2024-02-09T07:50:10.048 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librbd1-2:19.0.0-1310.g0089f33e.el9.x86_64 19/31 2024-02-09T07:50:10.078 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rbd-2:19.0.0-1310.g0089f33e.el9.x86_64 20/31 2024-02-09T07:50:10.124 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 21/31 2024-02-09T07:50:10.596 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 22/31 2024-02-09T07:50:10.644 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librgw2-2:19.0.0-1310.g0089f33e.el9.x86_64 23/31 2024-02-09T07:50:10.698 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librgw2-2:19.0.0-1310.g0089f33e.el9.x86_64 23/31 2024-02-09T07:50:10.777 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rgw-2:19.0.0-1310.g0089f33e.el9.x86_64 24/31 2024-02-09T07:50:10.804 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-ceph-common-2:19.0.0-1310.g0089f33e.el9.x8 25/31 2024-02-09T07:50:11.277 INFO:teuthology.orchestra.run.smithi103.stdout:[MIRROR] librdkafka-1.6.1-102.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for https://mirrors.ocf.berkeley.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/librdkafka-1.6.1-102.el9.x86_64.rpm [Failed to connect to mirrors.ocf.berkeley.edu port 443: No route to host] 2024-02-09T07:50:11.628 INFO:teuthology.orchestra.run.smithi103.stdout:[MIRROR] librabbitmq-0.11.0-7.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirrors.ocf.berkeley.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/librabbitmq-0.11.0-7.el9.x86_64.rpm [Failed to connect to mirrors.ocf.berkeley.edu port 80: No route to host] 2024-02-09T07:50:11.780 INFO:teuthology.orchestra.run.smithi103.stdout:(15/29): librabbitmq-0.11.0-7.el9.x86_64.rpm 7.0 kB/s | 45 kB 00:06 2024-02-09T07:50:13.090 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-common-2:19.0.0-1310.g0089f33e.el9.x86_64 26/31 2024-02-09T07:50:13.135 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-common-2:19.0.0-1310.g0089f33e.el9.x86_64 26/31 2024-02-09T07:50:13.703 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-common-2:19.0.0-1310.g0089f33e.el9.x86_64 26/31 2024-02-09T07:50:13.780 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-base-2:19.0.0-1310.g0089f33e.el9.x86_64 27/31 2024-02-09T07:50:13.876 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-base-2:19.0.0-1310.g0089f33e.el9.x86_64 27/31 2024-02-09T07:50:13.876 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-09T07:50:13.876 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-09T07:50:13.877 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:50:13.931 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-selinux-2:19.0.0-1310.g0089f33e.el9.x86_64 28/31 2024-02-09T07:50:14.508 INFO:teuthology.orchestra.run.smithi103.stdout:[MIRROR] lttng-ust-2.12.0-6.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirrors.ocf.berkeley.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/lttng-ust-2.12.0-6.el9.x86_64.rpm [Failed to connect to mirrors.ocf.berkeley.edu port 80: No route to host] 2024-02-09T07:50:14.700 INFO:teuthology.orchestra.run.smithi103.stdout:[MIRROR] librdkafka-1.6.1-102.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirrors.ocf.berkeley.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/librdkafka-1.6.1-102.el9.x86_64.rpm [Failed to connect to mirrors.ocf.berkeley.edu port 80: No route to host] 2024-02-09T07:50:14.854 INFO:teuthology.orchestra.run.smithi103.stdout:(16/29): librdkafka-1.6.1-102.el9.x86_64.rpm 99 kB/s | 662 kB 00:06 2024-02-09T07:50:14.913 INFO:teuthology.orchestra.run.smithi103.stdout:(17/29): python3-prettytable-0.7.2-27.el9.noarc 725 kB/s | 42 kB 00:00 2024-02-09T07:50:15.054 INFO:teuthology.orchestra.run.smithi103.stdout:(18/29): gperftools-libs-2.9.1-2.el9.x86_64.rpm 2.1 MB/s | 309 kB 00:00 2024-02-09T07:50:15.363 INFO:teuthology.orchestra.run.smithi103.stdout:(19/29): libarrow-9.0.0-10.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-02-09T07:50:15.405 INFO:teuthology.orchestra.run.smithi103.stdout:(20/29): libarrow-doc-9.0.0-10.el9.noarch.rpm 625 kB/s | 26 kB 00:00 2024-02-09T07:50:15.447 INFO:teuthology.orchestra.run.smithi103.stdout:(21/29): liboath-2.6.7-2.el9.x86_64.rpm 1.1 MB/s | 49 kB 00:00 2024-02-09T07:50:15.489 INFO:teuthology.orchestra.run.smithi103.stdout:(22/29): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-02-09T07:50:15.539 INFO:teuthology.orchestra.run.smithi103.stdout:(23/29): parquet-libs-9.0.0-10.el9.x86_64.rpm 16 MB/s | 838 kB 00:00 2024-02-09T07:50:15.581 INFO:teuthology.orchestra.run.smithi103.stdout:(24/29): re2-20211101-3.el9.x86_64.rpm 4.5 MB/s | 192 kB 00:00 2024-02-09T07:50:15.656 INFO:teuthology.orchestra.run.smithi103.stdout:(25/29): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-02-09T07:50:16.223 INFO:teuthology.orchestra.run.smithi103.stdout:(26/29): librados2-19.0.0-1310.g0089f33e.el9.x8 5.9 MB/s | 3.4 MB 00:00 2024-02-09T07:50:16.648 INFO:teuthology.orchestra.run.smithi103.stdout:(27/29): librbd1-19.0.0-1310.g0089f33e.el9.x86_ 7.4 MB/s | 3.1 MB 00:00 2024-02-09T07:50:18.151 INFO:teuthology.orchestra.run.smithi103.stdout:[MIRROR] lttng-ust-2.12.0-6.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for https://mirrors.ocf.berkeley.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/lttng-ust-2.12.0-6.el9.x86_64.rpm [Failed to connect to mirrors.ocf.berkeley.edu port 443: No route to host] 2024-02-09T07:50:18.307 INFO:teuthology.orchestra.run.smithi103.stdout:(28/29): lttng-ust-2.12.0-6.el9.x86_64.rpm 45 kB/s | 292 kB 00:06 2024-02-09T07:50:20.265 INFO:teuthology.orchestra.run.smithi103.stdout:[MIRROR] libpmemobj-1.12.1-1.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for https://mirrors.ocf.berkeley.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/libpmemobj-1.12.1-1.el9.x86_64.rpm [Failed to connect to mirrors.ocf.berkeley.edu port 443: No route to host] 2024-02-09T07:50:20.340 INFO:teuthology.orchestra.run.smithi103.stdout:(29/29): libpmemobj-1.12.1-1.el9.x86_64.rpm 9.7 kB/s | 160 kB 00:16 2024-02-09T07:50:20.343 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:50:20.343 INFO:teuthology.orchestra.run.smithi103.stdout:Total 2.6 MB/s | 57 MB 00:21 2024-02-09T07:50:20.415 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-02-09T07:50:20.451 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-02-09T07:50:20.451 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-02-09T07:50:20.940 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-02-09T07:50:20.940 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-02-09T07:50:22.326 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-02-09T07:50:22.399 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/31 2024-02-09T07:50:22.445 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/31 2024-02-09T07:50:22.496 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/31 2024-02-09T07:50:22.846 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/31 2024-02-09T07:50:22.945 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : librados2-2:19.0.0-1310.g0089f33e.el9.x86_64 5/31 2024-02-09T07:50:23.048 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librados2-2:19.0.0-1310.g0089f33e.el9.x86_64 5/31 2024-02-09T07:50:23.134 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rados-2:19.0.0-1310.g0089f33e.el9.x86_64 6/31 2024-02-09T07:50:23.162 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libcephfs2-2:19.0.0-1310.g0089f33e.el9.x86_64 7/31 2024-02-09T07:50:23.225 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libcephfs2-2:19.0.0-1310.g0089f33e.el9.x86_64 7/31 2024-02-09T07:50:23.254 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/31 2024-02-09T07:50:23.297 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-ceph-argparse-2:19.0.0-1310.g0089f33e.el9. 9/31 2024-02-09T07:50:23.367 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cephfs-2:19.0.0-1310.g0089f33e.el9.x86_64 10/31 2024-02-09T07:50:23.390 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libradosstriper1-2:19.0.0-1310.g0089f33e.el9.x86_6 11/31 2024-02-09T07:50:23.455 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1310.g0089f33e.el9.x86_6 11/31 2024-02-09T07:50:23.565 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/31 2024-02-09T07:50:23.606 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 13/31 2024-02-09T07:50:23.647 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/31 2024-02-09T07:50:23.679 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/31 2024-02-09T07:50:23.707 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 16/31 2024-02-09T07:50:23.741 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 17/31 2024-02-09T07:50:23.915 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1310.g0089f33e.el9.x86_64 28/31 2024-02-09T07:50:23.915 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /sys 2024-02-09T07:50:23.915 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /proc 2024-02-09T07:50:23.915 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /mnt 2024-02-09T07:50:23.915 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /var/tmp 2024-02-09T07:50:23.915 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /home 2024-02-09T07:50:23.915 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /root 2024-02-09T07:50:23.915 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /tmp 2024-02-09T07:50:23.916 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:50:24.041 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 18/31 2024-02-09T07:50:24.070 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : librbd1-2:19.0.0-1310.g0089f33e.el9.x86_64 19/31 2024-02-09T07:50:24.160 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librbd1-2:19.0.0-1310.g0089f33e.el9.x86_64 19/31 2024-02-09T07:50:24.208 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rbd-2:19.0.0-1310.g0089f33e.el9.x86_64 20/31 2024-02-09T07:50:24.248 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 21/31 2024-02-09T07:50:24.703 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 22/31 2024-02-09T07:50:24.731 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librgw2-2:19.0.0-1310.g0089f33e.el9.x86_64 23/31 2024-02-09T07:50:24.802 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librgw2-2:19.0.0-1310.g0089f33e.el9.x86_64 23/31 2024-02-09T07:50:24.870 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rgw-2:19.0.0-1310.g0089f33e.el9.x86_64 24/31 2024-02-09T07:50:24.900 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-ceph-common-2:19.0.0-1310.g0089f33e.el9.x8 25/31 2024-02-09T07:50:24.914 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-radosgw-2:19.0.0-1310.g0089f33e.el9.x86_64 29/31 2024-02-09T07:50:24.939 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1310.g0089f33e.el9.x86_64 29/31 2024-02-09T07:50:24.939 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-09T07:50:24.939 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-09T07:50:24.940 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-09T07:50:24.940 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-09T07:50:24.940 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:50:24.941 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 30/31 2024-02-09T07:50:25.027 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 30/31 2024-02-09T07:50:25.027 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 31/31 2024-02-09T07:50:26.272 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 31/31 2024-02-09T07:50:26.272 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-base-2:19.0.0-1310.g0089f33e.el9.x86_64 1/31 2024-02-09T07:50:26.272 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-common-2:19.0.0-1310.g0089f33e.el9.x86_64 2/31 2024-02-09T07:50:26.272 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-radosgw-2:19.0.0-1310.g0089f33e.el9.x86_64 3/31 2024-02-09T07:50:26.272 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-selinux-2:19.0.0-1310.g0089f33e.el9.x86_64 4/31 2024-02-09T07:50:26.272 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libcephfs2-2:19.0.0-1310.g0089f33e.el9.x86_64 5/31 2024-02-09T07:50:26.272 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libradosstriper1-2:19.0.0-1310.g0089f33e.el9.x86_6 6/31 2024-02-09T07:50:26.272 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librgw2-2:19.0.0-1310.g0089f33e.el9.x86_64 7/31 2024-02-09T07:50:26.272 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1310.g0089f33e.el9. 8/31 2024-02-09T07:50:26.273 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-ceph-common-2:19.0.0-1310.g0089f33e.el9.x8 9/31 2024-02-09T07:50:26.273 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cephfs-2:19.0.0-1310.g0089f33e.el9.x86_64 10/31 2024-02-09T07:50:26.273 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rados-2:19.0.0-1310.g0089f33e.el9.x86_64 11/31 2024-02-09T07:50:26.273 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rbd-2:19.0.0-1310.g0089f33e.el9.x86_64 12/31 2024-02-09T07:50:26.273 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rgw-2:19.0.0-1310.g0089f33e.el9.x86_64 13/31 2024-02-09T07:50:26.273 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/31 2024-02-09T07:50:26.273 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/31 2024-02-09T07:50:26.273 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/31 2024-02-09T07:50:26.273 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/31 2024-02-09T07:50:26.273 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/31 2024-02-09T07:50:26.273 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/31 2024-02-09T07:50:26.273 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 20/31 2024-02-09T07:50:26.273 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 21/31 2024-02-09T07:50:26.273 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 22/31 2024-02-09T07:50:26.274 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 23/31 2024-02-09T07:50:26.274 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 24/31 2024-02-09T07:50:26.274 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 25/31 2024-02-09T07:50:26.274 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : re2-1:20211101-3.el9.x86_64 26/31 2024-02-09T07:50:26.274 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 27/31 2024-02-09T07:50:26.274 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librados2-2:19.0.0-1310.g0089f33e.el9.x86_64 28/31 2024-02-09T07:50:26.274 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 29/31 2024-02-09T07:50:26.275 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librbd1-2:19.0.0-1310.g0089f33e.el9.x86_64 30/31 2024-02-09T07:50:27.063 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-common-2:19.0.0-1310.g0089f33e.el9.x86_64 26/31 2024-02-09T07:50:27.105 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-common-2:19.0.0-1310.g0089f33e.el9.x86_64 26/31 2024-02-09T07:50:27.119 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 31/31 2024-02-09T07:50:27.119 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:50:27.119 INFO:teuthology.orchestra.run.smithi062.stdout:Upgraded: 2024-02-09T07:50:27.119 INFO:teuthology.orchestra.run.smithi062.stdout: librados2-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:50:27.120 INFO:teuthology.orchestra.run.smithi062.stdout: librbd1-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:50:27.120 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-02-09T07:50:27.120 INFO:teuthology.orchestra.run.smithi062.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-02-09T07:50:27.120 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-base-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:50:27.120 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-common-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:50:27.120 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-radosgw-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:50:27.120 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-selinux-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:50:27.120 INFO:teuthology.orchestra.run.smithi062.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-09T07:50:27.120 INFO:teuthology.orchestra.run.smithi062.stdout: libarrow-9.0.0-10.el9.x86_64 2024-02-09T07:50:27.120 INFO:teuthology.orchestra.run.smithi062.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-02-09T07:50:27.120 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs2-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:50:27.120 INFO:teuthology.orchestra.run.smithi062.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-09T07:50:27.120 INFO:teuthology.orchestra.run.smithi062.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-09T07:50:27.121 INFO:teuthology.orchestra.run.smithi062.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-09T07:50:27.121 INFO:teuthology.orchestra.run.smithi062.stdout: libradosstriper1-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:50:27.121 INFO:teuthology.orchestra.run.smithi062.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-09T07:50:27.121 INFO:teuthology.orchestra.run.smithi062.stdout: librgw2-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:50:27.121 INFO:teuthology.orchestra.run.smithi062.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-09T07:50:27.121 INFO:teuthology.orchestra.run.smithi062.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-09T07:50:27.121 INFO:teuthology.orchestra.run.smithi062.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-02-09T07:50:27.121 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-argparse-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:50:27.121 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-common-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:50:27.121 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cephfs-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:50:27.121 INFO:teuthology.orchestra.run.smithi062.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-09T07:50:27.121 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rados-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:50:27.121 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rbd-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:50:27.122 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rgw-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:50:27.122 INFO:teuthology.orchestra.run.smithi062.stdout: re2-1:20211101-3.el9.x86_64 2024-02-09T07:50:27.122 INFO:teuthology.orchestra.run.smithi062.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-09T07:50:27.122 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:50:27.122 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-02-09T07:50:27.373 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-test 2024-02-09T07:50:27.690 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-common-2:19.0.0-1310.g0089f33e.el9.x86_64 26/31 2024-02-09T07:50:27.733 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-base-2:19.0.0-1310.g0089f33e.el9.x86_64 27/31 2024-02-09T07:50:27.805 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-base-2:19.0.0-1310.g0089f33e.el9.x86_64 27/31 2024-02-09T07:50:27.805 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-09T07:50:27.806 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-09T07:50:27.806 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:50:27.843 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-selinux-2:19.0.0-1310.g0089f33e.el9.x86_64 28/31 2024-02-09T07:50:27.977 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:00:33 ago on Fri 09 Feb 2024 07:49:54 AM UTC. 2024-02-09T07:50:28.288 INFO:teuthology.orchestra.run.smithi062.stderr:Modular dependency problems: 2024-02-09T07:50:28.288 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T07:50:28.288 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 1: conflicting requests 2024-02-09T07:50:28.288 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.289 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 2: conflicting requests 2024-02-09T07:50:28.289 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.289 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 3: conflicting requests 2024-02-09T07:50:28.289 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.289 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 4: conflicting requests 2024-02-09T07:50:28.289 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.290 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 5: conflicting requests 2024-02-09T07:50:28.290 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.290 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 6: conflicting requests 2024-02-09T07:50:28.290 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.290 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 7: conflicting requests 2024-02-09T07:50:28.291 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.291 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 8: conflicting requests 2024-02-09T07:50:28.291 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.291 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 9: conflicting requests 2024-02-09T07:50:28.291 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.291 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 10: conflicting requests 2024-02-09T07:50:28.291 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.291 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 11: conflicting requests 2024-02-09T07:50:28.291 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.292 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 12: conflicting requests 2024-02-09T07:50:28.292 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.292 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 13: conflicting requests 2024-02-09T07:50:28.292 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.292 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 14: conflicting requests 2024-02-09T07:50:28.292 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.293 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 15: conflicting requests 2024-02-09T07:50:28.293 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.293 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 16: conflicting requests 2024-02-09T07:50:28.293 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.293 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 17: conflicting requests 2024-02-09T07:50:28.293 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.293 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 18: conflicting requests 2024-02-09T07:50:28.294 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.294 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 19: conflicting requests 2024-02-09T07:50:28.294 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.294 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 20: conflicting requests 2024-02-09T07:50:28.294 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.294 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 21: conflicting requests 2024-02-09T07:50:28.294 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.294 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 22: conflicting requests 2024-02-09T07:50:28.294 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.294 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 23: conflicting requests 2024-02-09T07:50:28.294 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.294 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 24: conflicting requests 2024-02-09T07:50:28.294 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.295 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 25: conflicting requests 2024-02-09T07:50:28.295 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.295 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 26: conflicting requests 2024-02-09T07:50:28.295 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.295 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 27: conflicting requests 2024-02-09T07:50:28.295 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.295 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 28: conflicting requests 2024-02-09T07:50:28.295 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.295 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 29: conflicting requests 2024-02-09T07:50:28.295 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.295 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 30: conflicting requests 2024-02-09T07:50:28.295 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.295 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 31: conflicting requests 2024-02-09T07:50:28.295 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.296 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 32: conflicting requests 2024-02-09T07:50:28.296 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.296 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 33: conflicting requests 2024-02-09T07:50:28.296 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.297 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 34: conflicting requests 2024-02-09T07:50:28.297 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.297 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 35: conflicting requests 2024-02-09T07:50:28.297 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.297 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 36: conflicting requests 2024-02-09T07:50:28.297 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.297 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 37: conflicting requests 2024-02-09T07:50:28.298 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.298 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.298 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.299 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:50:28.299 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.299 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.299 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.299 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.299 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 39: conflicting requests 2024-02-09T07:50:28.299 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.299 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.299 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.299 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.300 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.300 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.300 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:50:28.300 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.300 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.300 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.300 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.300 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:50:28.300 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.300 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.301 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.301 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.301 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:50:28.301 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.301 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.301 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.301 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.301 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:50:28.301 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.301 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.301 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.301 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.301 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:50:28.301 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.302 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.302 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.302 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.302 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:50:28.302 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.302 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.302 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.302 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:50:28.359 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-02-09T07:50:28.360 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:50:28.360 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-02-09T07:50:28.360 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:50:28.361 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-02-09T07:50:28.361 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-test x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 47 M 2024-02-09T07:50:28.361 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-02-09T07:50:28.361 INFO:teuthology.orchestra.run.smithi062.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-02-09T07:50:28.361 INFO:teuthology.orchestra.run.smithi062.stdout: libcephsqlite x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 163 k 2024-02-09T07:50:28.361 INFO:teuthology.orchestra.run.smithi062.stdout: oniguruma x86_64 6.9.6-1.el9.5 baseos 218 k 2024-02-09T07:50:28.361 INFO:teuthology.orchestra.run.smithi062.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-02-09T07:50:28.361 INFO:teuthology.orchestra.run.smithi062.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-02-09T07:50:28.361 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:50:28.361 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-02-09T07:50:28.361 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:50:28.361 INFO:teuthology.orchestra.run.smithi062.stdout:Install 6 Packages 2024-02-09T07:50:28.361 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:50:28.362 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 48 M 2024-02-09T07:50:28.362 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 204 M 2024-02-09T07:50:28.362 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-02-09T07:50:28.873 INFO:teuthology.orchestra.run.smithi062.stdout:(1/6): libcephsqlite-19.0.0-1310.g0089f33e.el9. 433 kB/s | 163 kB 00:00 2024-02-09T07:50:30.060 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] jq-1.6-16.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for https://mirrors.ocf.berkeley.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/jq-1.6-16.el9.x86_64.rpm [Failed to connect to mirrors.ocf.berkeley.edu port 443: No route to host] 2024-02-09T07:50:32.198 INFO:teuthology.orchestra.run.smithi062.stdout:(2/6): ceph-test-19.0.0-1310.g0089f33e.el9.x86_ 13 MB/s | 47 MB 00:03 2024-02-09T07:50:32.553 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] oniguruma-6.9.6-1.el9.5.x86_64.rpm: Curl error (7): Couldn't connect to server for https://mirrors.ocf.berkeley.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/oniguruma-6.9.6-1.el9.5.x86_64.rpm [Failed to connect to mirrors.ocf.berkeley.edu port 443: No route to host] 2024-02-09T07:50:32.553 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] jq-1.6-16.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirrors.ocf.berkeley.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/jq-1.6-16.el9.x86_64.rpm [Failed to connect to mirrors.ocf.berkeley.edu port 80: No route to host] 2024-02-09T07:50:33.060 INFO:teuthology.orchestra.run.smithi062.stdout:(3/6): jq-1.6-16.el9.x86_64.rpm 41 kB/s | 187 kB 00:04 2024-02-09T07:50:35.786 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] xmlstarlet-1.6.1-20.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for https://mirrors.ocf.berkeley.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/xmlstarlet-1.6.1-20.el9.x86_64.rpm [Failed to connect to mirrors.ocf.berkeley.edu port 443: No route to host] 2024-02-09T07:50:36.204 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] socat-1.7.4.1-5.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for https://mirrors.ocf.berkeley.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/socat-1.7.4.1-5.el9.x86_64.rpm [Failed to connect to mirrors.ocf.berkeley.edu port 443: No route to host] 2024-02-09T07:50:36.204 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] oniguruma-6.9.6-1.el9.5.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirrors.ocf.berkeley.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/oniguruma-6.9.6-1.el9.5.x86_64.rpm [Failed to connect to mirrors.ocf.berkeley.edu port 80: No route to host] 2024-02-09T07:50:36.634 INFO:teuthology.orchestra.run.smithi062.stdout:(4/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 28 kB/s | 218 kB 00:07 2024-02-09T07:50:37.106 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1310.g0089f33e.el9.x86_64 28/31 2024-02-09T07:50:37.106 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /sys 2024-02-09T07:50:37.106 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /proc 2024-02-09T07:50:37.106 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /mnt 2024-02-09T07:50:37.106 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /var/tmp 2024-02-09T07:50:37.106 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /home 2024-02-09T07:50:37.106 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /root 2024-02-09T07:50:37.107 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /tmp 2024-02-09T07:50:37.107 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:50:38.026 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-radosgw-2:19.0.0-1310.g0089f33e.el9.x86_64 29/31 2024-02-09T07:50:38.050 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1310.g0089f33e.el9.x86_64 29/31 2024-02-09T07:50:38.051 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-09T07:50:38.051 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-09T07:50:38.051 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-09T07:50:38.051 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-09T07:50:38.051 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:50:38.053 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 30/31 2024-02-09T07:50:38.120 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 30/31 2024-02-09T07:50:38.121 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 31/31 2024-02-09T07:50:39.137 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] xmlstarlet-1.6.1-20.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirrors.ocf.berkeley.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/xmlstarlet-1.6.1-20.el9.x86_64.rpm [Failed to connect to mirrors.ocf.berkeley.edu port 80: No route to host] 2024-02-09T07:50:39.137 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] socat-1.7.4.1-5.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirrors.ocf.berkeley.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/socat-1.7.4.1-5.el9.x86_64.rpm [Failed to connect to mirrors.ocf.berkeley.edu port 80: No route to host] 2024-02-09T07:50:39.234 INFO:teuthology.orchestra.run.smithi062.stdout:(5/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 10 kB/s | 64 kB 00:06 2024-02-09T07:50:39.266 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 31/31 2024-02-09T07:50:39.266 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-base-2:19.0.0-1310.g0089f33e.el9.x86_64 1/31 2024-02-09T07:50:39.267 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-common-2:19.0.0-1310.g0089f33e.el9.x86_64 2/31 2024-02-09T07:50:39.267 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-radosgw-2:19.0.0-1310.g0089f33e.el9.x86_64 3/31 2024-02-09T07:50:39.267 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-selinux-2:19.0.0-1310.g0089f33e.el9.x86_64 4/31 2024-02-09T07:50:39.267 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libcephfs2-2:19.0.0-1310.g0089f33e.el9.x86_64 5/31 2024-02-09T07:50:39.267 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libradosstriper1-2:19.0.0-1310.g0089f33e.el9.x86_6 6/31 2024-02-09T07:50:39.267 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librgw2-2:19.0.0-1310.g0089f33e.el9.x86_64 7/31 2024-02-09T07:50:39.267 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1310.g0089f33e.el9. 8/31 2024-02-09T07:50:39.267 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-ceph-common-2:19.0.0-1310.g0089f33e.el9.x8 9/31 2024-02-09T07:50:39.267 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cephfs-2:19.0.0-1310.g0089f33e.el9.x86_64 10/31 2024-02-09T07:50:39.267 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rados-2:19.0.0-1310.g0089f33e.el9.x86_64 11/31 2024-02-09T07:50:39.267 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rbd-2:19.0.0-1310.g0089f33e.el9.x86_64 12/31 2024-02-09T07:50:39.267 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rgw-2:19.0.0-1310.g0089f33e.el9.x86_64 13/31 2024-02-09T07:50:39.267 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/31 2024-02-09T07:50:39.268 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/31 2024-02-09T07:50:39.268 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/31 2024-02-09T07:50:39.268 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/31 2024-02-09T07:50:39.268 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/31 2024-02-09T07:50:39.268 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/31 2024-02-09T07:50:39.268 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 20/31 2024-02-09T07:50:39.268 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 21/31 2024-02-09T07:50:39.268 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 22/31 2024-02-09T07:50:39.268 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 23/31 2024-02-09T07:50:39.268 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 24/31 2024-02-09T07:50:39.268 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 25/31 2024-02-09T07:50:39.268 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : re2-1:20211101-3.el9.x86_64 26/31 2024-02-09T07:50:39.268 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 27/31 2024-02-09T07:50:39.269 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librados2-2:19.0.0-1310.g0089f33e.el9.x86_64 28/31 2024-02-09T07:50:39.269 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 29/31 2024-02-09T07:50:39.269 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librbd1-2:19.0.0-1310.g0089f33e.el9.x86_64 30/31 2024-02-09T07:50:39.301 INFO:teuthology.orchestra.run.smithi062.stdout:(6/6): socat-1.7.4.1-5.el9.x86_64.rpm 43 kB/s | 305 kB 00:07 2024-02-09T07:50:39.302 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:50:39.302 INFO:teuthology.orchestra.run.smithi062.stdout:Total 4.4 MB/s | 48 MB 00:10 2024-02-09T07:50:39.353 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-02-09T07:50:39.375 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-02-09T07:50:39.375 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-02-09T07:50:39.779 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-02-09T07:50:39.779 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-02-09T07:50:40.335 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 31/31 2024-02-09T07:50:40.335 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:50:40.335 INFO:teuthology.orchestra.run.smithi103.stdout:Upgraded: 2024-02-09T07:50:40.335 INFO:teuthology.orchestra.run.smithi103.stdout: librados2-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:50:40.335 INFO:teuthology.orchestra.run.smithi103.stdout: librbd1-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:50:40.336 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-02-09T07:50:40.336 INFO:teuthology.orchestra.run.smithi103.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-02-09T07:50:40.336 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-base-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:50:40.336 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-common-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:50:40.336 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-radosgw-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:50:40.336 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-selinux-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:50:40.336 INFO:teuthology.orchestra.run.smithi103.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-09T07:50:40.336 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow-9.0.0-10.el9.x86_64 2024-02-09T07:50:40.336 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-02-09T07:50:40.336 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs2-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:50:40.336 INFO:teuthology.orchestra.run.smithi103.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-09T07:50:40.336 INFO:teuthology.orchestra.run.smithi103.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-09T07:50:40.336 INFO:teuthology.orchestra.run.smithi103.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-09T07:50:40.337 INFO:teuthology.orchestra.run.smithi103.stdout: libradosstriper1-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:50:40.337 INFO:teuthology.orchestra.run.smithi103.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-09T07:50:40.337 INFO:teuthology.orchestra.run.smithi103.stdout: librgw2-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:50:40.337 INFO:teuthology.orchestra.run.smithi103.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-09T07:50:40.337 INFO:teuthology.orchestra.run.smithi103.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-09T07:50:40.337 INFO:teuthology.orchestra.run.smithi103.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-02-09T07:50:40.337 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-argparse-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:50:40.337 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-common-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:50:40.337 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cephfs-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:50:40.337 INFO:teuthology.orchestra.run.smithi103.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-09T07:50:40.337 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rados-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:50:40.337 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rbd-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:50:40.337 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rgw-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:50:40.337 INFO:teuthology.orchestra.run.smithi103.stdout: re2-1:20211101-3.el9.x86_64 2024-02-09T07:50:40.337 INFO:teuthology.orchestra.run.smithi103.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-09T07:50:40.337 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:50:40.338 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-02-09T07:50:40.529 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-02-09T07:50:40.712 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-test 2024-02-09T07:50:40.734 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2024-02-09T07:50:40.778 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2024-02-09T07:50:40.814 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-02-09T07:50:40.863 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2024-02-09T07:50:40.921 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libcephsqlite-2:19.0.0-1310.g0089f33e.el9.x86_64 5/6 2024-02-09T07:50:41.318 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:00:46 ago on Fri 09 Feb 2024 07:49:55 AM UTC. 2024-02-09T07:50:41.611 INFO:teuthology.orchestra.run.smithi103.stderr:Modular dependency problems: 2024-02-09T07:50:41.612 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T07:50:41.612 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 1: conflicting requests 2024-02-09T07:50:41.612 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.612 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 2: conflicting requests 2024-02-09T07:50:41.612 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.612 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 3: conflicting requests 2024-02-09T07:50:41.612 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.612 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 4: conflicting requests 2024-02-09T07:50:41.612 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.612 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 5: conflicting requests 2024-02-09T07:50:41.612 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.613 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 6: conflicting requests 2024-02-09T07:50:41.613 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.613 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 7: conflicting requests 2024-02-09T07:50:41.613 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.613 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 8: conflicting requests 2024-02-09T07:50:41.613 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.613 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 9: conflicting requests 2024-02-09T07:50:41.613 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.613 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 10: conflicting requests 2024-02-09T07:50:41.613 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.613 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 11: conflicting requests 2024-02-09T07:50:41.614 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.614 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 12: conflicting requests 2024-02-09T07:50:41.614 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.614 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 13: conflicting requests 2024-02-09T07:50:41.614 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.614 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 14: conflicting requests 2024-02-09T07:50:41.614 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.614 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 15: conflicting requests 2024-02-09T07:50:41.614 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.614 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 16: conflicting requests 2024-02-09T07:50:41.614 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.615 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 17: conflicting requests 2024-02-09T07:50:41.615 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.615 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 18: conflicting requests 2024-02-09T07:50:41.615 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.615 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 19: conflicting requests 2024-02-09T07:50:41.615 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.615 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 20: conflicting requests 2024-02-09T07:50:41.615 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.615 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 21: conflicting requests 2024-02-09T07:50:41.615 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.615 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 22: conflicting requests 2024-02-09T07:50:41.616 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.616 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 23: conflicting requests 2024-02-09T07:50:41.616 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.616 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 24: conflicting requests 2024-02-09T07:50:41.616 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.616 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 25: conflicting requests 2024-02-09T07:50:41.616 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.616 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 26: conflicting requests 2024-02-09T07:50:41.616 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.616 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 27: conflicting requests 2024-02-09T07:50:41.616 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.617 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 28: conflicting requests 2024-02-09T07:50:41.617 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.617 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 29: conflicting requests 2024-02-09T07:50:41.617 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.617 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 30: conflicting requests 2024-02-09T07:50:41.617 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.617 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 31: conflicting requests 2024-02-09T07:50:41.617 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.617 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 32: conflicting requests 2024-02-09T07:50:41.617 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.617 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 33: conflicting requests 2024-02-09T07:50:41.618 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.618 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 34: conflicting requests 2024-02-09T07:50:41.618 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.618 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 35: conflicting requests 2024-02-09T07:50:41.618 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.618 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 36: conflicting requests 2024-02-09T07:50:41.618 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.618 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 37: conflicting requests 2024-02-09T07:50:41.618 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.618 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.618 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.619 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:50:41.619 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.619 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.619 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.619 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.619 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 39: conflicting requests 2024-02-09T07:50:41.619 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.619 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.619 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.619 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.619 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.619 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.620 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:50:41.620 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.620 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.620 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.620 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.620 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:50:41.620 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.620 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.621 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.621 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.621 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:50:41.621 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.621 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.621 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.621 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.621 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:50:41.621 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.621 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.622 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.622 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.622 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:50:41.622 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.622 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.622 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.622 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.622 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:50:41.622 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.622 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.622 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.623 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:50:41.679 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-02-09T07:50:41.680 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:50:41.680 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-02-09T07:50:41.680 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:50:41.680 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-02-09T07:50:41.680 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-test x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 47 M 2024-02-09T07:50:41.680 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-02-09T07:50:41.681 INFO:teuthology.orchestra.run.smithi103.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-02-09T07:50:41.681 INFO:teuthology.orchestra.run.smithi103.stdout: libcephsqlite x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 163 k 2024-02-09T07:50:41.681 INFO:teuthology.orchestra.run.smithi103.stdout: oniguruma x86_64 6.9.6-1.el9.5 baseos 218 k 2024-02-09T07:50:41.681 INFO:teuthology.orchestra.run.smithi103.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-02-09T07:50:41.681 INFO:teuthology.orchestra.run.smithi103.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-02-09T07:50:41.681 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:50:41.681 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-02-09T07:50:41.681 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:50:41.681 INFO:teuthology.orchestra.run.smithi103.stdout:Install 6 Packages 2024-02-09T07:50:41.681 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:50:41.682 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 48 M 2024-02-09T07:50:41.682 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 204 M 2024-02-09T07:50:41.682 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-02-09T07:50:42.188 INFO:teuthology.orchestra.run.smithi103.stdout:(1/6): libcephsqlite-19.0.0-1310.g0089f33e.el9. 411 kB/s | 163 kB 00:00 2024-02-09T07:50:42.330 INFO:teuthology.orchestra.run.smithi103.stdout:(2/6): jq-1.6-16.el9.x86_64.rpm 347 kB/s | 187 kB 00:00 2024-02-09T07:50:42.355 INFO:teuthology.orchestra.run.smithi103.stdout:(3/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.3 MB/s | 218 kB 00:00 2024-02-09T07:50:45.625 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1310.g0089f33e.el9.x86_64 5/6 2024-02-09T07:50:45.706 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-test-2:19.0.0-1310.g0089f33e.el9.x86_64 6/6 2024-02-09T07:50:48.254 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-test-2:19.0.0-1310.g0089f33e.el9.x86_64 6/6 2024-02-09T07:50:48.254 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-test-2:19.0.0-1310.g0089f33e.el9.x86_64 1/6 2024-02-09T07:50:48.255 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libcephsqlite-2:19.0.0-1310.g0089f33e.el9.x86_64 2/6 2024-02-09T07:50:48.255 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : jq-1.6-16.el9.x86_64 3/6 2024-02-09T07:50:48.255 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 4/6 2024-02-09T07:50:48.255 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 5/6 2024-02-09T07:50:48.637 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 6/6 2024-02-09T07:50:48.637 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:50:48.637 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-02-09T07:50:48.638 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-test-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:50:48.638 INFO:teuthology.orchestra.run.smithi062.stdout: jq-1.6-16.el9.x86_64 2024-02-09T07:50:48.638 INFO:teuthology.orchestra.run.smithi062.stdout: libcephsqlite-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:50:48.638 INFO:teuthology.orchestra.run.smithi062.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-02-09T07:50:48.638 INFO:teuthology.orchestra.run.smithi062.stdout: socat-1.7.4.1-5.el9.x86_64 2024-02-09T07:50:48.638 INFO:teuthology.orchestra.run.smithi062.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-02-09T07:50:48.638 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:50:48.638 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-02-09T07:50:48.958 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph 2024-02-09T07:50:49.447 INFO:teuthology.orchestra.run.smithi103.stdout:(4/6): ceph-test-19.0.0-1310.g0089f33e.el9.x86_ 6.2 MB/s | 47 MB 00:07 2024-02-09T07:50:49.570 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:00:55 ago on Fri 09 Feb 2024 07:49:54 AM UTC. 2024-02-09T07:50:49.877 INFO:teuthology.orchestra.run.smithi062.stderr:Modular dependency problems: 2024-02-09T07:50:49.877 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T07:50:49.878 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 1: conflicting requests 2024-02-09T07:50:49.878 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.878 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 2: conflicting requests 2024-02-09T07:50:49.878 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.878 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 3: conflicting requests 2024-02-09T07:50:49.878 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.879 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 4: conflicting requests 2024-02-09T07:50:49.879 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.879 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 5: conflicting requests 2024-02-09T07:50:49.879 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.879 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 6: conflicting requests 2024-02-09T07:50:49.879 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.880 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 7: conflicting requests 2024-02-09T07:50:49.880 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.880 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 8: conflicting requests 2024-02-09T07:50:49.880 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.880 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 9: conflicting requests 2024-02-09T07:50:49.880 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.881 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 10: conflicting requests 2024-02-09T07:50:49.881 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.881 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 11: conflicting requests 2024-02-09T07:50:49.881 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.881 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 12: conflicting requests 2024-02-09T07:50:49.881 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.882 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 13: conflicting requests 2024-02-09T07:50:49.882 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.882 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 14: conflicting requests 2024-02-09T07:50:49.882 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.882 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 15: conflicting requests 2024-02-09T07:50:49.882 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.882 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 16: conflicting requests 2024-02-09T07:50:49.883 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.883 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 17: conflicting requests 2024-02-09T07:50:49.883 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.883 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 18: conflicting requests 2024-02-09T07:50:49.883 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.883 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 19: conflicting requests 2024-02-09T07:50:49.884 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.884 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 20: conflicting requests 2024-02-09T07:50:49.884 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.884 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 21: conflicting requests 2024-02-09T07:50:49.884 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.884 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 22: conflicting requests 2024-02-09T07:50:49.885 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.885 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 23: conflicting requests 2024-02-09T07:50:49.885 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.885 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 24: conflicting requests 2024-02-09T07:50:49.885 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.885 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 25: conflicting requests 2024-02-09T07:50:49.886 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.886 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 26: conflicting requests 2024-02-09T07:50:49.886 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.886 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 27: conflicting requests 2024-02-09T07:50:49.886 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.886 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 28: conflicting requests 2024-02-09T07:50:49.887 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.887 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 29: conflicting requests 2024-02-09T07:50:49.887 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.887 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 30: conflicting requests 2024-02-09T07:50:49.887 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.887 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 31: conflicting requests 2024-02-09T07:50:49.887 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.887 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 32: conflicting requests 2024-02-09T07:50:49.888 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.888 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 33: conflicting requests 2024-02-09T07:50:49.888 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.888 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 34: conflicting requests 2024-02-09T07:50:49.888 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.888 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 35: conflicting requests 2024-02-09T07:50:49.888 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.889 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 36: conflicting requests 2024-02-09T07:50:49.889 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.889 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 37: conflicting requests 2024-02-09T07:50:49.889 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.889 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.889 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.890 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:50:49.890 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.890 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.890 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.890 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.890 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 39: conflicting requests 2024-02-09T07:50:49.891 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.891 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.891 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.891 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.891 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.891 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.892 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:50:49.892 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.892 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.892 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.892 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.892 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:50:49.893 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.893 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.893 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.893 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.893 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:50:49.893 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.894 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.894 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.894 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.894 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:50:49.894 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.894 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.895 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.895 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.895 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:50:49.895 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.895 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.895 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.896 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.896 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:50:49.896 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.896 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.896 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.897 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:50:49.950 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-02-09T07:50:49.953 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:50:49.953 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-02-09T07:50:49.953 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:50:49.953 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-02-09T07:50:49.953 INFO:teuthology.orchestra.run.smithi062.stdout: ceph x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 6.6 k 2024-02-09T07:50:49.953 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-02-09T07:50:49.953 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mds x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 2.1 M 2024-02-09T07:50:49.954 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 1.5 M 2024-02-09T07:50:49.954 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1310.g0089f33e.el9 ceph-noarch 247 k 2024-02-09T07:50:49.954 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mon x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 4.7 M 2024-02-09T07:50:49.954 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-osd x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 17 M 2024-02-09T07:50:49.954 INFO:teuthology.orchestra.run.smithi062.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-02-09T07:50:49.954 INFO:teuthology.orchestra.run.smithi062.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-02-09T07:50:49.954 INFO:teuthology.orchestra.run.smithi062.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-02-09T07:50:49.954 INFO:teuthology.orchestra.run.smithi062.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-09T07:50:49.954 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-02-09T07:50:49.954 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-09T07:50:49.954 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-09T07:50:49.954 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-02-09T07:50:49.954 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-09T07:50:49.954 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-09T07:50:49.954 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-collections 2024-02-09T07:50:49.955 INFO:teuthology.orchestra.run.smithi062.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-02-09T07:50:49.955 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-09T07:50:49.955 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-09T07:50:49.955 INFO:teuthology.orchestra.run.smithi062.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-09T07:50:49.955 INFO:teuthology.orchestra.run.smithi062.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-02-09T07:50:49.955 INFO:teuthology.orchestra.run.smithi062.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-02-09T07:50:49.955 INFO:teuthology.orchestra.run.smithi062.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-09T07:50:49.955 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-09T07:50:49.955 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-02-09T07:50:49.955 INFO:teuthology.orchestra.run.smithi062.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-09T07:50:49.955 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-09T07:50:49.955 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-02-09T07:50:49.955 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-02-09T07:50:49.955 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-02-09T07:50:49.956 INFO:teuthology.orchestra.run.smithi062.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-09T07:50:49.956 INFO:teuthology.orchestra.run.smithi062.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-02-09T07:50:49.956 INFO:teuthology.orchestra.run.smithi062.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-02-09T07:50:49.956 INFO:teuthology.orchestra.run.smithi062.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-09T07:50:49.956 INFO:teuthology.orchestra.run.smithi062.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-09T07:50:49.956 INFO:teuthology.orchestra.run.smithi062.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-09T07:50:49.956 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:50:49.956 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-02-09T07:50:49.956 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:50:49.956 INFO:teuthology.orchestra.run.smithi062.stdout:Install 36 Packages 2024-02-09T07:50:49.956 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:50:49.957 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 30 M 2024-02-09T07:50:49.957 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 107 M 2024-02-09T07:50:49.957 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-02-09T07:50:50.397 INFO:teuthology.orchestra.run.smithi062.stdout:(1/36): ceph-19.0.0-1310.g0089f33e.el9.x86_64.r 30 kB/s | 6.6 kB 00:00 2024-02-09T07:50:50.730 INFO:teuthology.orchestra.run.smithi062.stdout:(2/36): ceph-mgr-19.0.0-1310.g0089f33e.el9.x86_ 2.7 MB/s | 1.5 MB 00:00 2024-02-09T07:50:50.772 INFO:teuthology.orchestra.run.smithi062.stdout:(3/36): ceph-mds-19.0.0-1310.g0089f33e.el9.x86_ 3.6 MB/s | 2.1 MB 00:00 2024-02-09T07:50:50.856 INFO:teuthology.orchestra.run.smithi062.stdout:(4/36): ceph-mgr-modules-core-19.0.0-1310.g0089 2.9 MB/s | 247 kB 00:00 2024-02-09T07:50:51.106 INFO:teuthology.orchestra.run.smithi062.stdout:(5/36): ceph-mon-19.0.0-1310.g0089f33e.el9.x86_ 6.6 MB/s | 4.7 MB 00:00 2024-02-09T07:50:51.365 INFO:teuthology.orchestra.run.smithi062.stdout:(6/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 498 kB/s | 253 kB 00:00 2024-02-09T07:50:51.473 INFO:teuthology.orchestra.run.smithi062.stdout:(7/36): python3-ply-3.11-14.el9.noarch.rpm 985 kB/s | 106 kB 00:00 2024-02-09T07:50:51.649 INFO:teuthology.orchestra.run.smithi062.stdout:(8/36): ceph-osd-19.0.0-1310.g0089f33e.el9.x86_ 18 MB/s | 17 MB 00:00 2024-02-09T07:50:51.674 INFO:teuthology.orchestra.run.smithi062.stdout:(9/36): python3-pycparser-2.20-6.el9.noarch.rpm 675 kB/s | 135 kB 00:00 2024-02-09T07:50:51.774 INFO:teuthology.orchestra.run.smithi062.stdout:(10/36): python3-urllib3-1.26.5-5.el9.noarch.rp 2.1 MB/s | 215 kB 00:00 2024-02-09T07:50:51.899 INFO:teuthology.orchestra.run.smithi062.stdout:(11/36): lua-5.4.4-4.el9.x86_64.rpm 1.5 MB/s | 188 kB 00:00 2024-02-09T07:50:51.958 INFO:teuthology.orchestra.run.smithi062.stdout:(12/36): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-02-09T07:50:52.000 INFO:teuthology.orchestra.run.smithi062.stdout:(13/36): python3-markupsafe-1.1.1-12.el9.x86_64 830 kB/s | 35 kB 00:00 2024-02-09T07:50:52.042 INFO:teuthology.orchestra.run.smithi062.stdout:(14/36): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-02-09T07:50:52.076 INFO:teuthology.orchestra.run.smithi062.stdout:(15/36): python3-cryptography-36.0.1-4.el9.x86_ 1.3 MB/s | 1.2 MB 00:00 2024-02-09T07:50:52.101 INFO:teuthology.orchestra.run.smithi062.stdout:(16/36): python3-toml-0.10.2-6.el9.noarch.rpm 709 kB/s | 42 kB 00:00 2024-02-09T07:50:52.127 INFO:teuthology.orchestra.run.smithi062.stdout:(17/36): python3-requests-2.25.1-8.el9.noarch.r 262 kB/s | 125 kB 00:00 2024-02-09T07:50:52.460 INFO:teuthology.orchestra.run.smithi062.stdout:(18/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 130 kB/s | 43 kB 00:00 2024-02-09T07:50:52.535 INFO:teuthology.orchestra.run.smithi062.stdout:(19/36): luarocks-3.9.2-1.el9.noarch.rpm 348 kB/s | 151 kB 00:00 2024-02-09T07:50:52.643 INFO:teuthology.orchestra.run.smithi062.stdout:(20/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 936 kB/s | 172 kB 00:00 2024-02-09T07:50:52.728 INFO:teuthology.orchestra.run.smithi062.stdout:(21/36): python3-cherrypy-18.6.1-2.el9.noarch.r 1.8 MB/s | 358 kB 00:00 2024-02-09T07:50:52.744 INFO:teuthology.orchestra.run.smithi062.stdout:(22/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 106 kB/s | 11 kB 00:00 2024-02-09T07:50:52.828 INFO:teuthology.orchestra.run.smithi062.stdout:(23/36): python3-jaraco-classes-3.2.1-5.el9.noa 176 kB/s | 18 kB 00:00 2024-02-09T07:50:52.853 INFO:teuthology.orchestra.run.smithi062.stdout:(24/36): python3-jaraco-collections-3.0.0-8.el9 213 kB/s | 23 kB 00:00 2024-02-09T07:50:52.932 INFO:teuthology.orchestra.run.smithi062.stdout:(25/36): python3-jaraco-functools-3.5.0-2.el9.n 193 kB/s | 19 kB 00:00 2024-02-09T07:50:52.945 INFO:teuthology.orchestra.run.smithi062.stdout:(26/36): python3-jaraco-text-3.2.0-6.el9.noarch 214 kB/s | 20 kB 00:00 2024-02-09T07:50:53.021 INFO:teuthology.orchestra.run.smithi062.stdout:(27/36): python3-logutils-0.3.5-21.el9.noarch.r 504 kB/s | 46 kB 00:00 2024-02-09T07:50:53.046 INFO:teuthology.orchestra.run.smithi062.stdout:(28/36): python3-more-itertools-8.12.0-2.el9.no 786 kB/s | 79 kB 00:00 2024-02-09T07:50:53.121 INFO:teuthology.orchestra.run.smithi062.stdout:(29/36): python3-pecan-1.4.2-3.el9.noarch.rpm 2.7 MB/s | 272 kB 00:00 2024-02-09T07:50:53.138 INFO:teuthology.orchestra.run.smithi062.stdout:(30/36): python3-portend-3.1.0-2.el9.noarch.rpm 179 kB/s | 16 kB 00:00 2024-02-09T07:50:53.222 INFO:teuthology.orchestra.run.smithi062.stdout:(31/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 896 kB/s | 90 kB 00:00 2024-02-09T07:50:53.239 INFO:teuthology.orchestra.run.smithi062.stdout:(32/36): python3-tempora-5.0.0-2.el9.noarch.rpm 357 kB/s | 36 kB 00:00 2024-02-09T07:50:53.322 INFO:teuthology.orchestra.run.smithi062.stdout:(33/36): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-02-09T07:50:53.423 INFO:teuthology.orchestra.run.smithi062.stdout:(34/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 2.3 MB/s | 427 kB 00:00 2024-02-09T07:50:53.448 INFO:teuthology.orchestra.run.smithi062.stdout:(35/36): python3-zc-lockfile-2.0-10.el9.noarch. 159 kB/s | 20 kB 00:00 2024-02-09T07:50:54.951 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] lua-devel-5.4.4-4.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for https://mirrors.ocf.berkeley.edu/centos-stream/9-stream/CRB/x86_64/os/Packages/lua-devel-5.4.4-4.el9.x86_64.rpm [Failed to connect to mirrors.ocf.berkeley.edu port 443: No route to host] 2024-02-09T07:50:57.129 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] lua-devel-5.4.4-4.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirrors.ocf.berkeley.edu/centos-stream/9-stream/CRB/x86_64/os/Packages/lua-devel-5.4.4-4.el9.x86_64.rpm [Failed to connect to mirrors.ocf.berkeley.edu port 80: No route to host] 2024-02-09T07:50:57.798 INFO:teuthology.orchestra.run.smithi062.stdout:(36/36): lua-devel-5.4.4-4.el9.x86_64.rpm 3.9 kB/s | 22 kB 00:05 2024-02-09T07:50:57.800 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:50:57.800 INFO:teuthology.orchestra.run.smithi062.stdout:Total 3.8 MB/s | 30 MB 00:07 2024-02-09T07:50:57.939 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-02-09T07:50:57.982 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-02-09T07:50:57.982 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-02-09T07:50:58.427 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-02-09T07:50:58.428 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-02-09T07:50:59.782 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-02-09T07:50:59.851 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-02-09T07:50:59.896 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-02-09T07:50:59.920 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-02-09T07:50:59.988 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-02-09T07:51:00.038 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-02-09T07:51:00.071 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-02-09T07:51:00.169 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-02-09T07:51:00.252 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-02-09T07:51:00.299 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-02-09T07:51:00.333 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-02-09T07:51:00.363 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/36 2024-02-09T07:51:00.397 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/36 2024-02-09T07:51:00.431 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/36 2024-02-09T07:51:00.472 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/36 2024-02-09T07:51:00.515 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/36 2024-02-09T07:51:00.549 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/36 2024-02-09T07:51:00.588 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/36 2024-02-09T07:51:00.664 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 18/36 2024-02-09T07:51:00.814 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 19/36 2024-02-09T07:51:00.891 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 20/36 2024-02-09T07:51:00.950 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 21/36 2024-02-09T07:51:00.988 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 22/36 2024-02-09T07:51:01.045 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-ply-3.11-14.el9.noarch 23/36 2024-02-09T07:51:01.109 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 24/36 2024-02-09T07:51:01.327 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 25/36 2024-02-09T07:51:01.375 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 26/36 2024-02-09T07:51:01.456 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 27/36 2024-02-09T07:51:01.553 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 28/36 2024-02-09T07:51:01.590 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 29/36 2024-02-09T07:51:01.712 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 30/36 2024-02-09T07:51:01.878 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1310.g0089f33e.el9. 31/36 2024-02-09T07:51:01.908 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-2:19.0.0-1310.g0089f33e.el9.x86_64 32/36 2024-02-09T07:51:01.934 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1310.g0089f33e.el9.x86_64 32/36 2024-02-09T07:51:01.934 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-09T07:51:01.934 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-09T07:51:01.934 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-09T07:51:01.934 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-09T07:51:01.934 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:51:03.443 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-osd-2:19.0.0-1310.g0089f33e.el9.x86_64 33/36 2024-02-09T07:51:03.470 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-osd-2:19.0.0-1310.g0089f33e.el9.x86_64 33/36 2024-02-09T07:51:03.470 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-09T07:51:03.470 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-09T07:51:03.470 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-09T07:51:03.470 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-09T07:51:03.470 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:51:03.935 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mon-2:19.0.0-1310.g0089f33e.el9.x86_64 34/36 2024-02-09T07:51:03.958 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mon-2:19.0.0-1310.g0089f33e.el9.x86_64 34/36 2024-02-09T07:51:03.958 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-09T07:51:03.959 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-09T07:51:03.959 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-09T07:51:03.959 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-09T07:51:03.959 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:51:04.177 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mds-2:19.0.0-1310.g0089f33e.el9.x86_64 35/36 2024-02-09T07:51:04.200 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mds-2:19.0.0-1310.g0089f33e.el9.x86_64 35/36 2024-02-09T07:51:04.200 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-09T07:51:04.201 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-09T07:51:04.201 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-09T07:51:04.201 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-09T07:51:04.201 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:51:04.268 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-2:19.0.0-1310.g0089f33e.el9.x86_64 36/36 2024-02-09T07:51:05.928 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-2:19.0.0-1310.g0089f33e.el9.x86_64 36/36 2024-02-09T07:51:05.928 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-2:19.0.0-1310.g0089f33e.el9.x86_64 1/36 2024-02-09T07:51:05.928 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mds-2:19.0.0-1310.g0089f33e.el9.x86_64 2/36 2024-02-09T07:51:05.928 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-2:19.0.0-1310.g0089f33e.el9.x86_64 3/36 2024-02-09T07:51:05.928 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mon-2:19.0.0-1310.g0089f33e.el9.x86_64 4/36 2024-02-09T07:51:05.928 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-osd-2:19.0.0-1310.g0089f33e.el9.x86_64 5/36 2024-02-09T07:51:05.928 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1310.g0089f33e.el9. 6/36 2024-02-09T07:51:05.928 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/36 2024-02-09T07:51:05.928 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/36 2024-02-09T07:51:05.928 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/36 2024-02-09T07:51:05.929 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/36 2024-02-09T07:51:05.929 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/36 2024-02-09T07:51:05.929 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/36 2024-02-09T07:51:05.929 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/36 2024-02-09T07:51:05.929 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/36 2024-02-09T07:51:05.929 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/36 2024-02-09T07:51:05.929 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/36 2024-02-09T07:51:05.929 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/36 2024-02-09T07:51:05.929 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-02-09T07:51:05.929 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-02-09T07:51:05.929 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-02-09T07:51:05.929 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-02-09T07:51:05.929 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-02-09T07:51:05.929 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-02-09T07:51:05.929 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-02-09T07:51:05.930 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-02-09T07:51:05.930 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-02-09T07:51:05.930 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-02-09T07:51:05.930 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-02-09T07:51:05.930 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-02-09T07:51:05.930 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-02-09T07:51:05.930 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-02-09T07:51:05.930 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-02-09T07:51:05.930 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-02-09T07:51:05.930 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-02-09T07:51:05.930 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-02-09T07:51:06.986 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-02-09T07:51:06.986 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:51:06.986 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-02-09T07:51:06.986 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:51:06.986 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mds-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:51:06.986 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:51:06.987 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-modules-core-2:19.0.0-1310.g0089f33e.el9.noarch 2024-02-09T07:51:06.987 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mon-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:51:06.987 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-osd-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:51:06.987 INFO:teuthology.orchestra.run.smithi062.stdout: lua-5.4.4-4.el9.x86_64 2024-02-09T07:51:06.987 INFO:teuthology.orchestra.run.smithi062.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-02-09T07:51:06.987 INFO:teuthology.orchestra.run.smithi062.stdout: luarocks-3.9.2-1.el9.noarch 2024-02-09T07:51:06.987 INFO:teuthology.orchestra.run.smithi062.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-09T07:51:06.987 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-09T07:51:06.987 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-09T07:51:06.987 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-09T07:51:06.987 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-09T07:51:06.987 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-09T07:51:06.987 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-09T07:51:06.988 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-09T07:51:06.988 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-09T07:51:06.988 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-09T07:51:06.988 INFO:teuthology.orchestra.run.smithi062.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-09T07:51:06.988 INFO:teuthology.orchestra.run.smithi062.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-09T07:51:06.988 INFO:teuthology.orchestra.run.smithi062.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-09T07:51:06.988 INFO:teuthology.orchestra.run.smithi062.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-09T07:51:06.988 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-09T07:51:06.988 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ply-3.11-14.el9.noarch 2024-02-09T07:51:06.988 INFO:teuthology.orchestra.run.smithi062.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-09T07:51:06.988 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-09T07:51:06.988 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-09T07:51:06.988 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-09T07:51:06.988 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-09T07:51:06.989 INFO:teuthology.orchestra.run.smithi062.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-09T07:51:06.989 INFO:teuthology.orchestra.run.smithi062.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-09T07:51:06.989 INFO:teuthology.orchestra.run.smithi062.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-09T07:51:06.989 INFO:teuthology.orchestra.run.smithi062.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-09T07:51:06.989 INFO:teuthology.orchestra.run.smithi062.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-09T07:51:06.989 INFO:teuthology.orchestra.run.smithi062.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-09T07:51:06.989 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:51:06.989 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-02-09T07:51:07.222 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-base 2024-02-09T07:51:07.839 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:13 ago on Fri 09 Feb 2024 07:49:54 AM UTC. 2024-02-09T07:51:08.148 INFO:teuthology.orchestra.run.smithi062.stderr:Modular dependency problems: 2024-02-09T07:51:08.148 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T07:51:08.148 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 1: conflicting requests 2024-02-09T07:51:08.148 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.148 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 2: conflicting requests 2024-02-09T07:51:08.148 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.148 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 3: conflicting requests 2024-02-09T07:51:08.148 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.148 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 4: conflicting requests 2024-02-09T07:51:08.148 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.149 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 5: conflicting requests 2024-02-09T07:51:08.149 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.149 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 6: conflicting requests 2024-02-09T07:51:08.149 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.149 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 7: conflicting requests 2024-02-09T07:51:08.149 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.149 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 8: conflicting requests 2024-02-09T07:51:08.149 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.149 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 9: conflicting requests 2024-02-09T07:51:08.149 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.150 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 10: conflicting requests 2024-02-09T07:51:08.150 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.150 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 11: conflicting requests 2024-02-09T07:51:08.150 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.150 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 12: conflicting requests 2024-02-09T07:51:08.150 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.150 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 13: conflicting requests 2024-02-09T07:51:08.150 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.150 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 14: conflicting requests 2024-02-09T07:51:08.150 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.150 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 15: conflicting requests 2024-02-09T07:51:08.150 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.150 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 16: conflicting requests 2024-02-09T07:51:08.150 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.151 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 17: conflicting requests 2024-02-09T07:51:08.151 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.151 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 18: conflicting requests 2024-02-09T07:51:08.151 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.151 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 19: conflicting requests 2024-02-09T07:51:08.151 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.151 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 20: conflicting requests 2024-02-09T07:51:08.151 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.151 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 21: conflicting requests 2024-02-09T07:51:08.151 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.151 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 22: conflicting requests 2024-02-09T07:51:08.151 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.152 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 23: conflicting requests 2024-02-09T07:51:08.152 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.152 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 24: conflicting requests 2024-02-09T07:51:08.152 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.152 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 25: conflicting requests 2024-02-09T07:51:08.152 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.153 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 26: conflicting requests 2024-02-09T07:51:08.153 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.153 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 27: conflicting requests 2024-02-09T07:51:08.153 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.153 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 28: conflicting requests 2024-02-09T07:51:08.153 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.153 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 29: conflicting requests 2024-02-09T07:51:08.153 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.153 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 30: conflicting requests 2024-02-09T07:51:08.153 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.153 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 31: conflicting requests 2024-02-09T07:51:08.153 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.153 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 32: conflicting requests 2024-02-09T07:51:08.153 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.154 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 33: conflicting requests 2024-02-09T07:51:08.154 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.154 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 34: conflicting requests 2024-02-09T07:51:08.154 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.154 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 35: conflicting requests 2024-02-09T07:51:08.154 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.154 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 36: conflicting requests 2024-02-09T07:51:08.154 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.154 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 37: conflicting requests 2024-02-09T07:51:08.154 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.155 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.155 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.155 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:51:08.155 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.155 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.155 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.155 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.155 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 39: conflicting requests 2024-02-09T07:51:08.156 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.156 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.156 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.156 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.156 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.156 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.156 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:51:08.157 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.157 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.157 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.157 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.157 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:51:08.157 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.158 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.158 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.158 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.158 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:51:08.158 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.158 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.159 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.159 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.159 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:51:08.159 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.159 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.159 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.159 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.159 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:51:08.160 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.160 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.160 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.160 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.160 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:51:08.160 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.161 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.161 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.161 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:51:08.161 INFO:teuthology.orchestra.run.smithi062.stdout:Package ceph-base-2:19.0.0-1310.g0089f33e.el9.x86_64 is already installed. 2024-02-09T07:51:08.218 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-02-09T07:51:08.219 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do. 2024-02-09T07:51:08.219 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-02-09T07:51:08.280 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install cephadm 2024-02-09T07:51:08.896 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:14 ago on Fri 09 Feb 2024 07:49:54 AM UTC. 2024-02-09T07:51:09.201 INFO:teuthology.orchestra.run.smithi062.stderr:Modular dependency problems: 2024-02-09T07:51:09.201 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T07:51:09.201 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 1: conflicting requests 2024-02-09T07:51:09.201 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.202 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 2: conflicting requests 2024-02-09T07:51:09.202 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.202 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 3: conflicting requests 2024-02-09T07:51:09.202 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.202 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 4: conflicting requests 2024-02-09T07:51:09.202 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.202 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 5: conflicting requests 2024-02-09T07:51:09.202 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.202 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 6: conflicting requests 2024-02-09T07:51:09.202 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.202 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 7: conflicting requests 2024-02-09T07:51:09.202 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.202 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 8: conflicting requests 2024-02-09T07:51:09.203 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.203 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 9: conflicting requests 2024-02-09T07:51:09.203 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.203 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 10: conflicting requests 2024-02-09T07:51:09.203 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.203 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 11: conflicting requests 2024-02-09T07:51:09.203 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.203 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 12: conflicting requests 2024-02-09T07:51:09.203 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.203 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 13: conflicting requests 2024-02-09T07:51:09.203 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.203 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 14: conflicting requests 2024-02-09T07:51:09.203 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.203 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 15: conflicting requests 2024-02-09T07:51:09.204 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.204 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 16: conflicting requests 2024-02-09T07:51:09.204 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.204 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 17: conflicting requests 2024-02-09T07:51:09.204 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.204 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 18: conflicting requests 2024-02-09T07:51:09.204 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.204 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 19: conflicting requests 2024-02-09T07:51:09.204 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.204 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 20: conflicting requests 2024-02-09T07:51:09.204 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.204 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 21: conflicting requests 2024-02-09T07:51:09.204 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.205 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 22: conflicting requests 2024-02-09T07:51:09.205 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.205 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 23: conflicting requests 2024-02-09T07:51:09.205 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.205 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 24: conflicting requests 2024-02-09T07:51:09.205 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.205 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 25: conflicting requests 2024-02-09T07:51:09.205 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.205 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 26: conflicting requests 2024-02-09T07:51:09.205 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.205 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 27: conflicting requests 2024-02-09T07:51:09.205 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.205 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 28: conflicting requests 2024-02-09T07:51:09.206 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.206 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 29: conflicting requests 2024-02-09T07:51:09.206 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.206 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 30: conflicting requests 2024-02-09T07:51:09.206 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.206 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 31: conflicting requests 2024-02-09T07:51:09.206 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.206 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 32: conflicting requests 2024-02-09T07:51:09.206 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.206 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 33: conflicting requests 2024-02-09T07:51:09.206 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.206 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 34: conflicting requests 2024-02-09T07:51:09.206 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.207 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 35: conflicting requests 2024-02-09T07:51:09.207 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.207 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 36: conflicting requests 2024-02-09T07:51:09.207 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.207 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 37: conflicting requests 2024-02-09T07:51:09.207 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.207 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.207 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.207 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:51:09.207 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.207 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.207 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.207 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.207 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 39: conflicting requests 2024-02-09T07:51:09.208 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.208 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.208 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.208 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.208 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.208 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.208 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:51:09.208 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.209 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.209 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.209 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.209 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:51:09.209 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.209 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.209 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.209 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.209 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:51:09.209 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.209 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.209 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.209 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.210 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:51:09.210 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.210 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.210 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.210 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.210 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:51:09.210 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.210 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.210 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.210 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.210 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:51:09.210 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.210 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.211 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.211 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:51:09.271 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-02-09T07:51:09.272 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:51:09.272 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-02-09T07:51:09.272 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:51:09.272 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-02-09T07:51:09.272 INFO:teuthology.orchestra.run.smithi062.stdout: cephadm noarch 2:19.0.0-1310.g0089f33e.el9 ceph-noarch 748 k 2024-02-09T07:51:09.272 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:51:09.272 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-02-09T07:51:09.272 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:51:09.272 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2024-02-09T07:51:09.272 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:51:09.272 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 748 k 2024-02-09T07:51:09.272 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 754 k 2024-02-09T07:51:09.273 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-02-09T07:51:09.700 INFO:teuthology.orchestra.run.smithi062.stdout:cephadm-19.0.0-1310.g0089f33e.el9.noarch.rpm 1.7 MB/s | 748 kB 00:00 2024-02-09T07:51:09.701 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:51:09.701 INFO:teuthology.orchestra.run.smithi062.stdout:Total 1.7 MB/s | 748 kB 00:00 2024-02-09T07:51:09.701 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-02-09T07:51:09.706 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-02-09T07:51:09.706 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-02-09T07:51:09.712 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-02-09T07:51:09.713 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-02-09T07:51:09.785 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-02-09T07:51:10.259 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: cephadm-2:19.0.0-1310.g0089f33e.el9.noarch 1/1 2024-02-09T07:51:10.340 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : cephadm-2:19.0.0-1310.g0089f33e.el9.noarch 1/1 2024-02-09T07:51:10.713 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: cephadm-2:19.0.0-1310.g0089f33e.el9.noarch 1/1 2024-02-09T07:51:11.061 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : cephadm-2:19.0.0-1310.g0089f33e.el9.noarch 1/1 2024-02-09T07:51:11.062 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:51:11.062 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-02-09T07:51:11.062 INFO:teuthology.orchestra.run.smithi062.stdout: cephadm-2:19.0.0-1310.g0089f33e.el9.noarch 2024-02-09T07:51:11.062 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:51:11.062 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-02-09T07:51:11.260 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-immutable-object-cache 2024-02-09T07:51:11.874 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:17 ago on Fri 09 Feb 2024 07:49:54 AM UTC. 2024-02-09T07:51:12.186 INFO:teuthology.orchestra.run.smithi062.stderr:Modular dependency problems: 2024-02-09T07:51:12.186 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T07:51:12.186 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 1: conflicting requests 2024-02-09T07:51:12.186 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.187 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 2: conflicting requests 2024-02-09T07:51:12.187 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.187 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 3: conflicting requests 2024-02-09T07:51:12.187 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.187 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 4: conflicting requests 2024-02-09T07:51:12.187 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.187 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 5: conflicting requests 2024-02-09T07:51:12.187 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.187 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 6: conflicting requests 2024-02-09T07:51:12.187 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.188 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 7: conflicting requests 2024-02-09T07:51:12.188 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.188 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 8: conflicting requests 2024-02-09T07:51:12.188 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.188 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 9: conflicting requests 2024-02-09T07:51:12.188 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.188 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 10: conflicting requests 2024-02-09T07:51:12.188 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.188 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 11: conflicting requests 2024-02-09T07:51:12.188 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.188 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 12: conflicting requests 2024-02-09T07:51:12.188 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.189 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 13: conflicting requests 2024-02-09T07:51:12.189 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.189 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 14: conflicting requests 2024-02-09T07:51:12.189 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.189 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 15: conflicting requests 2024-02-09T07:51:12.189 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.189 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 16: conflicting requests 2024-02-09T07:51:12.189 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.190 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 17: conflicting requests 2024-02-09T07:51:12.190 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.190 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 18: conflicting requests 2024-02-09T07:51:12.190 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.190 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 19: conflicting requests 2024-02-09T07:51:12.190 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.190 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 20: conflicting requests 2024-02-09T07:51:12.190 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.190 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 21: conflicting requests 2024-02-09T07:51:12.190 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.191 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 22: conflicting requests 2024-02-09T07:51:12.191 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.191 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 23: conflicting requests 2024-02-09T07:51:12.191 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.191 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 24: conflicting requests 2024-02-09T07:51:12.192 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.192 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 25: conflicting requests 2024-02-09T07:51:12.192 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.192 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 26: conflicting requests 2024-02-09T07:51:12.193 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.193 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 27: conflicting requests 2024-02-09T07:51:12.193 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.193 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 28: conflicting requests 2024-02-09T07:51:12.193 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.194 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 29: conflicting requests 2024-02-09T07:51:12.194 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.194 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 30: conflicting requests 2024-02-09T07:51:12.194 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.194 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 31: conflicting requests 2024-02-09T07:51:12.194 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.195 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 32: conflicting requests 2024-02-09T07:51:12.195 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.195 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 33: conflicting requests 2024-02-09T07:51:12.195 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.195 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 34: conflicting requests 2024-02-09T07:51:12.195 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.196 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 35: conflicting requests 2024-02-09T07:51:12.196 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.196 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 36: conflicting requests 2024-02-09T07:51:12.196 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.196 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 37: conflicting requests 2024-02-09T07:51:12.196 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.197 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.197 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.197 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:51:12.197 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.197 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.198 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.198 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.198 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 39: conflicting requests 2024-02-09T07:51:12.198 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.198 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.198 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.199 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.199 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.199 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.199 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:51:12.199 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.199 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.200 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.200 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.200 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:51:12.200 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.200 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.201 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.201 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.201 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:51:12.201 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.201 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.201 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.202 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.202 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:51:12.202 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.202 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.203 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.203 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.203 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:51:12.203 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.203 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.203 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.203 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.203 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:51:12.203 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.203 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.204 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.204 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:51:12.258 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-02-09T07:51:12.259 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:51:12.259 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repo Size 2024-02-09T07:51:12.259 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:51:12.259 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-02-09T07:51:12.259 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 145 k 2024-02-09T07:51:12.259 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:51:12.259 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-02-09T07:51:12.259 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:51:12.259 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2024-02-09T07:51:12.260 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:51:12.260 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 145 k 2024-02-09T07:51:12.260 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 436 k 2024-02-09T07:51:12.260 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-02-09T07:51:12.606 INFO:teuthology.orchestra.run.smithi062.stdout:ceph-immutable-object-cache-19.0.0-1310.g0089f3 419 kB/s | 145 kB 00:00 2024-02-09T07:51:12.607 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:51:12.607 INFO:teuthology.orchestra.run.smithi062.stdout:Total 417 kB/s | 145 kB 00:00 2024-02-09T07:51:12.607 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-02-09T07:51:12.615 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-02-09T07:51:12.615 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-02-09T07:51:12.670 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-02-09T07:51:12.670 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-02-09T07:51:12.810 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-02-09T07:51:12.866 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1310.g0089f33e. 1/1 2024-02-09T07:51:12.890 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1310.g0089f33e. 1/1 2024-02-09T07:51:12.890 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-09T07:51:12.890 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-09T07:51:12.890 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:51:13.890 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1310.g0089f33e. 1/1 2024-02-09T07:51:13.891 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:51:13.891 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-02-09T07:51:13.891 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-immutable-object-cache-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:51:13.891 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:51:13.891 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-02-09T07:51:14.105 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-mgr 2024-02-09T07:51:14.721 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:20 ago on Fri 09 Feb 2024 07:49:54 AM UTC. 2024-02-09T07:51:15.032 INFO:teuthology.orchestra.run.smithi062.stderr:Modular dependency problems: 2024-02-09T07:51:15.032 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T07:51:15.032 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 1: conflicting requests 2024-02-09T07:51:15.032 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.032 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 2: conflicting requests 2024-02-09T07:51:15.032 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.032 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 3: conflicting requests 2024-02-09T07:51:15.032 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.032 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 4: conflicting requests 2024-02-09T07:51:15.032 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.032 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 5: conflicting requests 2024-02-09T07:51:15.033 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.033 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 6: conflicting requests 2024-02-09T07:51:15.033 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.033 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 7: conflicting requests 2024-02-09T07:51:15.033 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.033 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 8: conflicting requests 2024-02-09T07:51:15.033 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.033 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 9: conflicting requests 2024-02-09T07:51:15.033 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.033 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 10: conflicting requests 2024-02-09T07:51:15.033 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.033 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 11: conflicting requests 2024-02-09T07:51:15.033 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.033 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 12: conflicting requests 2024-02-09T07:51:15.034 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.034 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 13: conflicting requests 2024-02-09T07:51:15.034 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.034 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 14: conflicting requests 2024-02-09T07:51:15.034 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.034 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 15: conflicting requests 2024-02-09T07:51:15.034 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.034 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 16: conflicting requests 2024-02-09T07:51:15.034 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.034 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 17: conflicting requests 2024-02-09T07:51:15.034 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.034 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 18: conflicting requests 2024-02-09T07:51:15.035 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.035 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 19: conflicting requests 2024-02-09T07:51:15.035 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.035 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 20: conflicting requests 2024-02-09T07:51:15.035 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.035 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 21: conflicting requests 2024-02-09T07:51:15.035 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.035 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 22: conflicting requests 2024-02-09T07:51:15.035 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.035 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 23: conflicting requests 2024-02-09T07:51:15.035 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.035 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 24: conflicting requests 2024-02-09T07:51:15.035 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.035 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 25: conflicting requests 2024-02-09T07:51:15.036 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.036 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 26: conflicting requests 2024-02-09T07:51:15.036 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.036 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 27: conflicting requests 2024-02-09T07:51:15.036 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.036 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 28: conflicting requests 2024-02-09T07:51:15.036 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.036 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 29: conflicting requests 2024-02-09T07:51:15.036 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.036 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 30: conflicting requests 2024-02-09T07:51:15.036 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.036 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 31: conflicting requests 2024-02-09T07:51:15.036 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.037 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 32: conflicting requests 2024-02-09T07:51:15.037 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.037 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 33: conflicting requests 2024-02-09T07:51:15.037 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.037 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 34: conflicting requests 2024-02-09T07:51:15.037 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.037 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 35: conflicting requests 2024-02-09T07:51:15.037 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.037 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 36: conflicting requests 2024-02-09T07:51:15.037 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.037 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 37: conflicting requests 2024-02-09T07:51:15.037 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.037 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.038 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.038 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:51:15.038 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.038 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.038 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.038 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.038 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 39: conflicting requests 2024-02-09T07:51:15.038 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.038 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.038 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.038 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.038 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.038 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.039 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:51:15.039 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.039 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.039 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.039 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.039 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:51:15.039 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.039 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.039 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.039 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.039 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:51:15.039 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.039 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.040 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.040 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.040 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:51:15.040 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.040 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.040 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.040 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.040 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:51:15.040 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.040 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.040 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.040 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.040 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:51:15.041 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.041 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.041 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.041 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:51:15.041 INFO:teuthology.orchestra.run.smithi062.stdout:Package ceph-mgr-2:19.0.0-1310.g0089f33e.el9.x86_64 is already installed. 2024-02-09T07:51:15.103 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-02-09T07:51:15.104 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do. 2024-02-09T07:51:15.104 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-02-09T07:51:15.162 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-mgr-dashboard 2024-02-09T07:51:15.772 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:21 ago on Fri 09 Feb 2024 07:49:54 AM UTC. 2024-02-09T07:51:16.080 INFO:teuthology.orchestra.run.smithi062.stderr:Modular dependency problems: 2024-02-09T07:51:16.080 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T07:51:16.080 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 1: conflicting requests 2024-02-09T07:51:16.080 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.080 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 2: conflicting requests 2024-02-09T07:51:16.080 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.081 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 3: conflicting requests 2024-02-09T07:51:16.081 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.081 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 4: conflicting requests 2024-02-09T07:51:16.081 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.081 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 5: conflicting requests 2024-02-09T07:51:16.081 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.081 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 6: conflicting requests 2024-02-09T07:51:16.081 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.081 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 7: conflicting requests 2024-02-09T07:51:16.081 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.081 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 8: conflicting requests 2024-02-09T07:51:16.081 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.081 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 9: conflicting requests 2024-02-09T07:51:16.081 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.082 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 10: conflicting requests 2024-02-09T07:51:16.082 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.082 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 11: conflicting requests 2024-02-09T07:51:16.082 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.082 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 12: conflicting requests 2024-02-09T07:51:16.082 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.082 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 13: conflicting requests 2024-02-09T07:51:16.082 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.082 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 14: conflicting requests 2024-02-09T07:51:16.082 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.082 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 15: conflicting requests 2024-02-09T07:51:16.082 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.082 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 16: conflicting requests 2024-02-09T07:51:16.083 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.083 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 17: conflicting requests 2024-02-09T07:51:16.083 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.083 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 18: conflicting requests 2024-02-09T07:51:16.083 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.083 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 19: conflicting requests 2024-02-09T07:51:16.083 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.083 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 20: conflicting requests 2024-02-09T07:51:16.083 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.083 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 21: conflicting requests 2024-02-09T07:51:16.083 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.083 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 22: conflicting requests 2024-02-09T07:51:16.083 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.084 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 23: conflicting requests 2024-02-09T07:51:16.084 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.084 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 24: conflicting requests 2024-02-09T07:51:16.084 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.084 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 25: conflicting requests 2024-02-09T07:51:16.084 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.084 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 26: conflicting requests 2024-02-09T07:51:16.084 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.084 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 27: conflicting requests 2024-02-09T07:51:16.084 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.085 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 28: conflicting requests 2024-02-09T07:51:16.085 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.085 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 29: conflicting requests 2024-02-09T07:51:16.085 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.085 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 30: conflicting requests 2024-02-09T07:51:16.085 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.085 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 31: conflicting requests 2024-02-09T07:51:16.085 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.085 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 32: conflicting requests 2024-02-09T07:51:16.085 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.085 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 33: conflicting requests 2024-02-09T07:51:16.085 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.085 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 34: conflicting requests 2024-02-09T07:51:16.086 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.086 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 35: conflicting requests 2024-02-09T07:51:16.086 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.086 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 36: conflicting requests 2024-02-09T07:51:16.086 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.086 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 37: conflicting requests 2024-02-09T07:51:16.086 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.086 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.086 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.086 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:51:16.086 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.086 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.086 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.087 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.087 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 39: conflicting requests 2024-02-09T07:51:16.087 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.087 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.087 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.087 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.087 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.087 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.087 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:51:16.087 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.087 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.087 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.087 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.088 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:51:16.088 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.088 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.088 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.088 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.088 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:51:16.088 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.088 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.088 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.088 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.088 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:51:16.088 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.088 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.088 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.089 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.089 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:51:16.089 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.089 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.089 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.089 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.089 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:51:16.089 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.089 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.089 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.089 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:51:16.151 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-02-09T07:51:16.152 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:51:16.152 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-02-09T07:51:16.152 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:51:16.152 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-02-09T07:51:16.152 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1310.g0089f33e.el9 ceph-noarch 1.8 M 2024-02-09T07:51:16.152 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-02-09T07:51:16.153 INFO:teuthology.orchestra.run.smithi062.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-02-09T07:51:16.153 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1310.g0089f33e.el9 ceph-noarch 28 k 2024-02-09T07:51:16.153 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1310.g0089f33e.el9 ceph-noarch 15 k 2024-02-09T07:51:16.153 INFO:teuthology.orchestra.run.smithi062.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-02-09T07:51:16.153 INFO:teuthology.orchestra.run.smithi062.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-02-09T07:51:16.153 INFO:teuthology.orchestra.run.smithi062.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-02-09T07:51:16.153 INFO:teuthology.orchestra.run.smithi062.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-02-09T07:51:16.153 INFO:teuthology.orchestra.run.smithi062.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-02-09T07:51:16.153 INFO:teuthology.orchestra.run.smithi062.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-02-09T07:51:16.153 INFO:teuthology.orchestra.run.smithi062.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-09T07:51:16.153 INFO:teuthology.orchestra.run.smithi062.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-09T07:51:16.153 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:51:16.153 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-02-09T07:51:16.153 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:51:16.154 INFO:teuthology.orchestra.run.smithi062.stdout:Install 12 Packages 2024-02-09T07:51:16.154 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:51:16.155 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 6.9 M 2024-02-09T07:51:16.155 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 26 M 2024-02-09T07:51:16.155 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-02-09T07:51:17.035 INFO:teuthology.orchestra.run.smithi062.stdout:(1/12): ceph-grafana-dashboards-19.0.0-1310.g00 113 kB/s | 28 kB 00:00 2024-02-09T07:51:17.060 INFO:teuthology.orchestra.run.smithi062.stdout:(2/12): ceph-prometheus-alerts-19.0.0-1310.g008 56 kB/s | 15 kB 00:00 2024-02-09T07:51:17.210 INFO:teuthology.orchestra.run.smithi062.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.8 MB/s | 269 kB 00:00 2024-02-09T07:51:17.269 INFO:teuthology.orchestra.run.smithi062.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 4.3 MB/s | 1.0 MB 00:00 2024-02-09T07:51:17.403 INFO:teuthology.orchestra.run.smithi062.stdout:(5/12): ceph-mgr-dashboard-19.0.0-1310.g0089f33 2.8 MB/s | 1.8 MB 00:00 2024-02-09T07:51:17.661 INFO:teuthology.orchestra.run.smithi062.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 75 kB/s | 19 kB 00:00 2024-02-09T07:51:17.870 INFO:teuthology.orchestra.run.smithi062.stdout:(7/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 912 kB/s | 548 kB 00:00 2024-02-09T07:51:17.904 INFO:teuthology.orchestra.run.smithi062.stdout:(8/12): protobuf-compiler-3.14.0-13.el9.x86_64. 1.2 MB/s | 863 kB 00:00 2024-02-09T07:51:17.979 INFO:teuthology.orchestra.run.smithi062.stdout:(9/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 1.3 MB/s | 144 kB 00:00 2024-02-09T07:51:18.087 INFO:teuthology.orchestra.run.smithi062.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 1.7 MB/s | 188 kB 00:00 2024-02-09T07:51:18.163 INFO:teuthology.orchestra.run.smithi062.stdout:(11/12): python3-repoze-lru-0.7-16.el9.noarch.r 119 kB/s | 31 kB 00:00 2024-02-09T07:51:18.288 INFO:teuthology.orchestra.run.smithi062.stdout:(12/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 3.3 MB/s | 2.0 MB 00:00 2024-02-09T07:51:18.289 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:51:18.289 INFO:teuthology.orchestra.run.smithi062.stdout:Total 3.2 MB/s | 6.9 MB 00:02 2024-02-09T07:51:18.342 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-02-09T07:51:18.361 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-02-09T07:51:18.361 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-02-09T07:51:18.553 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-02-09T07:51:18.554 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-02-09T07:51:19.079 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-02-09T07:51:19.156 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-02-09T07:51:19.199 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-02-09T07:51:19.247 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-02-09T07:51:19.276 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-02-09T07:51:19.413 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-02-09T07:51:19.547 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-02-09T07:51:19.640 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-02-09T07:51:19.681 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-02-09T07:51:19.725 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-02-09T07:51:19.756 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1310.g0089f33e.el9 10/12 2024-02-09T07:51:20.009 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1310.g0089f33e.el 11/12 2024-02-09T07:51:20.041 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1310.g0089f33e.el9.noa 12/12 2024-02-09T07:51:20.827 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1310.g0089f33e.el9.noa 12/12 2024-02-09T07:51:20.827 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1310.g0089f33e.el 1/12 2024-02-09T07:51:20.827 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1310.g0089f33e.el9.noa 2/12 2024-02-09T07:51:20.827 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1310.g0089f33e.el9 3/12 2024-02-09T07:51:20.827 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-02-09T07:51:20.828 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-02-09T07:51:20.828 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-02-09T07:51:20.828 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-02-09T07:51:20.829 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-02-09T07:51:20.829 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-02-09T07:51:20.829 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-02-09T07:51:20.829 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-02-09T07:51:21.227 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-02-09T07:51:21.227 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:51:21.227 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-02-09T07:51:21.227 INFO:teuthology.orchestra.run.smithi062.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-02-09T07:51:21.228 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-grafana-dashboards-2:19.0.0-1310.g0089f33e.el9.noarch 2024-02-09T07:51:21.228 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-dashboard-2:19.0.0-1310.g0089f33e.el9.noarch 2024-02-09T07:51:21.228 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-prometheus-alerts-2:19.0.0-1310.g0089f33e.el9.noarch 2024-02-09T07:51:21.228 INFO:teuthology.orchestra.run.smithi062.stdout: grpc-data-1.46.7-10.el9.noarch 2024-02-09T07:51:21.228 INFO:teuthology.orchestra.run.smithi062.stdout: protobuf-3.14.0-13.el9.x86_64 2024-02-09T07:51:21.228 INFO:teuthology.orchestra.run.smithi062.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-02-09T07:51:21.228 INFO:teuthology.orchestra.run.smithi062.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-02-09T07:51:21.228 INFO:teuthology.orchestra.run.smithi062.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-02-09T07:51:21.228 INFO:teuthology.orchestra.run.smithi062.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-02-09T07:51:21.228 INFO:teuthology.orchestra.run.smithi062.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-09T07:51:21.228 INFO:teuthology.orchestra.run.smithi062.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-09T07:51:21.229 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:51:21.229 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-02-09T07:51:21.487 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-mgr-diskprediction-local 2024-02-09T07:51:22.101 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:28 ago on Fri 09 Feb 2024 07:49:54 AM UTC. 2024-02-09T07:51:22.407 INFO:teuthology.orchestra.run.smithi062.stderr:Modular dependency problems: 2024-02-09T07:51:22.407 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T07:51:22.407 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 1: conflicting requests 2024-02-09T07:51:22.407 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.407 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 2: conflicting requests 2024-02-09T07:51:22.407 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.407 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 3: conflicting requests 2024-02-09T07:51:22.407 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.407 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 4: conflicting requests 2024-02-09T07:51:22.407 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.408 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 5: conflicting requests 2024-02-09T07:51:22.408 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.408 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 6: conflicting requests 2024-02-09T07:51:22.408 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.408 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 7: conflicting requests 2024-02-09T07:51:22.408 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.408 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 8: conflicting requests 2024-02-09T07:51:22.408 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.408 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 9: conflicting requests 2024-02-09T07:51:22.408 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.408 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 10: conflicting requests 2024-02-09T07:51:22.408 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.408 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 11: conflicting requests 2024-02-09T07:51:22.409 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.409 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 12: conflicting requests 2024-02-09T07:51:22.409 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.409 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 13: conflicting requests 2024-02-09T07:51:22.409 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.409 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 14: conflicting requests 2024-02-09T07:51:22.409 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.409 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 15: conflicting requests 2024-02-09T07:51:22.409 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.409 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 16: conflicting requests 2024-02-09T07:51:22.409 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.409 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 17: conflicting requests 2024-02-09T07:51:22.409 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.410 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 18: conflicting requests 2024-02-09T07:51:22.410 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.410 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 19: conflicting requests 2024-02-09T07:51:22.410 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.410 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 20: conflicting requests 2024-02-09T07:51:22.410 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.410 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 21: conflicting requests 2024-02-09T07:51:22.410 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.410 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 22: conflicting requests 2024-02-09T07:51:22.410 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.410 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 23: conflicting requests 2024-02-09T07:51:22.410 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.410 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 24: conflicting requests 2024-02-09T07:51:22.411 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.411 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 25: conflicting requests 2024-02-09T07:51:22.411 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.411 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 26: conflicting requests 2024-02-09T07:51:22.411 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.411 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 27: conflicting requests 2024-02-09T07:51:22.411 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.411 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 28: conflicting requests 2024-02-09T07:51:22.411 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.411 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 29: conflicting requests 2024-02-09T07:51:22.411 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.411 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 30: conflicting requests 2024-02-09T07:51:22.411 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.411 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 31: conflicting requests 2024-02-09T07:51:22.412 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.412 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 32: conflicting requests 2024-02-09T07:51:22.412 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.412 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 33: conflicting requests 2024-02-09T07:51:22.412 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.412 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 34: conflicting requests 2024-02-09T07:51:22.412 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.412 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 35: conflicting requests 2024-02-09T07:51:22.412 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.412 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 36: conflicting requests 2024-02-09T07:51:22.412 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.412 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 37: conflicting requests 2024-02-09T07:51:22.412 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.412 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.413 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.413 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:51:22.413 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.413 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.413 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.413 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.413 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 39: conflicting requests 2024-02-09T07:51:22.413 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.413 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.413 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.413 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.413 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.413 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.414 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:51:22.414 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.414 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.414 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.414 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.414 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:51:22.414 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.414 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.414 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.414 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.414 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:51:22.414 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.414 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.415 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.415 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.415 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:51:22.416 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.416 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.416 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.416 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.416 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:51:22.416 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.416 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.416 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.416 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.416 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:51:22.416 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.416 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.416 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.416 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:51:22.479 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-02-09T07:51:22.481 INFO:teuthology.orchestra.run.smithi062.stdout:======================================================================================= 2024-02-09T07:51:22.481 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-02-09T07:51:22.481 INFO:teuthology.orchestra.run.smithi062.stdout:======================================================================================= 2024-02-09T07:51:22.481 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-02-09T07:51:22.482 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1310.g0089f33e.el9 ceph-noarch 7.4 M 2024-02-09T07:51:22.482 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-02-09T07:51:22.482 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-02-09T07:51:22.482 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-02-09T07:51:22.482 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-02-09T07:51:22.482 INFO:teuthology.orchestra.run.smithi062.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-02-09T07:51:22.482 INFO:teuthology.orchestra.run.smithi062.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-02-09T07:51:22.482 INFO:teuthology.orchestra.run.smithi062.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-02-09T07:51:22.482 INFO:teuthology.orchestra.run.smithi062.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-02-09T07:51:22.482 INFO:teuthology.orchestra.run.smithi062.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-09T07:51:22.483 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-02-09T07:51:22.483 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-02-09T07:51:22.483 INFO:teuthology.orchestra.run.smithi062.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-02-09T07:51:22.483 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:51:22.483 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-02-09T07:51:22.483 INFO:teuthology.orchestra.run.smithi062.stdout:======================================================================================= 2024-02-09T07:51:22.483 INFO:teuthology.orchestra.run.smithi062.stdout:Install 12 Packages 2024-02-09T07:51:22.483 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:51:22.484 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 38 M 2024-02-09T07:51:22.484 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 209 M 2024-02-09T07:51:22.484 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-02-09T07:51:22.853 INFO:teuthology.orchestra.run.smithi062.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 1.1 MB/s | 195 kB 00:00 2024-02-09T07:51:22.904 INFO:teuthology.orchestra.run.smithi062.stdout:(2/12): libgfortran-11.4.1-3.el9.x86_64.rpm 3.4 MB/s | 803 kB 00:00 2024-02-09T07:51:23.512 INFO:teuthology.orchestra.run.smithi062.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 50 kB/s | 33 kB 00:00 2024-02-09T07:51:23.646 INFO:teuthology.orchestra.run.smithi062.stdout:(4/12): ceph-mgr-diskprediction-local-19.0.0-13 7.6 MB/s | 7.4 MB 00:00 2024-02-09T07:51:24.113 INFO:teuthology.orchestra.run.smithi062.stdout:(5/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.5 MB/s | 3.0 MB 00:01 2024-02-09T07:51:24.138 INFO:teuthology.orchestra.run.smithi062.stdout:(6/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 29 kB/s | 18 kB 00:00 2024-02-09T07:51:24.372 INFO:teuthology.orchestra.run.smithi062.stdout:(7/12): openblas-0.3.21-2.el9.x86_64.rpm 48 kB/s | 35 kB 00:00 2024-02-09T07:51:25.055 INFO:teuthology.orchestra.run.smithi062.stdout:(8/12): python3-devel-3.9.17-2.el9.x86_64.rpm 268 kB/s | 245 kB 00:00 2024-02-09T07:51:25.406 INFO:teuthology.orchestra.run.smithi062.stdout:(9/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 3.7 MB/s | 4.7 MB 00:01 2024-02-09T07:51:25.767 INFO:teuthology.orchestra.run.smithi062.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.8 MB/s | 5.1 MB 00:01 2024-02-09T07:51:25.956 INFO:teuthology.orchestra.run.smithi062.stdout:(11/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 278 kB/s | 250 kB 00:00 2024-02-09T07:51:27.081 INFO:teuthology.orchestra.run.smithi062.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 9.7 MB/s | 16 MB 00:01 2024-02-09T07:51:27.083 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:51:27.083 INFO:teuthology.orchestra.run.smithi062.stdout:Total 8.3 MB/s | 38 MB 00:04 2024-02-09T07:51:27.441 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-02-09T07:51:27.470 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-02-09T07:51:27.470 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-02-09T07:51:27.930 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-02-09T07:51:27.931 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-02-09T07:51:28.713 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-02-09T07:51:28.802 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-02-09T07:51:28.846 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-02-09T07:51:28.953 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-02-09T07:51:28.989 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-02-09T07:51:29.172 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-02-09T07:51:29.196 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-02-09T07:51:29.274 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-02-09T07:51:29.990 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-02-09T07:51:30.114 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-02-09T07:51:31.451 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-02-09T07:51:32.523 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-02-09T07:51:32.553 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1310.g0089f 12/12 2024-02-09T07:51:35.080 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1310.g0089f 12/12 2024-02-09T07:51:35.081 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1310.g0089f 1/12 2024-02-09T07:51:35.081 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-02-09T07:51:35.081 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-02-09T07:51:35.081 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-02-09T07:51:35.081 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-02-09T07:51:35.081 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-02-09T07:51:35.081 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-02-09T07:51:35.081 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-02-09T07:51:35.081 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 9/12 2024-02-09T07:51:35.081 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-02-09T07:51:35.081 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-02-09T07:51:35.527 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-02-09T07:51:35.528 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:51:35.528 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-02-09T07:51:35.528 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1310.g0089f33e.el9.noarch 2024-02-09T07:51:35.528 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-09T07:51:35.528 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-09T07:51:35.528 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-09T07:51:35.529 INFO:teuthology.orchestra.run.smithi062.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-09T07:51:35.529 INFO:teuthology.orchestra.run.smithi062.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-09T07:51:35.529 INFO:teuthology.orchestra.run.smithi062.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-09T07:51:35.529 INFO:teuthology.orchestra.run.smithi062.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-09T07:51:35.529 INFO:teuthology.orchestra.run.smithi062.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-09T07:51:35.529 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-09T07:51:35.529 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-09T07:51:35.529 INFO:teuthology.orchestra.run.smithi062.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-09T07:51:35.529 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:51:35.529 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-02-09T07:51:35.899 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-mgr-rook 2024-02-09T07:51:36.517 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:42 ago on Fri 09 Feb 2024 07:49:54 AM UTC. 2024-02-09T07:51:36.824 INFO:teuthology.orchestra.run.smithi062.stderr:Modular dependency problems: 2024-02-09T07:51:36.824 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T07:51:36.825 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 1: conflicting requests 2024-02-09T07:51:36.825 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.825 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 2: conflicting requests 2024-02-09T07:51:36.825 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.825 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 3: conflicting requests 2024-02-09T07:51:36.825 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.826 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 4: conflicting requests 2024-02-09T07:51:36.826 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.826 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 5: conflicting requests 2024-02-09T07:51:36.826 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.826 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 6: conflicting requests 2024-02-09T07:51:36.826 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.827 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 7: conflicting requests 2024-02-09T07:51:36.827 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.827 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 8: conflicting requests 2024-02-09T07:51:36.827 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.827 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 9: conflicting requests 2024-02-09T07:51:36.827 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.827 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 10: conflicting requests 2024-02-09T07:51:36.828 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.828 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 11: conflicting requests 2024-02-09T07:51:36.828 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.828 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 12: conflicting requests 2024-02-09T07:51:36.828 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.828 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 13: conflicting requests 2024-02-09T07:51:36.828 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.828 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 14: conflicting requests 2024-02-09T07:51:36.828 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.828 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 15: conflicting requests 2024-02-09T07:51:36.828 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.828 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 16: conflicting requests 2024-02-09T07:51:36.829 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.829 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 17: conflicting requests 2024-02-09T07:51:36.829 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.829 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 18: conflicting requests 2024-02-09T07:51:36.829 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.829 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 19: conflicting requests 2024-02-09T07:51:36.829 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.829 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 20: conflicting requests 2024-02-09T07:51:36.829 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.829 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 21: conflicting requests 2024-02-09T07:51:36.829 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.830 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 22: conflicting requests 2024-02-09T07:51:36.830 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.830 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 23: conflicting requests 2024-02-09T07:51:36.830 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.830 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 24: conflicting requests 2024-02-09T07:51:36.830 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.830 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 25: conflicting requests 2024-02-09T07:51:36.830 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.830 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 26: conflicting requests 2024-02-09T07:51:36.830 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.830 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 27: conflicting requests 2024-02-09T07:51:36.831 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.831 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 28: conflicting requests 2024-02-09T07:51:36.831 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.831 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 29: conflicting requests 2024-02-09T07:51:36.831 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.831 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 30: conflicting requests 2024-02-09T07:51:36.831 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.831 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 31: conflicting requests 2024-02-09T07:51:36.831 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.831 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 32: conflicting requests 2024-02-09T07:51:36.831 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.831 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 33: conflicting requests 2024-02-09T07:51:36.832 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.832 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 34: conflicting requests 2024-02-09T07:51:36.832 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.832 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 35: conflicting requests 2024-02-09T07:51:36.832 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.832 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 36: conflicting requests 2024-02-09T07:51:36.832 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.832 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 37: conflicting requests 2024-02-09T07:51:36.832 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.832 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.832 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.832 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:51:36.833 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.833 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.833 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.833 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.833 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 39: conflicting requests 2024-02-09T07:51:36.833 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.833 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.833 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.833 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.833 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.833 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.834 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:51:36.834 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.834 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.834 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.834 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.834 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:51:36.834 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.834 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.834 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.834 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.834 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:51:36.834 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.835 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.835 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.835 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.835 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:51:36.835 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.835 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.835 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.835 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.835 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:51:36.835 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.835 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.835 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.835 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.835 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:51:36.836 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.836 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.836 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.836 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:51:36.897 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-02-09T07:51:36.899 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:51:36.899 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-02-09T07:51:36.899 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:51:36.899 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-02-09T07:51:36.899 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-rook noarch 2:19.0.0-1310.g0089f33e.el9 ceph-noarch 52 k 2024-02-09T07:51:36.899 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-02-09T07:51:36.900 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-09T07:51:36.900 INFO:teuthology.orchestra.run.smithi062.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-09T07:51:36.900 INFO:teuthology.orchestra.run.smithi062.stdout: python3-google-auth noarch 1:2.27.0-1.el9 epel 203 k 2024-02-09T07:51:36.900 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-02-09T07:51:36.900 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-02-09T07:51:36.900 INFO:teuthology.orchestra.run.smithi062.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-09T07:51:36.901 INFO:teuthology.orchestra.run.smithi062.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-02-09T07:51:36.901 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-02-09T07:51:36.901 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-02-09T07:51:36.901 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-02-09T07:51:36.901 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-09T07:51:36.902 INFO:teuthology.orchestra.run.smithi062.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-09T07:51:36.902 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:51:36.902 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-02-09T07:51:36.902 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:51:36.902 INFO:teuthology.orchestra.run.smithi062.stdout:Install 13 Packages 2024-02-09T07:51:36.902 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:51:36.904 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 2.2 M 2024-02-09T07:51:36.904 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 26 M 2024-02-09T07:51:36.904 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-02-09T07:51:37.111 INFO:teuthology.orchestra.run.smithi062.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 284 kB/s | 26 kB 00:00 2024-02-09T07:51:37.136 INFO:teuthology.orchestra.run.smithi062.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 166 kB/s | 19 kB 00:00 2024-02-09T07:51:37.228 INFO:teuthology.orchestra.run.smithi062.stdout:(3/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 159 kB 00:00 2024-02-09T07:51:37.254 INFO:teuthology.orchestra.run.smithi062.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.5 MB/s | 222 kB 00:00 2024-02-09T07:51:37.296 INFO:teuthology.orchestra.run.smithi062.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.0 MB/s | 279 kB 00:00 2024-02-09T07:51:37.321 INFO:teuthology.orchestra.run.smithi062.stdout:(6/13): ceph-mgr-rook-19.0.0-1310.g0089f33e.el9 174 kB/s | 52 kB 00:00 2024-02-09T07:51:37.346 INFO:teuthology.orchestra.run.smithi062.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 580 kB/s | 54 kB 00:00 2024-02-09T07:51:41.074 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-cachetools-4.2.4-1.el9.noarch.rpm: Curl error (7): Couldn't connect to server for https://mirrors.ocf.berkeley.edu/fedora/epel/9/Everything/x86_64/Packages/p/python3-cachetools-4.2.4-1.el9.noarch.rpm [Failed to connect to mirrors.ocf.berkeley.edu port 443: No route to host] 2024-02-09T07:51:41.075 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-certifi-2021.10.8-2.el9.noarch.rpm: Curl error (7): Couldn't connect to server for https://mirrors.ocf.berkeley.edu/fedora/epel/9/Everything/x86_64/Packages/p/python3-certifi-2021.10.8-2.el9.noarch.rpm [Failed to connect to mirrors.ocf.berkeley.edu port 443: No route to host] 2024-02-09T07:51:41.075 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-google-auth-2.27.0-1.el9.noarch.rpm: Curl error (7): Couldn't connect to server for https://mirrors.ocf.berkeley.edu/fedora/epel/9/Everything/x86_64/Packages/p/python3-google-auth-2.27.0-1.el9.noarch.rpm [Failed to connect to mirrors.ocf.berkeley.edu port 443: No route to host] 2024-02-09T07:51:43.209 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-certifi-2021.10.8-2.el9.noarch.rpm: Curl error (7): Couldn't connect to server for http://mirrors.ocf.berkeley.edu/fedora/epel/9/Everything/x86_64/Packages/p/python3-certifi-2021.10.8-2.el9.noarch.rpm [Failed to connect to mirrors.ocf.berkeley.edu port 80: No route to host] 2024-02-09T07:51:43.363 INFO:teuthology.orchestra.run.smithi062.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 2.5 kB/s | 15 kB 00:06 2024-02-09T07:51:43.789 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-cachetools-4.2.4-1.el9.noarch.rpm: Curl error (7): Couldn't connect to server for http://mirrors.ocf.berkeley.edu/fedora/epel/9/Everything/x86_64/Packages/p/python3-cachetools-4.2.4-1.el9.noarch.rpm [Failed to connect to mirrors.ocf.berkeley.edu port 80: No route to host] 2024-02-09T07:51:43.789 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-google-auth-2.27.0-1.el9.noarch.rpm: Curl error (7): Couldn't connect to server for http://mirrors.ocf.berkeley.edu/fedora/epel/9/Everything/x86_64/Packages/p/python3-google-auth-2.27.0-1.el9.noarch.rpm [Failed to connect to mirrors.ocf.berkeley.edu port 80: No route to host] 2024-02-09T07:51:43.896 INFO:teuthology.orchestra.run.smithi062.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 4.9 kB/s | 32 kB 00:06 2024-02-09T07:51:44.022 INFO:teuthology.orchestra.run.smithi062.stdout:(10/13): python3-google-auth-2.27.0-1.el9.noarc 30 kB/s | 203 kB 00:06 2024-02-09T07:51:46.403 INFO:teuthology.orchestra.run.smithi103.stdout:(5/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.0 kB/s | 64 kB 01:04 2024-02-09T07:51:46.445 INFO:teuthology.orchestra.run.smithi103.stdout:(6/6): socat-1.7.4.1-5.el9.x86_64.rpm 4.8 kB/s | 305 kB 01:04 2024-02-09T07:51:46.446 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:51:46.446 INFO:teuthology.orchestra.run.smithi103.stdout:Total 762 kB/s | 48 MB 01:04 2024-02-09T07:51:46.492 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-02-09T07:51:46.512 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-02-09T07:51:46.512 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-02-09T07:51:46.736 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-kubernetes-26.1.0-2.el9.noarch.rpm: Curl error (7): Couldn't connect to server for http://mirrors.ocf.berkeley.edu/fedora/epel/9/Everything/x86_64/Packages/p/python3-kubernetes-26.1.0-2.el9.noarch.rpm [Failed to connect to mirrors.ocf.berkeley.edu port 80: No route to host] 2024-02-09T07:51:46.860 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-rsa-4.9-2.el9.noarch.rpm: Curl error (7): Couldn't connect to server for http://mirrors.ocf.berkeley.edu/fedora/epel/9/Everything/x86_64/Packages/p/python3-rsa-4.9-2.el9.noarch.rpm [Failed to connect to mirrors.ocf.berkeley.edu port 80: No route to host] 2024-02-09T07:51:46.860 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-websocket-client-1.2.3-2.el9.noarch.rpm: Curl error (7): Couldn't connect to server for http://mirrors.ocf.berkeley.edu/fedora/epel/9/Everything/x86_64/Packages/p/python3-websocket-client-1.2.3-2.el9.noarch.rpm [Failed to connect to mirrors.ocf.berkeley.edu port 80: No route to host] 2024-02-09T07:51:46.900 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-02-09T07:51:46.900 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-02-09T07:51:47.474 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-02-09T07:51:47.563 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2024-02-09T07:51:47.604 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2024-02-09T07:51:47.639 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-02-09T07:51:47.687 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2024-02-09T07:51:47.707 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libcephsqlite-2:19.0.0-1310.g0089f33e.el9.x86_64 5/6 2024-02-09T07:51:49.574 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-kubernetes-26.1.0-2.el9.noarch.rpm: Curl error (7): Couldn't connect to server for https://mirrors.ocf.berkeley.edu/fedora/epel/9/Everything/x86_64/Packages/p/python3-kubernetes-26.1.0-2.el9.noarch.rpm [Failed to connect to mirrors.ocf.berkeley.edu port 443: No route to host] 2024-02-09T07:51:49.575 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-rsa-4.9-2.el9.noarch.rpm: Curl error (7): Couldn't connect to server for https://mirrors.ocf.berkeley.edu/fedora/epel/9/Everything/x86_64/Packages/p/python3-rsa-4.9-2.el9.noarch.rpm [Failed to connect to mirrors.ocf.berkeley.edu port 443: No route to host] 2024-02-09T07:51:49.575 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-websocket-client-1.2.3-2.el9.noarch.rpm: Curl error (7): Couldn't connect to server for https://mirrors.ocf.berkeley.edu/fedora/epel/9/Everything/x86_64/Packages/p/python3-websocket-client-1.2.3-2.el9.noarch.rpm [Failed to connect to mirrors.ocf.berkeley.edu port 443: No route to host] 2024-02-09T07:51:49.721 INFO:teuthology.orchestra.run.smithi062.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 10 kB/s | 59 kB 00:05 2024-02-09T07:51:49.805 INFO:teuthology.orchestra.run.smithi062.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 15 kB/s | 90 kB 00:05 2024-02-09T07:51:49.888 INFO:teuthology.orchestra.run.smithi062.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 160 kB/s | 1.0 MB 00:06 2024-02-09T07:51:49.890 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:51:49.890 INFO:teuthology.orchestra.run.smithi062.stdout:Total 174 kB/s | 2.2 MB 00:12 2024-02-09T07:51:49.958 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-02-09T07:51:49.974 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-02-09T07:51:49.974 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-02-09T07:51:50.087 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-02-09T07:51:50.088 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-02-09T07:51:50.622 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-02-09T07:51:50.802 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-02-09T07:51:50.857 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-02-09T07:51:50.913 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-02-09T07:51:50.949 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-02-09T07:51:50.991 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-02-09T07:51:51.089 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-02-09T07:51:51.208 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-google-auth-1:2.27.0-1.el9.noarch 7/13 2024-02-09T07:51:51.269 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-02-09T07:51:52.031 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-02-09T07:51:52.081 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-02-09T07:51:52.115 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-02-09T07:51:52.150 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1310.g0089f33e.el9.x86_64 5/6 2024-02-09T07:51:52.164 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-02-09T07:51:52.192 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-rook-2:19.0.0-1310.g0089f33e.el9.noarch 13/13 2024-02-09T07:51:52.231 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-test-2:19.0.0-1310.g0089f33e.el9.x86_64 6/6 2024-02-09T07:51:52.998 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1310.g0089f33e.el9.noarch 13/13 2024-02-09T07:51:52.998 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1310.g0089f33e.el9.noarch 1/13 2024-02-09T07:51:52.998 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-02-09T07:51:52.998 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-02-09T07:51:52.999 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-02-09T07:51:52.999 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-02-09T07:51:52.999 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-02-09T07:51:52.999 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-02-09T07:51:52.999 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-02-09T07:51:52.999 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-02-09T07:51:52.999 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-google-auth-1:2.27.0-1.el9.noarch 10/13 2024-02-09T07:51:52.999 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-02-09T07:51:52.999 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-02-09T07:51:53.397 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-02-09T07:51:53.397 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:51:53.397 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-02-09T07:51:53.397 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-rook-2:19.0.0-1310.g0089f33e.el9.noarch 2024-02-09T07:51:53.397 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-09T07:51:53.397 INFO:teuthology.orchestra.run.smithi062.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-09T07:51:53.397 INFO:teuthology.orchestra.run.smithi062.stdout: python3-google-auth-1:2.27.0-1.el9.noarch 2024-02-09T07:51:53.397 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-09T07:51:53.398 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-09T07:51:53.398 INFO:teuthology.orchestra.run.smithi062.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-09T07:51:53.398 INFO:teuthology.orchestra.run.smithi062.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-09T07:51:53.398 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-09T07:51:53.398 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-09T07:51:53.398 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-09T07:51:53.398 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-09T07:51:53.398 INFO:teuthology.orchestra.run.smithi062.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-09T07:51:53.398 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:51:53.398 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-02-09T07:51:53.644 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-mgr-cephadm 2024-02-09T07:51:54.261 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:02:00 ago on Fri 09 Feb 2024 07:49:54 AM UTC. 2024-02-09T07:51:54.571 INFO:teuthology.orchestra.run.smithi062.stderr:Modular dependency problems: 2024-02-09T07:51:54.572 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T07:51:54.572 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 1: conflicting requests 2024-02-09T07:51:54.572 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.572 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 2: conflicting requests 2024-02-09T07:51:54.572 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.572 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 3: conflicting requests 2024-02-09T07:51:54.572 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.572 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 4: conflicting requests 2024-02-09T07:51:54.572 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.572 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 5: conflicting requests 2024-02-09T07:51:54.572 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.572 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 6: conflicting requests 2024-02-09T07:51:54.572 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.573 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 7: conflicting requests 2024-02-09T07:51:54.573 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.573 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 8: conflicting requests 2024-02-09T07:51:54.573 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.573 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 9: conflicting requests 2024-02-09T07:51:54.573 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.573 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 10: conflicting requests 2024-02-09T07:51:54.573 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.573 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 11: conflicting requests 2024-02-09T07:51:54.573 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.574 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 12: conflicting requests 2024-02-09T07:51:54.574 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.574 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 13: conflicting requests 2024-02-09T07:51:54.574 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.574 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 14: conflicting requests 2024-02-09T07:51:54.574 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.574 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 15: conflicting requests 2024-02-09T07:51:54.574 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.574 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 16: conflicting requests 2024-02-09T07:51:54.574 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.574 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 17: conflicting requests 2024-02-09T07:51:54.574 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.574 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 18: conflicting requests 2024-02-09T07:51:54.575 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.575 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 19: conflicting requests 2024-02-09T07:51:54.575 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.575 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 20: conflicting requests 2024-02-09T07:51:54.575 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.575 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 21: conflicting requests 2024-02-09T07:51:54.575 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.575 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 22: conflicting requests 2024-02-09T07:51:54.575 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.575 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 23: conflicting requests 2024-02-09T07:51:54.576 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.576 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 24: conflicting requests 2024-02-09T07:51:54.577 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.577 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 25: conflicting requests 2024-02-09T07:51:54.577 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.577 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 26: conflicting requests 2024-02-09T07:51:54.577 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.577 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 27: conflicting requests 2024-02-09T07:51:54.577 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.577 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 28: conflicting requests 2024-02-09T07:51:54.577 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.577 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 29: conflicting requests 2024-02-09T07:51:54.578 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.578 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 30: conflicting requests 2024-02-09T07:51:54.578 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.578 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 31: conflicting requests 2024-02-09T07:51:54.578 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.578 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 32: conflicting requests 2024-02-09T07:51:54.578 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.578 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 33: conflicting requests 2024-02-09T07:51:54.578 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.578 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 34: conflicting requests 2024-02-09T07:51:54.578 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.578 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 35: conflicting requests 2024-02-09T07:51:54.578 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.579 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 36: conflicting requests 2024-02-09T07:51:54.579 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.579 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 37: conflicting requests 2024-02-09T07:51:54.579 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.579 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.579 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.580 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:51:54.580 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.580 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.580 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.580 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.580 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 39: conflicting requests 2024-02-09T07:51:54.580 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.580 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.580 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.580 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.580 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.580 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.580 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:51:54.580 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.581 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.581 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.581 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.581 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:51:54.581 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.581 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.581 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.581 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.581 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:51:54.581 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.581 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.581 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.581 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.581 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:51:54.582 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.582 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.582 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.582 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.582 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:51:54.582 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.582 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.582 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.582 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.582 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:51:54.582 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.582 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.582 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.582 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:51:54.644 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-02-09T07:51:54.645 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:51:54.645 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-02-09T07:51:54.645 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:51:54.645 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-02-09T07:51:54.645 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1310.g0089f33e.el9 ceph-noarch 138 k 2024-02-09T07:51:54.645 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-02-09T07:51:54.645 INFO:teuthology.orchestra.run.smithi062.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2024-02-09T07:51:54.645 INFO:teuthology.orchestra.run.smithi062.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-02-09T07:51:54.645 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jinja2 noarch 2.11.3-4.el9 appstream 249 k 2024-02-09T07:51:54.645 INFO:teuthology.orchestra.run.smithi062.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-09T07:51:54.645 INFO:teuthology.orchestra.run.smithi062.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-09T07:51:54.646 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:51:54.646 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-02-09T07:51:54.646 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:51:54.646 INFO:teuthology.orchestra.run.smithi062.stdout:Install 6 Packages 2024-02-09T07:51:54.646 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:51:54.646 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 7.0 M 2024-02-09T07:51:54.646 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 33 M 2024-02-09T07:51:54.647 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-02-09T07:51:54.665 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-test-2:19.0.0-1310.g0089f33e.el9.x86_64 6/6 2024-02-09T07:51:54.665 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-test-2:19.0.0-1310.g0089f33e.el9.x86_64 1/6 2024-02-09T07:51:54.665 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libcephsqlite-2:19.0.0-1310.g0089f33e.el9.x86_64 2/6 2024-02-09T07:51:54.665 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : jq-1.6-16.el9.x86_64 3/6 2024-02-09T07:51:54.665 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 4/6 2024-02-09T07:51:54.665 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 5/6 2024-02-09T07:51:55.051 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 6/6 2024-02-09T07:51:55.051 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:51:55.051 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-02-09T07:51:55.051 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-test-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:51:55.051 INFO:teuthology.orchestra.run.smithi103.stdout: jq-1.6-16.el9.x86_64 2024-02-09T07:51:55.051 INFO:teuthology.orchestra.run.smithi103.stdout: libcephsqlite-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:51:55.051 INFO:teuthology.orchestra.run.smithi103.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-02-09T07:51:55.052 INFO:teuthology.orchestra.run.smithi103.stdout: socat-1.7.4.1-5.el9.x86_64 2024-02-09T07:51:55.052 INFO:teuthology.orchestra.run.smithi103.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-02-09T07:51:55.052 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:51:55.052 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-02-09T07:51:55.240 INFO:teuthology.orchestra.run.smithi062.stdout:(1/6): python3-jinja2-2.11.3-4.el9.noarch.rpm 1.5 MB/s | 249 kB 00:00 2024-02-09T07:51:55.345 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph 2024-02-09T07:51:55.415 INFO:teuthology.orchestra.run.smithi062.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 6.0 MB 00:00 2024-02-09T07:51:55.474 INFO:teuthology.orchestra.run.smithi062.stdout:(3/6): ceph-mgr-cephadm-19.0.0-1310.g0089f33e.e 352 kB/s | 138 kB 00:00 2024-02-09T07:51:55.950 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:02:00 ago on Fri 09 Feb 2024 07:49:55 AM UTC. 2024-02-09T07:51:56.245 INFO:teuthology.orchestra.run.smithi103.stderr:Modular dependency problems: 2024-02-09T07:51:56.245 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T07:51:56.245 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 1: conflicting requests 2024-02-09T07:51:56.245 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.245 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 2: conflicting requests 2024-02-09T07:51:56.245 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.245 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 3: conflicting requests 2024-02-09T07:51:56.245 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.245 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 4: conflicting requests 2024-02-09T07:51:56.246 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.246 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 5: conflicting requests 2024-02-09T07:51:56.246 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.246 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 6: conflicting requests 2024-02-09T07:51:56.246 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.246 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 7: conflicting requests 2024-02-09T07:51:56.246 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.246 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 8: conflicting requests 2024-02-09T07:51:56.246 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.246 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 9: conflicting requests 2024-02-09T07:51:56.246 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.246 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 10: conflicting requests 2024-02-09T07:51:56.246 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.246 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 11: conflicting requests 2024-02-09T07:51:56.247 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.247 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 12: conflicting requests 2024-02-09T07:51:56.247 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.247 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 13: conflicting requests 2024-02-09T07:51:56.247 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.247 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 14: conflicting requests 2024-02-09T07:51:56.247 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.247 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 15: conflicting requests 2024-02-09T07:51:56.247 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.247 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 16: conflicting requests 2024-02-09T07:51:56.247 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.247 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 17: conflicting requests 2024-02-09T07:51:56.247 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.247 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 18: conflicting requests 2024-02-09T07:51:56.248 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.248 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 19: conflicting requests 2024-02-09T07:51:56.248 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.248 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 20: conflicting requests 2024-02-09T07:51:56.248 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.248 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 21: conflicting requests 2024-02-09T07:51:56.248 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.248 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 22: conflicting requests 2024-02-09T07:51:56.248 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.248 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 23: conflicting requests 2024-02-09T07:51:56.248 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.248 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 24: conflicting requests 2024-02-09T07:51:56.248 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.248 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 25: conflicting requests 2024-02-09T07:51:56.249 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.249 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 26: conflicting requests 2024-02-09T07:51:56.249 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.249 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 27: conflicting requests 2024-02-09T07:51:56.249 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.249 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 28: conflicting requests 2024-02-09T07:51:56.249 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.249 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 29: conflicting requests 2024-02-09T07:51:56.249 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.249 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 30: conflicting requests 2024-02-09T07:51:56.249 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.249 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 31: conflicting requests 2024-02-09T07:51:56.249 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.249 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 32: conflicting requests 2024-02-09T07:51:56.250 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.250 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 33: conflicting requests 2024-02-09T07:51:56.250 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.250 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 34: conflicting requests 2024-02-09T07:51:56.250 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.250 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 35: conflicting requests 2024-02-09T07:51:56.250 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.250 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 36: conflicting requests 2024-02-09T07:51:56.250 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.250 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 37: conflicting requests 2024-02-09T07:51:56.250 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.250 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.250 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.250 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:51:56.250 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.251 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.251 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.251 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.251 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 39: conflicting requests 2024-02-09T07:51:56.251 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.251 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.251 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.251 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.251 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.251 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.251 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:51:56.251 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.251 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.251 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.252 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.252 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:51:56.252 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.340 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.340 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.340 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.340 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:51:56.340 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.340 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.340 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.340 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.340 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:51:56.340 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.341 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.341 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.341 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.341 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:51:56.341 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.341 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.341 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.341 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.341 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:51:56.341 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.341 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.341 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.341 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:51:56.342 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-02-09T07:51:56.343 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:51:56.343 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-02-09T07:51:56.343 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:51:56.343 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-02-09T07:51:56.343 INFO:teuthology.orchestra.run.smithi103.stdout: ceph x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 6.6 k 2024-02-09T07:51:56.343 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-02-09T07:51:56.343 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mds x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 2.1 M 2024-02-09T07:51:56.343 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 1.5 M 2024-02-09T07:51:56.343 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1310.g0089f33e.el9 ceph-noarch 247 k 2024-02-09T07:51:56.343 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mon x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 4.7 M 2024-02-09T07:51:56.343 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-osd x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 17 M 2024-02-09T07:51:56.343 INFO:teuthology.orchestra.run.smithi103.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-02-09T07:51:56.343 INFO:teuthology.orchestra.run.smithi103.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-02-09T07:51:56.344 INFO:teuthology.orchestra.run.smithi103.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-02-09T07:51:56.344 INFO:teuthology.orchestra.run.smithi103.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-09T07:51:56.344 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-02-09T07:51:56.344 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-09T07:51:56.344 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-09T07:51:56.344 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-02-09T07:51:56.344 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-09T07:51:56.344 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-09T07:51:56.344 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-collections 2024-02-09T07:51:56.344 INFO:teuthology.orchestra.run.smithi103.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-02-09T07:51:56.344 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-09T07:51:56.344 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-09T07:51:56.344 INFO:teuthology.orchestra.run.smithi103.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-09T07:51:56.344 INFO:teuthology.orchestra.run.smithi103.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-02-09T07:51:56.345 INFO:teuthology.orchestra.run.smithi103.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-02-09T07:51:56.345 INFO:teuthology.orchestra.run.smithi103.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-09T07:51:56.345 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-09T07:51:56.345 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-02-09T07:51:56.345 INFO:teuthology.orchestra.run.smithi103.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-09T07:51:56.345 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-09T07:51:56.345 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-02-09T07:51:56.345 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-02-09T07:51:56.345 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-02-09T07:51:56.345 INFO:teuthology.orchestra.run.smithi103.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-09T07:51:56.345 INFO:teuthology.orchestra.run.smithi103.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-02-09T07:51:56.345 INFO:teuthology.orchestra.run.smithi103.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-02-09T07:51:56.345 INFO:teuthology.orchestra.run.smithi103.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-09T07:51:56.345 INFO:teuthology.orchestra.run.smithi103.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-09T07:51:56.345 INFO:teuthology.orchestra.run.smithi103.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-09T07:51:56.346 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:51:56.346 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-02-09T07:51:56.346 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:51:56.346 INFO:teuthology.orchestra.run.smithi103.stdout:Install 36 Packages 2024-02-09T07:51:56.346 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:51:56.346 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 30 M 2024-02-09T07:51:56.346 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 107 M 2024-02-09T07:51:56.346 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-02-09T07:51:56.941 INFO:teuthology.orchestra.run.smithi103.stdout:(1/36): ceph-19.0.0-1310.g0089f33e.el9.x86_64.r 30 kB/s | 6.6 kB 00:00 2024-02-09T07:51:57.250 INFO:teuthology.orchestra.run.smithi103.stdout:(2/36): ceph-mgr-19.0.0-1310.g0089f33e.el9.x86_ 2.8 MB/s | 1.5 MB 00:00 2024-02-09T07:51:57.342 INFO:teuthology.orchestra.run.smithi103.stdout:(3/36): ceph-mds-19.0.0-1310.g0089f33e.el9.x86_ 3.4 MB/s | 2.1 MB 00:00 2024-02-09T07:51:57.459 INFO:teuthology.orchestra.run.smithi103.stdout:(4/36): ceph-mgr-modules-core-19.0.0-1310.g0089 2.1 MB/s | 247 kB 00:00 2024-02-09T07:51:57.593 INFO:teuthology.orchestra.run.smithi103.stdout:(5/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.9 MB/s | 253 kB 00:00 2024-02-09T07:51:57.693 INFO:teuthology.orchestra.run.smithi103.stdout:(6/36): python3-cryptography-36.0.1-4.el9.x86_6 12 MB/s | 1.2 MB 00:00 2024-02-09T07:51:57.735 INFO:teuthology.orchestra.run.smithi103.stdout:(7/36): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-02-09T07:51:57.777 INFO:teuthology.orchestra.run.smithi103.stdout:(8/36): python3-pycparser-2.20-6.el9.noarch.rpm 3.2 MB/s | 135 kB 00:00 2024-02-09T07:51:57.819 INFO:teuthology.orchestra.run.smithi103.stdout:(9/36): python3-requests-2.25.1-8.el9.noarch.rp 2.9 MB/s | 125 kB 00:00 2024-02-09T07:51:57.869 INFO:teuthology.orchestra.run.smithi103.stdout:(10/36): python3-urllib3-1.26.5-5.el9.noarch.rp 4.2 MB/s | 215 kB 00:00 2024-02-09T07:51:58.044 INFO:teuthology.orchestra.run.smithi103.stdout:(11/36): ceph-mon-19.0.0-1310.g0089f33e.el9.x86 4.2 MB/s | 4.7 MB 00:01 2024-02-09T07:51:58.070 INFO:teuthology.orchestra.run.smithi103.stdout:(12/36): lua-5.4.4-4.el9.x86_64.rpm 941 kB/s | 188 kB 00:00 2024-02-09T07:51:58.253 INFO:teuthology.orchestra.run.smithi103.stdout:(13/36): ceph-osd-19.0.0-1310.g0089f33e.el9.x86 17 MB/s | 17 MB 00:01 2024-02-09T07:51:58.270 INFO:teuthology.orchestra.run.smithi103.stdout:(14/36): python3-markupsafe-1.1.1-12.el9.x86_64 173 kB/s | 35 kB 00:00 2024-02-09T07:51:58.312 INFO:teuthology.orchestra.run.smithi103.stdout:(15/36): python3-toml-0.10.2-6.el9.noarch.rpm 999 kB/s | 42 kB 00:00 2024-02-09T07:51:58.362 INFO:teuthology.orchestra.run.smithi103.stdout:(16/36): python3-pytz-2021.1-5.el9.noarch.rpm 468 kB/s | 51 kB 00:00 2024-02-09T07:51:58.379 INFO:teuthology.orchestra.run.smithi103.stdout:(17/36): lua-devel-5.4.4-4.el9.x86_64.rpm 334 kB/s | 22 kB 00:00 2024-02-09T07:51:58.405 INFO:teuthology.orchestra.run.smithi103.stdout:(18/36): python3-mako-1.1.4-6.el9.noarch.rpm 478 kB/s | 172 kB 00:00 2024-02-09T07:51:58.570 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-asyncssh-2.13.2-3.el9.noarch.rpm: Curl error (7): Couldn't connect to server for https://mirrors.ocf.berkeley.edu/fedora/epel/9/Everything/x86_64/Packages/p/python3-asyncssh-2.13.2-3.el9.noarch.rpm [Failed to connect to mirrors.ocf.berkeley.edu port 443: No route to host] 2024-02-09T07:51:58.570 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-natsort-7.1.1-5.el9.noarch.rpm: Curl error (7): Couldn't connect to server for https://mirrors.ocf.berkeley.edu/fedora/epel/9/Everything/x86_64/Packages/p/python3-natsort-7.1.1-5.el9.noarch.rpm [Failed to connect to mirrors.ocf.berkeley.edu port 443: No route to host] 2024-02-09T07:51:58.570 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-typing-extensions-4.4.0-2.el9.noarch.rpm: Curl error (7): Couldn't connect to server for https://mirrors.ocf.berkeley.edu/fedora/epel/9/Everything/x86_64/Packages/p/python3-typing-extensions-4.4.0-2.el9.noarch.rpm [Failed to connect to mirrors.ocf.berkeley.edu port 443: No route to host] 2024-02-09T07:51:58.664 INFO:teuthology.orchestra.run.smithi103.stdout:(19/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 153 kB/s | 43 kB 00:00 2024-02-09T07:51:58.706 INFO:teuthology.orchestra.run.smithi103.stdout:(20/36): luarocks-3.9.2-1.el9.noarch.rpm 441 kB/s | 151 kB 00:00 2024-02-09T07:51:58.840 INFO:teuthology.orchestra.run.smithi103.stdout:(21/36): python3-cherrypy-18.6.1-2.el9.noarch.r 2.0 MB/s | 358 kB 00:00 2024-02-09T07:51:58.856 INFO:teuthology.orchestra.run.smithi103.stdout:(22/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 71 kB/s | 11 kB 00:00 2024-02-09T07:51:58.898 INFO:teuthology.orchestra.run.smithi103.stdout:(23/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 386 kB/s | 172 kB 00:00 2024-02-09T07:51:58.915 INFO:teuthology.orchestra.run.smithi103.stdout:(24/36): python3-jaraco-classes-3.2.1-5.el9.noa 234 kB/s | 18 kB 00:00 2024-02-09T07:51:58.932 INFO:teuthology.orchestra.run.smithi103.stdout:(25/36): python3-jaraco-collections-3.0.0-8.el9 306 kB/s | 23 kB 00:00 2024-02-09T07:51:58.966 INFO:teuthology.orchestra.run.smithi103.stdout:(26/36): python3-jaraco-functools-3.5.0-2.el9.n 288 kB/s | 19 kB 00:00 2024-02-09T07:51:58.991 INFO:teuthology.orchestra.run.smithi103.stdout:(27/36): python3-jaraco-text-3.2.0-6.el9.noarch 260 kB/s | 20 kB 00:00 2024-02-09T07:51:59.016 INFO:teuthology.orchestra.run.smithi103.stdout:(28/36): python3-logutils-0.3.5-21.el9.noarch.r 551 kB/s | 46 kB 00:00 2024-02-09T07:51:59.075 INFO:teuthology.orchestra.run.smithi103.stdout:(29/36): python3-more-itertools-8.12.0-2.el9.no 724 kB/s | 79 kB 00:00 2024-02-09T07:51:59.150 INFO:teuthology.orchestra.run.smithi103.stdout:(30/36): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2024-02-09T07:51:59.167 INFO:teuthology.orchestra.run.smithi103.stdout:(31/36): python3-portend-3.1.0-2.el9.noarch.rpm 109 kB/s | 16 kB 00:00 2024-02-09T07:51:59.192 INFO:teuthology.orchestra.run.smithi103.stdout:(32/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 768 kB/s | 90 kB 00:00 2024-02-09T07:51:59.276 INFO:teuthology.orchestra.run.smithi103.stdout:(33/36): python3-tempora-5.0.0-2.el9.noarch.rpm 285 kB/s | 36 kB 00:00 2024-02-09T07:51:59.327 INFO:teuthology.orchestra.run.smithi103.stdout:(34/36): python3-webob-1.8.7-6.el9.noarch.rpm 1.4 MB/s | 230 kB 00:00 2024-02-09T07:51:59.410 INFO:teuthology.orchestra.run.smithi103.stdout:(35/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 1.9 MB/s | 427 kB 00:00 2024-02-09T07:51:59.435 INFO:teuthology.orchestra.run.smithi103.stdout:(36/36): python3-zc-lockfile-2.0-10.el9.noarch. 126 kB/s | 20 kB 00:00 2024-02-09T07:51:59.440 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:51:59.441 INFO:teuthology.orchestra.run.smithi103.stdout:Total 9.6 MB/s | 30 MB 00:03 2024-02-09T07:51:59.575 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-02-09T07:51:59.614 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-02-09T07:51:59.614 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-02-09T07:52:00.037 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-02-09T07:52:00.037 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-02-09T07:52:01.383 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-02-09T07:52:01.446 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-02-09T07:52:01.480 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-02-09T07:52:01.516 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-02-09T07:52:01.585 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-02-09T07:52:01.631 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-02-09T07:52:01.654 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-asyncssh-2.13.2-3.el9.noarch.rpm: Curl error (7): Couldn't connect to server for http://mirrors.ocf.berkeley.edu/fedora/epel/9/Everything/x86_64/Packages/p/python3-asyncssh-2.13.2-3.el9.noarch.rpm [Failed to connect to mirrors.ocf.berkeley.edu port 80: No route to host] 2024-02-09T07:52:01.654 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-typing-extensions-4.4.0-2.el9.noarch.rpm: Curl error (7): Couldn't connect to server for http://mirrors.ocf.berkeley.edu/fedora/epel/9/Everything/x86_64/Packages/p/python3-typing-extensions-4.4.0-2.el9.noarch.rpm [Failed to connect to mirrors.ocf.berkeley.edu port 80: No route to host] 2024-02-09T07:52:01.664 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-02-09T07:52:01.771 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-02-09T07:52:01.843 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-02-09T07:52:01.884 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-02-09T07:52:01.920 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-02-09T07:52:01.949 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/36 2024-02-09T07:52:01.983 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/36 2024-02-09T07:52:02.017 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/36 2024-02-09T07:52:02.057 INFO:teuthology.orchestra.run.smithi062.stdout:(4/6): python3-typing-extensions-4.4.0-2.el9.no 7.7 kB/s | 51 kB 00:06 2024-02-09T07:52:02.057 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/36 2024-02-09T07:52:02.092 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/36 2024-02-09T07:52:02.127 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/36 2024-02-09T07:52:02.166 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/36 2024-02-09T07:52:02.219 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-natsort-7.1.1-5.el9.noarch.rpm: Curl error (7): Couldn't connect to server for http://mirrors.ocf.berkeley.edu/fedora/epel/9/Everything/x86_64/Packages/p/python3-natsort-7.1.1-5.el9.noarch.rpm [Failed to connect to mirrors.ocf.berkeley.edu port 80: No route to host] 2024-02-09T07:52:02.238 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 18/36 2024-02-09T07:52:02.324 INFO:teuthology.orchestra.run.smithi062.stdout:(5/6): python3-natsort-7.1.1-5.el9.noarch.rpm 8.3 kB/s | 58 kB 00:06 2024-02-09T07:52:02.366 INFO:teuthology.orchestra.run.smithi062.stdout:(6/6): python3-asyncssh-2.13.2-3.el9.noarch.rpm 77 kB/s | 548 kB 00:07 2024-02-09T07:52:02.366 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:52:02.367 INFO:teuthology.orchestra.run.smithi062.stdout:Total 926 kB/s | 7.0 MB 00:07 2024-02-09T07:52:02.374 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 19/36 2024-02-09T07:52:02.441 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-02-09T07:52:02.453 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-02-09T07:52:02.453 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-02-09T07:52:02.456 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 20/36 2024-02-09T07:52:02.510 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 21/36 2024-02-09T07:52:02.548 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 22/36 2024-02-09T07:52:02.562 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-02-09T07:52:02.564 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-02-09T07:52:02.597 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-ply-3.11-14.el9.noarch 23/36 2024-02-09T07:52:02.654 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 24/36 2024-02-09T07:52:02.855 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 25/36 2024-02-09T07:52:02.890 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-02-09T07:52:02.903 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 26/36 2024-02-09T07:52:02.982 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 27/36 2024-02-09T07:52:03.062 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-02-09T07:52:03.069 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 28/36 2024-02-09T07:52:03.110 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 2/6 2024-02-09T07:52:03.111 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 29/36 2024-02-09T07:52:03.226 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 30/36 2024-02-09T07:52:03.395 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1310.g0089f33e.el9. 31/36 2024-02-09T07:52:03.422 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-2:19.0.0-1310.g0089f33e.el9.x86_64 32/36 2024-02-09T07:52:03.447 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1310.g0089f33e.el9.x86_64 32/36 2024-02-09T07:52:03.447 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-09T07:52:03.447 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-09T07:52:03.447 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-09T07:52:03.447 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-09T07:52:03.448 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:52:03.668 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-02-09T07:52:03.755 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-02-09T07:52:03.816 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 5/6 2024-02-09T07:52:03.846 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1310.g0089f33e.el9.noarch 6/6 2024-02-09T07:52:04.594 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1310.g0089f33e.el9.noarch 6/6 2024-02-09T07:52:04.594 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1310.g0089f33e.el9.noarch 1/6 2024-02-09T07:52:04.595 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-02-09T07:52:04.595 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 3/6 2024-02-09T07:52:04.595 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 4/6 2024-02-09T07:52:04.595 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-02-09T07:52:04.898 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-osd-2:19.0.0-1310.g0089f33e.el9.x86_64 33/36 2024-02-09T07:52:04.919 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-02-09T07:52:04.919 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:52:04.920 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-02-09T07:52:04.920 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-cephadm-2:19.0.0-1310.g0089f33e.el9.noarch 2024-02-09T07:52:04.920 INFO:teuthology.orchestra.run.smithi062.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2024-02-09T07:52:04.920 INFO:teuthology.orchestra.run.smithi062.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-09T07:52:04.920 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jinja2-2.11.3-4.el9.noarch 2024-02-09T07:52:04.920 INFO:teuthology.orchestra.run.smithi062.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-09T07:52:04.920 INFO:teuthology.orchestra.run.smithi062.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-09T07:52:04.920 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:52:04.920 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-02-09T07:52:04.924 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-osd-2:19.0.0-1310.g0089f33e.el9.x86_64 33/36 2024-02-09T07:52:04.924 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-09T07:52:04.924 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-09T07:52:04.925 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-09T07:52:04.925 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-09T07:52:04.925 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:52:05.178 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-fuse 2024-02-09T07:52:05.382 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mon-2:19.0.0-1310.g0089f33e.el9.x86_64 34/36 2024-02-09T07:52:05.406 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mon-2:19.0.0-1310.g0089f33e.el9.x86_64 34/36 2024-02-09T07:52:05.406 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-09T07:52:05.406 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-09T07:52:05.406 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-09T07:52:05.406 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-09T07:52:05.406 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:52:05.617 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mds-2:19.0.0-1310.g0089f33e.el9.x86_64 35/36 2024-02-09T07:52:05.639 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mds-2:19.0.0-1310.g0089f33e.el9.x86_64 35/36 2024-02-09T07:52:05.640 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-09T07:52:05.640 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-09T07:52:05.640 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-09T07:52:05.640 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-09T07:52:05.640 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:52:05.705 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-2:19.0.0-1310.g0089f33e.el9.x86_64 36/36 2024-02-09T07:52:05.788 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:02:11 ago on Fri 09 Feb 2024 07:49:54 AM UTC. 2024-02-09T07:52:06.094 INFO:teuthology.orchestra.run.smithi062.stderr:Modular dependency problems: 2024-02-09T07:52:06.094 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T07:52:06.094 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 1: conflicting requests 2024-02-09T07:52:06.094 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.095 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 2: conflicting requests 2024-02-09T07:52:06.095 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.095 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 3: conflicting requests 2024-02-09T07:52:06.095 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.095 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 4: conflicting requests 2024-02-09T07:52:06.095 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.095 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 5: conflicting requests 2024-02-09T07:52:06.095 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.095 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 6: conflicting requests 2024-02-09T07:52:06.095 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.095 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 7: conflicting requests 2024-02-09T07:52:06.095 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.095 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 8: conflicting requests 2024-02-09T07:52:06.095 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.096 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 9: conflicting requests 2024-02-09T07:52:06.096 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.096 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 10: conflicting requests 2024-02-09T07:52:06.096 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.096 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 11: conflicting requests 2024-02-09T07:52:06.096 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.096 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 12: conflicting requests 2024-02-09T07:52:06.096 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.096 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 13: conflicting requests 2024-02-09T07:52:06.096 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.096 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 14: conflicting requests 2024-02-09T07:52:06.096 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.096 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 15: conflicting requests 2024-02-09T07:52:06.097 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.097 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 16: conflicting requests 2024-02-09T07:52:06.097 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.097 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 17: conflicting requests 2024-02-09T07:52:06.097 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.097 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 18: conflicting requests 2024-02-09T07:52:06.097 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.097 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 19: conflicting requests 2024-02-09T07:52:06.097 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.097 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 20: conflicting requests 2024-02-09T07:52:06.097 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.097 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 21: conflicting requests 2024-02-09T07:52:06.097 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.098 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 22: conflicting requests 2024-02-09T07:52:06.098 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.098 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 23: conflicting requests 2024-02-09T07:52:06.098 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.098 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 24: conflicting requests 2024-02-09T07:52:06.098 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.098 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 25: conflicting requests 2024-02-09T07:52:06.098 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.098 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 26: conflicting requests 2024-02-09T07:52:06.098 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.098 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 27: conflicting requests 2024-02-09T07:52:06.098 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.098 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 28: conflicting requests 2024-02-09T07:52:06.099 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.099 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 29: conflicting requests 2024-02-09T07:52:06.099 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.099 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 30: conflicting requests 2024-02-09T07:52:06.099 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.099 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 31: conflicting requests 2024-02-09T07:52:06.099 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.099 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 32: conflicting requests 2024-02-09T07:52:06.099 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.099 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 33: conflicting requests 2024-02-09T07:52:06.099 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.099 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 34: conflicting requests 2024-02-09T07:52:06.099 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.099 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 35: conflicting requests 2024-02-09T07:52:06.100 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.100 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 36: conflicting requests 2024-02-09T07:52:06.100 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.100 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 37: conflicting requests 2024-02-09T07:52:06.100 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.100 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.100 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.100 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:52:06.100 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.100 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.100 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.100 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.100 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 39: conflicting requests 2024-02-09T07:52:06.100 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.101 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.101 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.101 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.101 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.101 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.101 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:52:06.101 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.101 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.101 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.101 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.101 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:52:06.101 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.101 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.101 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.102 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.102 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:52:06.102 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.102 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.102 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.102 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.102 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:52:06.102 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.102 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.102 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.102 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.102 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:52:06.102 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.102 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.103 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.103 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.103 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:52:06.103 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.103 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.103 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.103 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:52:06.166 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-02-09T07:52:06.167 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:52:06.167 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-02-09T07:52:06.167 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:52:06.167 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-02-09T07:52:06.167 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-fuse x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 886 k 2024-02-09T07:52:06.167 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-02-09T07:52:06.167 INFO:teuthology.orchestra.run.smithi062.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-02-09T07:52:06.167 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:52:06.167 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-02-09T07:52:06.167 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:52:06.168 INFO:teuthology.orchestra.run.smithi062.stdout:Install 2 Packages 2024-02-09T07:52:06.168 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:52:06.168 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 966 k 2024-02-09T07:52:06.168 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 2.8 M 2024-02-09T07:52:06.168 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-02-09T07:52:06.476 INFO:teuthology.orchestra.run.smithi062.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 435 kB/s | 80 kB 00:00 2024-02-09T07:52:06.726 INFO:teuthology.orchestra.run.smithi062.stdout:(2/2): ceph-fuse-19.0.0-1310.g0089f33e.el9.x86_ 2.0 MB/s | 886 kB 00:00 2024-02-09T07:52:06.726 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:52:06.727 INFO:teuthology.orchestra.run.smithi062.stdout:Total 1.7 MB/s | 966 kB 00:00 2024-02-09T07:52:06.738 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-02-09T07:52:06.760 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-02-09T07:52:06.760 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-02-09T07:52:06.843 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-02-09T07:52:06.843 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-02-09T07:52:07.035 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-02-09T07:52:07.173 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-02-09T07:52:07.253 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-fuse-2:19.0.0-1310.g0089f33e.el9.x86_64 2/2 2024-02-09T07:52:07.492 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-2:19.0.0-1310.g0089f33e.el9.x86_64 36/36 2024-02-09T07:52:07.492 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-2:19.0.0-1310.g0089f33e.el9.x86_64 1/36 2024-02-09T07:52:07.492 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mds-2:19.0.0-1310.g0089f33e.el9.x86_64 2/36 2024-02-09T07:52:07.492 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-2:19.0.0-1310.g0089f33e.el9.x86_64 3/36 2024-02-09T07:52:07.492 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mon-2:19.0.0-1310.g0089f33e.el9.x86_64 4/36 2024-02-09T07:52:07.492 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-osd-2:19.0.0-1310.g0089f33e.el9.x86_64 5/36 2024-02-09T07:52:07.493 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1310.g0089f33e.el9. 6/36 2024-02-09T07:52:07.493 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/36 2024-02-09T07:52:07.493 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/36 2024-02-09T07:52:07.493 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/36 2024-02-09T07:52:07.493 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/36 2024-02-09T07:52:07.493 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/36 2024-02-09T07:52:07.493 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/36 2024-02-09T07:52:07.493 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/36 2024-02-09T07:52:07.493 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/36 2024-02-09T07:52:07.493 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/36 2024-02-09T07:52:07.493 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/36 2024-02-09T07:52:07.493 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/36 2024-02-09T07:52:07.493 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-02-09T07:52:07.494 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-02-09T07:52:07.494 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-02-09T07:52:07.494 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-02-09T07:52:07.494 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-02-09T07:52:07.494 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-02-09T07:52:07.494 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-02-09T07:52:07.494 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-02-09T07:52:07.494 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-02-09T07:52:07.494 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-02-09T07:52:07.494 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-02-09T07:52:07.494 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-02-09T07:52:07.494 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-02-09T07:52:07.494 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-02-09T07:52:07.494 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-02-09T07:52:07.495 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-02-09T07:52:07.495 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-02-09T07:52:07.495 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-02-09T07:52:08.014 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-fuse-2:19.0.0-1310.g0089f33e.el9.x86_64 2/2 2024-02-09T07:52:08.014 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-fuse-2:19.0.0-1310.g0089f33e.el9.x86_64 1/2 2024-02-09T07:52:08.370 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-02-09T07:52:08.370 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:52:08.370 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-02-09T07:52:08.370 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-fuse-2:19.0.0-1310.g0089f33e.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-02-09T07:52:08.370 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:52:08.371 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-02-09T07:52:08.548 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-02-09T07:52:08.549 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:52:08.549 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-02-09T07:52:08.549 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:52:08.549 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mds-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:52:08.549 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:52:08.549 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-modules-core-2:19.0.0-1310.g0089f33e.el9.noarch 2024-02-09T07:52:08.549 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mon-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:52:08.549 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-osd-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:52:08.549 INFO:teuthology.orchestra.run.smithi103.stdout: lua-5.4.4-4.el9.x86_64 2024-02-09T07:52:08.549 INFO:teuthology.orchestra.run.smithi103.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-02-09T07:52:08.549 INFO:teuthology.orchestra.run.smithi103.stdout: luarocks-3.9.2-1.el9.noarch 2024-02-09T07:52:08.549 INFO:teuthology.orchestra.run.smithi103.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-09T07:52:08.549 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-09T07:52:08.550 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-09T07:52:08.550 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-09T07:52:08.550 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-09T07:52:08.550 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-09T07:52:08.550 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-09T07:52:08.550 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-09T07:52:08.550 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-09T07:52:08.550 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-09T07:52:08.550 INFO:teuthology.orchestra.run.smithi103.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-09T07:52:08.550 INFO:teuthology.orchestra.run.smithi103.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-09T07:52:08.550 INFO:teuthology.orchestra.run.smithi103.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-09T07:52:08.550 INFO:teuthology.orchestra.run.smithi103.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-09T07:52:08.550 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-09T07:52:08.551 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ply-3.11-14.el9.noarch 2024-02-09T07:52:08.551 INFO:teuthology.orchestra.run.smithi103.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-09T07:52:08.551 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-09T07:52:08.551 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-09T07:52:08.551 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-09T07:52:08.551 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-09T07:52:08.551 INFO:teuthology.orchestra.run.smithi103.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-09T07:52:08.551 INFO:teuthology.orchestra.run.smithi103.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-09T07:52:08.551 INFO:teuthology.orchestra.run.smithi103.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-09T07:52:08.551 INFO:teuthology.orchestra.run.smithi103.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-09T07:52:08.551 INFO:teuthology.orchestra.run.smithi103.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-09T07:52:08.551 INFO:teuthology.orchestra.run.smithi103.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-09T07:52:08.551 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:52:08.552 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-02-09T07:52:08.603 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-volume 2024-02-09T07:52:08.862 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-base 2024-02-09T07:52:09.228 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:02:15 ago on Fri 09 Feb 2024 07:49:54 AM UTC. 2024-02-09T07:52:09.467 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:02:14 ago on Fri 09 Feb 2024 07:49:55 AM UTC. 2024-02-09T07:52:09.541 INFO:teuthology.orchestra.run.smithi062.stderr:Modular dependency problems: 2024-02-09T07:52:09.541 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T07:52:09.541 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 1: conflicting requests 2024-02-09T07:52:09.541 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.541 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 2: conflicting requests 2024-02-09T07:52:09.541 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.541 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 3: conflicting requests 2024-02-09T07:52:09.541 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.541 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 4: conflicting requests 2024-02-09T07:52:09.541 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.542 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 5: conflicting requests 2024-02-09T07:52:09.542 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.542 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 6: conflicting requests 2024-02-09T07:52:09.542 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.542 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 7: conflicting requests 2024-02-09T07:52:09.542 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.542 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 8: conflicting requests 2024-02-09T07:52:09.542 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.542 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 9: conflicting requests 2024-02-09T07:52:09.542 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.542 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 10: conflicting requests 2024-02-09T07:52:09.542 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.543 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 11: conflicting requests 2024-02-09T07:52:09.543 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.543 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 12: conflicting requests 2024-02-09T07:52:09.543 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.543 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 13: conflicting requests 2024-02-09T07:52:09.543 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.543 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 14: conflicting requests 2024-02-09T07:52:09.543 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.543 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 15: conflicting requests 2024-02-09T07:52:09.543 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.543 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 16: conflicting requests 2024-02-09T07:52:09.544 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.544 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 17: conflicting requests 2024-02-09T07:52:09.544 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.544 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 18: conflicting requests 2024-02-09T07:52:09.544 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.544 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 19: conflicting requests 2024-02-09T07:52:09.544 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.544 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 20: conflicting requests 2024-02-09T07:52:09.544 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.544 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 21: conflicting requests 2024-02-09T07:52:09.544 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.544 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 22: conflicting requests 2024-02-09T07:52:09.545 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.545 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 23: conflicting requests 2024-02-09T07:52:09.545 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.545 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 24: conflicting requests 2024-02-09T07:52:09.545 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.545 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 25: conflicting requests 2024-02-09T07:52:09.545 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.545 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 26: conflicting requests 2024-02-09T07:52:09.545 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.545 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 27: conflicting requests 2024-02-09T07:52:09.545 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.545 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 28: conflicting requests 2024-02-09T07:52:09.546 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.546 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 29: conflicting requests 2024-02-09T07:52:09.546 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.546 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 30: conflicting requests 2024-02-09T07:52:09.546 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.546 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 31: conflicting requests 2024-02-09T07:52:09.546 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.546 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 32: conflicting requests 2024-02-09T07:52:09.546 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.546 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 33: conflicting requests 2024-02-09T07:52:09.546 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.546 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 34: conflicting requests 2024-02-09T07:52:09.547 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.547 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 35: conflicting requests 2024-02-09T07:52:09.547 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.547 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 36: conflicting requests 2024-02-09T07:52:09.547 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.547 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 37: conflicting requests 2024-02-09T07:52:09.547 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.547 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.547 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.547 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:52:09.547 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.547 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.548 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.548 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.548 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 39: conflicting requests 2024-02-09T07:52:09.548 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.548 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.548 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.548 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.548 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.548 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.548 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:52:09.548 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.548 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.549 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.549 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.549 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:52:09.549 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.549 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.549 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.549 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.549 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:52:09.549 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.549 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.549 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.549 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.550 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:52:09.550 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.550 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.550 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.550 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.550 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:52:09.550 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.550 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.550 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.550 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.550 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:52:09.550 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.551 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.551 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.551 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.614 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-02-09T07:52:09.614 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:52:09.614 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-02-09T07:52:09.614 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:52:09.615 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-02-09T07:52:09.615 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-volume noarch 2:19.0.0-1310.g0089f33e.el9 ceph-noarch 264 k 2024-02-09T07:52:09.615 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-02-09T07:52:09.615 INFO:teuthology.orchestra.run.smithi062.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-02-09T07:52:09.615 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:52:09.615 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-02-09T07:52:09.615 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:52:09.615 INFO:teuthology.orchestra.run.smithi062.stdout:Install 2 Packages 2024-02-09T07:52:09.615 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:52:09.616 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 341 k 2024-02-09T07:52:09.616 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 1.5 M 2024-02-09T07:52:09.616 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-02-09T07:52:09.765 INFO:teuthology.orchestra.run.smithi103.stderr:Modular dependency problems: 2024-02-09T07:52:09.765 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T07:52:09.765 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 1: conflicting requests 2024-02-09T07:52:09.765 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.765 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 2: conflicting requests 2024-02-09T07:52:09.766 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.766 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 3: conflicting requests 2024-02-09T07:52:09.766 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.766 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 4: conflicting requests 2024-02-09T07:52:09.766 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.766 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 5: conflicting requests 2024-02-09T07:52:09.766 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.766 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 6: conflicting requests 2024-02-09T07:52:09.766 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.766 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 7: conflicting requests 2024-02-09T07:52:09.766 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.766 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 8: conflicting requests 2024-02-09T07:52:09.766 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.766 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 9: conflicting requests 2024-02-09T07:52:09.767 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.767 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 10: conflicting requests 2024-02-09T07:52:09.767 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.767 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 11: conflicting requests 2024-02-09T07:52:09.767 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.767 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 12: conflicting requests 2024-02-09T07:52:09.767 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.767 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 13: conflicting requests 2024-02-09T07:52:09.767 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.767 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 14: conflicting requests 2024-02-09T07:52:09.767 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.767 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 15: conflicting requests 2024-02-09T07:52:09.767 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.767 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 16: conflicting requests 2024-02-09T07:52:09.768 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.768 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 17: conflicting requests 2024-02-09T07:52:09.768 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.768 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 18: conflicting requests 2024-02-09T07:52:09.768 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.768 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 19: conflicting requests 2024-02-09T07:52:09.768 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.768 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 20: conflicting requests 2024-02-09T07:52:09.768 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.768 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 21: conflicting requests 2024-02-09T07:52:09.768 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.768 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 22: conflicting requests 2024-02-09T07:52:09.768 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.769 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 23: conflicting requests 2024-02-09T07:52:09.769 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.769 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 24: conflicting requests 2024-02-09T07:52:09.769 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.769 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 25: conflicting requests 2024-02-09T07:52:09.769 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.769 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 26: conflicting requests 2024-02-09T07:52:09.769 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.769 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 27: conflicting requests 2024-02-09T07:52:09.769 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.769 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 28: conflicting requests 2024-02-09T07:52:09.769 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.769 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 29: conflicting requests 2024-02-09T07:52:09.769 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.769 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 30: conflicting requests 2024-02-09T07:52:09.770 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.770 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 31: conflicting requests 2024-02-09T07:52:09.770 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.770 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 32: conflicting requests 2024-02-09T07:52:09.770 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.770 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 33: conflicting requests 2024-02-09T07:52:09.770 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.770 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 34: conflicting requests 2024-02-09T07:52:09.770 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.770 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 35: conflicting requests 2024-02-09T07:52:09.770 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.770 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 36: conflicting requests 2024-02-09T07:52:09.770 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.770 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 37: conflicting requests 2024-02-09T07:52:09.771 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.771 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.771 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.771 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:52:09.771 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.771 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.771 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.771 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.771 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 39: conflicting requests 2024-02-09T07:52:09.771 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.771 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.771 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.771 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.771 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.772 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.772 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:52:09.772 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.772 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.772 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.772 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.772 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:52:09.772 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.772 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.772 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.772 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.772 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:52:09.772 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.772 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.773 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.773 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.773 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:52:09.773 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.773 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.773 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.773 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.773 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:52:09.773 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.773 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.773 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.773 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.773 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:52:09.773 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.774 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.774 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.774 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:52:09.774 INFO:teuthology.orchestra.run.smithi103.stdout:Package ceph-base-2:19.0.0-1310.g0089f33e.el9.x86_64 is already installed. 2024-02-09T07:52:09.789 INFO:teuthology.orchestra.run.smithi062.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 595 kB/s | 77 kB 00:00 2024-02-09T07:52:09.832 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-02-09T07:52:09.833 INFO:teuthology.orchestra.run.smithi103.stdout:Nothing to do. 2024-02-09T07:52:09.833 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-02-09T07:52:09.903 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install cephadm 2024-02-09T07:52:10.030 INFO:teuthology.orchestra.run.smithi062.stdout:(2/2): ceph-volume-19.0.0-1310.g0089f33e.el9.no 710 kB/s | 264 kB 00:00 2024-02-09T07:52:10.031 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:52:10.031 INFO:teuthology.orchestra.run.smithi062.stdout:Total 819 kB/s | 341 kB 00:00 2024-02-09T07:52:10.043 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-02-09T07:52:10.053 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-02-09T07:52:10.053 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-02-09T07:52:10.099 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-02-09T07:52:10.099 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-02-09T07:52:10.252 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-02-09T07:52:10.438 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-02-09T07:52:10.475 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-volume-2:19.0.0-1310.g0089f33e.el9.noarch 2/2 2024-02-09T07:52:10.491 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-volume-2:19.0.0-1310.g0089f33e.el9.noarch 2/2 2024-02-09T07:52:10.491 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-09T07:52:10.491 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-02-09T07:52:10.491 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:52:10.508 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:02:15 ago on Fri 09 Feb 2024 07:49:55 AM UTC. 2024-02-09T07:52:10.800 INFO:teuthology.orchestra.run.smithi103.stderr:Modular dependency problems: 2024-02-09T07:52:10.801 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T07:52:10.801 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 1: conflicting requests 2024-02-09T07:52:10.801 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.801 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 2: conflicting requests 2024-02-09T07:52:10.801 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.801 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 3: conflicting requests 2024-02-09T07:52:10.801 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.801 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 4: conflicting requests 2024-02-09T07:52:10.801 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.801 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 5: conflicting requests 2024-02-09T07:52:10.801 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.801 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 6: conflicting requests 2024-02-09T07:52:10.802 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.802 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 7: conflicting requests 2024-02-09T07:52:10.802 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.802 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 8: conflicting requests 2024-02-09T07:52:10.803 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.803 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 9: conflicting requests 2024-02-09T07:52:10.803 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.803 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 10: conflicting requests 2024-02-09T07:52:10.803 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.803 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 11: conflicting requests 2024-02-09T07:52:10.803 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.803 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 12: conflicting requests 2024-02-09T07:52:10.803 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.803 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 13: conflicting requests 2024-02-09T07:52:10.803 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.803 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 14: conflicting requests 2024-02-09T07:52:10.803 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.804 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 15: conflicting requests 2024-02-09T07:52:10.804 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.804 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 16: conflicting requests 2024-02-09T07:52:10.804 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.804 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 17: conflicting requests 2024-02-09T07:52:10.804 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.804 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 18: conflicting requests 2024-02-09T07:52:10.804 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.804 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 19: conflicting requests 2024-02-09T07:52:10.804 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.804 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 20: conflicting requests 2024-02-09T07:52:10.804 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.804 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 21: conflicting requests 2024-02-09T07:52:10.805 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.805 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 22: conflicting requests 2024-02-09T07:52:10.805 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.805 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 23: conflicting requests 2024-02-09T07:52:10.805 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.805 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 24: conflicting requests 2024-02-09T07:52:10.805 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.805 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 25: conflicting requests 2024-02-09T07:52:10.805 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.805 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 26: conflicting requests 2024-02-09T07:52:10.805 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.805 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 27: conflicting requests 2024-02-09T07:52:10.805 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.806 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 28: conflicting requests 2024-02-09T07:52:10.806 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.806 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 29: conflicting requests 2024-02-09T07:52:10.806 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.806 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 30: conflicting requests 2024-02-09T07:52:10.806 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.806 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 31: conflicting requests 2024-02-09T07:52:10.806 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.806 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 32: conflicting requests 2024-02-09T07:52:10.806 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.806 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 33: conflicting requests 2024-02-09T07:52:10.806 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.806 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 34: conflicting requests 2024-02-09T07:52:10.806 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.806 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 35: conflicting requests 2024-02-09T07:52:10.807 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.807 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 36: conflicting requests 2024-02-09T07:52:10.807 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.807 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 37: conflicting requests 2024-02-09T07:52:10.808 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.808 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.808 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.808 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:52:10.808 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.808 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.808 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.808 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.808 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 39: conflicting requests 2024-02-09T07:52:10.808 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.808 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.808 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.809 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.809 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.809 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.809 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:52:10.809 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.809 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.809 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.809 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.809 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:52:10.809 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.809 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.809 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.809 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.810 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:52:10.810 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.810 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.810 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.810 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.810 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:52:10.810 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.810 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.810 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.810 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.810 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:52:10.810 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.810 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.810 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.811 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.811 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:52:10.811 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.811 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.811 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.811 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:52:10.866 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-02-09T07:52:10.867 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:52:10.867 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-02-09T07:52:10.867 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:52:10.867 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-02-09T07:52:10.867 INFO:teuthology.orchestra.run.smithi103.stdout: cephadm noarch 2:19.0.0-1310.g0089f33e.el9 ceph-noarch 748 k 2024-02-09T07:52:10.867 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:52:10.867 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-02-09T07:52:10.867 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:52:10.868 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-02-09T07:52:10.868 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:52:10.868 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 748 k 2024-02-09T07:52:10.868 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 754 k 2024-02-09T07:52:10.868 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-02-09T07:52:11.267 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-volume-2:19.0.0-1310.g0089f33e.el9.noarch 1/2 2024-02-09T07:52:11.308 INFO:teuthology.orchestra.run.smithi103.stdout:cephadm-19.0.0-1310.g0089f33e.el9.noarch.rpm 1.7 MB/s | 748 kB 00:00 2024-02-09T07:52:11.308 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:52:11.309 INFO:teuthology.orchestra.run.smithi103.stdout:Total 1.7 MB/s | 748 kB 00:00 2024-02-09T07:52:11.309 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-02-09T07:52:11.314 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-02-09T07:52:11.314 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-02-09T07:52:11.320 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-02-09T07:52:11.320 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-02-09T07:52:11.395 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-02-09T07:52:11.645 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-02-09T07:52:11.645 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:52:11.645 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-02-09T07:52:11.645 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-volume-2:19.0.0-1310.g0089f33e.el9.noarch 2024-02-09T07:52:11.645 INFO:teuthology.orchestra.run.smithi062.stdout: python3-packaging-20.9-5.el9.noarch 2024-02-09T07:52:11.646 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:52:11.646 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-02-09T07:52:11.816 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: cephadm-2:19.0.0-1310.g0089f33e.el9.noarch 1/1 2024-02-09T07:52:11.904 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : cephadm-2:19.0.0-1310.g0089f33e.el9.noarch 1/1 2024-02-09T07:52:11.976 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install librados-devel 2024-02-09T07:52:12.294 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: cephadm-2:19.0.0-1310.g0089f33e.el9.noarch 1/1 2024-02-09T07:52:12.597 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:02:18 ago on Fri 09 Feb 2024 07:49:54 AM UTC. 2024-02-09T07:52:12.638 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : cephadm-2:19.0.0-1310.g0089f33e.el9.noarch 1/1 2024-02-09T07:52:12.638 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:52:12.638 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-02-09T07:52:12.638 INFO:teuthology.orchestra.run.smithi103.stdout: cephadm-2:19.0.0-1310.g0089f33e.el9.noarch 2024-02-09T07:52:12.638 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:52:12.638 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-02-09T07:52:12.836 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-immutable-object-cache 2024-02-09T07:52:12.910 INFO:teuthology.orchestra.run.smithi062.stderr:Modular dependency problems: 2024-02-09T07:52:12.910 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T07:52:12.910 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 1: conflicting requests 2024-02-09T07:52:12.910 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.910 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 2: conflicting requests 2024-02-09T07:52:12.910 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.911 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 3: conflicting requests 2024-02-09T07:52:12.911 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.911 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 4: conflicting requests 2024-02-09T07:52:12.911 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.911 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 5: conflicting requests 2024-02-09T07:52:12.911 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.911 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 6: conflicting requests 2024-02-09T07:52:12.911 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.911 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 7: conflicting requests 2024-02-09T07:52:12.911 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.912 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 8: conflicting requests 2024-02-09T07:52:12.912 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.912 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 9: conflicting requests 2024-02-09T07:52:12.912 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.912 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 10: conflicting requests 2024-02-09T07:52:12.912 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.912 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 11: conflicting requests 2024-02-09T07:52:12.912 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.912 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 12: conflicting requests 2024-02-09T07:52:12.912 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.912 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 13: conflicting requests 2024-02-09T07:52:12.912 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.912 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 14: conflicting requests 2024-02-09T07:52:12.913 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.913 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 15: conflicting requests 2024-02-09T07:52:12.913 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.913 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 16: conflicting requests 2024-02-09T07:52:12.913 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.913 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 17: conflicting requests 2024-02-09T07:52:12.913 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.913 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 18: conflicting requests 2024-02-09T07:52:12.913 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.914 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 19: conflicting requests 2024-02-09T07:52:12.914 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.914 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 20: conflicting requests 2024-02-09T07:52:12.914 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.914 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 21: conflicting requests 2024-02-09T07:52:12.914 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.914 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 22: conflicting requests 2024-02-09T07:52:12.914 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.914 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 23: conflicting requests 2024-02-09T07:52:12.914 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.914 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 24: conflicting requests 2024-02-09T07:52:12.914 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.914 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 25: conflicting requests 2024-02-09T07:52:12.914 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.915 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 26: conflicting requests 2024-02-09T07:52:12.915 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.915 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 27: conflicting requests 2024-02-09T07:52:12.915 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.915 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 28: conflicting requests 2024-02-09T07:52:12.915 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.915 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 29: conflicting requests 2024-02-09T07:52:12.915 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.915 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 30: conflicting requests 2024-02-09T07:52:12.915 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.915 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 31: conflicting requests 2024-02-09T07:52:12.915 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.916 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 32: conflicting requests 2024-02-09T07:52:12.916 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.916 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 33: conflicting requests 2024-02-09T07:52:12.916 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.916 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 34: conflicting requests 2024-02-09T07:52:12.916 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.916 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 35: conflicting requests 2024-02-09T07:52:12.916 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.916 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 36: conflicting requests 2024-02-09T07:52:12.916 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.917 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 37: conflicting requests 2024-02-09T07:52:12.917 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.917 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.917 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.917 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:52:12.917 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.917 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.917 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.917 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.917 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 39: conflicting requests 2024-02-09T07:52:12.917 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.918 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.918 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.918 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.918 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.918 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.918 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:52:12.918 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.918 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.918 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.918 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.918 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:52:12.918 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.918 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.918 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.918 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.918 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:52:12.919 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.919 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.919 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.919 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.919 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:52:12.919 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.919 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.919 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.919 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.919 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:52:12.920 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.920 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.920 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.920 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.920 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:52:12.920 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.920 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.920 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.920 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:52:12.982 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-02-09T07:52:12.983 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:52:12.983 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repo Size 2024-02-09T07:52:12.983 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:52:12.984 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-02-09T07:52:12.984 INFO:teuthology.orchestra.run.smithi062.stdout: librados-devel x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 127 k 2024-02-09T07:52:12.984 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:52:12.984 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-02-09T07:52:12.984 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:52:12.984 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2024-02-09T07:52:12.984 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:52:12.984 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 127 k 2024-02-09T07:52:12.984 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 456 k 2024-02-09T07:52:12.984 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-02-09T07:52:13.452 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:02:18 ago on Fri 09 Feb 2024 07:49:55 AM UTC. 2024-02-09T07:52:13.470 INFO:teuthology.orchestra.run.smithi062.stdout:librados-devel-19.0.0-1310.g0089f33e.el9.x86_64 261 kB/s | 127 kB 00:00 2024-02-09T07:52:13.470 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:52:13.471 INFO:teuthology.orchestra.run.smithi062.stdout:Total 260 kB/s | 127 kB 00:00 2024-02-09T07:52:13.471 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-02-09T07:52:13.477 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-02-09T07:52:13.477 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-02-09T07:52:13.540 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-02-09T07:52:13.540 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-02-09T07:52:13.698 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-02-09T07:52:13.747 INFO:teuthology.orchestra.run.smithi103.stderr:Modular dependency problems: 2024-02-09T07:52:13.748 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T07:52:13.748 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 1: conflicting requests 2024-02-09T07:52:13.748 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.748 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 2: conflicting requests 2024-02-09T07:52:13.748 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.748 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 3: conflicting requests 2024-02-09T07:52:13.748 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.748 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 4: conflicting requests 2024-02-09T07:52:13.748 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.748 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 5: conflicting requests 2024-02-09T07:52:13.748 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.748 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 6: conflicting requests 2024-02-09T07:52:13.749 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.749 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 7: conflicting requests 2024-02-09T07:52:13.749 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.749 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 8: conflicting requests 2024-02-09T07:52:13.749 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.749 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 9: conflicting requests 2024-02-09T07:52:13.749 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.749 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 10: conflicting requests 2024-02-09T07:52:13.749 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.749 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 11: conflicting requests 2024-02-09T07:52:13.749 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.749 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 12: conflicting requests 2024-02-09T07:52:13.749 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.749 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 13: conflicting requests 2024-02-09T07:52:13.749 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.750 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 14: conflicting requests 2024-02-09T07:52:13.750 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.750 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 15: conflicting requests 2024-02-09T07:52:13.750 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.750 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 16: conflicting requests 2024-02-09T07:52:13.750 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.750 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 17: conflicting requests 2024-02-09T07:52:13.750 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.750 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 18: conflicting requests 2024-02-09T07:52:13.750 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.750 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 19: conflicting requests 2024-02-09T07:52:13.750 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.750 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 20: conflicting requests 2024-02-09T07:52:13.750 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.750 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 21: conflicting requests 2024-02-09T07:52:13.751 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.751 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 22: conflicting requests 2024-02-09T07:52:13.751 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.751 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 23: conflicting requests 2024-02-09T07:52:13.751 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.751 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 24: conflicting requests 2024-02-09T07:52:13.751 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.751 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 25: conflicting requests 2024-02-09T07:52:13.751 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.751 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 26: conflicting requests 2024-02-09T07:52:13.751 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.751 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 27: conflicting requests 2024-02-09T07:52:13.751 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.751 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 28: conflicting requests 2024-02-09T07:52:13.752 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.752 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 29: conflicting requests 2024-02-09T07:52:13.752 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.752 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 30: conflicting requests 2024-02-09T07:52:13.752 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.752 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 31: conflicting requests 2024-02-09T07:52:13.752 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.752 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 32: conflicting requests 2024-02-09T07:52:13.752 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.752 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 33: conflicting requests 2024-02-09T07:52:13.752 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.752 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 34: conflicting requests 2024-02-09T07:52:13.752 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.752 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 35: conflicting requests 2024-02-09T07:52:13.753 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.753 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 36: conflicting requests 2024-02-09T07:52:13.753 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.753 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 37: conflicting requests 2024-02-09T07:52:13.753 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.753 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.753 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.753 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:52:13.753 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.753 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.753 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.753 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.753 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 39: conflicting requests 2024-02-09T07:52:13.754 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.754 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.754 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.754 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.754 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.754 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.754 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:52:13.754 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.754 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.754 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.754 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.754 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:52:13.754 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.754 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.754 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.755 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.755 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:52:13.755 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.755 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.755 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.755 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.755 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:52:13.755 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.755 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.755 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.755 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.755 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:52:13.755 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.755 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.756 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.756 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.756 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:52:13.756 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.756 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.756 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.756 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:52:13.807 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librados-devel-2:19.0.0-1310.g0089f33e.el9.x86_64 1/1 2024-02-09T07:52:13.815 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-02-09T07:52:13.816 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:52:13.816 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repo Size 2024-02-09T07:52:13.816 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:52:13.816 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-02-09T07:52:13.816 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 145 k 2024-02-09T07:52:13.816 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:52:13.816 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-02-09T07:52:13.816 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:52:13.817 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-02-09T07:52:13.817 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:52:13.817 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 145 k 2024-02-09T07:52:13.817 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 436 k 2024-02-09T07:52:13.817 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-02-09T07:52:14.147 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-immutable-object-cache-19.0.0-1310.g0089f3 439 kB/s | 145 kB 00:00 2024-02-09T07:52:14.148 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:52:14.148 INFO:teuthology.orchestra.run.smithi103.stdout:Total 437 kB/s | 145 kB 00:00 2024-02-09T07:52:14.148 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-02-09T07:52:14.156 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-02-09T07:52:14.156 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-02-09T07:52:14.212 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-02-09T07:52:14.212 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-02-09T07:52:14.284 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librados-devel-2:19.0.0-1310.g0089f33e.el9.x86_64 1/1 2024-02-09T07:52:14.360 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-02-09T07:52:14.416 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1310.g0089f33e. 1/1 2024-02-09T07:52:14.440 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1310.g0089f33e. 1/1 2024-02-09T07:52:14.440 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-09T07:52:14.440 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-09T07:52:14.440 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:52:14.595 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librados-devel-2:19.0.0-1310.g0089f33e.el9.x86_64 1/1 2024-02-09T07:52:14.596 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:52:14.596 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-02-09T07:52:14.596 INFO:teuthology.orchestra.run.smithi062.stdout: librados-devel-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:52:14.596 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:52:14.596 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-02-09T07:52:14.852 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install libcephfs2 2024-02-09T07:52:15.476 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:02:21 ago on Fri 09 Feb 2024 07:49:54 AM UTC. 2024-02-09T07:52:15.482 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1310.g0089f33e. 1/1 2024-02-09T07:52:15.482 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:52:15.482 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-02-09T07:52:15.482 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-immutable-object-cache-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:52:15.482 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:52:15.482 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-02-09T07:52:15.712 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-mgr 2024-02-09T07:52:15.792 INFO:teuthology.orchestra.run.smithi062.stderr:Modular dependency problems: 2024-02-09T07:52:15.792 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T07:52:15.792 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 1: conflicting requests 2024-02-09T07:52:15.792 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.792 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 2: conflicting requests 2024-02-09T07:52:15.792 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.792 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 3: conflicting requests 2024-02-09T07:52:15.792 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.792 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 4: conflicting requests 2024-02-09T07:52:15.793 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.793 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 5: conflicting requests 2024-02-09T07:52:15.793 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.793 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 6: conflicting requests 2024-02-09T07:52:15.793 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.793 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 7: conflicting requests 2024-02-09T07:52:15.793 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.793 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 8: conflicting requests 2024-02-09T07:52:15.793 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.793 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 9: conflicting requests 2024-02-09T07:52:15.793 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.793 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 10: conflicting requests 2024-02-09T07:52:15.793 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.793 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 11: conflicting requests 2024-02-09T07:52:15.794 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.794 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 12: conflicting requests 2024-02-09T07:52:15.794 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.794 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 13: conflicting requests 2024-02-09T07:52:15.794 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.794 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 14: conflicting requests 2024-02-09T07:52:15.794 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.794 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 15: conflicting requests 2024-02-09T07:52:15.794 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.794 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 16: conflicting requests 2024-02-09T07:52:15.794 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.794 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 17: conflicting requests 2024-02-09T07:52:15.795 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.795 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 18: conflicting requests 2024-02-09T07:52:15.795 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.795 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 19: conflicting requests 2024-02-09T07:52:15.795 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.795 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 20: conflicting requests 2024-02-09T07:52:15.795 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.795 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 21: conflicting requests 2024-02-09T07:52:15.795 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.795 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 22: conflicting requests 2024-02-09T07:52:15.795 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.795 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 23: conflicting requests 2024-02-09T07:52:15.796 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.796 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 24: conflicting requests 2024-02-09T07:52:15.796 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.796 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 25: conflicting requests 2024-02-09T07:52:15.796 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.796 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 26: conflicting requests 2024-02-09T07:52:15.796 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.796 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 27: conflicting requests 2024-02-09T07:52:15.796 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.796 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 28: conflicting requests 2024-02-09T07:52:15.796 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.796 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 29: conflicting requests 2024-02-09T07:52:15.796 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.796 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 30: conflicting requests 2024-02-09T07:52:15.797 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.797 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 31: conflicting requests 2024-02-09T07:52:15.797 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.797 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 32: conflicting requests 2024-02-09T07:52:15.797 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.797 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 33: conflicting requests 2024-02-09T07:52:15.797 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.797 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 34: conflicting requests 2024-02-09T07:52:15.797 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.797 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 35: conflicting requests 2024-02-09T07:52:15.797 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.797 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 36: conflicting requests 2024-02-09T07:52:15.798 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.798 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 37: conflicting requests 2024-02-09T07:52:15.798 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.798 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.798 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.798 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:52:15.798 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.798 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.798 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.798 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.798 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 39: conflicting requests 2024-02-09T07:52:15.798 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.798 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.798 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.799 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.799 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.799 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.799 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:52:15.799 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.799 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.799 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.799 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.799 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:52:15.799 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.799 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.799 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.799 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.800 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:52:15.800 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.800 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.800 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.800 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.800 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:52:15.800 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.800 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.800 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.800 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.800 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:52:15.800 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.800 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.800 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.801 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.801 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:52:15.801 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.801 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.801 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.801 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:52:15.802 INFO:teuthology.orchestra.run.smithi062.stdout:Package libcephfs2-2:19.0.0-1310.g0089f33e.el9.x86_64 is already installed. 2024-02-09T07:52:15.864 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-02-09T07:52:15.865 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do. 2024-02-09T07:52:15.865 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-02-09T07:52:15.921 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install libcephfs-devel 2024-02-09T07:52:16.329 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:02:21 ago on Fri 09 Feb 2024 07:49:55 AM UTC. 2024-02-09T07:52:16.537 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:02:22 ago on Fri 09 Feb 2024 07:49:54 AM UTC. 2024-02-09T07:52:16.624 INFO:teuthology.orchestra.run.smithi103.stderr:Modular dependency problems: 2024-02-09T07:52:16.624 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T07:52:16.624 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 1: conflicting requests 2024-02-09T07:52:16.624 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.624 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 2: conflicting requests 2024-02-09T07:52:16.624 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.624 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 3: conflicting requests 2024-02-09T07:52:16.624 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.625 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 4: conflicting requests 2024-02-09T07:52:16.625 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.625 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 5: conflicting requests 2024-02-09T07:52:16.625 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.625 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 6: conflicting requests 2024-02-09T07:52:16.625 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.625 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 7: conflicting requests 2024-02-09T07:52:16.625 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.625 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 8: conflicting requests 2024-02-09T07:52:16.625 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.625 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 9: conflicting requests 2024-02-09T07:52:16.625 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.625 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 10: conflicting requests 2024-02-09T07:52:16.626 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.626 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 11: conflicting requests 2024-02-09T07:52:16.626 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.626 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 12: conflicting requests 2024-02-09T07:52:16.626 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.626 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 13: conflicting requests 2024-02-09T07:52:16.626 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.626 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 14: conflicting requests 2024-02-09T07:52:16.626 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.626 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 15: conflicting requests 2024-02-09T07:52:16.626 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.626 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 16: conflicting requests 2024-02-09T07:52:16.626 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.626 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 17: conflicting requests 2024-02-09T07:52:16.626 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.627 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 18: conflicting requests 2024-02-09T07:52:16.627 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.627 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 19: conflicting requests 2024-02-09T07:52:16.627 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.627 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 20: conflicting requests 2024-02-09T07:52:16.627 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.627 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 21: conflicting requests 2024-02-09T07:52:16.627 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.627 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 22: conflicting requests 2024-02-09T07:52:16.627 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.627 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 23: conflicting requests 2024-02-09T07:52:16.627 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.627 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 24: conflicting requests 2024-02-09T07:52:16.628 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.628 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 25: conflicting requests 2024-02-09T07:52:16.628 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.628 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 26: conflicting requests 2024-02-09T07:52:16.628 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.628 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 27: conflicting requests 2024-02-09T07:52:16.628 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.628 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 28: conflicting requests 2024-02-09T07:52:16.628 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.628 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 29: conflicting requests 2024-02-09T07:52:16.628 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.628 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 30: conflicting requests 2024-02-09T07:52:16.628 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.628 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 31: conflicting requests 2024-02-09T07:52:16.629 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.629 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 32: conflicting requests 2024-02-09T07:52:16.629 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.629 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 33: conflicting requests 2024-02-09T07:52:16.629 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.629 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 34: conflicting requests 2024-02-09T07:52:16.629 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.629 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 35: conflicting requests 2024-02-09T07:52:16.629 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.629 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 36: conflicting requests 2024-02-09T07:52:16.629 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.629 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 37: conflicting requests 2024-02-09T07:52:16.629 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.629 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.630 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.630 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:52:16.630 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.630 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.630 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.630 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.630 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 39: conflicting requests 2024-02-09T07:52:16.630 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.630 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.630 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.630 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.630 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.630 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.630 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:52:16.631 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.631 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.631 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.631 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.631 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:52:16.631 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.631 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.631 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.631 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.631 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:52:16.631 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.631 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.631 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.632 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.632 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:52:16.632 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.632 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.632 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.632 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.632 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:52:16.632 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.632 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.632 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.632 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.632 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:52:16.633 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.633 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.633 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.633 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.633 INFO:teuthology.orchestra.run.smithi103.stdout:Package ceph-mgr-2:19.0.0-1310.g0089f33e.el9.x86_64 is already installed. 2024-02-09T07:52:16.690 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-02-09T07:52:16.691 INFO:teuthology.orchestra.run.smithi103.stdout:Nothing to do. 2024-02-09T07:52:16.691 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-02-09T07:52:16.764 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-mgr-dashboard 2024-02-09T07:52:16.847 INFO:teuthology.orchestra.run.smithi062.stderr:Modular dependency problems: 2024-02-09T07:52:16.847 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T07:52:16.847 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 1: conflicting requests 2024-02-09T07:52:16.847 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.847 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 2: conflicting requests 2024-02-09T07:52:16.847 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.847 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 3: conflicting requests 2024-02-09T07:52:16.847 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.847 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 4: conflicting requests 2024-02-09T07:52:16.847 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.847 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 5: conflicting requests 2024-02-09T07:52:16.847 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.848 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 6: conflicting requests 2024-02-09T07:52:16.848 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.848 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 7: conflicting requests 2024-02-09T07:52:16.848 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.848 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 8: conflicting requests 2024-02-09T07:52:16.848 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.848 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 9: conflicting requests 2024-02-09T07:52:16.848 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.848 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 10: conflicting requests 2024-02-09T07:52:16.848 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.848 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 11: conflicting requests 2024-02-09T07:52:16.848 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.848 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 12: conflicting requests 2024-02-09T07:52:16.849 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.849 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 13: conflicting requests 2024-02-09T07:52:16.849 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.849 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 14: conflicting requests 2024-02-09T07:52:16.849 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.849 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 15: conflicting requests 2024-02-09T07:52:16.849 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.849 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 16: conflicting requests 2024-02-09T07:52:16.849 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.849 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 17: conflicting requests 2024-02-09T07:52:16.849 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.849 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 18: conflicting requests 2024-02-09T07:52:16.849 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.850 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 19: conflicting requests 2024-02-09T07:52:16.850 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.850 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 20: conflicting requests 2024-02-09T07:52:16.850 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.850 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 21: conflicting requests 2024-02-09T07:52:16.850 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.850 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 22: conflicting requests 2024-02-09T07:52:16.850 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.850 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 23: conflicting requests 2024-02-09T07:52:16.850 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.850 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 24: conflicting requests 2024-02-09T07:52:16.850 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.851 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 25: conflicting requests 2024-02-09T07:52:16.851 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.851 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 26: conflicting requests 2024-02-09T07:52:16.851 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.851 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 27: conflicting requests 2024-02-09T07:52:16.851 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.851 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 28: conflicting requests 2024-02-09T07:52:16.851 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.851 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 29: conflicting requests 2024-02-09T07:52:16.851 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.851 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 30: conflicting requests 2024-02-09T07:52:16.851 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.851 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 31: conflicting requests 2024-02-09T07:52:16.852 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.852 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 32: conflicting requests 2024-02-09T07:52:16.852 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.852 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 33: conflicting requests 2024-02-09T07:52:16.852 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.852 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 34: conflicting requests 2024-02-09T07:52:16.852 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.852 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 35: conflicting requests 2024-02-09T07:52:16.852 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.852 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 36: conflicting requests 2024-02-09T07:52:16.852 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.852 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 37: conflicting requests 2024-02-09T07:52:16.852 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.853 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.853 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.853 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:52:16.853 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.853 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.853 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.853 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.853 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 39: conflicting requests 2024-02-09T07:52:16.853 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.853 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.853 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.853 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.854 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.854 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.854 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:52:16.854 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.854 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.854 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.854 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.854 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:52:16.854 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.854 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.854 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.854 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.855 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:52:16.855 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.855 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.855 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.855 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.855 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:52:16.855 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.855 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.855 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.855 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.855 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:52:16.855 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.855 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.856 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.856 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.856 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:52:16.856 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.856 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.856 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.856 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:52:16.919 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-02-09T07:52:16.920 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:52:16.920 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repo Size 2024-02-09T07:52:16.920 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:52:16.920 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-02-09T07:52:16.920 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs-devel x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 31 k 2024-02-09T07:52:16.920 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:52:16.920 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-02-09T07:52:16.920 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:52:16.920 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2024-02-09T07:52:16.920 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:52:16.920 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 31 k 2024-02-09T07:52:16.920 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 140 k 2024-02-09T07:52:16.921 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-02-09T07:52:17.225 INFO:teuthology.orchestra.run.smithi062.stdout:libcephfs-devel-19.0.0-1310.g0089f33e.el9.x86_6 102 kB/s | 31 kB 00:00 2024-02-09T07:52:17.225 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:52:17.226 INFO:teuthology.orchestra.run.smithi062.stdout:Total 102 kB/s | 31 kB 00:00 2024-02-09T07:52:17.226 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-02-09T07:52:17.229 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-02-09T07:52:17.230 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-02-09T07:52:17.260 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-02-09T07:52:17.261 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-02-09T07:52:17.349 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-02-09T07:52:17.371 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:02:22 ago on Fri 09 Feb 2024 07:49:55 AM UTC. 2024-02-09T07:52:17.467 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libcephfs-devel-2:19.0.0-1310.g0089f33e.el9.x86_64 1/1 2024-02-09T07:52:17.666 INFO:teuthology.orchestra.run.smithi103.stderr:Modular dependency problems: 2024-02-09T07:52:17.666 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T07:52:17.666 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 1: conflicting requests 2024-02-09T07:52:17.666 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.666 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 2: conflicting requests 2024-02-09T07:52:17.666 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.667 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 3: conflicting requests 2024-02-09T07:52:17.667 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.667 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 4: conflicting requests 2024-02-09T07:52:17.667 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.667 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 5: conflicting requests 2024-02-09T07:52:17.667 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.667 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 6: conflicting requests 2024-02-09T07:52:17.667 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.667 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 7: conflicting requests 2024-02-09T07:52:17.667 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.667 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 8: conflicting requests 2024-02-09T07:52:17.667 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.667 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 9: conflicting requests 2024-02-09T07:52:17.668 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.668 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 10: conflicting requests 2024-02-09T07:52:17.668 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.668 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 11: conflicting requests 2024-02-09T07:52:17.668 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.668 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 12: conflicting requests 2024-02-09T07:52:17.668 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.668 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 13: conflicting requests 2024-02-09T07:52:17.668 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.668 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 14: conflicting requests 2024-02-09T07:52:17.668 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.668 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 15: conflicting requests 2024-02-09T07:52:17.668 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.669 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 16: conflicting requests 2024-02-09T07:52:17.669 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.669 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 17: conflicting requests 2024-02-09T07:52:17.669 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.669 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 18: conflicting requests 2024-02-09T07:52:17.669 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.669 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 19: conflicting requests 2024-02-09T07:52:17.669 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.669 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 20: conflicting requests 2024-02-09T07:52:17.669 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.669 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 21: conflicting requests 2024-02-09T07:52:17.669 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.669 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 22: conflicting requests 2024-02-09T07:52:17.670 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.670 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 23: conflicting requests 2024-02-09T07:52:17.670 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.670 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 24: conflicting requests 2024-02-09T07:52:17.670 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.670 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 25: conflicting requests 2024-02-09T07:52:17.670 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.670 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 26: conflicting requests 2024-02-09T07:52:17.670 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.670 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 27: conflicting requests 2024-02-09T07:52:17.670 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.670 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 28: conflicting requests 2024-02-09T07:52:17.670 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.670 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 29: conflicting requests 2024-02-09T07:52:17.671 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.671 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 30: conflicting requests 2024-02-09T07:52:17.671 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.671 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 31: conflicting requests 2024-02-09T07:52:17.671 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.671 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 32: conflicting requests 2024-02-09T07:52:17.671 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.671 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 33: conflicting requests 2024-02-09T07:52:17.671 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.671 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 34: conflicting requests 2024-02-09T07:52:17.671 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.672 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 35: conflicting requests 2024-02-09T07:52:17.672 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.672 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 36: conflicting requests 2024-02-09T07:52:17.672 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.672 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 37: conflicting requests 2024-02-09T07:52:17.672 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.672 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.672 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.672 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:52:17.672 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.672 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.672 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.672 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.673 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 39: conflicting requests 2024-02-09T07:52:17.673 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.673 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.673 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.673 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.673 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.673 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.673 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:52:17.673 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.673 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.673 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.673 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.673 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:52:17.673 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.674 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.674 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.674 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.674 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:52:17.674 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.674 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.674 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.674 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.674 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:52:17.674 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.674 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.674 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.675 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.675 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:52:17.675 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.675 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.675 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.675 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.675 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:52:17.675 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.675 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.675 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.675 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:52:17.734 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-02-09T07:52:17.735 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:52:17.735 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-02-09T07:52:17.735 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:52:17.735 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-02-09T07:52:17.735 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1310.g0089f33e.el9 ceph-noarch 1.8 M 2024-02-09T07:52:17.735 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-02-09T07:52:17.736 INFO:teuthology.orchestra.run.smithi103.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-02-09T07:52:17.736 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1310.g0089f33e.el9 ceph-noarch 28 k 2024-02-09T07:52:17.736 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1310.g0089f33e.el9 ceph-noarch 15 k 2024-02-09T07:52:17.736 INFO:teuthology.orchestra.run.smithi103.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-02-09T07:52:17.736 INFO:teuthology.orchestra.run.smithi103.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-02-09T07:52:17.736 INFO:teuthology.orchestra.run.smithi103.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-02-09T07:52:17.736 INFO:teuthology.orchestra.run.smithi103.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-02-09T07:52:17.736 INFO:teuthology.orchestra.run.smithi103.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-02-09T07:52:17.736 INFO:teuthology.orchestra.run.smithi103.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-02-09T07:52:17.736 INFO:teuthology.orchestra.run.smithi103.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-09T07:52:17.736 INFO:teuthology.orchestra.run.smithi103.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-09T07:52:17.736 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:52:17.736 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-02-09T07:52:17.736 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:52:17.737 INFO:teuthology.orchestra.run.smithi103.stdout:Install 12 Packages 2024-02-09T07:52:17.737 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:52:17.737 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 6.9 M 2024-02-09T07:52:17.737 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 26 M 2024-02-09T07:52:17.737 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-02-09T07:52:17.815 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-1310.g0089f33e.el9.x86_64 1/1 2024-02-09T07:52:18.110 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libcephfs-devel-2:19.0.0-1310.g0089f33e.el9.x86_64 1/1 2024-02-09T07:52:18.110 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:52:18.110 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-02-09T07:52:18.110 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs-devel-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:52:18.110 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:52:18.110 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-02-09T07:52:18.291 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install librados2 2024-02-09T07:52:18.560 INFO:teuthology.orchestra.run.smithi103.stdout:(1/12): ceph-grafana-dashboards-19.0.0-1310.g00 113 kB/s | 28 kB 00:00 2024-02-09T07:52:18.602 INFO:teuthology.orchestra.run.smithi103.stdout:(2/12): ceph-prometheus-alerts-19.0.0-1310.g008 52 kB/s | 15 kB 00:00 2024-02-09T07:52:18.678 INFO:teuthology.orchestra.run.smithi103.stdout:(3/12): protobuf-3.14.0-13.el9.x86_64.rpm 8.6 MB/s | 1.0 MB 00:00 2024-02-09T07:52:18.753 INFO:teuthology.orchestra.run.smithi103.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.7 MB/s | 269 kB 00:00 2024-02-09T07:52:18.901 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:02:24 ago on Fri 09 Feb 2024 07:49:54 AM UTC. 2024-02-09T07:52:19.211 INFO:teuthology.orchestra.run.smithi062.stderr:Modular dependency problems: 2024-02-09T07:52:19.211 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T07:52:19.212 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 1: conflicting requests 2024-02-09T07:52:19.212 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.212 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 2: conflicting requests 2024-02-09T07:52:19.212 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.212 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 3: conflicting requests 2024-02-09T07:52:19.212 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.212 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 4: conflicting requests 2024-02-09T07:52:19.212 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.212 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 5: conflicting requests 2024-02-09T07:52:19.212 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.212 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 6: conflicting requests 2024-02-09T07:52:19.212 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.213 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 7: conflicting requests 2024-02-09T07:52:19.213 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.213 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 8: conflicting requests 2024-02-09T07:52:19.213 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.213 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 9: conflicting requests 2024-02-09T07:52:19.213 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.213 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 10: conflicting requests 2024-02-09T07:52:19.213 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.213 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 11: conflicting requests 2024-02-09T07:52:19.213 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.213 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 12: conflicting requests 2024-02-09T07:52:19.213 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.213 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 13: conflicting requests 2024-02-09T07:52:19.213 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.214 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 14: conflicting requests 2024-02-09T07:52:19.214 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.214 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 15: conflicting requests 2024-02-09T07:52:19.214 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.214 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 16: conflicting requests 2024-02-09T07:52:19.214 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.214 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 17: conflicting requests 2024-02-09T07:52:19.214 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.214 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 18: conflicting requests 2024-02-09T07:52:19.214 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.214 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 19: conflicting requests 2024-02-09T07:52:19.214 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.214 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 20: conflicting requests 2024-02-09T07:52:19.215 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.215 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 21: conflicting requests 2024-02-09T07:52:19.215 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.215 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 22: conflicting requests 2024-02-09T07:52:19.215 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.215 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 23: conflicting requests 2024-02-09T07:52:19.215 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.215 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 24: conflicting requests 2024-02-09T07:52:19.215 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.215 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 25: conflicting requests 2024-02-09T07:52:19.215 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.215 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 26: conflicting requests 2024-02-09T07:52:19.215 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.216 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 27: conflicting requests 2024-02-09T07:52:19.216 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.216 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 28: conflicting requests 2024-02-09T07:52:19.216 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.216 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 29: conflicting requests 2024-02-09T07:52:19.216 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.216 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 30: conflicting requests 2024-02-09T07:52:19.216 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.216 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 31: conflicting requests 2024-02-09T07:52:19.216 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.216 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 32: conflicting requests 2024-02-09T07:52:19.216 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.217 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 33: conflicting requests 2024-02-09T07:52:19.217 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.217 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 34: conflicting requests 2024-02-09T07:52:19.217 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.217 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 35: conflicting requests 2024-02-09T07:52:19.217 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.217 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 36: conflicting requests 2024-02-09T07:52:19.217 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.217 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 37: conflicting requests 2024-02-09T07:52:19.217 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.217 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.217 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.217 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:52:19.217 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.217 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.218 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.218 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.218 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 39: conflicting requests 2024-02-09T07:52:19.218 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.218 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.218 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.218 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.218 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.218 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.218 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:52:19.218 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.218 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.219 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.219 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.219 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:52:19.219 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.219 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.219 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.219 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.219 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:52:19.219 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.219 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.219 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.220 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.220 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:52:19.220 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.220 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.220 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.220 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.220 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:52:19.220 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.220 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.220 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.220 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.220 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:52:19.220 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.221 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.221 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.221 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:52:19.221 INFO:teuthology.orchestra.run.smithi062.stdout:Package librados2-2:19.0.0-1310.g0089f33e.el9.x86_64 is already installed. 2024-02-09T07:52:19.228 INFO:teuthology.orchestra.run.smithi103.stdout:(5/12): ceph-mgr-dashboard-19.0.0-1310.g0089f33 1.9 MB/s | 1.8 MB 00:00 2024-02-09T07:52:19.282 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-02-09T07:52:19.283 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do. 2024-02-09T07:52:19.284 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-02-09T07:52:19.341 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install librbd1 2024-02-09T07:52:19.345 INFO:teuthology.orchestra.run.smithi103.stdout:(6/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 926 kB/s | 548 kB 00:00 2024-02-09T07:52:19.504 INFO:teuthology.orchestra.run.smithi103.stdout:(7/12): grpc-data-1.46.7-10.el9.noarch.rpm 70 kB/s | 19 kB 00:00 2024-02-09T07:52:19.704 INFO:teuthology.orchestra.run.smithi103.stdout:(8/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 5.7 MB/s | 2.0 MB 00:00 2024-02-09T07:52:19.813 INFO:teuthology.orchestra.run.smithi103.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 284 kB/s | 31 kB 00:00 2024-02-09T07:52:19.838 INFO:teuthology.orchestra.run.smithi103.stdout:(10/12): python3-grpcio-tools-1.46.7-10.el9.x86 433 kB/s | 144 kB 00:00 2024-02-09T07:52:19.880 INFO:teuthology.orchestra.run.smithi103.stdout:(11/12): protobuf-compiler-3.14.0-13.el9.x86_64 718 kB/s | 863 kB 00:01 2024-02-09T07:52:19.922 INFO:teuthology.orchestra.run.smithi103.stdout:(12/12): python3-routes-2.5.1-5.el9.noarch.rpm 1.7 MB/s | 188 kB 00:00 2024-02-09T07:52:19.924 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:52:19.924 INFO:teuthology.orchestra.run.smithi103.stdout:Total 3.1 MB/s | 6.9 MB 00:02 2024-02-09T07:52:19.950 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:02:25 ago on Fri 09 Feb 2024 07:49:54 AM UTC. 2024-02-09T07:52:19.976 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-02-09T07:52:19.996 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-02-09T07:52:19.996 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-02-09T07:52:20.163 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-02-09T07:52:20.164 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-02-09T07:52:20.255 INFO:teuthology.orchestra.run.smithi062.stderr:Modular dependency problems: 2024-02-09T07:52:20.256 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T07:52:20.256 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 1: conflicting requests 2024-02-09T07:52:20.256 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.256 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 2: conflicting requests 2024-02-09T07:52:20.256 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.256 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 3: conflicting requests 2024-02-09T07:52:20.256 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.256 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 4: conflicting requests 2024-02-09T07:52:20.256 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.256 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 5: conflicting requests 2024-02-09T07:52:20.256 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.257 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 6: conflicting requests 2024-02-09T07:52:20.257 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.257 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 7: conflicting requests 2024-02-09T07:52:20.257 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.257 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 8: conflicting requests 2024-02-09T07:52:20.257 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.257 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 9: conflicting requests 2024-02-09T07:52:20.257 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.257 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 10: conflicting requests 2024-02-09T07:52:20.257 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.257 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 11: conflicting requests 2024-02-09T07:52:20.257 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.257 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 12: conflicting requests 2024-02-09T07:52:20.257 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.258 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 13: conflicting requests 2024-02-09T07:52:20.258 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.258 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 14: conflicting requests 2024-02-09T07:52:20.258 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.258 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 15: conflicting requests 2024-02-09T07:52:20.258 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.258 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 16: conflicting requests 2024-02-09T07:52:20.258 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.258 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 17: conflicting requests 2024-02-09T07:52:20.258 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.258 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 18: conflicting requests 2024-02-09T07:52:20.258 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.258 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 19: conflicting requests 2024-02-09T07:52:20.258 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.259 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 20: conflicting requests 2024-02-09T07:52:20.259 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.259 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 21: conflicting requests 2024-02-09T07:52:20.259 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.259 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 22: conflicting requests 2024-02-09T07:52:20.259 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.259 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 23: conflicting requests 2024-02-09T07:52:20.259 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.259 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 24: conflicting requests 2024-02-09T07:52:20.259 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.259 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 25: conflicting requests 2024-02-09T07:52:20.259 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.259 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 26: conflicting requests 2024-02-09T07:52:20.259 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.260 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 27: conflicting requests 2024-02-09T07:52:20.260 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.260 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 28: conflicting requests 2024-02-09T07:52:20.260 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.260 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 29: conflicting requests 2024-02-09T07:52:20.260 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.260 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 30: conflicting requests 2024-02-09T07:52:20.260 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.260 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 31: conflicting requests 2024-02-09T07:52:20.260 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.260 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 32: conflicting requests 2024-02-09T07:52:20.260 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.260 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 33: conflicting requests 2024-02-09T07:52:20.260 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.261 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 34: conflicting requests 2024-02-09T07:52:20.261 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.261 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 35: conflicting requests 2024-02-09T07:52:20.261 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.261 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 36: conflicting requests 2024-02-09T07:52:20.261 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.261 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 37: conflicting requests 2024-02-09T07:52:20.261 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.261 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.261 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.261 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:52:20.261 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.261 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.261 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.262 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.262 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 39: conflicting requests 2024-02-09T07:52:20.262 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.262 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.262 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.262 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.262 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.262 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.262 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:52:20.262 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.262 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.262 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.262 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.262 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:52:20.263 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.263 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.263 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.263 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.263 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:52:20.263 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.263 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.263 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.263 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.263 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:52:20.263 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.263 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.263 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.263 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.263 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:52:20.264 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.264 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.264 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.264 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.264 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:52:20.264 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.264 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.264 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.264 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:52:20.265 INFO:teuthology.orchestra.run.smithi062.stdout:Package librbd1-2:19.0.0-1310.g0089f33e.el9.x86_64 is already installed. 2024-02-09T07:52:20.328 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-02-09T07:52:20.329 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do. 2024-02-09T07:52:20.329 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-02-09T07:52:20.394 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install python3-rados 2024-02-09T07:52:20.682 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-02-09T07:52:20.756 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-02-09T07:52:20.800 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-02-09T07:52:20.855 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-02-09T07:52:20.885 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-02-09T07:52:20.989 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-02-09T07:52:21.008 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:02:27 ago on Fri 09 Feb 2024 07:49:54 AM UTC. 2024-02-09T07:52:21.123 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-02-09T07:52:21.217 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-02-09T07:52:21.266 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-02-09T07:52:21.294 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-02-09T07:52:21.316 INFO:teuthology.orchestra.run.smithi062.stderr:Modular dependency problems: 2024-02-09T07:52:21.316 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T07:52:21.316 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 1: conflicting requests 2024-02-09T07:52:21.317 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.317 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 2: conflicting requests 2024-02-09T07:52:21.317 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.317 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 3: conflicting requests 2024-02-09T07:52:21.317 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.317 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 4: conflicting requests 2024-02-09T07:52:21.317 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.317 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 5: conflicting requests 2024-02-09T07:52:21.317 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.317 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 6: conflicting requests 2024-02-09T07:52:21.317 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.317 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 7: conflicting requests 2024-02-09T07:52:21.317 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.318 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 8: conflicting requests 2024-02-09T07:52:21.318 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.318 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 9: conflicting requests 2024-02-09T07:52:21.318 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.318 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 10: conflicting requests 2024-02-09T07:52:21.318 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.318 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 11: conflicting requests 2024-02-09T07:52:21.318 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.318 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 12: conflicting requests 2024-02-09T07:52:21.318 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.318 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 13: conflicting requests 2024-02-09T07:52:21.318 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.318 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 14: conflicting requests 2024-02-09T07:52:21.318 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.319 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 15: conflicting requests 2024-02-09T07:52:21.319 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.319 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 16: conflicting requests 2024-02-09T07:52:21.319 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.319 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 17: conflicting requests 2024-02-09T07:52:21.319 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.319 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 18: conflicting requests 2024-02-09T07:52:21.319 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.319 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 19: conflicting requests 2024-02-09T07:52:21.319 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.319 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 20: conflicting requests 2024-02-09T07:52:21.319 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.320 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 21: conflicting requests 2024-02-09T07:52:21.320 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.320 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 22: conflicting requests 2024-02-09T07:52:21.320 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.320 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 23: conflicting requests 2024-02-09T07:52:21.320 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.320 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 24: conflicting requests 2024-02-09T07:52:21.320 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.320 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 25: conflicting requests 2024-02-09T07:52:21.320 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.320 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 26: conflicting requests 2024-02-09T07:52:21.320 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.320 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 27: conflicting requests 2024-02-09T07:52:21.321 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.321 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 28: conflicting requests 2024-02-09T07:52:21.321 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.321 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 29: conflicting requests 2024-02-09T07:52:21.321 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.321 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 30: conflicting requests 2024-02-09T07:52:21.321 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.321 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 31: conflicting requests 2024-02-09T07:52:21.321 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.321 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 32: conflicting requests 2024-02-09T07:52:21.321 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.321 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 33: conflicting requests 2024-02-09T07:52:21.321 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.321 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 34: conflicting requests 2024-02-09T07:52:21.322 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.322 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 35: conflicting requests 2024-02-09T07:52:21.322 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.322 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 36: conflicting requests 2024-02-09T07:52:21.322 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.322 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 37: conflicting requests 2024-02-09T07:52:21.322 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.322 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.322 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.322 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:52:21.322 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.322 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.322 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.323 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.323 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 39: conflicting requests 2024-02-09T07:52:21.323 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.323 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.323 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.323 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.323 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.323 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.323 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:52:21.323 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.323 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.323 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.323 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.323 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:52:21.323 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.324 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.324 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.324 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.324 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:52:21.324 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.324 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.324 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.324 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.324 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:52:21.324 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.324 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.324 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.324 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.325 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:52:21.325 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.325 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.325 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.325 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.325 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:52:21.325 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.325 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.325 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.325 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:52:21.326 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1310.g0089f33e.el9 10/12 2024-02-09T07:52:21.326 INFO:teuthology.orchestra.run.smithi062.stdout:Package python3-rados-2:19.0.0-1310.g0089f33e.el9.x86_64 is already installed. 2024-02-09T07:52:21.388 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-02-09T07:52:21.390 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do. 2024-02-09T07:52:21.390 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-02-09T07:52:21.445 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install python3-rgw 2024-02-09T07:52:21.571 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1310.g0089f33e.el 11/12 2024-02-09T07:52:21.601 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1310.g0089f33e.el9.noa 12/12 2024-02-09T07:52:22.070 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:02:28 ago on Fri 09 Feb 2024 07:49:54 AM UTC. 2024-02-09T07:52:22.381 INFO:teuthology.orchestra.run.smithi062.stderr:Modular dependency problems: 2024-02-09T07:52:22.381 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T07:52:22.381 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 1: conflicting requests 2024-02-09T07:52:22.381 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.381 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 2: conflicting requests 2024-02-09T07:52:22.381 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.381 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 3: conflicting requests 2024-02-09T07:52:22.381 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.381 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 4: conflicting requests 2024-02-09T07:52:22.381 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.381 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 5: conflicting requests 2024-02-09T07:52:22.381 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.382 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 6: conflicting requests 2024-02-09T07:52:22.382 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.382 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 7: conflicting requests 2024-02-09T07:52:22.382 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.382 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 8: conflicting requests 2024-02-09T07:52:22.382 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.382 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 9: conflicting requests 2024-02-09T07:52:22.382 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.382 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 10: conflicting requests 2024-02-09T07:52:22.382 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.382 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 11: conflicting requests 2024-02-09T07:52:22.382 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.383 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 12: conflicting requests 2024-02-09T07:52:22.383 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.383 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 13: conflicting requests 2024-02-09T07:52:22.383 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.383 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 14: conflicting requests 2024-02-09T07:52:22.383 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.383 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 15: conflicting requests 2024-02-09T07:52:22.383 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.383 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 16: conflicting requests 2024-02-09T07:52:22.383 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.383 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 17: conflicting requests 2024-02-09T07:52:22.383 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.384 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 18: conflicting requests 2024-02-09T07:52:22.384 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.384 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 19: conflicting requests 2024-02-09T07:52:22.384 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.384 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 20: conflicting requests 2024-02-09T07:52:22.384 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.384 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 21: conflicting requests 2024-02-09T07:52:22.384 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.384 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 22: conflicting requests 2024-02-09T07:52:22.384 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.384 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 23: conflicting requests 2024-02-09T07:52:22.384 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.384 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 24: conflicting requests 2024-02-09T07:52:22.385 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.385 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 25: conflicting requests 2024-02-09T07:52:22.385 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.385 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 26: conflicting requests 2024-02-09T07:52:22.385 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.385 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 27: conflicting requests 2024-02-09T07:52:22.385 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.385 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 28: conflicting requests 2024-02-09T07:52:22.385 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.385 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 29: conflicting requests 2024-02-09T07:52:22.385 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.385 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 30: conflicting requests 2024-02-09T07:52:22.385 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.385 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 31: conflicting requests 2024-02-09T07:52:22.386 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.386 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 32: conflicting requests 2024-02-09T07:52:22.386 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.386 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 33: conflicting requests 2024-02-09T07:52:22.386 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.386 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 34: conflicting requests 2024-02-09T07:52:22.386 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.386 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 35: conflicting requests 2024-02-09T07:52:22.386 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.386 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 36: conflicting requests 2024-02-09T07:52:22.386 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.386 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 37: conflicting requests 2024-02-09T07:52:22.386 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.387 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.387 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.387 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:52:22.387 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.387 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.387 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.387 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.387 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 39: conflicting requests 2024-02-09T07:52:22.387 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.387 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.387 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.388 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.388 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.388 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.388 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:52:22.388 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.388 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.388 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.388 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.388 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:52:22.388 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.388 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.388 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.388 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.389 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:52:22.389 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.389 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.389 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.389 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.389 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:52:22.389 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.389 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.389 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.389 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.389 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:52:22.389 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.389 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.390 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.390 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.390 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:52:22.390 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.390 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.390 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.390 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:52:22.391 INFO:teuthology.orchestra.run.smithi062.stdout:Package python3-rgw-2:19.0.0-1310.g0089f33e.el9.x86_64 is already installed. 2024-02-09T07:52:22.453 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-02-09T07:52:22.455 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1310.g0089f33e.el9.noa 12/12 2024-02-09T07:52:22.455 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1310.g0089f33e.el 1/12 2024-02-09T07:52:22.455 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1310.g0089f33e.el9.noa 2/12 2024-02-09T07:52:22.455 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1310.g0089f33e.el9 3/12 2024-02-09T07:52:22.455 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-02-09T07:52:22.455 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-02-09T07:52:22.455 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-02-09T07:52:22.455 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-02-09T07:52:22.455 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-02-09T07:52:22.455 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-02-09T07:52:22.455 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-02-09T07:52:22.455 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-02-09T07:52:22.456 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do. 2024-02-09T07:52:22.456 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-02-09T07:52:22.521 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install python3-cephfs 2024-02-09T07:52:22.829 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-02-09T07:52:22.830 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:52:22.830 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-02-09T07:52:22.830 INFO:teuthology.orchestra.run.smithi103.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-02-09T07:52:22.830 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-grafana-dashboards-2:19.0.0-1310.g0089f33e.el9.noarch 2024-02-09T07:52:22.830 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-dashboard-2:19.0.0-1310.g0089f33e.el9.noarch 2024-02-09T07:52:22.830 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-prometheus-alerts-2:19.0.0-1310.g0089f33e.el9.noarch 2024-02-09T07:52:22.830 INFO:teuthology.orchestra.run.smithi103.stdout: grpc-data-1.46.7-10.el9.noarch 2024-02-09T07:52:22.830 INFO:teuthology.orchestra.run.smithi103.stdout: protobuf-3.14.0-13.el9.x86_64 2024-02-09T07:52:22.830 INFO:teuthology.orchestra.run.smithi103.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-02-09T07:52:22.830 INFO:teuthology.orchestra.run.smithi103.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-02-09T07:52:22.830 INFO:teuthology.orchestra.run.smithi103.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-02-09T07:52:22.830 INFO:teuthology.orchestra.run.smithi103.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-02-09T07:52:22.830 INFO:teuthology.orchestra.run.smithi103.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-09T07:52:22.830 INFO:teuthology.orchestra.run.smithi103.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-09T07:52:22.830 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:52:22.831 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-02-09T07:52:23.094 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-mgr-diskprediction-local 2024-02-09T07:52:23.151 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:02:29 ago on Fri 09 Feb 2024 07:49:54 AM UTC. 2024-02-09T07:52:23.459 INFO:teuthology.orchestra.run.smithi062.stderr:Modular dependency problems: 2024-02-09T07:52:23.459 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T07:52:23.459 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 1: conflicting requests 2024-02-09T07:52:23.459 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.459 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 2: conflicting requests 2024-02-09T07:52:23.459 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.459 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 3: conflicting requests 2024-02-09T07:52:23.460 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.460 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 4: conflicting requests 2024-02-09T07:52:23.460 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.460 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 5: conflicting requests 2024-02-09T07:52:23.460 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.460 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 6: conflicting requests 2024-02-09T07:52:23.460 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.460 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 7: conflicting requests 2024-02-09T07:52:23.460 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.460 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 8: conflicting requests 2024-02-09T07:52:23.460 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.460 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 9: conflicting requests 2024-02-09T07:52:23.460 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.460 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 10: conflicting requests 2024-02-09T07:52:23.461 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.461 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 11: conflicting requests 2024-02-09T07:52:23.461 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.461 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 12: conflicting requests 2024-02-09T07:52:23.461 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.461 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 13: conflicting requests 2024-02-09T07:52:23.461 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.461 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 14: conflicting requests 2024-02-09T07:52:23.461 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.461 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 15: conflicting requests 2024-02-09T07:52:23.461 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.461 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 16: conflicting requests 2024-02-09T07:52:23.461 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.462 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 17: conflicting requests 2024-02-09T07:52:23.462 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.462 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 18: conflicting requests 2024-02-09T07:52:23.462 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.462 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 19: conflicting requests 2024-02-09T07:52:23.462 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.462 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 20: conflicting requests 2024-02-09T07:52:23.462 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.462 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 21: conflicting requests 2024-02-09T07:52:23.463 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.463 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 22: conflicting requests 2024-02-09T07:52:23.463 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.463 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 23: conflicting requests 2024-02-09T07:52:23.463 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.463 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 24: conflicting requests 2024-02-09T07:52:23.463 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.463 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 25: conflicting requests 2024-02-09T07:52:23.463 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.463 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 26: conflicting requests 2024-02-09T07:52:23.463 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.463 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 27: conflicting requests 2024-02-09T07:52:23.463 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.463 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 28: conflicting requests 2024-02-09T07:52:23.463 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.464 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 29: conflicting requests 2024-02-09T07:52:23.464 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.464 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 30: conflicting requests 2024-02-09T07:52:23.464 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.464 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 31: conflicting requests 2024-02-09T07:52:23.464 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.464 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 32: conflicting requests 2024-02-09T07:52:23.464 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.464 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 33: conflicting requests 2024-02-09T07:52:23.464 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.465 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 34: conflicting requests 2024-02-09T07:52:23.465 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.465 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 35: conflicting requests 2024-02-09T07:52:23.465 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.465 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 36: conflicting requests 2024-02-09T07:52:23.465 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.465 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 37: conflicting requests 2024-02-09T07:52:23.465 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.465 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.465 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.465 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:52:23.465 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.465 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.466 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.466 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.466 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 39: conflicting requests 2024-02-09T07:52:23.466 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.466 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.466 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.466 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.466 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.466 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.466 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:52:23.466 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.466 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.466 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.466 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.467 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:52:23.467 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.467 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.467 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.467 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.467 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:52:23.467 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.467 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.467 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.468 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.468 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:52:23.468 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.468 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.468 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.468 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.468 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:52:23.468 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.468 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.468 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.469 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.469 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:52:23.469 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.469 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.469 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.469 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:52:23.469 INFO:teuthology.orchestra.run.smithi062.stdout:Package python3-cephfs-2:19.0.0-1310.g0089f33e.el9.x86_64 is already installed. 2024-02-09T07:52:23.531 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-02-09T07:52:23.532 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do. 2024-02-09T07:52:23.532 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-02-09T07:52:23.600 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install python3-rbd 2024-02-09T07:52:23.713 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:02:28 ago on Fri 09 Feb 2024 07:49:55 AM UTC. 2024-02-09T07:52:24.023 INFO:teuthology.orchestra.run.smithi103.stderr:Modular dependency problems: 2024-02-09T07:52:24.023 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T07:52:24.023 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 1: conflicting requests 2024-02-09T07:52:24.023 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.023 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 2: conflicting requests 2024-02-09T07:52:24.023 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.023 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 3: conflicting requests 2024-02-09T07:52:24.023 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.023 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 4: conflicting requests 2024-02-09T07:52:24.024 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.024 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 5: conflicting requests 2024-02-09T07:52:24.024 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.024 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 6: conflicting requests 2024-02-09T07:52:24.024 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.024 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 7: conflicting requests 2024-02-09T07:52:24.024 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.024 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 8: conflicting requests 2024-02-09T07:52:24.024 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.024 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 9: conflicting requests 2024-02-09T07:52:24.025 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.025 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 10: conflicting requests 2024-02-09T07:52:24.025 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.025 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 11: conflicting requests 2024-02-09T07:52:24.025 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.025 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 12: conflicting requests 2024-02-09T07:52:24.025 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.025 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 13: conflicting requests 2024-02-09T07:52:24.025 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.025 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 14: conflicting requests 2024-02-09T07:52:24.025 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.025 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 15: conflicting requests 2024-02-09T07:52:24.026 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.026 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 16: conflicting requests 2024-02-09T07:52:24.026 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.026 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 17: conflicting requests 2024-02-09T07:52:24.026 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.026 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 18: conflicting requests 2024-02-09T07:52:24.026 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.026 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 19: conflicting requests 2024-02-09T07:52:24.026 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.026 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 20: conflicting requests 2024-02-09T07:52:24.026 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.027 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 21: conflicting requests 2024-02-09T07:52:24.027 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.027 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 22: conflicting requests 2024-02-09T07:52:24.027 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.027 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 23: conflicting requests 2024-02-09T07:52:24.027 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.027 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 24: conflicting requests 2024-02-09T07:52:24.027 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.027 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 25: conflicting requests 2024-02-09T07:52:24.027 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.027 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 26: conflicting requests 2024-02-09T07:52:24.028 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.028 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 27: conflicting requests 2024-02-09T07:52:24.028 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.028 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 28: conflicting requests 2024-02-09T07:52:24.028 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.028 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 29: conflicting requests 2024-02-09T07:52:24.028 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.028 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 30: conflicting requests 2024-02-09T07:52:24.028 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.028 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 31: conflicting requests 2024-02-09T07:52:24.028 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.029 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 32: conflicting requests 2024-02-09T07:52:24.029 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.029 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 33: conflicting requests 2024-02-09T07:52:24.030 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.030 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 34: conflicting requests 2024-02-09T07:52:24.030 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.030 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 35: conflicting requests 2024-02-09T07:52:24.030 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.030 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 36: conflicting requests 2024-02-09T07:52:24.030 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.030 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 37: conflicting requests 2024-02-09T07:52:24.030 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.030 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.031 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.031 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:52:24.031 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.031 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.031 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.031 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.031 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 39: conflicting requests 2024-02-09T07:52:24.031 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.031 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.031 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.031 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.031 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.031 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.032 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:52:24.032 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.032 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.032 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.032 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.032 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:52:24.032 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.032 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.032 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.032 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.032 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:52:24.033 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.033 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.033 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.033 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.033 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:52:24.033 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.033 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.033 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.033 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.033 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:52:24.034 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.034 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.034 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.034 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.034 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:52:24.034 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.034 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.034 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.034 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.094 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-02-09T07:52:24.095 INFO:teuthology.orchestra.run.smithi103.stdout:======================================================================================= 2024-02-09T07:52:24.095 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-02-09T07:52:24.095 INFO:teuthology.orchestra.run.smithi103.stdout:======================================================================================= 2024-02-09T07:52:24.096 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-02-09T07:52:24.096 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1310.g0089f33e.el9 ceph-noarch 7.4 M 2024-02-09T07:52:24.096 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-02-09T07:52:24.096 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-02-09T07:52:24.096 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-02-09T07:52:24.096 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-02-09T07:52:24.096 INFO:teuthology.orchestra.run.smithi103.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-02-09T07:52:24.096 INFO:teuthology.orchestra.run.smithi103.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-02-09T07:52:24.096 INFO:teuthology.orchestra.run.smithi103.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-02-09T07:52:24.096 INFO:teuthology.orchestra.run.smithi103.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-02-09T07:52:24.096 INFO:teuthology.orchestra.run.smithi103.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-09T07:52:24.097 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-02-09T07:52:24.097 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-02-09T07:52:24.097 INFO:teuthology.orchestra.run.smithi103.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-02-09T07:52:24.097 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:52:24.097 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-02-09T07:52:24.097 INFO:teuthology.orchestra.run.smithi103.stdout:======================================================================================= 2024-02-09T07:52:24.097 INFO:teuthology.orchestra.run.smithi103.stdout:Install 12 Packages 2024-02-09T07:52:24.097 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:52:24.098 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 38 M 2024-02-09T07:52:24.098 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 209 M 2024-02-09T07:52:24.098 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-02-09T07:52:24.222 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:02:30 ago on Fri 09 Feb 2024 07:49:54 AM UTC. 2024-02-09T07:52:24.528 INFO:teuthology.orchestra.run.smithi062.stderr:Modular dependency problems: 2024-02-09T07:52:24.529 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T07:52:24.529 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 1: conflicting requests 2024-02-09T07:52:24.529 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.529 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 2: conflicting requests 2024-02-09T07:52:24.529 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.529 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 3: conflicting requests 2024-02-09T07:52:24.529 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.529 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 4: conflicting requests 2024-02-09T07:52:24.529 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.529 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 5: conflicting requests 2024-02-09T07:52:24.529 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.529 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 6: conflicting requests 2024-02-09T07:52:24.529 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.530 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 7: conflicting requests 2024-02-09T07:52:24.530 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.530 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 8: conflicting requests 2024-02-09T07:52:24.530 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.530 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 9: conflicting requests 2024-02-09T07:52:24.530 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.530 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 10: conflicting requests 2024-02-09T07:52:24.530 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.530 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 11: conflicting requests 2024-02-09T07:52:24.531 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.531 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 12: conflicting requests 2024-02-09T07:52:24.531 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.531 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 13: conflicting requests 2024-02-09T07:52:24.531 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.531 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 14: conflicting requests 2024-02-09T07:52:24.531 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.531 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 15: conflicting requests 2024-02-09T07:52:24.531 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.531 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 16: conflicting requests 2024-02-09T07:52:24.531 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.532 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 17: conflicting requests 2024-02-09T07:52:24.532 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.532 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 18: conflicting requests 2024-02-09T07:52:24.532 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.532 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 19: conflicting requests 2024-02-09T07:52:24.532 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.532 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 20: conflicting requests 2024-02-09T07:52:24.532 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.532 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 21: conflicting requests 2024-02-09T07:52:24.532 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.532 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 22: conflicting requests 2024-02-09T07:52:24.532 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.533 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 23: conflicting requests 2024-02-09T07:52:24.533 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.533 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 24: conflicting requests 2024-02-09T07:52:24.533 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.533 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 25: conflicting requests 2024-02-09T07:52:24.533 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.533 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 26: conflicting requests 2024-02-09T07:52:24.533 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.533 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 27: conflicting requests 2024-02-09T07:52:24.533 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.533 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 28: conflicting requests 2024-02-09T07:52:24.533 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.533 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 29: conflicting requests 2024-02-09T07:52:24.533 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.534 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 30: conflicting requests 2024-02-09T07:52:24.534 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.534 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 31: conflicting requests 2024-02-09T07:52:24.534 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.534 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 32: conflicting requests 2024-02-09T07:52:24.534 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.534 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 33: conflicting requests 2024-02-09T07:52:24.534 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.534 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 34: conflicting requests 2024-02-09T07:52:24.534 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.534 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 35: conflicting requests 2024-02-09T07:52:24.534 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.534 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 36: conflicting requests 2024-02-09T07:52:24.534 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.535 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 37: conflicting requests 2024-02-09T07:52:24.535 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.535 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.535 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.535 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:52:24.535 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.535 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.535 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.535 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.535 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 39: conflicting requests 2024-02-09T07:52:24.536 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.536 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.536 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.536 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.536 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.536 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.536 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:52:24.536 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.536 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.536 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.536 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.537 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:52:24.537 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.537 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.537 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.537 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.537 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:52:24.537 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.537 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.537 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.537 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.537 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:52:24.537 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.537 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.537 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.538 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.538 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:52:24.538 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.538 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.538 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.538 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.538 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:52:24.538 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.538 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.538 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.538 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:52:24.539 INFO:teuthology.orchestra.run.smithi062.stdout:Package python3-rbd-2:19.0.0-1310.g0089f33e.el9.x86_64 is already installed. 2024-02-09T07:52:24.601 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-02-09T07:52:24.603 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do. 2024-02-09T07:52:24.603 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-02-09T07:52:24.614 INFO:teuthology.orchestra.run.smithi103.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 2.0 MB/s | 195 kB 00:00 2024-02-09T07:52:24.662 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install rbd-fuse 2024-02-09T07:52:24.664 INFO:teuthology.orchestra.run.smithi103.stdout:(2/12): libgfortran-11.4.1-3.el9.x86_64.rpm 5.3 MB/s | 803 kB 00:00 2024-02-09T07:52:24.831 INFO:teuthology.orchestra.run.smithi103.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 151 kB/s | 33 kB 00:00 2024-02-09T07:52:24.890 INFO:teuthology.orchestra.run.smithi103.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 312 kB/s | 18 kB 00:00 2024-02-09T07:52:24.949 INFO:teuthology.orchestra.run.smithi103.stdout:(5/12): openblas-0.3.21-2.el9.x86_64.rpm 603 kB/s | 35 kB 00:00 2024-02-09T07:52:25.049 INFO:teuthology.orchestra.run.smithi103.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 7.8 MB/s | 3.0 MB 00:00 2024-02-09T07:52:25.116 INFO:teuthology.orchestra.run.smithi103.stdout:(7/12): python3-devel-3.9.17-2.el9.x86_64.rpm 3.6 MB/s | 245 kB 00:00 2024-02-09T07:52:25.277 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:02:31 ago on Fri 09 Feb 2024 07:49:54 AM UTC. 2024-02-09T07:52:25.283 INFO:teuthology.orchestra.run.smithi103.stdout:(8/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 31 MB/s | 5.1 MB 00:00 2024-02-09T07:52:25.350 INFO:teuthology.orchestra.run.smithi103.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 3.7 MB/s | 250 kB 00:00 2024-02-09T07:52:25.584 INFO:teuthology.orchestra.run.smithi062.stderr:Modular dependency problems: 2024-02-09T07:52:25.584 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T07:52:25.584 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 1: conflicting requests 2024-02-09T07:52:25.584 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.585 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 2: conflicting requests 2024-02-09T07:52:25.585 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.585 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 3: conflicting requests 2024-02-09T07:52:25.585 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.585 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 4: conflicting requests 2024-02-09T07:52:25.585 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.585 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 5: conflicting requests 2024-02-09T07:52:25.585 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.586 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 6: conflicting requests 2024-02-09T07:52:25.586 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.586 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 7: conflicting requests 2024-02-09T07:52:25.586 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.586 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 8: conflicting requests 2024-02-09T07:52:25.586 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.586 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 9: conflicting requests 2024-02-09T07:52:25.586 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.586 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 10: conflicting requests 2024-02-09T07:52:25.586 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.586 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 11: conflicting requests 2024-02-09T07:52:25.587 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.587 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 12: conflicting requests 2024-02-09T07:52:25.587 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.587 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 13: conflicting requests 2024-02-09T07:52:25.587 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.587 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 14: conflicting requests 2024-02-09T07:52:25.587 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.587 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 15: conflicting requests 2024-02-09T07:52:25.587 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.587 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 16: conflicting requests 2024-02-09T07:52:25.587 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.588 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 17: conflicting requests 2024-02-09T07:52:25.588 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.588 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 18: conflicting requests 2024-02-09T07:52:25.588 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.588 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 19: conflicting requests 2024-02-09T07:52:25.588 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.588 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 20: conflicting requests 2024-02-09T07:52:25.588 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.588 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 21: conflicting requests 2024-02-09T07:52:25.588 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.588 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 22: conflicting requests 2024-02-09T07:52:25.589 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.589 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 23: conflicting requests 2024-02-09T07:52:25.589 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.589 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 24: conflicting requests 2024-02-09T07:52:25.589 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.589 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 25: conflicting requests 2024-02-09T07:52:25.589 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.589 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 26: conflicting requests 2024-02-09T07:52:25.589 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.589 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 27: conflicting requests 2024-02-09T07:52:25.590 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.590 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 28: conflicting requests 2024-02-09T07:52:25.590 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.590 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 29: conflicting requests 2024-02-09T07:52:25.590 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.590 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 30: conflicting requests 2024-02-09T07:52:25.590 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.590 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 31: conflicting requests 2024-02-09T07:52:25.590 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.590 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 32: conflicting requests 2024-02-09T07:52:25.590 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.590 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 33: conflicting requests 2024-02-09T07:52:25.590 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.591 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 34: conflicting requests 2024-02-09T07:52:25.591 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.591 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 35: conflicting requests 2024-02-09T07:52:25.591 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.591 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 36: conflicting requests 2024-02-09T07:52:25.591 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.591 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 37: conflicting requests 2024-02-09T07:52:25.591 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.591 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.591 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.591 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:52:25.591 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.591 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.592 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.592 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.592 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 39: conflicting requests 2024-02-09T07:52:25.592 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.592 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.592 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.592 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.592 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.592 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.592 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:52:25.592 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.592 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.593 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.593 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.593 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:52:25.593 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.593 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.593 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.593 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.593 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:52:25.593 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.593 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.593 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.594 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.594 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:52:25.594 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.594 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.594 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.594 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.594 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:52:25.594 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.594 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.594 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.594 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.594 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:52:25.594 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.594 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.595 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.595 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:52:25.656 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-02-09T07:52:25.657 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:52:25.657 INFO:teuthology.orchestra.run.smithi062.stdout: Package Architecture Version Repository Size 2024-02-09T07:52:25.657 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:52:25.657 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-02-09T07:52:25.657 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-fuse x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 85 k 2024-02-09T07:52:25.657 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:52:25.657 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-02-09T07:52:25.658 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:52:25.658 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2024-02-09T07:52:25.658 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:52:25.658 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 85 k 2024-02-09T07:52:25.658 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 231 k 2024-02-09T07:52:25.658 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-02-09T07:52:25.851 INFO:teuthology.orchestra.run.smithi103.stdout:(10/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-02-09T07:52:25.951 INFO:teuthology.orchestra.run.smithi103.stdout:(11/12): openblas-openmp-0.3.21-2.el9.x86_64.rp 4.7 MB/s | 4.7 MB 00:01 2024-02-09T07:52:26.137 INFO:teuthology.orchestra.run.smithi062.stdout:rbd-fuse-19.0.0-1310.g0089f33e.el9.x86_64.rpm 178 kB/s | 85 kB 00:00 2024-02-09T07:52:26.137 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:52:26.138 INFO:teuthology.orchestra.run.smithi062.stdout:Total 177 kB/s | 85 kB 00:00 2024-02-09T07:52:26.138 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-02-09T07:52:26.145 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-02-09T07:52:26.145 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-02-09T07:52:26.208 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-02-09T07:52:26.208 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-02-09T07:52:26.276 INFO:teuthology.orchestra.run.smithi103.stdout:(12/12): ceph-mgr-diskprediction-local-19.0.0-1 4.2 MB/s | 7.4 MB 00:01 2024-02-09T07:52:26.278 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:52:26.279 INFO:teuthology.orchestra.run.smithi103.stdout:Total 17 MB/s | 38 MB 00:02 2024-02-09T07:52:26.467 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-02-09T07:52:26.563 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : rbd-fuse-2:19.0.0-1310.g0089f33e.el9.x86_64 1/1 2024-02-09T07:52:26.622 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-02-09T07:52:26.649 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-02-09T07:52:26.649 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-02-09T07:52:27.004 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: rbd-fuse-2:19.0.0-1310.g0089f33e.el9.x86_64 1/1 2024-02-09T07:52:27.088 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-02-09T07:52:27.089 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-02-09T07:52:27.376 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : rbd-fuse-2:19.0.0-1310.g0089f33e.el9.x86_64 1/1 2024-02-09T07:52:27.376 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:52:27.376 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-02-09T07:52:27.376 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-fuse-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:52:27.376 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:52:27.376 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-02-09T07:52:27.595 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install rbd-mirror 2024-02-09T07:52:27.861 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-02-09T07:52:27.930 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-02-09T07:52:27.974 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-02-09T07:52:28.074 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-02-09T07:52:28.109 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-02-09T07:52:28.218 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:02:34 ago on Fri 09 Feb 2024 07:49:54 AM UTC. 2024-02-09T07:52:28.279 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-02-09T07:52:28.308 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-02-09T07:52:28.385 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-02-09T07:52:28.528 INFO:teuthology.orchestra.run.smithi062.stderr:Modular dependency problems: 2024-02-09T07:52:28.528 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T07:52:28.528 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 1: conflicting requests 2024-02-09T07:52:28.528 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.529 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 2: conflicting requests 2024-02-09T07:52:28.529 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.529 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 3: conflicting requests 2024-02-09T07:52:28.529 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.529 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 4: conflicting requests 2024-02-09T07:52:28.529 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.529 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 5: conflicting requests 2024-02-09T07:52:28.529 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.529 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 6: conflicting requests 2024-02-09T07:52:28.529 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.529 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 7: conflicting requests 2024-02-09T07:52:28.529 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.529 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 8: conflicting requests 2024-02-09T07:52:28.530 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.530 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 9: conflicting requests 2024-02-09T07:52:28.530 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.530 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 10: conflicting requests 2024-02-09T07:52:28.530 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.530 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 11: conflicting requests 2024-02-09T07:52:28.530 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.530 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 12: conflicting requests 2024-02-09T07:52:28.530 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.530 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 13: conflicting requests 2024-02-09T07:52:28.530 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.530 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 14: conflicting requests 2024-02-09T07:52:28.530 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.531 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 15: conflicting requests 2024-02-09T07:52:28.531 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.531 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 16: conflicting requests 2024-02-09T07:52:28.531 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.531 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 17: conflicting requests 2024-02-09T07:52:28.531 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.531 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 18: conflicting requests 2024-02-09T07:52:28.531 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.531 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 19: conflicting requests 2024-02-09T07:52:28.531 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.531 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 20: conflicting requests 2024-02-09T07:52:28.531 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.531 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 21: conflicting requests 2024-02-09T07:52:28.532 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.532 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 22: conflicting requests 2024-02-09T07:52:28.532 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.532 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 23: conflicting requests 2024-02-09T07:52:28.532 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.532 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 24: conflicting requests 2024-02-09T07:52:28.532 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.532 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 25: conflicting requests 2024-02-09T07:52:28.532 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.532 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 26: conflicting requests 2024-02-09T07:52:28.532 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.532 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 27: conflicting requests 2024-02-09T07:52:28.532 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.532 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 28: conflicting requests 2024-02-09T07:52:28.533 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.533 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 29: conflicting requests 2024-02-09T07:52:28.533 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.533 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 30: conflicting requests 2024-02-09T07:52:28.533 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.533 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 31: conflicting requests 2024-02-09T07:52:28.533 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.533 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 32: conflicting requests 2024-02-09T07:52:28.533 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.533 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 33: conflicting requests 2024-02-09T07:52:28.533 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.533 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 34: conflicting requests 2024-02-09T07:52:28.534 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.534 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 35: conflicting requests 2024-02-09T07:52:28.534 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.534 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 36: conflicting requests 2024-02-09T07:52:28.534 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.534 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 37: conflicting requests 2024-02-09T07:52:28.534 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.534 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.534 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.534 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:52:28.534 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.534 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.534 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.535 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.535 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 39: conflicting requests 2024-02-09T07:52:28.535 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.535 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.535 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.535 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.535 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.535 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.535 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:52:28.535 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.535 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.535 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.535 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.535 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:52:28.536 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.536 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.536 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.536 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.536 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:52:28.536 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.536 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.536 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.536 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.536 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:52:28.536 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.536 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.536 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.536 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.537 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:52:28.537 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.537 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.537 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.537 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.537 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:52:28.537 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.537 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.537 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.537 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:52:28.600 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-02-09T07:52:28.601 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:52:28.601 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repo Size 2024-02-09T07:52:28.601 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:52:28.601 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-02-09T07:52:28.601 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-mirror x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 3.1 M 2024-02-09T07:52:28.601 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:52:28.601 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-02-09T07:52:28.601 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:52:28.601 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2024-02-09T07:52:28.601 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:52:28.602 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 3.1 M 2024-02-09T07:52:28.602 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 13 M 2024-02-09T07:52:28.602 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-02-09T07:52:29.049 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-02-09T07:52:29.188 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-02-09T07:52:29.523 INFO:teuthology.orchestra.run.smithi062.stdout:rbd-mirror-19.0.0-1310.g0089f33e.el9.x86_64.rpm 3.4 MB/s | 3.1 MB 00:00 2024-02-09T07:52:29.523 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:52:29.524 INFO:teuthology.orchestra.run.smithi062.stdout:Total 3.3 MB/s | 3.1 MB 00:00 2024-02-09T07:52:29.524 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-02-09T07:52:29.534 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-02-09T07:52:29.534 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-02-09T07:52:29.617 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-02-09T07:52:29.617 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-02-09T07:52:30.074 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-02-09T07:52:30.132 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : rbd-mirror-2:19.0.0-1310.g0089f33e.el9.x86_64 1/1 2024-02-09T07:52:30.156 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1310.g0089f33e.el9.x86_64 1/1 2024-02-09T07:52:30.156 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-09T07:52:30.156 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-09T07:52:30.156 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-09T07:52:30.156 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-09T07:52:30.156 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:52:30.451 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-02-09T07:52:31.367 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : rbd-mirror-2:19.0.0-1310.g0089f33e.el9.x86_64 1/1 2024-02-09T07:52:31.367 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:52:31.367 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-02-09T07:52:31.367 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-mirror-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:52:31.368 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:52:31.368 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-02-09T07:52:31.491 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-02-09T07:52:31.517 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1310.g0089f 12/12 2024-02-09T07:52:31.646 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install rbd-nbd 2024-02-09T07:52:32.261 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:02:38 ago on Fri 09 Feb 2024 07:49:54 AM UTC. 2024-02-09T07:52:32.568 INFO:teuthology.orchestra.run.smithi062.stderr:Modular dependency problems: 2024-02-09T07:52:32.568 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T07:52:32.568 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 1: conflicting requests 2024-02-09T07:52:32.568 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.569 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 2: conflicting requests 2024-02-09T07:52:32.569 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.569 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 3: conflicting requests 2024-02-09T07:52:32.569 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.569 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 4: conflicting requests 2024-02-09T07:52:32.569 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.570 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 5: conflicting requests 2024-02-09T07:52:32.570 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.570 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 6: conflicting requests 2024-02-09T07:52:32.570 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.570 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 7: conflicting requests 2024-02-09T07:52:32.570 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.570 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 8: conflicting requests 2024-02-09T07:52:32.570 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.570 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 9: conflicting requests 2024-02-09T07:52:32.570 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.570 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 10: conflicting requests 2024-02-09T07:52:32.570 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.571 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 11: conflicting requests 2024-02-09T07:52:32.571 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.571 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 12: conflicting requests 2024-02-09T07:52:32.571 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.571 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 13: conflicting requests 2024-02-09T07:52:32.571 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.571 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 14: conflicting requests 2024-02-09T07:52:32.571 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.571 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 15: conflicting requests 2024-02-09T07:52:32.571 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.571 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 16: conflicting requests 2024-02-09T07:52:32.571 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.571 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 17: conflicting requests 2024-02-09T07:52:32.571 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.572 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 18: conflicting requests 2024-02-09T07:52:32.572 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.572 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 19: conflicting requests 2024-02-09T07:52:32.572 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.572 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 20: conflicting requests 2024-02-09T07:52:32.572 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.573 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 21: conflicting requests 2024-02-09T07:52:32.573 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.573 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 22: conflicting requests 2024-02-09T07:52:32.573 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.573 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 23: conflicting requests 2024-02-09T07:52:32.573 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.574 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 24: conflicting requests 2024-02-09T07:52:32.574 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.574 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 25: conflicting requests 2024-02-09T07:52:32.574 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.574 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 26: conflicting requests 2024-02-09T07:52:32.575 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.575 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 27: conflicting requests 2024-02-09T07:52:32.575 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.575 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 28: conflicting requests 2024-02-09T07:52:32.575 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.575 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 29: conflicting requests 2024-02-09T07:52:32.576 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.576 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 30: conflicting requests 2024-02-09T07:52:32.576 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.576 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 31: conflicting requests 2024-02-09T07:52:32.576 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.577 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 32: conflicting requests 2024-02-09T07:52:32.577 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.577 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 33: conflicting requests 2024-02-09T07:52:32.577 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.577 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 34: conflicting requests 2024-02-09T07:52:32.577 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.578 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 35: conflicting requests 2024-02-09T07:52:32.578 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.578 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 36: conflicting requests 2024-02-09T07:52:32.578 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.578 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 37: conflicting requests 2024-02-09T07:52:32.578 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.579 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.579 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.579 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:52:32.579 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.580 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.580 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.580 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.580 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 39: conflicting requests 2024-02-09T07:52:32.580 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.581 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.581 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.581 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.581 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.581 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.581 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:52:32.582 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.582 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.582 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.582 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.582 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:52:32.583 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.583 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.583 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.583 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.583 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:52:32.583 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.584 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.584 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.584 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.584 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:52:32.584 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.584 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.586 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.586 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.587 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:52:32.587 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.587 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.587 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.587 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.587 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:52:32.587 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.587 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.587 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.587 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:52:32.641 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-02-09T07:52:32.641 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:52:32.642 INFO:teuthology.orchestra.run.smithi062.stdout: Package Architecture Version Repository Size 2024-02-09T07:52:32.642 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:52:32.642 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-02-09T07:52:32.642 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-nbd x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 171 k 2024-02-09T07:52:32.642 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:52:32.642 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-02-09T07:52:32.642 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:52:32.642 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2024-02-09T07:52:32.642 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:52:32.642 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 171 k 2024-02-09T07:52:32.642 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 494 k 2024-02-09T07:52:32.643 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-02-09T07:52:33.001 INFO:teuthology.orchestra.run.smithi062.stdout:rbd-nbd-19.0.0-1310.g0089f33e.el9.x86_64.rpm 478 kB/s | 171 kB 00:00 2024-02-09T07:52:33.001 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:52:33.001 INFO:teuthology.orchestra.run.smithi062.stdout:Total 476 kB/s | 171 kB 00:00 2024-02-09T07:52:33.002 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-02-09T07:52:33.011 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-02-09T07:52:33.011 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-02-09T07:52:33.075 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-02-09T07:52:33.076 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-02-09T07:52:33.259 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-02-09T07:52:33.360 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : rbd-nbd-2:19.0.0-1310.g0089f33e.el9.x86_64 1/1 2024-02-09T07:52:33.818 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: rbd-nbd-2:19.0.0-1310.g0089f33e.el9.x86_64 1/1 2024-02-09T07:52:34.178 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : rbd-nbd-2:19.0.0-1310.g0089f33e.el9.x86_64 1/1 2024-02-09T07:52:34.178 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:52:34.178 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-02-09T07:52:34.178 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-nbd-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:52:34.178 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:52:34.178 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-02-09T07:52:34.185 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1310.g0089f 12/12 2024-02-09T07:52:34.185 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1310.g0089f 1/12 2024-02-09T07:52:34.185 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-02-09T07:52:34.185 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-02-09T07:52:34.185 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-02-09T07:52:34.185 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-02-09T07:52:34.185 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-02-09T07:52:34.185 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-02-09T07:52:34.185 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-02-09T07:52:34.185 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 9/12 2024-02-09T07:52:34.185 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-02-09T07:52:34.185 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-02-09T07:52:34.370 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-base-debuginfo 2024-02-09T07:52:34.648 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-02-09T07:52:34.648 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:52:34.648 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-02-09T07:52:34.649 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1310.g0089f33e.el9.noarch 2024-02-09T07:52:34.649 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-09T07:52:34.649 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-09T07:52:34.649 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-09T07:52:34.649 INFO:teuthology.orchestra.run.smithi103.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-09T07:52:34.649 INFO:teuthology.orchestra.run.smithi103.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-09T07:52:34.649 INFO:teuthology.orchestra.run.smithi103.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-09T07:52:34.649 INFO:teuthology.orchestra.run.smithi103.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-09T07:52:34.649 INFO:teuthology.orchestra.run.smithi103.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-09T07:52:34.649 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-09T07:52:34.649 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-09T07:52:34.649 INFO:teuthology.orchestra.run.smithi103.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-09T07:52:34.649 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:52:34.649 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-02-09T07:52:34.989 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:02:40 ago on Fri 09 Feb 2024 07:49:54 AM UTC. 2024-02-09T07:52:35.017 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-mgr-rook 2024-02-09T07:52:35.297 INFO:teuthology.orchestra.run.smithi062.stderr:Modular dependency problems: 2024-02-09T07:52:35.297 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T07:52:35.297 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 1: conflicting requests 2024-02-09T07:52:35.297 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.297 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 2: conflicting requests 2024-02-09T07:52:35.297 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.297 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 3: conflicting requests 2024-02-09T07:52:35.297 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.297 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 4: conflicting requests 2024-02-09T07:52:35.297 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.298 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 5: conflicting requests 2024-02-09T07:52:35.298 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.298 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 6: conflicting requests 2024-02-09T07:52:35.298 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.298 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 7: conflicting requests 2024-02-09T07:52:35.298 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.298 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 8: conflicting requests 2024-02-09T07:52:35.298 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.298 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 9: conflicting requests 2024-02-09T07:52:35.298 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.298 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 10: conflicting requests 2024-02-09T07:52:35.298 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.298 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 11: conflicting requests 2024-02-09T07:52:35.299 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.299 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 12: conflicting requests 2024-02-09T07:52:35.299 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.299 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 13: conflicting requests 2024-02-09T07:52:35.299 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.299 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 14: conflicting requests 2024-02-09T07:52:35.299 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.299 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 15: conflicting requests 2024-02-09T07:52:35.299 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.299 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 16: conflicting requests 2024-02-09T07:52:35.299 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.299 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 17: conflicting requests 2024-02-09T07:52:35.299 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.299 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 18: conflicting requests 2024-02-09T07:52:35.299 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.300 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 19: conflicting requests 2024-02-09T07:52:35.300 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.300 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 20: conflicting requests 2024-02-09T07:52:35.300 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.300 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 21: conflicting requests 2024-02-09T07:52:35.300 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.300 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 22: conflicting requests 2024-02-09T07:52:35.300 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.300 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 23: conflicting requests 2024-02-09T07:52:35.300 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.300 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 24: conflicting requests 2024-02-09T07:52:35.300 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.300 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 25: conflicting requests 2024-02-09T07:52:35.301 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.301 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 26: conflicting requests 2024-02-09T07:52:35.301 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.301 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 27: conflicting requests 2024-02-09T07:52:35.301 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.301 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 28: conflicting requests 2024-02-09T07:52:35.301 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.301 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 29: conflicting requests 2024-02-09T07:52:35.301 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.301 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 30: conflicting requests 2024-02-09T07:52:35.301 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.301 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 31: conflicting requests 2024-02-09T07:52:35.301 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.301 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 32: conflicting requests 2024-02-09T07:52:35.302 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.302 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 33: conflicting requests 2024-02-09T07:52:35.302 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.302 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 34: conflicting requests 2024-02-09T07:52:35.302 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.302 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 35: conflicting requests 2024-02-09T07:52:35.302 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.302 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 36: conflicting requests 2024-02-09T07:52:35.302 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.302 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 37: conflicting requests 2024-02-09T07:52:35.302 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.302 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.302 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.303 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:52:35.303 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.303 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.303 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.303 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.303 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 39: conflicting requests 2024-02-09T07:52:35.303 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.303 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.303 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.303 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.303 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.303 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.303 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:52:35.303 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.304 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.304 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.304 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.304 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:52:35.304 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.304 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.304 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.304 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.304 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:52:35.304 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.304 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.304 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.304 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.305 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:52:35.305 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.305 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.305 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.305 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.305 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:52:35.305 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.305 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.305 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.305 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.306 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:52:35.306 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.307 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.307 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.307 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.368 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-02-09T07:52:35.368 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:52:35.369 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repo Size 2024-02-09T07:52:35.369 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:52:35.369 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-02-09T07:52:35.369 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-base-debuginfo x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 67 M 2024-02-09T07:52:35.369 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-02-09T07:52:35.369 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-debuginfo x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 22 M 2024-02-09T07:52:35.369 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:52:35.369 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-02-09T07:52:35.369 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:52:35.369 INFO:teuthology.orchestra.run.smithi062.stdout:Install 2 Packages 2024-02-09T07:52:35.369 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:52:35.370 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 89 M 2024-02-09T07:52:35.370 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 490 M 2024-02-09T07:52:35.370 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-02-09T07:52:35.626 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:02:40 ago on Fri 09 Feb 2024 07:49:55 AM UTC. 2024-02-09T07:52:35.920 INFO:teuthology.orchestra.run.smithi103.stderr:Modular dependency problems: 2024-02-09T07:52:35.920 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T07:52:35.920 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 1: conflicting requests 2024-02-09T07:52:35.920 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.920 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 2: conflicting requests 2024-02-09T07:52:35.920 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.920 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 3: conflicting requests 2024-02-09T07:52:35.920 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.920 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 4: conflicting requests 2024-02-09T07:52:35.920 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.920 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 5: conflicting requests 2024-02-09T07:52:35.920 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.921 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 6: conflicting requests 2024-02-09T07:52:35.921 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.921 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 7: conflicting requests 2024-02-09T07:52:35.921 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.921 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 8: conflicting requests 2024-02-09T07:52:35.921 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.921 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 9: conflicting requests 2024-02-09T07:52:35.921 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.921 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 10: conflicting requests 2024-02-09T07:52:35.921 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.921 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 11: conflicting requests 2024-02-09T07:52:35.921 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.921 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 12: conflicting requests 2024-02-09T07:52:35.921 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.922 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 13: conflicting requests 2024-02-09T07:52:35.922 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.922 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 14: conflicting requests 2024-02-09T07:52:35.922 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.922 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 15: conflicting requests 2024-02-09T07:52:35.922 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.922 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 16: conflicting requests 2024-02-09T07:52:35.922 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.922 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 17: conflicting requests 2024-02-09T07:52:35.922 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.922 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 18: conflicting requests 2024-02-09T07:52:35.922 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.922 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 19: conflicting requests 2024-02-09T07:52:35.923 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.923 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 20: conflicting requests 2024-02-09T07:52:35.923 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.923 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 21: conflicting requests 2024-02-09T07:52:35.923 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.923 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 22: conflicting requests 2024-02-09T07:52:35.923 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.923 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 23: conflicting requests 2024-02-09T07:52:35.923 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.923 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 24: conflicting requests 2024-02-09T07:52:35.923 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.923 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 25: conflicting requests 2024-02-09T07:52:35.923 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.923 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 26: conflicting requests 2024-02-09T07:52:35.924 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.924 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 27: conflicting requests 2024-02-09T07:52:35.924 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.924 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 28: conflicting requests 2024-02-09T07:52:35.924 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.924 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 29: conflicting requests 2024-02-09T07:52:35.924 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.924 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 30: conflicting requests 2024-02-09T07:52:35.924 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.924 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 31: conflicting requests 2024-02-09T07:52:35.924 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.924 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 32: conflicting requests 2024-02-09T07:52:35.924 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.925 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 33: conflicting requests 2024-02-09T07:52:35.925 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.925 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 34: conflicting requests 2024-02-09T07:52:35.925 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.926 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 35: conflicting requests 2024-02-09T07:52:35.926 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.926 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 36: conflicting requests 2024-02-09T07:52:35.926 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.926 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 37: conflicting requests 2024-02-09T07:52:35.926 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.926 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.926 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.926 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:52:35.927 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.927 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.927 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.927 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.927 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 39: conflicting requests 2024-02-09T07:52:35.927 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.927 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.927 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.927 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.927 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.927 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.927 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:52:35.927 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.927 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.927 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.928 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.928 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:52:35.928 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.928 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.928 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.928 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.928 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:52:35.928 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.928 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.928 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.928 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.928 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:52:35.928 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.929 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.929 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.929 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.929 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:52:35.929 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.929 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.929 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.929 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.929 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:52:35.929 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.929 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.929 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.929 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:52:35.987 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-02-09T07:52:35.988 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:52:35.988 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-02-09T07:52:35.989 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:52:35.989 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-02-09T07:52:35.989 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-rook noarch 2:19.0.0-1310.g0089f33e.el9 ceph-noarch 52 k 2024-02-09T07:52:35.989 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-02-09T07:52:35.989 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-09T07:52:35.989 INFO:teuthology.orchestra.run.smithi103.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-09T07:52:35.989 INFO:teuthology.orchestra.run.smithi103.stdout: python3-google-auth noarch 1:2.27.0-1.el9 epel 203 k 2024-02-09T07:52:35.990 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-02-09T07:52:35.990 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-02-09T07:52:35.990 INFO:teuthology.orchestra.run.smithi103.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-09T07:52:35.990 INFO:teuthology.orchestra.run.smithi103.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-02-09T07:52:35.990 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-02-09T07:52:35.990 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-02-09T07:52:35.991 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-02-09T07:52:35.991 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-09T07:52:35.991 INFO:teuthology.orchestra.run.smithi103.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-09T07:52:35.991 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:52:35.991 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-02-09T07:52:35.991 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:52:35.992 INFO:teuthology.orchestra.run.smithi103.stdout:Install 13 Packages 2024-02-09T07:52:35.992 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:52:35.993 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 2.2 M 2024-02-09T07:52:35.993 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 26 M 2024-02-09T07:52:35.993 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-02-09T07:52:36.436 INFO:teuthology.orchestra.run.smithi103.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 185 kB/s | 26 kB 00:00 2024-02-09T07:52:36.461 INFO:teuthology.orchestra.run.smithi103.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 117 kB/s | 19 kB 00:00 2024-02-09T07:52:36.620 INFO:teuthology.orchestra.run.smithi103.stdout:(3/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.0 MB/s | 159 kB 00:00 2024-02-09T07:52:36.645 INFO:teuthology.orchestra.run.smithi103.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.0 MB/s | 222 kB 00:00 2024-02-09T07:52:36.670 INFO:teuthology.orchestra.run.smithi103.stdout:(5/13): ceph-mgr-rook-19.0.0-1310.g0089f33e.el9 140 kB/s | 52 kB 00:00 2024-02-09T07:52:36.704 INFO:teuthology.orchestra.run.smithi103.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 918 kB/s | 54 kB 00:00 2024-02-09T07:52:36.729 INFO:teuthology.orchestra.run.smithi103.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.5 MB/s | 279 kB 00:00 2024-02-09T07:52:36.938 INFO:teuthology.orchestra.run.smithi103.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 120 kB/s | 32 kB 00:00 2024-02-09T07:52:36.971 INFO:teuthology.orchestra.run.smithi103.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 56 kB/s | 15 kB 00:00 2024-02-09T07:52:37.238 INFO:teuthology.orchestra.run.smithi103.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 222 kB/s | 59 kB 00:00 2024-02-09T07:52:37.263 INFO:teuthology.orchestra.run.smithi103.stdout:(11/13): python3-google-auth-2.27.0-1.el9.noarc 379 kB/s | 203 kB 00:00 2024-02-09T07:52:37.422 INFO:teuthology.orchestra.run.smithi103.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 489 kB/s | 90 kB 00:00 2024-02-09T07:52:37.456 INFO:teuthology.orchestra.run.smithi103.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 2.0 MB/s | 1.0 MB 00:00 2024-02-09T07:52:37.456 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:52:37.456 INFO:teuthology.orchestra.run.smithi103.stdout:Total 1.5 MB/s | 2.2 MB 00:01 2024-02-09T07:52:37.518 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-02-09T07:52:37.533 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-02-09T07:52:37.533 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-02-09T07:52:37.641 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-02-09T07:52:37.642 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-02-09T07:52:38.180 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-02-09T07:52:38.339 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-02-09T07:52:38.390 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-02-09T07:52:38.420 INFO:teuthology.orchestra.run.smithi062.stdout:(1/2): ceph-debuginfo-19.0.0-1310.g0089f33e.el9 7.3 MB/s | 22 MB 00:03 2024-02-09T07:52:38.454 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-02-09T07:52:38.492 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-02-09T07:52:38.533 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-02-09T07:52:38.627 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-02-09T07:52:38.736 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-google-auth-1:2.27.0-1.el9.noarch 7/13 2024-02-09T07:52:38.802 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-02-09T07:52:39.532 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-02-09T07:52:39.574 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-02-09T07:52:39.607 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-02-09T07:52:39.656 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-02-09T07:52:39.677 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-rook-2:19.0.0-1310.g0089f33e.el9.noarch 13/13 2024-02-09T07:52:40.512 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1310.g0089f33e.el9.noarch 13/13 2024-02-09T07:52:40.512 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1310.g0089f33e.el9.noarch 1/13 2024-02-09T07:52:40.512 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-02-09T07:52:40.512 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-02-09T07:52:40.512 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-02-09T07:52:40.512 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-02-09T07:52:40.512 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-02-09T07:52:40.512 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-02-09T07:52:40.512 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-02-09T07:52:40.513 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-02-09T07:52:40.513 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-google-auth-1:2.27.0-1.el9.noarch 10/13 2024-02-09T07:52:40.513 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-02-09T07:52:40.513 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-02-09T07:52:40.820 INFO:teuthology.orchestra.run.smithi062.stdout:(2/2): ceph-base-debuginfo-19.0.0-1310.g0089f33 12 MB/s | 67 MB 00:05 2024-02-09T07:52:40.822 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:52:40.822 INFO:teuthology.orchestra.run.smithi062.stdout:Total 16 MB/s | 89 MB 00:05 2024-02-09T07:52:40.823 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-02-09T07:52:40.828 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-02-09T07:52:40.828 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-02-09T07:52:40.911 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-02-09T07:52:40.911 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:52:40.912 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-02-09T07:52:40.912 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-rook-2:19.0.0-1310.g0089f33e.el9.noarch 2024-02-09T07:52:40.912 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-09T07:52:40.912 INFO:teuthology.orchestra.run.smithi103.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-09T07:52:40.912 INFO:teuthology.orchestra.run.smithi103.stdout: python3-google-auth-1:2.27.0-1.el9.noarch 2024-02-09T07:52:40.912 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-09T07:52:40.912 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-09T07:52:40.912 INFO:teuthology.orchestra.run.smithi103.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-09T07:52:40.912 INFO:teuthology.orchestra.run.smithi103.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-09T07:52:40.912 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-09T07:52:40.912 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-09T07:52:40.912 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-09T07:52:40.913 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-09T07:52:40.913 INFO:teuthology.orchestra.run.smithi103.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-09T07:52:40.913 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:52:40.913 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-02-09T07:52:41.176 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-mgr-cephadm 2024-02-09T07:52:41.431 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-02-09T07:52:41.431 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-02-09T07:52:41.780 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:02:46 ago on Fri 09 Feb 2024 07:49:55 AM UTC. 2024-02-09T07:52:42.074 INFO:teuthology.orchestra.run.smithi103.stderr:Modular dependency problems: 2024-02-09T07:52:42.074 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T07:52:42.074 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 1: conflicting requests 2024-02-09T07:52:42.074 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.074 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 2: conflicting requests 2024-02-09T07:52:42.074 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.074 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 3: conflicting requests 2024-02-09T07:52:42.074 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.075 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 4: conflicting requests 2024-02-09T07:52:42.075 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.075 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 5: conflicting requests 2024-02-09T07:52:42.075 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.075 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 6: conflicting requests 2024-02-09T07:52:42.075 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.075 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 7: conflicting requests 2024-02-09T07:52:42.075 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.075 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 8: conflicting requests 2024-02-09T07:52:42.075 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.075 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 9: conflicting requests 2024-02-09T07:52:42.075 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.075 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 10: conflicting requests 2024-02-09T07:52:42.075 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.075 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 11: conflicting requests 2024-02-09T07:52:42.076 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.076 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 12: conflicting requests 2024-02-09T07:52:42.076 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.076 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 13: conflicting requests 2024-02-09T07:52:42.076 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.076 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 14: conflicting requests 2024-02-09T07:52:42.076 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.076 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 15: conflicting requests 2024-02-09T07:52:42.076 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.076 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 16: conflicting requests 2024-02-09T07:52:42.076 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.076 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 17: conflicting requests 2024-02-09T07:52:42.076 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.077 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 18: conflicting requests 2024-02-09T07:52:42.077 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.077 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 19: conflicting requests 2024-02-09T07:52:42.077 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.077 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 20: conflicting requests 2024-02-09T07:52:42.077 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.077 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 21: conflicting requests 2024-02-09T07:52:42.077 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.077 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 22: conflicting requests 2024-02-09T07:52:42.077 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.077 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 23: conflicting requests 2024-02-09T07:52:42.077 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.077 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 24: conflicting requests 2024-02-09T07:52:42.078 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.078 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 25: conflicting requests 2024-02-09T07:52:42.078 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.078 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 26: conflicting requests 2024-02-09T07:52:42.078 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.078 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 27: conflicting requests 2024-02-09T07:52:42.078 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.078 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 28: conflicting requests 2024-02-09T07:52:42.078 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.078 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 29: conflicting requests 2024-02-09T07:52:42.078 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.078 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 30: conflicting requests 2024-02-09T07:52:42.078 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.078 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 31: conflicting requests 2024-02-09T07:52:42.078 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.079 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 32: conflicting requests 2024-02-09T07:52:42.079 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.079 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 33: conflicting requests 2024-02-09T07:52:42.079 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.079 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 34: conflicting requests 2024-02-09T07:52:42.079 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.079 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 35: conflicting requests 2024-02-09T07:52:42.079 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.079 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 36: conflicting requests 2024-02-09T07:52:42.079 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.079 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 37: conflicting requests 2024-02-09T07:52:42.079 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.079 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.079 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.080 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:52:42.080 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.080 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.080 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.080 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.080 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 39: conflicting requests 2024-02-09T07:52:42.080 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.080 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.080 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.080 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.080 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.080 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.080 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:52:42.081 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.081 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.081 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.081 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.081 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:52:42.081 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.081 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.081 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.081 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.081 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:52:42.081 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.081 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.081 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.081 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.081 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:52:42.082 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.082 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.082 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.082 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.082 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:52:42.082 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.082 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.082 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.082 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.082 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:52:42.082 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.082 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.082 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.082 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:52:42.143 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-02-09T07:52:42.143 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:52:42.144 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-02-09T07:52:42.144 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:52:42.144 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-02-09T07:52:42.144 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1310.g0089f33e.el9 ceph-noarch 138 k 2024-02-09T07:52:42.144 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-02-09T07:52:42.144 INFO:teuthology.orchestra.run.smithi103.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2024-02-09T07:52:42.144 INFO:teuthology.orchestra.run.smithi103.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-02-09T07:52:42.144 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jinja2 noarch 2.11.3-4.el9 appstream 249 k 2024-02-09T07:52:42.144 INFO:teuthology.orchestra.run.smithi103.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-09T07:52:42.144 INFO:teuthology.orchestra.run.smithi103.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-09T07:52:42.144 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:52:42.144 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-02-09T07:52:42.145 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:52:42.145 INFO:teuthology.orchestra.run.smithi103.stdout:Install 6 Packages 2024-02-09T07:52:42.145 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:52:42.145 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 7.0 M 2024-02-09T07:52:42.145 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 33 M 2024-02-09T07:52:42.145 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-02-09T07:52:42.552 INFO:teuthology.orchestra.run.smithi103.stdout:(1/6): ceph-mgr-cephadm-19.0.0-1310.g0089f33e.e 430 kB/s | 138 kB 00:00 2024-02-09T07:52:42.877 INFO:teuthology.orchestra.run.smithi103.stdout:(2/6): python3-jinja2-2.11.3-4.el9.noarch.rpm 387 kB/s | 249 kB 00:00 2024-02-09T07:52:43.003 INFO:teuthology.orchestra.run.smithi103.stdout:(3/6): python3-babel-2.9.1-2.el9.noarch.rpm 7.7 MB/s | 6.0 MB 00:00 2024-02-09T07:52:44.691 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-02-09T07:52:44.718 INFO:teuthology.orchestra.run.smithi103.stdout:[MIRROR] python3-typing-extensions-4.4.0-2.el9.noarch.rpm: Curl error (7): Couldn't connect to server for https://mirrors.ocf.berkeley.edu/fedora/epel/9/Everything/x86_64/Packages/p/python3-typing-extensions-4.4.0-2.el9.noarch.rpm [Failed to connect to mirrors.ocf.berkeley.edu port 443: No route to host] 2024-02-09T07:52:45.228 INFO:teuthology.orchestra.run.smithi103.stdout:[MIRROR] python3-asyncssh-2.13.2-3.el9.noarch.rpm: Curl error (7): Couldn't connect to server for https://mirrors.ocf.berkeley.edu/fedora/epel/9/Everything/x86_64/Packages/p/python3-asyncssh-2.13.2-3.el9.noarch.rpm [Failed to connect to mirrors.ocf.berkeley.edu port 443: No route to host] 2024-02-09T07:52:45.228 INFO:teuthology.orchestra.run.smithi103.stdout:[MIRROR] python3-natsort-7.1.1-5.el9.noarch.rpm: Curl error (7): Couldn't connect to server for https://mirrors.ocf.berkeley.edu/fedora/epel/9/Everything/x86_64/Packages/p/python3-natsort-7.1.1-5.el9.noarch.rpm [Failed to connect to mirrors.ocf.berkeley.edu port 443: No route to host] 2024-02-09T07:52:47.937 INFO:teuthology.orchestra.run.smithi103.stdout:[MIRROR] python3-typing-extensions-4.4.0-2.el9.noarch.rpm: Curl error (7): Couldn't connect to server for http://mirrors.ocf.berkeley.edu/fedora/epel/9/Everything/x86_64/Packages/p/python3-typing-extensions-4.4.0-2.el9.noarch.rpm [Failed to connect to mirrors.ocf.berkeley.edu port 80: No route to host] 2024-02-09T07:52:47.937 INFO:teuthology.orchestra.run.smithi103.stdout:[MIRROR] python3-asyncssh-2.13.2-3.el9.noarch.rpm: Curl error (7): Couldn't connect to server for http://mirrors.ocf.berkeley.edu/fedora/epel/9/Everything/x86_64/Packages/p/python3-asyncssh-2.13.2-3.el9.noarch.rpm [Failed to connect to mirrors.ocf.berkeley.edu port 80: No route to host] 2024-02-09T07:52:48.044 INFO:teuthology.orchestra.run.smithi103.stdout:(4/6): python3-typing-extensions-4.4.0-2.el9.no 10 kB/s | 51 kB 00:05 2024-02-09T07:52:48.111 INFO:teuthology.orchestra.run.smithi103.stdout:(5/6): python3-asyncssh-2.13.2-3.el9.noarch.rpm 99 kB/s | 548 kB 00:05 2024-02-09T07:52:48.299 INFO:teuthology.orchestra.run.smithi103.stdout:[MIRROR] python3-natsort-7.1.1-5.el9.noarch.rpm: Curl error (7): Couldn't connect to server for http://mirrors.ocf.berkeley.edu/fedora/epel/9/Everything/x86_64/Packages/p/python3-natsort-7.1.1-5.el9.noarch.rpm [Failed to connect to mirrors.ocf.berkeley.edu port 80: No route to host] 2024-02-09T07:52:48.345 INFO:teuthology.orchestra.run.smithi103.stdout:(6/6): python3-natsort-7.1.1-5.el9.noarch.rpm 11 kB/s | 58 kB 00:05 2024-02-09T07:52:48.345 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:52:48.345 INFO:teuthology.orchestra.run.smithi103.stdout:Total 1.1 MB/s | 7.0 MB 00:06 2024-02-09T07:52:48.417 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-02-09T07:52:48.429 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-02-09T07:52:48.429 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-02-09T07:52:48.535 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-02-09T07:52:48.535 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-02-09T07:52:48.849 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-02-09T07:52:49.016 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-02-09T07:52:49.079 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 2/6 2024-02-09T07:52:49.587 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-02-09T07:52:49.690 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-02-09T07:52:49.761 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 5/6 2024-02-09T07:52:49.784 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1310.g0089f33e.el9.noarch 6/6 2024-02-09T07:52:50.611 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1310.g0089f33e.el9.noarch 6/6 2024-02-09T07:52:50.611 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1310.g0089f33e.el9.noarch 1/6 2024-02-09T07:52:50.611 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-02-09T07:52:50.611 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 3/6 2024-02-09T07:52:50.611 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 4/6 2024-02-09T07:52:50.612 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-02-09T07:52:50.932 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-02-09T07:52:50.932 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:52:50.932 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-02-09T07:52:50.933 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-cephadm-2:19.0.0-1310.g0089f33e.el9.noarch 2024-02-09T07:52:50.933 INFO:teuthology.orchestra.run.smithi103.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2024-02-09T07:52:50.933 INFO:teuthology.orchestra.run.smithi103.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-09T07:52:50.933 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jinja2-2.11.3-4.el9.noarch 2024-02-09T07:52:50.933 INFO:teuthology.orchestra.run.smithi103.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-09T07:52:50.933 INFO:teuthology.orchestra.run.smithi103.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-09T07:52:50.933 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:52:50.933 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-02-09T07:52:51.183 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-fuse 2024-02-09T07:52:51.784 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:02:56 ago on Fri 09 Feb 2024 07:49:55 AM UTC. 2024-02-09T07:52:52.041 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 1/2 2024-02-09T07:52:52.078 INFO:teuthology.orchestra.run.smithi103.stderr:Modular dependency problems: 2024-02-09T07:52:52.078 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T07:52:52.078 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 1: conflicting requests 2024-02-09T07:52:52.078 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.078 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 2: conflicting requests 2024-02-09T07:52:52.078 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.078 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 3: conflicting requests 2024-02-09T07:52:52.078 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.078 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 4: conflicting requests 2024-02-09T07:52:52.079 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.079 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 5: conflicting requests 2024-02-09T07:52:52.079 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.079 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 6: conflicting requests 2024-02-09T07:52:52.079 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.079 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 7: conflicting requests 2024-02-09T07:52:52.079 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.079 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 8: conflicting requests 2024-02-09T07:52:52.079 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.079 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 9: conflicting requests 2024-02-09T07:52:52.079 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.079 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 10: conflicting requests 2024-02-09T07:52:52.079 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.080 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 11: conflicting requests 2024-02-09T07:52:52.080 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.080 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 12: conflicting requests 2024-02-09T07:52:52.080 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.080 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 13: conflicting requests 2024-02-09T07:52:52.080 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.080 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 14: conflicting requests 2024-02-09T07:52:52.080 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.080 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 15: conflicting requests 2024-02-09T07:52:52.080 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.080 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 16: conflicting requests 2024-02-09T07:52:52.080 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.080 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 17: conflicting requests 2024-02-09T07:52:52.081 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.081 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 18: conflicting requests 2024-02-09T07:52:52.081 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.081 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 19: conflicting requests 2024-02-09T07:52:52.081 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.081 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 20: conflicting requests 2024-02-09T07:52:52.081 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.081 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 21: conflicting requests 2024-02-09T07:52:52.081 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.081 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 22: conflicting requests 2024-02-09T07:52:52.081 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.081 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 23: conflicting requests 2024-02-09T07:52:52.081 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.082 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 24: conflicting requests 2024-02-09T07:52:52.082 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.082 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 25: conflicting requests 2024-02-09T07:52:52.082 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.082 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 26: conflicting requests 2024-02-09T07:52:52.082 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.082 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 27: conflicting requests 2024-02-09T07:52:52.082 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.082 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 28: conflicting requests 2024-02-09T07:52:52.082 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.082 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 29: conflicting requests 2024-02-09T07:52:52.082 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.082 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 30: conflicting requests 2024-02-09T07:52:52.083 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.083 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 31: conflicting requests 2024-02-09T07:52:52.083 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.083 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 32: conflicting requests 2024-02-09T07:52:52.083 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.083 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 33: conflicting requests 2024-02-09T07:52:52.083 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.083 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 34: conflicting requests 2024-02-09T07:52:52.083 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.083 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 35: conflicting requests 2024-02-09T07:52:52.083 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.083 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 36: conflicting requests 2024-02-09T07:52:52.083 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.083 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 37: conflicting requests 2024-02-09T07:52:52.084 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.084 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.084 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.084 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:52:52.084 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.084 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.084 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.084 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.084 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 39: conflicting requests 2024-02-09T07:52:52.084 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.084 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.084 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.084 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.085 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.085 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.085 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:52:52.085 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.085 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.085 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.085 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.085 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:52:52.085 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.085 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.085 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.085 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.085 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:52:52.086 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.086 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.086 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.086 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.086 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:52:52.086 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.086 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.086 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.086 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.086 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:52:52.086 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.086 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.086 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.087 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.087 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:52:52.087 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.087 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.087 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.087 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:52:52.115 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-base-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_ 2/2 2024-02-09T07:52:52.145 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-02-09T07:52:52.145 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:52:52.145 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-02-09T07:52:52.145 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:52:52.145 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-02-09T07:52:52.145 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-fuse x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 886 k 2024-02-09T07:52:52.146 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-02-09T07:52:52.146 INFO:teuthology.orchestra.run.smithi103.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-02-09T07:52:52.146 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:52:52.146 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-02-09T07:52:52.146 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:52:52.146 INFO:teuthology.orchestra.run.smithi103.stdout:Install 2 Packages 2024-02-09T07:52:52.146 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:52:52.147 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 966 k 2024-02-09T07:52:52.147 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 2.8 M 2024-02-09T07:52:52.147 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-02-09T07:52:52.539 INFO:teuthology.orchestra.run.smithi103.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 229 kB/s | 80 kB 00:00 2024-02-09T07:52:52.606 INFO:teuthology.orchestra.run.smithi103.stdout:(2/2): ceph-fuse-19.0.0-1310.g0089f33e.el9.x86_ 2.1 MB/s | 886 kB 00:00 2024-02-09T07:52:52.606 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:52:52.607 INFO:teuthology.orchestra.run.smithi103.stdout:Total 2.0 MB/s | 966 kB 00:00 2024-02-09T07:52:52.618 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-02-09T07:52:52.638 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-02-09T07:52:52.638 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-02-09T07:52:52.719 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-02-09T07:52:52.719 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-02-09T07:52:52.903 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-02-09T07:52:53.023 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-02-09T07:52:53.090 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-fuse-2:19.0.0-1310.g0089f33e.el9.x86_64 2/2 2024-02-09T07:52:53.787 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-fuse-2:19.0.0-1310.g0089f33e.el9.x86_64 2/2 2024-02-09T07:52:53.788 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-fuse-2:19.0.0-1310.g0089f33e.el9.x86_64 1/2 2024-02-09T07:52:54.155 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-02-09T07:52:54.156 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:52:54.156 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-02-09T07:52:54.156 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-fuse-2:19.0.0-1310.g0089f33e.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-02-09T07:52:54.156 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:52:54.156 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-02-09T07:52:54.420 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-volume 2024-02-09T07:52:55.057 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:03:00 ago on Fri 09 Feb 2024 07:49:55 AM UTC. 2024-02-09T07:52:55.352 INFO:teuthology.orchestra.run.smithi103.stderr:Modular dependency problems: 2024-02-09T07:52:55.352 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T07:52:55.352 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 1: conflicting requests 2024-02-09T07:52:55.352 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.352 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 2: conflicting requests 2024-02-09T07:52:55.352 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.352 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 3: conflicting requests 2024-02-09T07:52:55.352 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.352 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 4: conflicting requests 2024-02-09T07:52:55.352 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.352 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 5: conflicting requests 2024-02-09T07:52:55.353 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.353 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 6: conflicting requests 2024-02-09T07:52:55.353 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.353 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 7: conflicting requests 2024-02-09T07:52:55.353 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.353 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 8: conflicting requests 2024-02-09T07:52:55.353 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.353 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 9: conflicting requests 2024-02-09T07:52:55.353 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.353 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 10: conflicting requests 2024-02-09T07:52:55.353 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.353 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 11: conflicting requests 2024-02-09T07:52:55.353 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.353 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 12: conflicting requests 2024-02-09T07:52:55.354 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.354 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 13: conflicting requests 2024-02-09T07:52:55.354 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.354 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 14: conflicting requests 2024-02-09T07:52:55.354 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.354 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 15: conflicting requests 2024-02-09T07:52:55.354 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.354 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 16: conflicting requests 2024-02-09T07:52:55.354 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.354 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 17: conflicting requests 2024-02-09T07:52:55.354 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.354 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 18: conflicting requests 2024-02-09T07:52:55.355 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.355 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 19: conflicting requests 2024-02-09T07:52:55.355 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.355 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 20: conflicting requests 2024-02-09T07:52:55.355 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.355 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 21: conflicting requests 2024-02-09T07:52:55.355 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.355 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 22: conflicting requests 2024-02-09T07:52:55.355 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.355 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 23: conflicting requests 2024-02-09T07:52:55.355 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.355 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 24: conflicting requests 2024-02-09T07:52:55.355 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.356 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 25: conflicting requests 2024-02-09T07:52:55.356 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.356 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 26: conflicting requests 2024-02-09T07:52:55.356 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.356 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 27: conflicting requests 2024-02-09T07:52:55.356 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.356 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 28: conflicting requests 2024-02-09T07:52:55.356 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.356 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 29: conflicting requests 2024-02-09T07:52:55.356 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.356 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 30: conflicting requests 2024-02-09T07:52:55.356 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.356 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 31: conflicting requests 2024-02-09T07:52:55.357 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.357 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 32: conflicting requests 2024-02-09T07:52:55.357 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.357 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 33: conflicting requests 2024-02-09T07:52:55.357 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.357 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 34: conflicting requests 2024-02-09T07:52:55.357 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.357 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 35: conflicting requests 2024-02-09T07:52:55.357 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.357 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 36: conflicting requests 2024-02-09T07:52:55.357 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.357 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 37: conflicting requests 2024-02-09T07:52:55.357 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.357 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.357 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.358 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:52:55.358 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.358 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.358 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.358 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.358 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 39: conflicting requests 2024-02-09T07:52:55.358 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.358 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.358 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.358 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.358 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.358 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.358 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:52:55.358 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.359 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.359 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.359 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.359 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:52:55.359 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.359 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.359 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.359 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.359 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:52:55.359 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.359 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.359 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.360 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.360 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:52:55.360 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.360 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.360 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.360 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.360 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:52:55.360 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.360 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.360 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.360 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.360 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:52:55.360 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.361 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.361 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.361 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:52:55.420 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-02-09T07:52:55.422 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:52:55.422 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-02-09T07:52:55.422 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:52:55.422 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-02-09T07:52:55.422 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-volume noarch 2:19.0.0-1310.g0089f33e.el9 ceph-noarch 264 k 2024-02-09T07:52:55.422 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-02-09T07:52:55.422 INFO:teuthology.orchestra.run.smithi103.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-02-09T07:52:55.422 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:52:55.422 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-02-09T07:52:55.422 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:52:55.422 INFO:teuthology.orchestra.run.smithi103.stdout:Install 2 Packages 2024-02-09T07:52:55.422 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:52:55.423 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 341 k 2024-02-09T07:52:55.423 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 1.5 M 2024-02-09T07:52:55.423 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-02-09T07:52:55.453 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-base-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_ 2/2 2024-02-09T07:52:55.454 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-base-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_ 1/2 2024-02-09T07:52:55.767 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 2/2 2024-02-09T07:52:55.768 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:52:55.768 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-02-09T07:52:55.768 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-base-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:52:55.768 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:52:55.768 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:52:55.768 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-02-09T07:52:55.855 INFO:teuthology.orchestra.run.smithi103.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 485 kB/s | 77 kB 00:00 2024-02-09T07:52:55.972 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-common-debuginfo 2024-02-09T07:52:56.105 INFO:teuthology.orchestra.run.smithi103.stdout:(2/2): ceph-volume-19.0.0-1310.g0089f33e.el9.no 644 kB/s | 264 kB 00:00 2024-02-09T07:52:56.105 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:52:56.105 INFO:teuthology.orchestra.run.smithi103.stdout:Total 498 kB/s | 341 kB 00:00 2024-02-09T07:52:56.117 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-02-09T07:52:56.126 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-02-09T07:52:56.127 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-02-09T07:52:56.168 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-02-09T07:52:56.169 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-02-09T07:52:56.320 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-02-09T07:52:56.503 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-02-09T07:52:56.541 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-volume-2:19.0.0-1310.g0089f33e.el9.noarch 2/2 2024-02-09T07:52:56.558 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-volume-2:19.0.0-1310.g0089f33e.el9.noarch 2/2 2024-02-09T07:52:56.558 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-09T07:52:56.558 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-02-09T07:52:56.558 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:52:56.591 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:03:02 ago on Fri 09 Feb 2024 07:49:54 AM UTC. 2024-02-09T07:52:56.903 INFO:teuthology.orchestra.run.smithi062.stderr:Modular dependency problems: 2024-02-09T07:52:56.903 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T07:52:56.904 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 1: conflicting requests 2024-02-09T07:52:56.904 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.904 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 2: conflicting requests 2024-02-09T07:52:56.904 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.904 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 3: conflicting requests 2024-02-09T07:52:56.904 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.904 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 4: conflicting requests 2024-02-09T07:52:56.904 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.904 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 5: conflicting requests 2024-02-09T07:52:56.904 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.904 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 6: conflicting requests 2024-02-09T07:52:56.904 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.905 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 7: conflicting requests 2024-02-09T07:52:56.905 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.905 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 8: conflicting requests 2024-02-09T07:52:56.905 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.905 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 9: conflicting requests 2024-02-09T07:52:56.905 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.905 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 10: conflicting requests 2024-02-09T07:52:56.905 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.905 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 11: conflicting requests 2024-02-09T07:52:56.905 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.905 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 12: conflicting requests 2024-02-09T07:52:56.905 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.905 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 13: conflicting requests 2024-02-09T07:52:56.906 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.906 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 14: conflicting requests 2024-02-09T07:52:56.906 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.906 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 15: conflicting requests 2024-02-09T07:52:56.906 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.906 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 16: conflicting requests 2024-02-09T07:52:56.906 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.906 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 17: conflicting requests 2024-02-09T07:52:56.906 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.906 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 18: conflicting requests 2024-02-09T07:52:56.906 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.906 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 19: conflicting requests 2024-02-09T07:52:56.906 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.907 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 20: conflicting requests 2024-02-09T07:52:56.907 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.907 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 21: conflicting requests 2024-02-09T07:52:56.907 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.907 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 22: conflicting requests 2024-02-09T07:52:56.907 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.907 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 23: conflicting requests 2024-02-09T07:52:56.907 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.907 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 24: conflicting requests 2024-02-09T07:52:56.907 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.907 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 25: conflicting requests 2024-02-09T07:52:56.907 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.907 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 26: conflicting requests 2024-02-09T07:52:56.908 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.908 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 27: conflicting requests 2024-02-09T07:52:56.908 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.908 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 28: conflicting requests 2024-02-09T07:52:56.908 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.908 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 29: conflicting requests 2024-02-09T07:52:56.908 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.908 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 30: conflicting requests 2024-02-09T07:52:56.908 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.908 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 31: conflicting requests 2024-02-09T07:52:56.908 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.908 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 32: conflicting requests 2024-02-09T07:52:56.908 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.908 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 33: conflicting requests 2024-02-09T07:52:56.909 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.909 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 34: conflicting requests 2024-02-09T07:52:56.909 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.909 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 35: conflicting requests 2024-02-09T07:52:56.909 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.909 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 36: conflicting requests 2024-02-09T07:52:56.909 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.909 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 37: conflicting requests 2024-02-09T07:52:56.909 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.909 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.909 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.909 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:52:56.909 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.909 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.910 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.910 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.910 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 39: conflicting requests 2024-02-09T07:52:56.910 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.910 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.910 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.910 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.910 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.910 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.910 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:52:56.910 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.910 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.910 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.911 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.911 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:52:56.911 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.911 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.911 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.911 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.911 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:52:56.911 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.911 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.911 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.911 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.911 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:52:56.911 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.911 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.912 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.912 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.912 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:52:56.912 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.912 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.912 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.912 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.912 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:52:56.912 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.912 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.912 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.912 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:52:56.975 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-02-09T07:52:56.976 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:52:56.976 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repo Size 2024-02-09T07:52:56.976 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:52:56.976 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-02-09T07:52:56.976 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-common-debuginfo x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 416 M 2024-02-09T07:52:56.976 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:52:56.976 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-02-09T07:52:56.977 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:52:56.977 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2024-02-09T07:52:56.977 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:52:56.977 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 416 M 2024-02-09T07:52:56.977 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 1.7 G 2024-02-09T07:52:56.977 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-02-09T07:52:57.294 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-volume-2:19.0.0-1310.g0089f33e.el9.noarch 1/2 2024-02-09T07:52:57.684 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-02-09T07:52:57.685 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:52:57.685 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-02-09T07:52:57.685 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-volume-2:19.0.0-1310.g0089f33e.el9.noarch 2024-02-09T07:52:57.685 INFO:teuthology.orchestra.run.smithi103.stdout: python3-packaging-20.9-5.el9.noarch 2024-02-09T07:52:57.685 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:52:57.685 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-02-09T07:52:58.031 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install librados-devel 2024-02-09T07:52:58.647 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:03:03 ago on Fri 09 Feb 2024 07:49:55 AM UTC. 2024-02-09T07:52:58.938 INFO:teuthology.orchestra.run.smithi103.stderr:Modular dependency problems: 2024-02-09T07:52:58.939 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T07:52:58.939 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 1: conflicting requests 2024-02-09T07:52:58.939 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.939 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 2: conflicting requests 2024-02-09T07:52:58.939 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.939 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 3: conflicting requests 2024-02-09T07:52:58.939 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.939 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 4: conflicting requests 2024-02-09T07:52:58.939 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.939 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 5: conflicting requests 2024-02-09T07:52:58.939 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.940 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 6: conflicting requests 2024-02-09T07:52:58.940 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.940 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 7: conflicting requests 2024-02-09T07:52:58.940 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.940 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 8: conflicting requests 2024-02-09T07:52:58.940 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.940 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 9: conflicting requests 2024-02-09T07:52:58.940 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.940 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 10: conflicting requests 2024-02-09T07:52:58.940 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.940 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 11: conflicting requests 2024-02-09T07:52:58.940 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.940 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 12: conflicting requests 2024-02-09T07:52:58.941 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.941 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 13: conflicting requests 2024-02-09T07:52:58.941 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.941 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 14: conflicting requests 2024-02-09T07:52:58.941 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.941 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 15: conflicting requests 2024-02-09T07:52:58.941 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.941 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 16: conflicting requests 2024-02-09T07:52:58.941 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.941 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 17: conflicting requests 2024-02-09T07:52:58.941 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.941 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 18: conflicting requests 2024-02-09T07:52:58.941 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.941 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 19: conflicting requests 2024-02-09T07:52:58.942 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.942 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 20: conflicting requests 2024-02-09T07:52:58.942 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.942 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 21: conflicting requests 2024-02-09T07:52:58.942 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.942 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 22: conflicting requests 2024-02-09T07:52:58.942 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.942 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 23: conflicting requests 2024-02-09T07:52:58.942 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.942 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 24: conflicting requests 2024-02-09T07:52:58.942 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.942 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 25: conflicting requests 2024-02-09T07:52:58.942 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.942 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 26: conflicting requests 2024-02-09T07:52:58.942 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.943 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 27: conflicting requests 2024-02-09T07:52:58.943 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.943 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 28: conflicting requests 2024-02-09T07:52:58.943 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.943 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 29: conflicting requests 2024-02-09T07:52:58.943 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.943 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 30: conflicting requests 2024-02-09T07:52:58.943 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.943 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 31: conflicting requests 2024-02-09T07:52:58.943 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.943 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 32: conflicting requests 2024-02-09T07:52:58.943 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.943 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 33: conflicting requests 2024-02-09T07:52:58.943 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.944 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 34: conflicting requests 2024-02-09T07:52:58.944 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.944 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 35: conflicting requests 2024-02-09T07:52:58.944 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.944 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 36: conflicting requests 2024-02-09T07:52:58.944 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.944 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 37: conflicting requests 2024-02-09T07:52:58.944 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.944 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.944 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.944 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:52:58.944 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.944 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.945 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.945 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.945 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 39: conflicting requests 2024-02-09T07:52:58.945 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.945 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.945 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.945 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.945 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.945 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.946 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:52:58.946 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.946 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.946 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.946 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.946 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:52:58.946 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.946 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.946 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.946 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.946 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:52:58.947 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.947 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.947 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.947 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.947 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:52:58.947 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.947 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.947 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.948 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.948 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:52:58.948 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.948 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.948 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.948 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.948 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:52:58.948 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.948 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.948 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:52:58.948 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:52:59.006 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-02-09T07:52:59.007 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:52:59.007 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repo Size 2024-02-09T07:52:59.007 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:52:59.007 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-02-09T07:52:59.007 INFO:teuthology.orchestra.run.smithi103.stdout: librados-devel x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 127 k 2024-02-09T07:52:59.007 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:52:59.007 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-02-09T07:52:59.007 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:52:59.008 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-02-09T07:52:59.008 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:52:59.008 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 127 k 2024-02-09T07:52:59.008 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 456 k 2024-02-09T07:52:59.008 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-02-09T07:52:59.437 INFO:teuthology.orchestra.run.smithi103.stdout:librados-devel-19.0.0-1310.g0089f33e.el9.x86_64 295 kB/s | 127 kB 00:00 2024-02-09T07:52:59.438 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:52:59.438 INFO:teuthology.orchestra.run.smithi103.stdout:Total 294 kB/s | 127 kB 00:00 2024-02-09T07:52:59.438 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-02-09T07:52:59.444 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-02-09T07:52:59.444 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-02-09T07:52:59.504 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-02-09T07:52:59.504 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-02-09T07:52:59.655 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-02-09T07:52:59.769 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librados-devel-2:19.0.0-1310.g0089f33e.el9.x86_64 1/1 2024-02-09T07:53:00.279 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librados-devel-2:19.0.0-1310.g0089f33e.el9.x86_64 1/1 2024-02-09T07:53:00.614 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librados-devel-2:19.0.0-1310.g0089f33e.el9.x86_64 1/1 2024-02-09T07:53:00.614 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:53:00.614 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-02-09T07:53:00.614 INFO:teuthology.orchestra.run.smithi103.stdout: librados-devel-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:53:00.614 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:53:00.614 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-02-09T07:53:00.880 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install libcephfs2 2024-02-09T07:53:01.501 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:03:06 ago on Fri 09 Feb 2024 07:49:55 AM UTC. 2024-02-09T07:53:01.797 INFO:teuthology.orchestra.run.smithi103.stderr:Modular dependency problems: 2024-02-09T07:53:01.797 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T07:53:01.797 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 1: conflicting requests 2024-02-09T07:53:01.798 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.798 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 2: conflicting requests 2024-02-09T07:53:01.798 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.798 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 3: conflicting requests 2024-02-09T07:53:01.798 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.798 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 4: conflicting requests 2024-02-09T07:53:01.798 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.798 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 5: conflicting requests 2024-02-09T07:53:01.798 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.798 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 6: conflicting requests 2024-02-09T07:53:01.798 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.798 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 7: conflicting requests 2024-02-09T07:53:01.798 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.798 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 8: conflicting requests 2024-02-09T07:53:01.799 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.799 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 9: conflicting requests 2024-02-09T07:53:01.799 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.799 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 10: conflicting requests 2024-02-09T07:53:01.799 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.799 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 11: conflicting requests 2024-02-09T07:53:01.799 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.799 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 12: conflicting requests 2024-02-09T07:53:01.799 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.799 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 13: conflicting requests 2024-02-09T07:53:01.799 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.799 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 14: conflicting requests 2024-02-09T07:53:01.799 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.800 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 15: conflicting requests 2024-02-09T07:53:01.800 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.800 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 16: conflicting requests 2024-02-09T07:53:01.800 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.800 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 17: conflicting requests 2024-02-09T07:53:01.800 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.800 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 18: conflicting requests 2024-02-09T07:53:01.800 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.800 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 19: conflicting requests 2024-02-09T07:53:01.800 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.800 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 20: conflicting requests 2024-02-09T07:53:01.801 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.801 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 21: conflicting requests 2024-02-09T07:53:01.801 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.801 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 22: conflicting requests 2024-02-09T07:53:01.801 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.801 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 23: conflicting requests 2024-02-09T07:53:01.801 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.801 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 24: conflicting requests 2024-02-09T07:53:01.801 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.801 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 25: conflicting requests 2024-02-09T07:53:01.801 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.801 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 26: conflicting requests 2024-02-09T07:53:01.802 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.802 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 27: conflicting requests 2024-02-09T07:53:01.802 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.802 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 28: conflicting requests 2024-02-09T07:53:01.802 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.802 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 29: conflicting requests 2024-02-09T07:53:01.802 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.802 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 30: conflicting requests 2024-02-09T07:53:01.802 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.802 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 31: conflicting requests 2024-02-09T07:53:01.802 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.802 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 32: conflicting requests 2024-02-09T07:53:01.802 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.802 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 33: conflicting requests 2024-02-09T07:53:01.803 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.803 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 34: conflicting requests 2024-02-09T07:53:01.803 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.803 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 35: conflicting requests 2024-02-09T07:53:01.803 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.803 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 36: conflicting requests 2024-02-09T07:53:01.803 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.803 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 37: conflicting requests 2024-02-09T07:53:01.803 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.803 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.803 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.803 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:53:01.803 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.803 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.803 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.804 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.804 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 39: conflicting requests 2024-02-09T07:53:01.804 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.804 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.804 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.804 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.804 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.804 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.804 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:53:01.804 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.804 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.804 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.804 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.805 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:53:01.805 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.805 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.805 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.805 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.805 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:53:01.805 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.805 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.805 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.805 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.805 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:53:01.805 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.805 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.805 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.806 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.806 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:53:01.806 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.806 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.806 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.806 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.806 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:53:01.806 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.806 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.806 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.806 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:53:01.807 INFO:teuthology.orchestra.run.smithi103.stdout:Package libcephfs2-2:19.0.0-1310.g0089f33e.el9.x86_64 is already installed. 2024-02-09T07:53:01.865 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-02-09T07:53:01.866 INFO:teuthology.orchestra.run.smithi103.stdout:Nothing to do. 2024-02-09T07:53:01.867 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-02-09T07:53:01.937 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install libcephfs-devel 2024-02-09T07:53:02.546 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:03:07 ago on Fri 09 Feb 2024 07:49:55 AM UTC. 2024-02-09T07:53:02.840 INFO:teuthology.orchestra.run.smithi103.stderr:Modular dependency problems: 2024-02-09T07:53:02.840 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T07:53:02.841 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 1: conflicting requests 2024-02-09T07:53:02.841 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.841 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 2: conflicting requests 2024-02-09T07:53:02.841 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.841 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 3: conflicting requests 2024-02-09T07:53:02.841 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.841 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 4: conflicting requests 2024-02-09T07:53:02.841 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.841 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 5: conflicting requests 2024-02-09T07:53:02.841 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.841 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 6: conflicting requests 2024-02-09T07:53:02.841 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.841 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 7: conflicting requests 2024-02-09T07:53:02.841 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.842 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 8: conflicting requests 2024-02-09T07:53:02.842 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.842 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 9: conflicting requests 2024-02-09T07:53:02.842 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.842 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 10: conflicting requests 2024-02-09T07:53:02.842 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.842 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 11: conflicting requests 2024-02-09T07:53:02.842 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.842 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 12: conflicting requests 2024-02-09T07:53:02.842 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.842 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 13: conflicting requests 2024-02-09T07:53:02.842 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.842 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 14: conflicting requests 2024-02-09T07:53:02.843 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.843 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 15: conflicting requests 2024-02-09T07:53:02.843 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.843 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 16: conflicting requests 2024-02-09T07:53:02.843 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.843 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 17: conflicting requests 2024-02-09T07:53:02.843 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.843 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 18: conflicting requests 2024-02-09T07:53:02.843 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.843 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 19: conflicting requests 2024-02-09T07:53:02.843 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.843 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 20: conflicting requests 2024-02-09T07:53:02.843 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.843 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 21: conflicting requests 2024-02-09T07:53:02.844 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.844 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 22: conflicting requests 2024-02-09T07:53:02.844 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.844 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 23: conflicting requests 2024-02-09T07:53:02.844 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.844 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 24: conflicting requests 2024-02-09T07:53:02.844 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.844 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 25: conflicting requests 2024-02-09T07:53:02.844 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.844 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 26: conflicting requests 2024-02-09T07:53:02.844 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.844 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 27: conflicting requests 2024-02-09T07:53:02.844 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.844 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 28: conflicting requests 2024-02-09T07:53:02.845 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.845 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 29: conflicting requests 2024-02-09T07:53:02.845 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.845 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 30: conflicting requests 2024-02-09T07:53:02.845 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.845 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 31: conflicting requests 2024-02-09T07:53:02.845 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.845 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 32: conflicting requests 2024-02-09T07:53:02.845 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.845 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 33: conflicting requests 2024-02-09T07:53:02.845 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.845 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 34: conflicting requests 2024-02-09T07:53:02.845 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.845 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 35: conflicting requests 2024-02-09T07:53:02.846 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.846 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 36: conflicting requests 2024-02-09T07:53:02.846 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.846 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 37: conflicting requests 2024-02-09T07:53:02.846 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.846 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.846 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.846 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:53:02.846 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.846 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.846 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.846 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.847 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 39: conflicting requests 2024-02-09T07:53:02.847 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.847 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.847 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.847 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.847 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.847 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.847 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:53:02.847 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.847 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.847 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.847 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.848 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:53:02.848 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.848 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.848 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.848 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.848 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:53:02.848 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.848 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.848 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.848 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.848 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:53:02.848 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.848 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.848 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.849 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.849 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:53:02.849 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.849 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.849 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.849 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.849 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:53:02.849 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.849 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.849 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.849 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:53:02.908 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-02-09T07:53:02.909 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:53:02.909 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repo Size 2024-02-09T07:53:02.909 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:53:02.909 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-02-09T07:53:02.909 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs-devel x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 31 k 2024-02-09T07:53:02.909 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:53:02.909 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-02-09T07:53:02.909 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:53:02.909 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-02-09T07:53:02.910 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:53:02.910 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 31 k 2024-02-09T07:53:02.910 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 140 k 2024-02-09T07:53:02.910 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-02-09T07:53:03.167 INFO:teuthology.orchestra.run.smithi103.stdout:libcephfs-devel-19.0.0-1310.g0089f33e.el9.x86_6 121 kB/s | 31 kB 00:00 2024-02-09T07:53:03.168 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:53:03.168 INFO:teuthology.orchestra.run.smithi103.stdout:Total 121 kB/s | 31 kB 00:00 2024-02-09T07:53:03.168 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-02-09T07:53:03.172 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-02-09T07:53:03.172 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-02-09T07:53:03.199 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-02-09T07:53:03.199 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-02-09T07:53:03.294 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-02-09T07:53:03.408 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libcephfs-devel-2:19.0.0-1310.g0089f33e.el9.x86_64 1/1 2024-02-09T07:53:03.789 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-1310.g0089f33e.el9.x86_64 1/1 2024-02-09T07:53:04.075 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libcephfs-devel-2:19.0.0-1310.g0089f33e.el9.x86_64 1/1 2024-02-09T07:53:04.075 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:53:04.075 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-02-09T07:53:04.075 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs-devel-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:53:04.075 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:53:04.075 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-02-09T07:53:04.281 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install librados2 2024-02-09T07:53:04.885 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:03:09 ago on Fri 09 Feb 2024 07:49:55 AM UTC. 2024-02-09T07:53:05.198 INFO:teuthology.orchestra.run.smithi103.stderr:Modular dependency problems: 2024-02-09T07:53:05.198 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T07:53:05.198 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 1: conflicting requests 2024-02-09T07:53:05.198 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.198 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 2: conflicting requests 2024-02-09T07:53:05.198 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.198 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 3: conflicting requests 2024-02-09T07:53:05.199 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.199 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 4: conflicting requests 2024-02-09T07:53:05.199 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.199 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 5: conflicting requests 2024-02-09T07:53:05.199 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.199 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 6: conflicting requests 2024-02-09T07:53:05.199 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.199 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 7: conflicting requests 2024-02-09T07:53:05.199 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.199 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 8: conflicting requests 2024-02-09T07:53:05.199 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.199 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 9: conflicting requests 2024-02-09T07:53:05.199 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.199 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 10: conflicting requests 2024-02-09T07:53:05.200 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.200 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 11: conflicting requests 2024-02-09T07:53:05.200 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.200 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 12: conflicting requests 2024-02-09T07:53:05.200 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.200 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 13: conflicting requests 2024-02-09T07:53:05.200 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.200 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 14: conflicting requests 2024-02-09T07:53:05.200 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.200 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 15: conflicting requests 2024-02-09T07:53:05.200 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.200 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 16: conflicting requests 2024-02-09T07:53:05.200 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.201 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 17: conflicting requests 2024-02-09T07:53:05.201 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.201 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 18: conflicting requests 2024-02-09T07:53:05.201 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.201 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 19: conflicting requests 2024-02-09T07:53:05.201 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.201 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 20: conflicting requests 2024-02-09T07:53:05.201 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.201 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 21: conflicting requests 2024-02-09T07:53:05.201 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.201 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 22: conflicting requests 2024-02-09T07:53:05.201 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.201 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 23: conflicting requests 2024-02-09T07:53:05.201 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.201 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 24: conflicting requests 2024-02-09T07:53:05.202 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.202 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 25: conflicting requests 2024-02-09T07:53:05.202 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.202 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 26: conflicting requests 2024-02-09T07:53:05.202 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.202 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 27: conflicting requests 2024-02-09T07:53:05.202 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.202 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 28: conflicting requests 2024-02-09T07:53:05.202 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.202 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 29: conflicting requests 2024-02-09T07:53:05.202 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.202 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 30: conflicting requests 2024-02-09T07:53:05.202 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.202 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 31: conflicting requests 2024-02-09T07:53:05.203 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.203 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 32: conflicting requests 2024-02-09T07:53:05.203 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.203 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 33: conflicting requests 2024-02-09T07:53:05.203 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.204 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 34: conflicting requests 2024-02-09T07:53:05.204 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.204 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 35: conflicting requests 2024-02-09T07:53:05.204 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.204 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 36: conflicting requests 2024-02-09T07:53:05.204 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.204 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 37: conflicting requests 2024-02-09T07:53:05.204 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.204 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.204 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.204 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:53:05.204 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.205 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.205 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.205 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.205 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 39: conflicting requests 2024-02-09T07:53:05.205 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.205 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.205 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.205 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.205 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.205 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.205 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:53:05.205 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.205 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.205 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.206 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.206 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:53:05.206 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.206 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.206 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.206 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.206 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:53:05.206 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.206 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.206 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.206 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.206 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:53:05.206 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.206 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.207 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.207 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.207 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:53:05.207 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.207 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.207 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.207 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.207 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:53:05.207 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.207 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.208 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.208 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:53:05.208 INFO:teuthology.orchestra.run.smithi103.stdout:Package librados2-2:19.0.0-1310.g0089f33e.el9.x86_64 is already installed. 2024-02-09T07:53:05.268 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-02-09T07:53:05.269 INFO:teuthology.orchestra.run.smithi103.stdout:Nothing to do. 2024-02-09T07:53:05.269 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-02-09T07:53:05.348 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install librbd1 2024-02-09T07:53:05.944 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:03:10 ago on Fri 09 Feb 2024 07:49:55 AM UTC. 2024-02-09T07:53:06.236 INFO:teuthology.orchestra.run.smithi103.stderr:Modular dependency problems: 2024-02-09T07:53:06.236 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T07:53:06.236 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 1: conflicting requests 2024-02-09T07:53:06.236 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.236 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 2: conflicting requests 2024-02-09T07:53:06.236 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.236 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 3: conflicting requests 2024-02-09T07:53:06.237 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.237 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 4: conflicting requests 2024-02-09T07:53:06.237 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.237 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 5: conflicting requests 2024-02-09T07:53:06.237 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.237 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 6: conflicting requests 2024-02-09T07:53:06.237 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.237 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 7: conflicting requests 2024-02-09T07:53:06.237 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.237 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 8: conflicting requests 2024-02-09T07:53:06.237 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.237 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 9: conflicting requests 2024-02-09T07:53:06.237 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.238 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 10: conflicting requests 2024-02-09T07:53:06.238 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.238 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 11: conflicting requests 2024-02-09T07:53:06.238 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.238 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 12: conflicting requests 2024-02-09T07:53:06.238 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.238 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 13: conflicting requests 2024-02-09T07:53:06.238 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.238 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 14: conflicting requests 2024-02-09T07:53:06.238 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.238 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 15: conflicting requests 2024-02-09T07:53:06.238 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.238 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 16: conflicting requests 2024-02-09T07:53:06.238 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.239 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 17: conflicting requests 2024-02-09T07:53:06.239 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.239 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 18: conflicting requests 2024-02-09T07:53:06.239 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.239 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 19: conflicting requests 2024-02-09T07:53:06.239 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.239 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 20: conflicting requests 2024-02-09T07:53:06.239 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.239 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 21: conflicting requests 2024-02-09T07:53:06.239 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.239 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 22: conflicting requests 2024-02-09T07:53:06.239 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.239 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 23: conflicting requests 2024-02-09T07:53:06.239 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.240 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 24: conflicting requests 2024-02-09T07:53:06.240 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.240 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 25: conflicting requests 2024-02-09T07:53:06.240 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.240 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 26: conflicting requests 2024-02-09T07:53:06.240 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.240 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 27: conflicting requests 2024-02-09T07:53:06.240 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.240 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 28: conflicting requests 2024-02-09T07:53:06.240 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.240 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 29: conflicting requests 2024-02-09T07:53:06.240 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.241 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 30: conflicting requests 2024-02-09T07:53:06.241 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.241 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 31: conflicting requests 2024-02-09T07:53:06.241 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.241 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 32: conflicting requests 2024-02-09T07:53:06.241 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.241 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 33: conflicting requests 2024-02-09T07:53:06.241 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.241 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 34: conflicting requests 2024-02-09T07:53:06.241 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.241 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 35: conflicting requests 2024-02-09T07:53:06.241 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.241 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 36: conflicting requests 2024-02-09T07:53:06.241 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.242 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 37: conflicting requests 2024-02-09T07:53:06.242 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.242 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.242 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.242 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:53:06.242 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.242 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.242 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.242 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.242 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 39: conflicting requests 2024-02-09T07:53:06.242 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.242 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.242 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.242 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.243 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.243 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.243 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:53:06.243 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.243 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.243 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.243 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.243 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:53:06.243 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.244 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.244 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.244 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.244 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:53:06.244 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.244 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.244 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.244 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.245 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:53:06.245 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.245 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.245 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.245 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.245 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:53:06.245 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.245 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.245 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.245 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.246 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:53:06.246 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.246 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.246 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.246 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:53:06.246 INFO:teuthology.orchestra.run.smithi103.stdout:Package librbd1-2:19.0.0-1310.g0089f33e.el9.x86_64 is already installed. 2024-02-09T07:53:06.303 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-02-09T07:53:06.304 INFO:teuthology.orchestra.run.smithi103.stdout:Nothing to do. 2024-02-09T07:53:06.304 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-02-09T07:53:06.377 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install python3-rados 2024-02-09T07:53:06.979 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:03:11 ago on Fri 09 Feb 2024 07:49:55 AM UTC. 2024-02-09T07:53:07.273 INFO:teuthology.orchestra.run.smithi103.stderr:Modular dependency problems: 2024-02-09T07:53:07.273 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T07:53:07.273 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 1: conflicting requests 2024-02-09T07:53:07.273 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.273 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 2: conflicting requests 2024-02-09T07:53:07.273 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.274 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 3: conflicting requests 2024-02-09T07:53:07.274 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.274 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 4: conflicting requests 2024-02-09T07:53:07.274 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.274 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 5: conflicting requests 2024-02-09T07:53:07.274 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.274 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 6: conflicting requests 2024-02-09T07:53:07.274 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.274 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 7: conflicting requests 2024-02-09T07:53:07.274 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.274 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 8: conflicting requests 2024-02-09T07:53:07.274 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.274 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 9: conflicting requests 2024-02-09T07:53:07.274 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.275 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 10: conflicting requests 2024-02-09T07:53:07.275 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.275 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 11: conflicting requests 2024-02-09T07:53:07.275 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.275 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 12: conflicting requests 2024-02-09T07:53:07.275 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.276 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 13: conflicting requests 2024-02-09T07:53:07.276 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.276 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 14: conflicting requests 2024-02-09T07:53:07.276 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.276 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 15: conflicting requests 2024-02-09T07:53:07.276 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.276 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 16: conflicting requests 2024-02-09T07:53:07.276 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.276 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 17: conflicting requests 2024-02-09T07:53:07.276 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.276 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 18: conflicting requests 2024-02-09T07:53:07.277 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.277 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 19: conflicting requests 2024-02-09T07:53:07.277 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.277 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 20: conflicting requests 2024-02-09T07:53:07.277 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.277 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 21: conflicting requests 2024-02-09T07:53:07.277 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.277 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 22: conflicting requests 2024-02-09T07:53:07.277 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.277 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 23: conflicting requests 2024-02-09T07:53:07.277 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.277 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 24: conflicting requests 2024-02-09T07:53:07.277 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.277 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 25: conflicting requests 2024-02-09T07:53:07.278 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.278 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 26: conflicting requests 2024-02-09T07:53:07.278 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.278 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 27: conflicting requests 2024-02-09T07:53:07.278 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.278 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 28: conflicting requests 2024-02-09T07:53:07.278 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.278 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 29: conflicting requests 2024-02-09T07:53:07.278 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.278 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 30: conflicting requests 2024-02-09T07:53:07.278 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.278 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 31: conflicting requests 2024-02-09T07:53:07.278 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.278 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 32: conflicting requests 2024-02-09T07:53:07.278 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.279 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 33: conflicting requests 2024-02-09T07:53:07.279 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.279 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 34: conflicting requests 2024-02-09T07:53:07.279 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.279 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 35: conflicting requests 2024-02-09T07:53:07.279 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.279 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 36: conflicting requests 2024-02-09T07:53:07.279 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.279 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 37: conflicting requests 2024-02-09T07:53:07.279 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.279 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.279 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.279 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:53:07.279 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.280 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.280 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.280 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.280 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 39: conflicting requests 2024-02-09T07:53:07.280 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.280 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.281 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.281 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.281 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.281 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.281 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:53:07.281 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.281 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.282 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.282 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.282 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:53:07.282 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.282 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.282 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.282 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.282 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:53:07.282 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.282 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.282 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.282 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.282 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:53:07.283 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.283 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.283 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.283 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.283 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:53:07.283 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.283 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.283 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.283 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.283 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:53:07.283 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.283 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.284 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.284 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:53:07.284 INFO:teuthology.orchestra.run.smithi103.stdout:Package python3-rados-2:19.0.0-1310.g0089f33e.el9.x86_64 is already installed. 2024-02-09T07:53:07.341 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-02-09T07:53:07.342 INFO:teuthology.orchestra.run.smithi103.stdout:Nothing to do. 2024-02-09T07:53:07.342 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-02-09T07:53:07.419 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install python3-rgw 2024-02-09T07:53:08.029 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:03:13 ago on Fri 09 Feb 2024 07:49:55 AM UTC. 2024-02-09T07:53:08.325 INFO:teuthology.orchestra.run.smithi103.stderr:Modular dependency problems: 2024-02-09T07:53:08.325 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T07:53:08.325 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 1: conflicting requests 2024-02-09T07:53:08.326 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.326 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 2: conflicting requests 2024-02-09T07:53:08.326 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.326 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 3: conflicting requests 2024-02-09T07:53:08.326 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.327 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 4: conflicting requests 2024-02-09T07:53:08.327 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.327 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 5: conflicting requests 2024-02-09T07:53:08.327 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.327 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 6: conflicting requests 2024-02-09T07:53:08.327 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.328 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 7: conflicting requests 2024-02-09T07:53:08.328 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.328 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 8: conflicting requests 2024-02-09T07:53:08.328 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.328 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 9: conflicting requests 2024-02-09T07:53:08.328 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.329 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 10: conflicting requests 2024-02-09T07:53:08.329 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.329 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 11: conflicting requests 2024-02-09T07:53:08.329 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.329 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 12: conflicting requests 2024-02-09T07:53:08.329 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.330 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 13: conflicting requests 2024-02-09T07:53:08.330 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.330 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 14: conflicting requests 2024-02-09T07:53:08.330 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.330 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 15: conflicting requests 2024-02-09T07:53:08.330 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.330 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 16: conflicting requests 2024-02-09T07:53:08.331 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.331 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 17: conflicting requests 2024-02-09T07:53:08.331 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.331 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 18: conflicting requests 2024-02-09T07:53:08.331 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.331 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 19: conflicting requests 2024-02-09T07:53:08.331 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.331 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 20: conflicting requests 2024-02-09T07:53:08.331 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.332 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 21: conflicting requests 2024-02-09T07:53:08.332 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.332 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 22: conflicting requests 2024-02-09T07:53:08.332 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.332 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 23: conflicting requests 2024-02-09T07:53:08.332 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.332 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 24: conflicting requests 2024-02-09T07:53:08.332 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.333 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 25: conflicting requests 2024-02-09T07:53:08.333 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.333 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 26: conflicting requests 2024-02-09T07:53:08.333 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.333 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 27: conflicting requests 2024-02-09T07:53:08.333 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.333 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 28: conflicting requests 2024-02-09T07:53:08.333 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.334 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 29: conflicting requests 2024-02-09T07:53:08.334 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.334 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 30: conflicting requests 2024-02-09T07:53:08.334 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.334 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 31: conflicting requests 2024-02-09T07:53:08.334 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.335 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 32: conflicting requests 2024-02-09T07:53:08.335 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.335 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 33: conflicting requests 2024-02-09T07:53:08.335 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.335 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 34: conflicting requests 2024-02-09T07:53:08.335 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.335 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 35: conflicting requests 2024-02-09T07:53:08.335 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.335 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 36: conflicting requests 2024-02-09T07:53:08.335 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.335 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 37: conflicting requests 2024-02-09T07:53:08.335 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.336 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.336 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.336 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:53:08.336 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.336 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.336 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.336 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.336 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 39: conflicting requests 2024-02-09T07:53:08.336 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.336 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.336 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.336 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.336 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.336 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.337 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:53:08.337 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.337 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.337 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.337 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.337 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:53:08.337 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.337 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.337 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.337 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.337 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:53:08.338 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.338 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.338 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.338 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.338 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:53:08.338 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.338 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.338 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.338 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.338 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:53:08.338 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.338 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.338 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.339 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.339 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:53:08.339 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.339 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.339 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.339 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:53:08.339 INFO:teuthology.orchestra.run.smithi103.stdout:Package python3-rgw-2:19.0.0-1310.g0089f33e.el9.x86_64 is already installed. 2024-02-09T07:53:08.393 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-02-09T07:53:08.394 INFO:teuthology.orchestra.run.smithi103.stdout:Nothing to do. 2024-02-09T07:53:08.394 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-02-09T07:53:08.470 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install python3-cephfs 2024-02-09T07:53:09.083 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:03:14 ago on Fri 09 Feb 2024 07:49:55 AM UTC. 2024-02-09T07:53:09.375 INFO:teuthology.orchestra.run.smithi103.stderr:Modular dependency problems: 2024-02-09T07:53:09.375 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T07:53:09.375 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 1: conflicting requests 2024-02-09T07:53:09.375 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.375 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 2: conflicting requests 2024-02-09T07:53:09.375 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.375 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 3: conflicting requests 2024-02-09T07:53:09.376 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.376 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 4: conflicting requests 2024-02-09T07:53:09.376 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.376 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 5: conflicting requests 2024-02-09T07:53:09.376 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.376 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 6: conflicting requests 2024-02-09T07:53:09.376 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.376 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 7: conflicting requests 2024-02-09T07:53:09.376 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.376 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 8: conflicting requests 2024-02-09T07:53:09.376 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.376 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 9: conflicting requests 2024-02-09T07:53:09.376 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.377 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 10: conflicting requests 2024-02-09T07:53:09.377 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.377 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 11: conflicting requests 2024-02-09T07:53:09.377 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.377 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 12: conflicting requests 2024-02-09T07:53:09.377 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.377 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 13: conflicting requests 2024-02-09T07:53:09.377 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.377 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 14: conflicting requests 2024-02-09T07:53:09.377 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.377 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 15: conflicting requests 2024-02-09T07:53:09.377 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.377 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 16: conflicting requests 2024-02-09T07:53:09.378 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.378 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 17: conflicting requests 2024-02-09T07:53:09.378 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.378 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 18: conflicting requests 2024-02-09T07:53:09.378 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.378 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 19: conflicting requests 2024-02-09T07:53:09.378 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.378 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 20: conflicting requests 2024-02-09T07:53:09.378 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.378 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 21: conflicting requests 2024-02-09T07:53:09.378 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.378 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 22: conflicting requests 2024-02-09T07:53:09.378 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.378 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 23: conflicting requests 2024-02-09T07:53:09.379 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.379 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 24: conflicting requests 2024-02-09T07:53:09.379 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.379 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 25: conflicting requests 2024-02-09T07:53:09.379 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.379 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 26: conflicting requests 2024-02-09T07:53:09.379 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.379 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 27: conflicting requests 2024-02-09T07:53:09.379 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.379 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 28: conflicting requests 2024-02-09T07:53:09.379 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.379 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 29: conflicting requests 2024-02-09T07:53:09.380 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.380 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 30: conflicting requests 2024-02-09T07:53:09.380 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.380 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 31: conflicting requests 2024-02-09T07:53:09.380 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.380 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 32: conflicting requests 2024-02-09T07:53:09.380 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.380 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 33: conflicting requests 2024-02-09T07:53:09.380 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.380 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 34: conflicting requests 2024-02-09T07:53:09.381 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.381 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 35: conflicting requests 2024-02-09T07:53:09.381 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.381 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 36: conflicting requests 2024-02-09T07:53:09.381 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.381 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 37: conflicting requests 2024-02-09T07:53:09.381 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.381 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.381 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.381 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:53:09.381 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.381 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.381 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.381 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.381 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 39: conflicting requests 2024-02-09T07:53:09.382 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.382 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.382 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.382 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.382 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.382 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.382 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:53:09.382 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.382 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.382 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.382 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.382 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:53:09.382 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.382 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.382 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.383 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.383 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:53:09.383 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.383 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.383 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.383 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.383 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:53:09.383 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.383 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.383 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.383 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.383 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:53:09.383 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.383 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.383 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.384 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.384 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:53:09.384 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.384 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.384 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.384 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:53:09.384 INFO:teuthology.orchestra.run.smithi103.stdout:Package python3-cephfs-2:19.0.0-1310.g0089f33e.el9.x86_64 is already installed. 2024-02-09T07:53:09.444 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-02-09T07:53:09.445 INFO:teuthology.orchestra.run.smithi103.stdout:Nothing to do. 2024-02-09T07:53:09.445 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-02-09T07:53:09.524 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install python3-rbd 2024-02-09T07:53:10.133 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:03:15 ago on Fri 09 Feb 2024 07:49:55 AM UTC. 2024-02-09T07:53:10.428 INFO:teuthology.orchestra.run.smithi103.stderr:Modular dependency problems: 2024-02-09T07:53:10.428 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T07:53:10.428 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 1: conflicting requests 2024-02-09T07:53:10.428 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.428 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 2: conflicting requests 2024-02-09T07:53:10.428 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.428 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 3: conflicting requests 2024-02-09T07:53:10.428 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.428 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 4: conflicting requests 2024-02-09T07:53:10.428 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.429 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 5: conflicting requests 2024-02-09T07:53:10.429 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.429 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 6: conflicting requests 2024-02-09T07:53:10.429 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.429 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 7: conflicting requests 2024-02-09T07:53:10.429 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.429 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 8: conflicting requests 2024-02-09T07:53:10.429 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.429 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 9: conflicting requests 2024-02-09T07:53:10.429 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.429 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 10: conflicting requests 2024-02-09T07:53:10.429 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.429 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 11: conflicting requests 2024-02-09T07:53:10.429 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.430 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 12: conflicting requests 2024-02-09T07:53:10.430 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.430 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 13: conflicting requests 2024-02-09T07:53:10.430 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.430 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 14: conflicting requests 2024-02-09T07:53:10.430 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.430 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 15: conflicting requests 2024-02-09T07:53:10.430 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.430 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 16: conflicting requests 2024-02-09T07:53:10.430 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.430 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 17: conflicting requests 2024-02-09T07:53:10.430 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.430 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 18: conflicting requests 2024-02-09T07:53:10.430 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.431 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 19: conflicting requests 2024-02-09T07:53:10.431 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.431 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 20: conflicting requests 2024-02-09T07:53:10.431 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.431 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 21: conflicting requests 2024-02-09T07:53:10.431 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.431 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 22: conflicting requests 2024-02-09T07:53:10.431 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.431 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 23: conflicting requests 2024-02-09T07:53:10.431 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.431 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 24: conflicting requests 2024-02-09T07:53:10.431 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.431 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 25: conflicting requests 2024-02-09T07:53:10.431 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.431 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 26: conflicting requests 2024-02-09T07:53:10.432 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.432 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 27: conflicting requests 2024-02-09T07:53:10.432 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.432 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 28: conflicting requests 2024-02-09T07:53:10.432 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.432 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 29: conflicting requests 2024-02-09T07:53:10.432 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.432 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 30: conflicting requests 2024-02-09T07:53:10.432 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.432 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 31: conflicting requests 2024-02-09T07:53:10.432 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.432 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 32: conflicting requests 2024-02-09T07:53:10.432 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.433 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 33: conflicting requests 2024-02-09T07:53:10.433 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.433 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 34: conflicting requests 2024-02-09T07:53:10.433 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.433 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 35: conflicting requests 2024-02-09T07:53:10.433 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.433 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 36: conflicting requests 2024-02-09T07:53:10.433 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.433 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 37: conflicting requests 2024-02-09T07:53:10.433 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.433 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.434 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.434 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:53:10.434 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.434 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.434 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.434 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.434 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 39: conflicting requests 2024-02-09T07:53:10.434 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.434 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.434 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.434 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.434 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.434 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.434 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:53:10.434 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.435 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.435 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.435 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.435 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:53:10.436 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.436 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.436 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.436 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.436 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:53:10.436 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.436 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.436 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.436 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.436 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:53:10.436 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.436 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.436 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.437 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.437 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:53:10.437 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.437 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.437 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.437 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.437 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:53:10.437 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.437 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.437 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.437 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:53:10.438 INFO:teuthology.orchestra.run.smithi103.stdout:Package python3-rbd-2:19.0.0-1310.g0089f33e.el9.x86_64 is already installed. 2024-02-09T07:53:10.496 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-02-09T07:53:10.497 INFO:teuthology.orchestra.run.smithi103.stdout:Nothing to do. 2024-02-09T07:53:10.497 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-02-09T07:53:10.570 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install rbd-fuse 2024-02-09T07:53:11.175 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:03:16 ago on Fri 09 Feb 2024 07:49:55 AM UTC. 2024-02-09T07:53:11.475 INFO:teuthology.orchestra.run.smithi103.stderr:Modular dependency problems: 2024-02-09T07:53:11.475 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T07:53:11.475 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 1: conflicting requests 2024-02-09T07:53:11.475 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.475 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 2: conflicting requests 2024-02-09T07:53:11.475 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.475 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 3: conflicting requests 2024-02-09T07:53:11.476 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.476 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 4: conflicting requests 2024-02-09T07:53:11.476 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.476 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 5: conflicting requests 2024-02-09T07:53:11.476 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.476 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 6: conflicting requests 2024-02-09T07:53:11.476 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.476 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 7: conflicting requests 2024-02-09T07:53:11.476 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.476 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 8: conflicting requests 2024-02-09T07:53:11.476 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.476 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 9: conflicting requests 2024-02-09T07:53:11.476 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.476 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 10: conflicting requests 2024-02-09T07:53:11.477 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.477 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 11: conflicting requests 2024-02-09T07:53:11.477 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.477 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 12: conflicting requests 2024-02-09T07:53:11.477 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.477 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 13: conflicting requests 2024-02-09T07:53:11.477 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.477 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 14: conflicting requests 2024-02-09T07:53:11.477 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.477 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 15: conflicting requests 2024-02-09T07:53:11.477 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.477 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 16: conflicting requests 2024-02-09T07:53:11.477 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.478 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 17: conflicting requests 2024-02-09T07:53:11.478 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.478 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 18: conflicting requests 2024-02-09T07:53:11.478 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.478 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 19: conflicting requests 2024-02-09T07:53:11.478 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.478 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 20: conflicting requests 2024-02-09T07:53:11.478 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.478 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 21: conflicting requests 2024-02-09T07:53:11.478 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.478 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 22: conflicting requests 2024-02-09T07:53:11.478 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.478 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 23: conflicting requests 2024-02-09T07:53:11.479 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.479 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 24: conflicting requests 2024-02-09T07:53:11.479 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.479 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 25: conflicting requests 2024-02-09T07:53:11.479 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.479 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 26: conflicting requests 2024-02-09T07:53:11.479 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.479 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 27: conflicting requests 2024-02-09T07:53:11.479 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.479 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 28: conflicting requests 2024-02-09T07:53:11.479 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.479 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 29: conflicting requests 2024-02-09T07:53:11.479 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.479 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 30: conflicting requests 2024-02-09T07:53:11.480 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.480 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 31: conflicting requests 2024-02-09T07:53:11.480 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.480 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 32: conflicting requests 2024-02-09T07:53:11.480 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.480 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 33: conflicting requests 2024-02-09T07:53:11.480 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.480 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 34: conflicting requests 2024-02-09T07:53:11.480 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.480 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 35: conflicting requests 2024-02-09T07:53:11.480 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.480 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 36: conflicting requests 2024-02-09T07:53:11.481 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.481 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 37: conflicting requests 2024-02-09T07:53:11.481 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.481 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.481 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.481 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:53:11.481 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.481 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.481 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.481 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.481 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 39: conflicting requests 2024-02-09T07:53:11.481 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.481 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.481 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.481 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.482 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.482 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.482 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:53:11.482 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.482 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.482 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.482 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.482 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:53:11.482 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.482 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.482 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.482 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.482 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:53:11.482 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.482 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.483 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.483 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.483 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:53:11.483 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.483 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.483 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.483 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.483 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:53:11.483 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.483 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.483 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.483 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.483 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:53:11.483 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.483 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.483 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.484 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:53:11.544 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-02-09T07:53:11.545 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:53:11.545 INFO:teuthology.orchestra.run.smithi103.stdout: Package Architecture Version Repository Size 2024-02-09T07:53:11.546 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:53:11.546 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-02-09T07:53:11.546 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-fuse x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 85 k 2024-02-09T07:53:11.546 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:53:11.546 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-02-09T07:53:11.546 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:53:11.546 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-02-09T07:53:11.546 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:53:11.546 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 85 k 2024-02-09T07:53:11.546 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 231 k 2024-02-09T07:53:11.546 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-02-09T07:53:11.862 INFO:teuthology.orchestra.run.smithi103.stdout:rbd-fuse-19.0.0-1310.g0089f33e.el9.x86_64.rpm 269 kB/s | 85 kB 00:00 2024-02-09T07:53:11.863 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:53:11.863 INFO:teuthology.orchestra.run.smithi103.stdout:Total 268 kB/s | 85 kB 00:00 2024-02-09T07:53:11.863 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-02-09T07:53:11.871 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-02-09T07:53:11.871 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-02-09T07:53:11.930 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-02-09T07:53:11.931 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-02-09T07:53:12.076 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-02-09T07:53:12.178 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-fuse-2:19.0.0-1310.g0089f33e.el9.x86_64 1/1 2024-02-09T07:53:12.572 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: rbd-fuse-2:19.0.0-1310.g0089f33e.el9.x86_64 1/1 2024-02-09T07:53:12.906 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-fuse-2:19.0.0-1310.g0089f33e.el9.x86_64 1/1 2024-02-09T07:53:12.907 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:53:12.907 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-02-09T07:53:12.907 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-fuse-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:53:12.907 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:53:12.907 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-02-09T07:53:13.177 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install rbd-mirror 2024-02-09T07:53:13.788 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:03:18 ago on Fri 09 Feb 2024 07:49:55 AM UTC. 2024-02-09T07:53:14.094 INFO:teuthology.orchestra.run.smithi103.stderr:Modular dependency problems: 2024-02-09T07:53:14.094 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T07:53:14.094 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 1: conflicting requests 2024-02-09T07:53:14.094 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.094 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 2: conflicting requests 2024-02-09T07:53:14.094 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.094 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 3: conflicting requests 2024-02-09T07:53:14.094 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.094 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 4: conflicting requests 2024-02-09T07:53:14.094 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.094 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 5: conflicting requests 2024-02-09T07:53:14.095 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.095 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 6: conflicting requests 2024-02-09T07:53:14.095 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.095 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 7: conflicting requests 2024-02-09T07:53:14.095 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.095 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 8: conflicting requests 2024-02-09T07:53:14.095 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.095 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 9: conflicting requests 2024-02-09T07:53:14.095 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.095 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 10: conflicting requests 2024-02-09T07:53:14.095 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.095 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 11: conflicting requests 2024-02-09T07:53:14.095 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.095 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 12: conflicting requests 2024-02-09T07:53:14.096 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.096 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 13: conflicting requests 2024-02-09T07:53:14.096 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.096 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 14: conflicting requests 2024-02-09T07:53:14.096 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.096 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 15: conflicting requests 2024-02-09T07:53:14.096 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.096 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 16: conflicting requests 2024-02-09T07:53:14.096 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.096 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 17: conflicting requests 2024-02-09T07:53:14.096 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.096 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 18: conflicting requests 2024-02-09T07:53:14.096 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.097 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 19: conflicting requests 2024-02-09T07:53:14.097 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.097 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 20: conflicting requests 2024-02-09T07:53:14.097 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.097 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 21: conflicting requests 2024-02-09T07:53:14.097 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.097 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 22: conflicting requests 2024-02-09T07:53:14.098 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.098 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 23: conflicting requests 2024-02-09T07:53:14.098 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.098 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 24: conflicting requests 2024-02-09T07:53:14.098 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.098 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 25: conflicting requests 2024-02-09T07:53:14.098 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.098 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 26: conflicting requests 2024-02-09T07:53:14.098 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.098 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 27: conflicting requests 2024-02-09T07:53:14.098 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.098 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 28: conflicting requests 2024-02-09T07:53:14.098 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.099 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 29: conflicting requests 2024-02-09T07:53:14.099 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.099 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 30: conflicting requests 2024-02-09T07:53:14.099 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.099 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 31: conflicting requests 2024-02-09T07:53:14.099 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.099 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 32: conflicting requests 2024-02-09T07:53:14.099 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.100 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 33: conflicting requests 2024-02-09T07:53:14.100 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.100 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 34: conflicting requests 2024-02-09T07:53:14.100 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.100 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 35: conflicting requests 2024-02-09T07:53:14.100 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.100 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 36: conflicting requests 2024-02-09T07:53:14.100 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.100 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 37: conflicting requests 2024-02-09T07:53:14.100 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.100 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.100 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.100 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:53:14.100 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.101 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.101 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.101 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.101 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 39: conflicting requests 2024-02-09T07:53:14.101 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.101 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.101 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.101 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.101 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.101 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.101 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:53:14.101 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.101 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.102 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.102 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.102 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:53:14.102 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.102 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.102 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.102 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.102 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:53:14.102 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.102 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.102 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.102 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.102 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:53:14.102 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.102 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.103 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.103 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.103 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:53:14.103 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.103 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.103 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.103 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.103 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:53:14.103 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.103 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.103 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.103 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:53:14.161 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-02-09T07:53:14.162 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:53:14.162 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repo Size 2024-02-09T07:53:14.162 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:53:14.162 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-02-09T07:53:14.162 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-mirror x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 3.1 M 2024-02-09T07:53:14.162 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:53:14.162 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-02-09T07:53:14.162 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:53:14.162 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-02-09T07:53:14.162 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:53:14.163 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 3.1 M 2024-02-09T07:53:14.163 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 13 M 2024-02-09T07:53:14.163 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-02-09T07:53:15.301 INFO:teuthology.orchestra.run.smithi103.stdout:rbd-mirror-19.0.0-1310.g0089f33e.el9.x86_64.rpm 2.7 MB/s | 3.1 MB 00:01 2024-02-09T07:53:15.301 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:53:15.301 INFO:teuthology.orchestra.run.smithi103.stdout:Total 2.7 MB/s | 3.1 MB 00:01 2024-02-09T07:53:15.302 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-02-09T07:53:15.312 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-02-09T07:53:15.312 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-02-09T07:53:15.395 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-02-09T07:53:15.396 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-02-09T07:53:15.822 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-02-09T07:53:15.885 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-mirror-2:19.0.0-1310.g0089f33e.el9.x86_64 1/1 2024-02-09T07:53:15.908 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1310.g0089f33e.el9.x86_64 1/1 2024-02-09T07:53:15.908 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-09T07:53:15.909 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-09T07:53:15.909 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-09T07:53:15.909 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-09T07:53:15.909 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:53:17.106 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-mirror-2:19.0.0-1310.g0089f33e.el9.x86_64 1/1 2024-02-09T07:53:17.106 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:53:17.106 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-02-09T07:53:17.106 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-mirror-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:53:17.107 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:53:17.107 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-02-09T07:53:17.398 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install rbd-nbd 2024-02-09T07:53:18.010 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:03:23 ago on Fri 09 Feb 2024 07:49:55 AM UTC. 2024-02-09T07:53:18.303 INFO:teuthology.orchestra.run.smithi103.stderr:Modular dependency problems: 2024-02-09T07:53:18.303 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T07:53:18.303 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 1: conflicting requests 2024-02-09T07:53:18.304 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.304 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 2: conflicting requests 2024-02-09T07:53:18.304 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.304 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 3: conflicting requests 2024-02-09T07:53:18.304 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.304 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 4: conflicting requests 2024-02-09T07:53:18.304 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.304 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 5: conflicting requests 2024-02-09T07:53:18.304 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.304 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 6: conflicting requests 2024-02-09T07:53:18.304 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.304 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 7: conflicting requests 2024-02-09T07:53:18.304 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.305 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 8: conflicting requests 2024-02-09T07:53:18.305 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.305 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 9: conflicting requests 2024-02-09T07:53:18.305 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.305 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 10: conflicting requests 2024-02-09T07:53:18.305 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.305 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 11: conflicting requests 2024-02-09T07:53:18.305 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.305 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 12: conflicting requests 2024-02-09T07:53:18.305 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.305 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 13: conflicting requests 2024-02-09T07:53:18.305 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.305 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 14: conflicting requests 2024-02-09T07:53:18.305 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.306 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 15: conflicting requests 2024-02-09T07:53:18.306 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.306 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 16: conflicting requests 2024-02-09T07:53:18.306 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.306 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 17: conflicting requests 2024-02-09T07:53:18.306 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.306 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 18: conflicting requests 2024-02-09T07:53:18.306 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.306 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 19: conflicting requests 2024-02-09T07:53:18.306 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.306 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 20: conflicting requests 2024-02-09T07:53:18.306 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.306 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 21: conflicting requests 2024-02-09T07:53:18.306 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.307 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 22: conflicting requests 2024-02-09T07:53:18.307 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.307 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 23: conflicting requests 2024-02-09T07:53:18.307 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.307 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 24: conflicting requests 2024-02-09T07:53:18.307 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.307 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 25: conflicting requests 2024-02-09T07:53:18.307 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.307 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 26: conflicting requests 2024-02-09T07:53:18.307 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.307 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 27: conflicting requests 2024-02-09T07:53:18.307 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.308 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 28: conflicting requests 2024-02-09T07:53:18.308 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.308 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 29: conflicting requests 2024-02-09T07:53:18.308 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.308 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 30: conflicting requests 2024-02-09T07:53:18.308 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.308 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 31: conflicting requests 2024-02-09T07:53:18.308 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.308 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 32: conflicting requests 2024-02-09T07:53:18.309 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.309 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 33: conflicting requests 2024-02-09T07:53:18.309 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.309 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 34: conflicting requests 2024-02-09T07:53:18.309 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.309 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 35: conflicting requests 2024-02-09T07:53:18.309 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.310 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 36: conflicting requests 2024-02-09T07:53:18.310 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.310 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 37: conflicting requests 2024-02-09T07:53:18.310 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.310 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.310 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.310 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:53:18.310 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.310 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.310 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.310 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.310 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 39: conflicting requests 2024-02-09T07:53:18.310 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.310 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.311 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.311 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.311 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.311 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.311 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:53:18.311 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.311 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.311 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.311 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.311 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:53:18.311 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.311 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.312 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.312 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.312 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:53:18.312 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.313 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.313 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.313 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.313 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:53:18.313 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.313 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.313 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.313 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.313 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:53:18.313 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.313 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.313 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.314 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.314 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:53:18.314 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.314 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.314 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.314 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:53:18.371 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-02-09T07:53:18.372 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:53:18.372 INFO:teuthology.orchestra.run.smithi103.stdout: Package Architecture Version Repository Size 2024-02-09T07:53:18.372 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:53:18.372 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-02-09T07:53:18.372 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-nbd x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 171 k 2024-02-09T07:53:18.372 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:53:18.372 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-02-09T07:53:18.373 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:53:18.373 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-02-09T07:53:18.373 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:53:18.373 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 171 k 2024-02-09T07:53:18.373 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 494 k 2024-02-09T07:53:18.373 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-02-09T07:53:18.846 INFO:teuthology.orchestra.run.smithi103.stdout:rbd-nbd-19.0.0-1310.g0089f33e.el9.x86_64.rpm 361 kB/s | 171 kB 00:00 2024-02-09T07:53:18.847 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:53:18.848 INFO:teuthology.orchestra.run.smithi103.stdout:Total 360 kB/s | 171 kB 00:00 2024-02-09T07:53:18.848 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-02-09T07:53:18.855 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-02-09T07:53:18.855 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-02-09T07:53:18.914 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-02-09T07:53:18.915 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-02-09T07:53:19.110 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-02-09T07:53:19.212 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-nbd-2:19.0.0-1310.g0089f33e.el9.x86_64 1/1 2024-02-09T07:53:19.652 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: rbd-nbd-2:19.0.0-1310.g0089f33e.el9.x86_64 1/1 2024-02-09T07:53:19.982 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-nbd-2:19.0.0-1310.g0089f33e.el9.x86_64 1/1 2024-02-09T07:53:19.982 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:53:19.982 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-02-09T07:53:19.983 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-nbd-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:53:19.983 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:53:19.983 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-02-09T07:53:20.215 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-base-debuginfo 2024-02-09T07:53:20.843 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:03:25 ago on Fri 09 Feb 2024 07:49:55 AM UTC. 2024-02-09T07:53:21.141 INFO:teuthology.orchestra.run.smithi103.stderr:Modular dependency problems: 2024-02-09T07:53:21.141 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T07:53:21.141 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 1: conflicting requests 2024-02-09T07:53:21.141 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.141 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 2: conflicting requests 2024-02-09T07:53:21.141 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.141 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 3: conflicting requests 2024-02-09T07:53:21.141 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.141 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 4: conflicting requests 2024-02-09T07:53:21.141 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.142 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 5: conflicting requests 2024-02-09T07:53:21.142 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.142 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 6: conflicting requests 2024-02-09T07:53:21.142 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.142 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 7: conflicting requests 2024-02-09T07:53:21.142 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.142 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 8: conflicting requests 2024-02-09T07:53:21.142 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.142 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 9: conflicting requests 2024-02-09T07:53:21.142 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.142 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 10: conflicting requests 2024-02-09T07:53:21.142 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.142 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 11: conflicting requests 2024-02-09T07:53:21.142 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.143 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 12: conflicting requests 2024-02-09T07:53:21.143 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.143 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 13: conflicting requests 2024-02-09T07:53:21.143 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.143 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 14: conflicting requests 2024-02-09T07:53:21.143 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.143 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 15: conflicting requests 2024-02-09T07:53:21.143 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.143 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 16: conflicting requests 2024-02-09T07:53:21.143 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.143 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 17: conflicting requests 2024-02-09T07:53:21.143 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.143 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 18: conflicting requests 2024-02-09T07:53:21.144 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.144 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 19: conflicting requests 2024-02-09T07:53:21.144 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.144 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 20: conflicting requests 2024-02-09T07:53:21.144 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.144 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 21: conflicting requests 2024-02-09T07:53:21.144 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.144 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 22: conflicting requests 2024-02-09T07:53:21.144 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.144 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 23: conflicting requests 2024-02-09T07:53:21.144 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.144 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 24: conflicting requests 2024-02-09T07:53:21.144 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.145 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 25: conflicting requests 2024-02-09T07:53:21.145 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.145 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 26: conflicting requests 2024-02-09T07:53:21.145 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.145 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 27: conflicting requests 2024-02-09T07:53:21.145 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.145 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 28: conflicting requests 2024-02-09T07:53:21.145 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.145 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 29: conflicting requests 2024-02-09T07:53:21.145 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.145 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 30: conflicting requests 2024-02-09T07:53:21.145 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.145 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 31: conflicting requests 2024-02-09T07:53:21.145 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.146 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 32: conflicting requests 2024-02-09T07:53:21.146 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.146 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 33: conflicting requests 2024-02-09T07:53:21.146 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.146 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 34: conflicting requests 2024-02-09T07:53:21.146 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.146 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 35: conflicting requests 2024-02-09T07:53:21.146 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.146 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 36: conflicting requests 2024-02-09T07:53:21.146 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.146 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 37: conflicting requests 2024-02-09T07:53:21.146 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.146 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.146 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.147 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:53:21.147 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.147 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.147 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.147 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.147 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 39: conflicting requests 2024-02-09T07:53:21.147 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.147 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.147 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.147 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.147 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.147 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.147 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:53:21.147 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.147 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.148 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.148 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.148 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:53:21.148 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.148 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.148 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.148 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.148 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:53:21.148 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.148 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.148 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.148 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.148 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:53:21.149 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.149 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.149 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.149 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.149 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:53:21.149 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.149 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.149 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.149 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.149 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:53:21.149 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.149 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.149 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.149 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:53:21.209 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-02-09T07:53:21.209 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:53:21.209 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repo Size 2024-02-09T07:53:21.209 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:53:21.209 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-02-09T07:53:21.209 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-base-debuginfo x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 67 M 2024-02-09T07:53:21.210 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-02-09T07:53:21.210 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-debuginfo x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 22 M 2024-02-09T07:53:21.210 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:53:21.210 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-02-09T07:53:21.210 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:53:21.210 INFO:teuthology.orchestra.run.smithi103.stdout:Install 2 Packages 2024-02-09T07:53:21.210 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:53:21.210 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 89 M 2024-02-09T07:53:21.211 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 490 M 2024-02-09T07:53:21.211 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-02-09T07:53:25.201 INFO:teuthology.orchestra.run.smithi103.stdout:(1/2): ceph-debuginfo-19.0.0-1310.g0089f33e.el9 5.6 MB/s | 22 MB 00:03 2024-02-09T07:53:29.173 INFO:teuthology.orchestra.run.smithi062.stdout:ceph-common-debuginfo-19.0.0-1310.g0089f33e.el9 13 MB/s | 416 MB 00:32 2024-02-09T07:53:29.173 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:53:29.174 INFO:teuthology.orchestra.run.smithi062.stdout:Total 13 MB/s | 416 MB 00:32 2024-02-09T07:53:29.174 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-02-09T07:53:29.179 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-02-09T07:53:29.179 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-02-09T07:53:30.592 INFO:teuthology.orchestra.run.smithi103.stdout:(2/2): ceph-base-debuginfo-19.0.0-1310.g0089f33 7.1 MB/s | 67 MB 00:09 2024-02-09T07:53:30.594 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:53:30.594 INFO:teuthology.orchestra.run.smithi103.stdout:Total 9.5 MB/s | 89 MB 00:09 2024-02-09T07:53:30.595 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-02-09T07:53:30.599 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-02-09T07:53:30.600 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-02-09T07:53:31.185 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-02-09T07:53:31.186 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-02-09T07:53:31.777 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-02-09T07:53:31.777 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-02-09T07:53:34.277 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-02-09T07:53:41.242 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 1/2 2024-02-09T07:53:41.318 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-base-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_ 2/2 2024-02-09T07:53:44.757 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-base-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_ 2/2 2024-02-09T07:53:44.758 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-base-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_ 1/2 2024-02-09T07:53:45.060 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 2/2 2024-02-09T07:53:45.060 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:53:45.060 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-02-09T07:53:45.060 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-base-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:53:45.061 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:53:45.061 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:53:45.061 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-02-09T07:53:45.292 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-common-debuginfo 2024-02-09T07:53:45.905 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:03:50 ago on Fri 09 Feb 2024 07:49:55 AM UTC. 2024-02-09T07:53:46.219 INFO:teuthology.orchestra.run.smithi103.stderr:Modular dependency problems: 2024-02-09T07:53:46.219 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T07:53:46.219 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 1: conflicting requests 2024-02-09T07:53:46.219 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.219 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 2: conflicting requests 2024-02-09T07:53:46.220 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.220 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 3: conflicting requests 2024-02-09T07:53:46.220 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.220 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 4: conflicting requests 2024-02-09T07:53:46.220 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.220 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 5: conflicting requests 2024-02-09T07:53:46.220 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.220 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 6: conflicting requests 2024-02-09T07:53:46.220 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.220 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 7: conflicting requests 2024-02-09T07:53:46.220 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.220 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 8: conflicting requests 2024-02-09T07:53:46.220 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.221 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 9: conflicting requests 2024-02-09T07:53:46.221 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.221 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 10: conflicting requests 2024-02-09T07:53:46.221 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.221 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 11: conflicting requests 2024-02-09T07:53:46.221 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.221 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 12: conflicting requests 2024-02-09T07:53:46.221 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.221 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 13: conflicting requests 2024-02-09T07:53:46.221 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.221 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 14: conflicting requests 2024-02-09T07:53:46.221 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.221 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 15: conflicting requests 2024-02-09T07:53:46.222 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.222 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 16: conflicting requests 2024-02-09T07:53:46.222 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.222 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 17: conflicting requests 2024-02-09T07:53:46.222 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.222 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 18: conflicting requests 2024-02-09T07:53:46.222 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.222 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 19: conflicting requests 2024-02-09T07:53:46.222 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.222 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 20: conflicting requests 2024-02-09T07:53:46.222 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.222 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 21: conflicting requests 2024-02-09T07:53:46.222 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.223 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 22: conflicting requests 2024-02-09T07:53:46.223 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.223 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 23: conflicting requests 2024-02-09T07:53:46.223 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.223 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 24: conflicting requests 2024-02-09T07:53:46.223 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.223 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 25: conflicting requests 2024-02-09T07:53:46.223 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.223 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 26: conflicting requests 2024-02-09T07:53:46.223 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.223 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 27: conflicting requests 2024-02-09T07:53:46.223 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.223 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 28: conflicting requests 2024-02-09T07:53:46.223 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.224 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 29: conflicting requests 2024-02-09T07:53:46.224 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.224 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 30: conflicting requests 2024-02-09T07:53:46.224 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.224 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 31: conflicting requests 2024-02-09T07:53:46.224 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.224 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 32: conflicting requests 2024-02-09T07:53:46.224 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.224 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 33: conflicting requests 2024-02-09T07:53:46.224 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.224 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 34: conflicting requests 2024-02-09T07:53:46.224 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.224 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 35: conflicting requests 2024-02-09T07:53:46.225 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.225 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 36: conflicting requests 2024-02-09T07:53:46.225 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.225 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 37: conflicting requests 2024-02-09T07:53:46.225 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.225 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.225 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.225 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:53:46.225 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.225 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.225 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.225 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.225 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 39: conflicting requests 2024-02-09T07:53:46.226 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.226 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.226 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.226 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.226 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.226 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.226 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:53:46.226 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.226 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.226 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.226 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.226 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:53:46.226 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.226 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.227 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.227 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.227 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:53:46.227 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.227 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.227 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.227 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.227 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:53:46.227 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.227 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.227 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.227 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.227 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:53:46.227 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.228 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.228 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.228 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.228 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:53:46.228 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.228 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.228 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.228 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:53:46.287 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-02-09T07:53:46.288 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:53:46.288 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repo Size 2024-02-09T07:53:46.288 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:53:46.288 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-02-09T07:53:46.288 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-common-debuginfo x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 416 M 2024-02-09T07:53:46.288 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:53:46.288 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-02-09T07:53:46.289 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:53:46.289 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-02-09T07:53:46.289 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:53:46.289 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 416 M 2024-02-09T07:53:46.289 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 1.7 G 2024-02-09T07:53:46.289 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-02-09T07:54:16.585 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-02-09T07:54:16.679 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-common-debuginfo-2:19.0.0-1310.g0089f33e.el9.x8 1/1 2024-02-09T07:54:23.652 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-common-debuginfo-2:19.0.0-1310.g0089f33e.el9.x8 1/1 2024-02-09T07:54:23.972 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-common-debuginfo-2:19.0.0-1310.g0089f33e.el9.x8 1/1 2024-02-09T07:54:23.973 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:54:23.973 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-02-09T07:54:23.973 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-common-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:54:23.973 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:54:23.973 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-02-09T07:54:24.188 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2024-02-09T07:54:24.818 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:04:30 ago on Fri 09 Feb 2024 07:49:54 AM UTC. 2024-02-09T07:54:25.139 INFO:teuthology.orchestra.run.smithi062.stderr:Modular dependency problems: 2024-02-09T07:54:25.139 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T07:54:25.139 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 1: conflicting requests 2024-02-09T07:54:25.139 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.139 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 2: conflicting requests 2024-02-09T07:54:25.139 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.139 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 3: conflicting requests 2024-02-09T07:54:25.139 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.140 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 4: conflicting requests 2024-02-09T07:54:25.140 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.140 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 5: conflicting requests 2024-02-09T07:54:25.140 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.140 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 6: conflicting requests 2024-02-09T07:54:25.140 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.140 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 7: conflicting requests 2024-02-09T07:54:25.140 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.140 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 8: conflicting requests 2024-02-09T07:54:25.140 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.140 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 9: conflicting requests 2024-02-09T07:54:25.140 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.141 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 10: conflicting requests 2024-02-09T07:54:25.141 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.141 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 11: conflicting requests 2024-02-09T07:54:25.141 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.141 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 12: conflicting requests 2024-02-09T07:54:25.141 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.141 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 13: conflicting requests 2024-02-09T07:54:25.141 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.141 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 14: conflicting requests 2024-02-09T07:54:25.141 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.141 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 15: conflicting requests 2024-02-09T07:54:25.141 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.142 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 16: conflicting requests 2024-02-09T07:54:25.142 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.142 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 17: conflicting requests 2024-02-09T07:54:25.142 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.142 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 18: conflicting requests 2024-02-09T07:54:25.142 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.142 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 19: conflicting requests 2024-02-09T07:54:25.142 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.142 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 20: conflicting requests 2024-02-09T07:54:25.142 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.142 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 21: conflicting requests 2024-02-09T07:54:25.142 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.142 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 22: conflicting requests 2024-02-09T07:54:25.143 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.143 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 23: conflicting requests 2024-02-09T07:54:25.143 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.143 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 24: conflicting requests 2024-02-09T07:54:25.143 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.143 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 25: conflicting requests 2024-02-09T07:54:25.143 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.143 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 26: conflicting requests 2024-02-09T07:54:25.143 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.143 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 27: conflicting requests 2024-02-09T07:54:25.143 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.144 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 28: conflicting requests 2024-02-09T07:54:25.144 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.144 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 29: conflicting requests 2024-02-09T07:54:25.144 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.144 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 30: conflicting requests 2024-02-09T07:54:25.144 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.144 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 31: conflicting requests 2024-02-09T07:54:25.144 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.144 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 32: conflicting requests 2024-02-09T07:54:25.144 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.144 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 33: conflicting requests 2024-02-09T07:54:25.144 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.145 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 34: conflicting requests 2024-02-09T07:54:25.145 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.145 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 35: conflicting requests 2024-02-09T07:54:25.145 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.145 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 36: conflicting requests 2024-02-09T07:54:25.145 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.145 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 37: conflicting requests 2024-02-09T07:54:25.145 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.145 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.145 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.146 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:54:25.146 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.146 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.146 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.146 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.146 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 39: conflicting requests 2024-02-09T07:54:25.147 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.147 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.147 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.147 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.147 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.147 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.147 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:54:25.148 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.148 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.148 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.148 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.148 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:54:25.149 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.149 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.149 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.149 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.149 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:54:25.149 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.149 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.150 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.150 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.150 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:54:25.150 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.150 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.150 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.151 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.151 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:54:25.151 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.151 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.151 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.151 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.151 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:54:25.152 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.152 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.152 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.152 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:54:25.211 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-02-09T07:54:25.211 INFO:teuthology.orchestra.run.smithi062.stdout:======================================================================================== 2024-02-09T07:54:25.212 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repo Size 2024-02-09T07:54:25.212 INFO:teuthology.orchestra.run.smithi062.stdout:======================================================================================== 2024-02-09T07:54:25.212 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-02-09T07:54:25.212 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 1.4 M 2024-02-09T07:54:25.212 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:54:25.212 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-02-09T07:54:25.212 INFO:teuthology.orchestra.run.smithi062.stdout:======================================================================================== 2024-02-09T07:54:25.212 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2024-02-09T07:54:25.213 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:54:25.213 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 1.4 M 2024-02-09T07:54:25.213 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 6.4 M 2024-02-09T07:54:25.214 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-02-09T07:54:25.905 INFO:teuthology.orchestra.run.smithi062.stdout:ceph-immutable-object-cache-debuginfo-19.0.0-13 2.1 MB/s | 1.4 MB 00:00 2024-02-09T07:54:25.906 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:54:25.906 INFO:teuthology.orchestra.run.smithi062.stdout:Total 2.1 MB/s | 1.4 MB 00:00 2024-02-09T07:54:25.906 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-02-09T07:54:25.910 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-02-09T07:54:25.910 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-02-09T07:54:25.952 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-02-09T07:54:25.953 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-02-09T07:54:26.219 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-02-09T07:54:26.315 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.0.0-1310. 1/1 2024-02-09T07:54:26.722 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:19.0.0-1310. 1/1 2024-02-09T07:54:27.017 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.0.0-1310. 1/1 2024-02-09T07:54:27.017 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:54:27.017 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-02-09T07:54:27.017 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-immutable-object-cache-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:54:27.017 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:54:27.017 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-02-09T07:54:27.169 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-radosgw-debuginfo 2024-02-09T07:54:27.788 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:04:33 ago on Fri 09 Feb 2024 07:49:54 AM UTC. 2024-02-09T07:54:28.098 INFO:teuthology.orchestra.run.smithi062.stderr:Modular dependency problems: 2024-02-09T07:54:28.098 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T07:54:28.099 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 1: conflicting requests 2024-02-09T07:54:28.099 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.099 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 2: conflicting requests 2024-02-09T07:54:28.099 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.099 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 3: conflicting requests 2024-02-09T07:54:28.099 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.099 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 4: conflicting requests 2024-02-09T07:54:28.099 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.099 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 5: conflicting requests 2024-02-09T07:54:28.099 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.099 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 6: conflicting requests 2024-02-09T07:54:28.099 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.099 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 7: conflicting requests 2024-02-09T07:54:28.099 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.100 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 8: conflicting requests 2024-02-09T07:54:28.100 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.100 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 9: conflicting requests 2024-02-09T07:54:28.100 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.100 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 10: conflicting requests 2024-02-09T07:54:28.100 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.100 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 11: conflicting requests 2024-02-09T07:54:28.100 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.100 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 12: conflicting requests 2024-02-09T07:54:28.100 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.100 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 13: conflicting requests 2024-02-09T07:54:28.100 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.100 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 14: conflicting requests 2024-02-09T07:54:28.100 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.101 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 15: conflicting requests 2024-02-09T07:54:28.101 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.101 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 16: conflicting requests 2024-02-09T07:54:28.101 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.101 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 17: conflicting requests 2024-02-09T07:54:28.101 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.101 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 18: conflicting requests 2024-02-09T07:54:28.101 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.101 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 19: conflicting requests 2024-02-09T07:54:28.101 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.101 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 20: conflicting requests 2024-02-09T07:54:28.101 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.101 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 21: conflicting requests 2024-02-09T07:54:28.101 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.101 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 22: conflicting requests 2024-02-09T07:54:28.102 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.102 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 23: conflicting requests 2024-02-09T07:54:28.102 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.102 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 24: conflicting requests 2024-02-09T07:54:28.102 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.102 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 25: conflicting requests 2024-02-09T07:54:28.102 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.102 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 26: conflicting requests 2024-02-09T07:54:28.102 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.102 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 27: conflicting requests 2024-02-09T07:54:28.102 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.102 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 28: conflicting requests 2024-02-09T07:54:28.102 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.103 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 29: conflicting requests 2024-02-09T07:54:28.103 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.103 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 30: conflicting requests 2024-02-09T07:54:28.103 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.103 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 31: conflicting requests 2024-02-09T07:54:28.103 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.103 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 32: conflicting requests 2024-02-09T07:54:28.103 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.103 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 33: conflicting requests 2024-02-09T07:54:28.103 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.103 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 34: conflicting requests 2024-02-09T07:54:28.103 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.103 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 35: conflicting requests 2024-02-09T07:54:28.103 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.103 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 36: conflicting requests 2024-02-09T07:54:28.104 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.104 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 37: conflicting requests 2024-02-09T07:54:28.104 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.104 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.104 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.104 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:54:28.104 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.104 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.104 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.104 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.104 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 39: conflicting requests 2024-02-09T07:54:28.104 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.104 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.105 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.105 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.105 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.105 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.105 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:54:28.105 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.105 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.105 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.105 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.105 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:54:28.105 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.105 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.105 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.105 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.106 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:54:28.106 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.106 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.106 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.106 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.106 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:54:28.106 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.106 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.106 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.106 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.106 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:54:28.106 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.106 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.107 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.107 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.107 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:54:28.107 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.107 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.107 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.107 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:54:28.170 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-02-09T07:54:28.170 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:54:28.170 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repo Size 2024-02-09T07:54:28.171 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:54:28.171 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-02-09T07:54:28.171 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-radosgw-debuginfo x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 176 M 2024-02-09T07:54:28.171 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:54:28.171 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-02-09T07:54:28.171 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:54:28.171 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2024-02-09T07:54:28.171 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:54:28.172 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 176 M 2024-02-09T07:54:28.172 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 753 M 2024-02-09T07:54:28.172 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-02-09T07:54:37.932 INFO:teuthology.orchestra.run.smithi062.stdout:ceph-radosgw-debuginfo-19.0.0-1310.g0089f33e.el 18 MB/s | 176 MB 00:09 2024-02-09T07:54:37.933 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:54:37.934 INFO:teuthology.orchestra.run.smithi062.stdout:Total 18 MB/s | 176 MB 00:09 2024-02-09T07:54:37.934 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-02-09T07:54:37.938 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-02-09T07:54:37.938 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-02-09T07:54:38.019 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-common-debuginfo-19.0.0-1310.g0089f33e.el9 8.0 MB/s | 416 MB 00:51 2024-02-09T07:54:38.020 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:54:38.020 INFO:teuthology.orchestra.run.smithi103.stdout:Total 8.0 MB/s | 416 MB 00:51 2024-02-09T07:54:38.020 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-02-09T07:54:38.025 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-02-09T07:54:38.025 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-02-09T07:54:39.053 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-02-09T07:54:39.053 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-02-09T07:54:40.509 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-02-09T07:54:40.510 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-02-09T07:54:58.108 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-02-09T07:54:58.198 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-radosgw-debuginfo-2:19.0.0-1310.g0089f33e.el9.x 1/1 2024-02-09T07:55:02.907 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:19.0.0-1310.g0089f33e.el9.x 1/1 2024-02-09T07:55:03.216 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-radosgw-debuginfo-2:19.0.0-1310.g0089f33e.el9.x 1/1 2024-02-09T07:55:03.216 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:55:03.216 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-02-09T07:55:03.216 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-radosgw-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:55:03.216 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:55:03.216 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-02-09T07:55:03.404 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-test-debuginfo 2024-02-09T07:55:04.022 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:05:10 ago on Fri 09 Feb 2024 07:49:54 AM UTC. 2024-02-09T07:55:04.352 INFO:teuthology.orchestra.run.smithi062.stderr:Modular dependency problems: 2024-02-09T07:55:04.352 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T07:55:04.352 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 1: conflicting requests 2024-02-09T07:55:04.352 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.353 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 2: conflicting requests 2024-02-09T07:55:04.353 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.353 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 3: conflicting requests 2024-02-09T07:55:04.353 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.353 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 4: conflicting requests 2024-02-09T07:55:04.353 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.353 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 5: conflicting requests 2024-02-09T07:55:04.353 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.353 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 6: conflicting requests 2024-02-09T07:55:04.353 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.353 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 7: conflicting requests 2024-02-09T07:55:04.353 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.353 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 8: conflicting requests 2024-02-09T07:55:04.354 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.354 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 9: conflicting requests 2024-02-09T07:55:04.354 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.354 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 10: conflicting requests 2024-02-09T07:55:04.354 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.354 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 11: conflicting requests 2024-02-09T07:55:04.354 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.354 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 12: conflicting requests 2024-02-09T07:55:04.354 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.354 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 13: conflicting requests 2024-02-09T07:55:04.354 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.354 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 14: conflicting requests 2024-02-09T07:55:04.354 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.355 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 15: conflicting requests 2024-02-09T07:55:04.355 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.355 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 16: conflicting requests 2024-02-09T07:55:04.355 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.355 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 17: conflicting requests 2024-02-09T07:55:04.355 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.355 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 18: conflicting requests 2024-02-09T07:55:04.355 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.355 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 19: conflicting requests 2024-02-09T07:55:04.355 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.355 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 20: conflicting requests 2024-02-09T07:55:04.355 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.355 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 21: conflicting requests 2024-02-09T07:55:04.356 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.356 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 22: conflicting requests 2024-02-09T07:55:04.356 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.356 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 23: conflicting requests 2024-02-09T07:55:04.356 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.356 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 24: conflicting requests 2024-02-09T07:55:04.356 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.356 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 25: conflicting requests 2024-02-09T07:55:04.356 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.356 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 26: conflicting requests 2024-02-09T07:55:04.356 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.356 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 27: conflicting requests 2024-02-09T07:55:04.356 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.357 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 28: conflicting requests 2024-02-09T07:55:04.357 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.357 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 29: conflicting requests 2024-02-09T07:55:04.357 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.357 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 30: conflicting requests 2024-02-09T07:55:04.357 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.357 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 31: conflicting requests 2024-02-09T07:55:04.357 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.357 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 32: conflicting requests 2024-02-09T07:55:04.357 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.357 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 33: conflicting requests 2024-02-09T07:55:04.357 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.357 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 34: conflicting requests 2024-02-09T07:55:04.357 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.358 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 35: conflicting requests 2024-02-09T07:55:04.358 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.358 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 36: conflicting requests 2024-02-09T07:55:04.358 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.358 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 37: conflicting requests 2024-02-09T07:55:04.358 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.358 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.358 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.358 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:55:04.358 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.358 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.358 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.358 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.358 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 39: conflicting requests 2024-02-09T07:55:04.359 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.359 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.359 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.359 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.359 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.359 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.359 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:55:04.359 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.359 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.359 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.359 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.359 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:55:04.359 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.359 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.360 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.360 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.360 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:55:04.360 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.360 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.360 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.360 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.360 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:55:04.360 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.360 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.360 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.360 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.360 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:55:04.360 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.361 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.361 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.361 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.361 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:55:04.361 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.361 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.361 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.361 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:55:04.423 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-02-09T07:55:04.423 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:55:04.424 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repo Size 2024-02-09T07:55:04.424 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:55:04.424 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-02-09T07:55:04.424 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-test-debuginfo x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 672 M 2024-02-09T07:55:04.424 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:55:04.424 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-02-09T07:55:04.424 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:55:04.424 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2024-02-09T07:55:04.424 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:55:04.425 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 672 M 2024-02-09T07:55:04.425 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 3.1 G 2024-02-09T07:55:04.427 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-02-09T07:55:22.970 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-02-09T07:55:23.066 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-common-debuginfo-2:19.0.0-1310.g0089f33e.el9.x8 1/1 2024-02-09T07:55:27.891 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-common-debuginfo-2:19.0.0-1310.g0089f33e.el9.x8 1/1 2024-02-09T07:55:28.180 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-common-debuginfo-2:19.0.0-1310.g0089f33e.el9.x8 1/1 2024-02-09T07:55:28.180 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:55:28.180 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-02-09T07:55:28.180 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-common-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:55:28.180 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:55:28.180 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-02-09T07:55:28.426 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2024-02-09T07:55:29.037 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:05:34 ago on Fri 09 Feb 2024 07:49:55 AM UTC. 2024-02-09T07:55:29.338 INFO:teuthology.orchestra.run.smithi103.stderr:Modular dependency problems: 2024-02-09T07:55:29.339 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T07:55:29.339 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 1: conflicting requests 2024-02-09T07:55:29.339 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.339 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 2: conflicting requests 2024-02-09T07:55:29.339 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.339 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 3: conflicting requests 2024-02-09T07:55:29.339 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.339 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 4: conflicting requests 2024-02-09T07:55:29.339 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.339 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 5: conflicting requests 2024-02-09T07:55:29.339 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.339 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 6: conflicting requests 2024-02-09T07:55:29.340 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.340 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 7: conflicting requests 2024-02-09T07:55:29.340 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.340 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 8: conflicting requests 2024-02-09T07:55:29.340 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.340 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 9: conflicting requests 2024-02-09T07:55:29.340 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.340 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 10: conflicting requests 2024-02-09T07:55:29.340 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.340 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 11: conflicting requests 2024-02-09T07:55:29.340 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.340 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 12: conflicting requests 2024-02-09T07:55:29.341 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.341 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 13: conflicting requests 2024-02-09T07:55:29.341 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.341 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 14: conflicting requests 2024-02-09T07:55:29.341 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.341 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 15: conflicting requests 2024-02-09T07:55:29.341 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.341 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 16: conflicting requests 2024-02-09T07:55:29.341 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.341 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 17: conflicting requests 2024-02-09T07:55:29.341 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.341 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 18: conflicting requests 2024-02-09T07:55:29.342 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.342 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 19: conflicting requests 2024-02-09T07:55:29.342 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.342 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 20: conflicting requests 2024-02-09T07:55:29.342 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.342 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 21: conflicting requests 2024-02-09T07:55:29.342 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.342 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 22: conflicting requests 2024-02-09T07:55:29.342 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.342 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 23: conflicting requests 2024-02-09T07:55:29.342 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.342 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 24: conflicting requests 2024-02-09T07:55:29.342 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.342 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 25: conflicting requests 2024-02-09T07:55:29.343 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.343 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 26: conflicting requests 2024-02-09T07:55:29.343 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.343 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 27: conflicting requests 2024-02-09T07:55:29.343 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.343 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 28: conflicting requests 2024-02-09T07:55:29.343 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.343 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 29: conflicting requests 2024-02-09T07:55:29.343 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.343 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 30: conflicting requests 2024-02-09T07:55:29.343 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.343 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 31: conflicting requests 2024-02-09T07:55:29.343 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.344 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 32: conflicting requests 2024-02-09T07:55:29.344 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.344 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 33: conflicting requests 2024-02-09T07:55:29.344 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.344 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 34: conflicting requests 2024-02-09T07:55:29.344 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.344 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 35: conflicting requests 2024-02-09T07:55:29.344 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.344 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 36: conflicting requests 2024-02-09T07:55:29.344 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.344 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 37: conflicting requests 2024-02-09T07:55:29.344 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.344 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.344 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.345 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:55:29.345 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.345 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.345 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.345 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.345 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 39: conflicting requests 2024-02-09T07:55:29.345 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.345 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.345 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.345 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.345 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.345 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.345 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:55:29.345 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.346 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.346 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.346 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.346 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:55:29.346 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.346 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.346 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.346 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.346 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:55:29.346 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.346 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.346 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.346 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.346 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:55:29.347 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.347 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.347 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.347 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.347 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:55:29.347 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.347 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.347 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.347 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.347 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:55:29.347 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.347 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.347 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.348 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:55:29.407 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-02-09T07:55:29.407 INFO:teuthology.orchestra.run.smithi103.stdout:======================================================================================== 2024-02-09T07:55:29.408 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repo Size 2024-02-09T07:55:29.408 INFO:teuthology.orchestra.run.smithi103.stdout:======================================================================================== 2024-02-09T07:55:29.408 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-02-09T07:55:29.408 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 1.4 M 2024-02-09T07:55:29.408 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:55:29.408 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-02-09T07:55:29.408 INFO:teuthology.orchestra.run.smithi103.stdout:======================================================================================== 2024-02-09T07:55:29.408 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-02-09T07:55:29.408 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:55:29.408 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 1.4 M 2024-02-09T07:55:29.408 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 6.4 M 2024-02-09T07:55:29.409 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-02-09T07:55:29.945 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-immutable-object-cache-debuginfo-19.0.0-13 2.7 MB/s | 1.4 MB 00:00 2024-02-09T07:55:29.945 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:55:29.946 INFO:teuthology.orchestra.run.smithi103.stdout:Total 2.6 MB/s | 1.4 MB 00:00 2024-02-09T07:55:29.946 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-02-09T07:55:29.949 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-02-09T07:55:29.949 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-02-09T07:55:29.992 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-02-09T07:55:29.992 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-02-09T07:55:30.251 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-02-09T07:55:30.352 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.0.0-1310. 1/1 2024-02-09T07:55:30.764 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:19.0.0-1310. 1/1 2024-02-09T07:55:31.101 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.0.0-1310. 1/1 2024-02-09T07:55:31.101 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:55:31.101 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-02-09T07:55:31.101 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-immutable-object-cache-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:55:31.101 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:55:31.101 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-02-09T07:55:31.294 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-radosgw-debuginfo 2024-02-09T07:55:31.902 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:05:36 ago on Fri 09 Feb 2024 07:49:55 AM UTC. 2024-02-09T07:55:32.197 INFO:teuthology.orchestra.run.smithi103.stderr:Modular dependency problems: 2024-02-09T07:55:32.197 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T07:55:32.197 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 1: conflicting requests 2024-02-09T07:55:32.197 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.197 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 2: conflicting requests 2024-02-09T07:55:32.197 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.197 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 3: conflicting requests 2024-02-09T07:55:32.197 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.198 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 4: conflicting requests 2024-02-09T07:55:32.198 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.198 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 5: conflicting requests 2024-02-09T07:55:32.198 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.198 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 6: conflicting requests 2024-02-09T07:55:32.198 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.198 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 7: conflicting requests 2024-02-09T07:55:32.198 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.198 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 8: conflicting requests 2024-02-09T07:55:32.198 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.198 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 9: conflicting requests 2024-02-09T07:55:32.198 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.198 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 10: conflicting requests 2024-02-09T07:55:32.198 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.199 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 11: conflicting requests 2024-02-09T07:55:32.199 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.199 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 12: conflicting requests 2024-02-09T07:55:32.199 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.199 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 13: conflicting requests 2024-02-09T07:55:32.199 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.199 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 14: conflicting requests 2024-02-09T07:55:32.199 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.199 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 15: conflicting requests 2024-02-09T07:55:32.199 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.199 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 16: conflicting requests 2024-02-09T07:55:32.199 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.199 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 17: conflicting requests 2024-02-09T07:55:32.199 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.200 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 18: conflicting requests 2024-02-09T07:55:32.200 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.200 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 19: conflicting requests 2024-02-09T07:55:32.200 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.200 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 20: conflicting requests 2024-02-09T07:55:32.200 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.200 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 21: conflicting requests 2024-02-09T07:55:32.200 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.200 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 22: conflicting requests 2024-02-09T07:55:32.200 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.200 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 23: conflicting requests 2024-02-09T07:55:32.200 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.200 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 24: conflicting requests 2024-02-09T07:55:32.200 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.201 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 25: conflicting requests 2024-02-09T07:55:32.201 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.201 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 26: conflicting requests 2024-02-09T07:55:32.201 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.201 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 27: conflicting requests 2024-02-09T07:55:32.201 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.201 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 28: conflicting requests 2024-02-09T07:55:32.201 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.201 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 29: conflicting requests 2024-02-09T07:55:32.201 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.201 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 30: conflicting requests 2024-02-09T07:55:32.201 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.202 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 31: conflicting requests 2024-02-09T07:55:32.202 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.202 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 32: conflicting requests 2024-02-09T07:55:32.202 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.202 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 33: conflicting requests 2024-02-09T07:55:32.202 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.202 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 34: conflicting requests 2024-02-09T07:55:32.202 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.202 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 35: conflicting requests 2024-02-09T07:55:32.202 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.202 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 36: conflicting requests 2024-02-09T07:55:32.202 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.202 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 37: conflicting requests 2024-02-09T07:55:32.202 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.203 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.203 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.203 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:55:32.203 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.203 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.203 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.203 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.203 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 39: conflicting requests 2024-02-09T07:55:32.203 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.203 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.203 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.203 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.203 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.203 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.204 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:55:32.204 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.204 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.204 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.204 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.204 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:55:32.204 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.204 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.204 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.204 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.204 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:55:32.204 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.204 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.205 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.205 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.205 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:55:32.205 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.205 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.205 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.205 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.205 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:55:32.205 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.205 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.205 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.205 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.205 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:55:32.205 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.206 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.206 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.206 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:55:32.265 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-02-09T07:55:32.266 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:55:32.266 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repo Size 2024-02-09T07:55:32.266 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:55:32.266 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-02-09T07:55:32.266 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-radosgw-debuginfo x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 176 M 2024-02-09T07:55:32.266 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:55:32.266 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-02-09T07:55:32.266 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:55:32.266 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-02-09T07:55:32.266 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:55:32.266 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 176 M 2024-02-09T07:55:32.267 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 753 M 2024-02-09T07:55:32.267 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-02-09T07:55:34.764 INFO:teuthology.orchestra.run.smithi062.stdout:ceph-test-debuginfo-19.0.0-1310.g0089f33e.el9.x 22 MB/s | 672 MB 00:30 2024-02-09T07:55:34.765 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:55:34.765 INFO:teuthology.orchestra.run.smithi062.stdout:Total 22 MB/s | 672 MB 00:30 2024-02-09T07:55:34.766 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-02-09T07:55:34.772 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-02-09T07:55:34.772 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-02-09T07:55:38.952 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-02-09T07:55:38.953 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-02-09T07:55:42.298 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-radosgw-debuginfo-19.0.0-1310.g0089f33e.el 18 MB/s | 176 MB 00:10 2024-02-09T07:55:42.298 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:55:42.299 INFO:teuthology.orchestra.run.smithi103.stdout:Total 18 MB/s | 176 MB 00:10 2024-02-09T07:55:42.299 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-02-09T07:55:42.303 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-02-09T07:55:42.304 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-02-09T07:55:43.368 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-02-09T07:55:43.368 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-02-09T07:56:01.395 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-02-09T07:56:01.479 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-radosgw-debuginfo-2:19.0.0-1310.g0089f33e.el9.x 1/1 2024-02-09T07:56:06.280 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:19.0.0-1310.g0089f33e.el9.x 1/1 2024-02-09T07:56:06.579 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-radosgw-debuginfo-2:19.0.0-1310.g0089f33e.el9.x 1/1 2024-02-09T07:56:06.580 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:56:06.580 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-02-09T07:56:06.580 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-radosgw-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:56:06.580 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:56:06.580 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-02-09T07:56:06.804 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-test-debuginfo 2024-02-09T07:56:07.414 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:06:12 ago on Fri 09 Feb 2024 07:49:55 AM UTC. 2024-02-09T07:56:07.709 INFO:teuthology.orchestra.run.smithi103.stderr:Modular dependency problems: 2024-02-09T07:56:07.709 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T07:56:07.709 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 1: conflicting requests 2024-02-09T07:56:07.709 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.709 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 2: conflicting requests 2024-02-09T07:56:07.709 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.710 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 3: conflicting requests 2024-02-09T07:56:07.710 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.710 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 4: conflicting requests 2024-02-09T07:56:07.710 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.710 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 5: conflicting requests 2024-02-09T07:56:07.710 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.710 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 6: conflicting requests 2024-02-09T07:56:07.710 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.710 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 7: conflicting requests 2024-02-09T07:56:07.710 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.710 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 8: conflicting requests 2024-02-09T07:56:07.710 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.710 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 9: conflicting requests 2024-02-09T07:56:07.711 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.711 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 10: conflicting requests 2024-02-09T07:56:07.711 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.711 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 11: conflicting requests 2024-02-09T07:56:07.711 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.711 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 12: conflicting requests 2024-02-09T07:56:07.711 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.711 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 13: conflicting requests 2024-02-09T07:56:07.711 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.711 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 14: conflicting requests 2024-02-09T07:56:07.711 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.711 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 15: conflicting requests 2024-02-09T07:56:07.711 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.711 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 16: conflicting requests 2024-02-09T07:56:07.712 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.712 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 17: conflicting requests 2024-02-09T07:56:07.712 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.712 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 18: conflicting requests 2024-02-09T07:56:07.712 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.712 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 19: conflicting requests 2024-02-09T07:56:07.712 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.712 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 20: conflicting requests 2024-02-09T07:56:07.712 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.712 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 21: conflicting requests 2024-02-09T07:56:07.712 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.712 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 22: conflicting requests 2024-02-09T07:56:07.713 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.713 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 23: conflicting requests 2024-02-09T07:56:07.713 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.713 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 24: conflicting requests 2024-02-09T07:56:07.713 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.713 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 25: conflicting requests 2024-02-09T07:56:07.713 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.713 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 26: conflicting requests 2024-02-09T07:56:07.713 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.713 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 27: conflicting requests 2024-02-09T07:56:07.713 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.713 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 28: conflicting requests 2024-02-09T07:56:07.713 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.714 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 29: conflicting requests 2024-02-09T07:56:07.714 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.714 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 30: conflicting requests 2024-02-09T07:56:07.714 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.714 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 31: conflicting requests 2024-02-09T07:56:07.714 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.714 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 32: conflicting requests 2024-02-09T07:56:07.714 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.714 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 33: conflicting requests 2024-02-09T07:56:07.714 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.714 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 34: conflicting requests 2024-02-09T07:56:07.714 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.714 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 35: conflicting requests 2024-02-09T07:56:07.715 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.715 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 36: conflicting requests 2024-02-09T07:56:07.715 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.715 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 37: conflicting requests 2024-02-09T07:56:07.715 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.715 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.715 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.715 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:56:07.715 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.715 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.715 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.715 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.715 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 39: conflicting requests 2024-02-09T07:56:07.715 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.715 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.716 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.716 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.716 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.716 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.716 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:56:07.716 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.716 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.716 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.716 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.716 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:56:07.716 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.716 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.716 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.717 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.717 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:56:07.717 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.717 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.717 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.717 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.717 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:56:07.717 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.717 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.717 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.718 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.718 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:56:07.718 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.718 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.718 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.718 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.718 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:56:07.718 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.718 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.718 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.718 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:56:07.776 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-02-09T07:56:07.777 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:56:07.777 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repo Size 2024-02-09T07:56:07.777 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:56:07.777 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-02-09T07:56:07.777 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-test-debuginfo x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 672 M 2024-02-09T07:56:07.777 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:56:07.777 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-02-09T07:56:07.777 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:56:07.778 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-02-09T07:56:07.778 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:56:07.778 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 672 M 2024-02-09T07:56:07.778 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 3.1 G 2024-02-09T07:56:07.778 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-02-09T07:56:39.972 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-test-debuginfo-19.0.0-1310.g0089f33e.el9.x 21 MB/s | 672 MB 00:32 2024-02-09T07:56:39.973 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:56:39.973 INFO:teuthology.orchestra.run.smithi103.stdout:Total 21 MB/s | 672 MB 00:32 2024-02-09T07:56:39.973 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-02-09T07:56:39.978 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-02-09T07:56:39.978 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-02-09T07:56:43.941 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-02-09T07:56:43.941 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-02-09T07:56:53.900 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-02-09T07:56:54.009 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-test-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_ 1/1 2024-02-09T07:57:02.891 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-test-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_ 1/1 2024-02-09T07:57:03.221 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-test-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_ 1/1 2024-02-09T07:57:03.221 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:57:03.221 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-02-09T07:57:03.222 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-test-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:57:03.222 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:57:03.222 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-02-09T07:57:03.467 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-base-debuginfo 2024-02-09T07:57:04.081 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:07:10 ago on Fri 09 Feb 2024 07:49:54 AM UTC. 2024-02-09T07:57:04.398 INFO:teuthology.orchestra.run.smithi062.stderr:Modular dependency problems: 2024-02-09T07:57:04.398 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T07:57:04.399 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 1: conflicting requests 2024-02-09T07:57:04.399 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.399 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 2: conflicting requests 2024-02-09T07:57:04.399 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.399 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 3: conflicting requests 2024-02-09T07:57:04.399 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.400 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 4: conflicting requests 2024-02-09T07:57:04.400 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.400 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 5: conflicting requests 2024-02-09T07:57:04.400 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.400 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 6: conflicting requests 2024-02-09T07:57:04.400 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.401 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 7: conflicting requests 2024-02-09T07:57:04.401 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.401 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 8: conflicting requests 2024-02-09T07:57:04.401 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.401 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 9: conflicting requests 2024-02-09T07:57:04.401 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.402 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 10: conflicting requests 2024-02-09T07:57:04.402 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.402 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 11: conflicting requests 2024-02-09T07:57:04.402 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.402 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 12: conflicting requests 2024-02-09T07:57:04.403 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.403 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 13: conflicting requests 2024-02-09T07:57:04.403 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.403 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 14: conflicting requests 2024-02-09T07:57:04.403 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.403 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 15: conflicting requests 2024-02-09T07:57:04.404 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.404 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 16: conflicting requests 2024-02-09T07:57:04.405 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.405 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 17: conflicting requests 2024-02-09T07:57:04.405 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.405 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 18: conflicting requests 2024-02-09T07:57:04.405 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.406 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 19: conflicting requests 2024-02-09T07:57:04.406 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.406 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 20: conflicting requests 2024-02-09T07:57:04.406 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.406 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 21: conflicting requests 2024-02-09T07:57:04.406 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.407 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 22: conflicting requests 2024-02-09T07:57:04.407 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.407 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 23: conflicting requests 2024-02-09T07:57:04.407 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.407 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 24: conflicting requests 2024-02-09T07:57:04.407 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.407 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 25: conflicting requests 2024-02-09T07:57:04.407 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.407 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 26: conflicting requests 2024-02-09T07:57:04.407 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.407 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 27: conflicting requests 2024-02-09T07:57:04.408 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.408 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 28: conflicting requests 2024-02-09T07:57:04.408 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.408 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 29: conflicting requests 2024-02-09T07:57:04.408 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.408 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 30: conflicting requests 2024-02-09T07:57:04.408 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.408 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 31: conflicting requests 2024-02-09T07:57:04.408 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.408 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 32: conflicting requests 2024-02-09T07:57:04.408 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.408 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 33: conflicting requests 2024-02-09T07:57:04.408 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.409 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 34: conflicting requests 2024-02-09T07:57:04.409 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.409 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 35: conflicting requests 2024-02-09T07:57:04.409 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.409 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 36: conflicting requests 2024-02-09T07:57:04.409 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.409 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 37: conflicting requests 2024-02-09T07:57:04.409 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.409 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.409 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.409 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:57:04.409 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.410 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.410 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.410 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.410 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 39: conflicting requests 2024-02-09T07:57:04.410 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.410 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.410 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.410 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.411 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.411 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.411 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:57:04.411 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.411 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.411 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.411 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.411 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:57:04.411 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.412 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.412 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.412 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.412 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:57:04.412 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.412 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.412 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.412 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.413 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:57:04.413 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.413 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.413 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.413 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.413 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:57:04.413 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.413 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.414 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.414 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.414 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:57:04.414 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.414 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.414 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.414 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:57:04.416 INFO:teuthology.orchestra.run.smithi062.stdout:Package ceph-base-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 is already installed. 2024-02-09T07:57:04.469 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-02-09T07:57:04.470 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do. 2024-02-09T07:57:04.470 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-02-09T07:57:04.536 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-mgr-debuginfo 2024-02-09T07:57:05.151 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:07:11 ago on Fri 09 Feb 2024 07:49:54 AM UTC. 2024-02-09T07:57:05.460 INFO:teuthology.orchestra.run.smithi062.stderr:Modular dependency problems: 2024-02-09T07:57:05.460 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T07:57:05.460 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 1: conflicting requests 2024-02-09T07:57:05.461 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.461 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 2: conflicting requests 2024-02-09T07:57:05.461 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.461 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 3: conflicting requests 2024-02-09T07:57:05.461 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.461 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 4: conflicting requests 2024-02-09T07:57:05.461 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.461 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 5: conflicting requests 2024-02-09T07:57:05.461 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.461 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 6: conflicting requests 2024-02-09T07:57:05.461 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.461 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 7: conflicting requests 2024-02-09T07:57:05.461 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.461 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 8: conflicting requests 2024-02-09T07:57:05.462 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.462 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 9: conflicting requests 2024-02-09T07:57:05.462 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.462 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 10: conflicting requests 2024-02-09T07:57:05.462 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.462 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 11: conflicting requests 2024-02-09T07:57:05.462 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.462 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 12: conflicting requests 2024-02-09T07:57:05.462 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.462 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 13: conflicting requests 2024-02-09T07:57:05.462 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.462 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 14: conflicting requests 2024-02-09T07:57:05.462 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.463 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 15: conflicting requests 2024-02-09T07:57:05.463 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.463 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 16: conflicting requests 2024-02-09T07:57:05.463 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.463 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 17: conflicting requests 2024-02-09T07:57:05.463 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.463 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 18: conflicting requests 2024-02-09T07:57:05.463 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.463 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 19: conflicting requests 2024-02-09T07:57:05.463 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.463 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 20: conflicting requests 2024-02-09T07:57:05.463 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.463 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 21: conflicting requests 2024-02-09T07:57:05.463 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.464 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 22: conflicting requests 2024-02-09T07:57:05.464 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.464 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 23: conflicting requests 2024-02-09T07:57:05.464 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.464 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 24: conflicting requests 2024-02-09T07:57:05.464 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.464 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 25: conflicting requests 2024-02-09T07:57:05.464 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.464 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 26: conflicting requests 2024-02-09T07:57:05.464 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.464 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 27: conflicting requests 2024-02-09T07:57:05.464 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.464 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 28: conflicting requests 2024-02-09T07:57:05.465 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.465 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 29: conflicting requests 2024-02-09T07:57:05.465 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.465 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 30: conflicting requests 2024-02-09T07:57:05.465 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.465 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 31: conflicting requests 2024-02-09T07:57:05.465 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.465 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 32: conflicting requests 2024-02-09T07:57:05.465 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.465 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 33: conflicting requests 2024-02-09T07:57:05.465 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.465 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 34: conflicting requests 2024-02-09T07:57:05.465 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.465 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 35: conflicting requests 2024-02-09T07:57:05.465 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.466 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 36: conflicting requests 2024-02-09T07:57:05.466 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.466 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 37: conflicting requests 2024-02-09T07:57:05.466 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.466 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.466 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.466 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:57:05.466 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.466 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.466 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.466 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.466 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 39: conflicting requests 2024-02-09T07:57:05.466 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.466 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.467 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.467 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.467 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.467 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.467 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:57:05.467 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.467 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.467 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.467 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.467 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:57:05.468 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.468 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.469 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.469 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.469 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:57:05.469 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.469 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.469 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.470 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.470 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:57:05.470 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.470 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.470 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.470 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.471 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:57:05.471 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.471 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.471 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.471 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.471 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:57:05.472 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.472 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.472 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.472 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:57:05.532 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-02-09T07:57:05.533 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:57:05.533 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repo Size 2024-02-09T07:57:05.534 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:57:05.534 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-02-09T07:57:05.534 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-debuginfo x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 20 M 2024-02-09T07:57:05.534 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:57:05.534 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-02-09T07:57:05.535 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:57:05.535 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2024-02-09T07:57:05.535 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:57:05.535 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 20 M 2024-02-09T07:57:05.535 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 103 M 2024-02-09T07:57:05.535 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-02-09T07:57:09.187 INFO:teuthology.orchestra.run.smithi062.stdout:ceph-mgr-debuginfo-19.0.0-1310.g0089f33e.el9.x8 5.4 MB/s | 20 MB 00:03 2024-02-09T07:57:09.187 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:57:09.188 INFO:teuthology.orchestra.run.smithi062.stdout:Total 5.4 MB/s | 20 MB 00:03 2024-02-09T07:57:09.188 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-02-09T07:57:09.192 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-02-09T07:57:09.192 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-02-09T07:57:09.348 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-02-09T07:57:09.365 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-02-09T07:57:11.704 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-02-09T07:57:11.796 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_6 1/1 2024-02-09T07:57:12.783 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_6 1/1 2024-02-09T07:57:13.086 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_6 1/1 2024-02-09T07:57:13.086 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:57:13.086 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-02-09T07:57:13.086 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:57:13.086 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:57:13.086 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-02-09T07:57:13.397 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-mds-debuginfo 2024-02-09T07:57:14.017 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:07:20 ago on Fri 09 Feb 2024 07:49:54 AM UTC. 2024-02-09T07:57:14.329 INFO:teuthology.orchestra.run.smithi062.stderr:Modular dependency problems: 2024-02-09T07:57:14.330 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T07:57:14.330 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 1: conflicting requests 2024-02-09T07:57:14.330 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.330 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 2: conflicting requests 2024-02-09T07:57:14.330 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.330 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 3: conflicting requests 2024-02-09T07:57:14.330 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.330 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 4: conflicting requests 2024-02-09T07:57:14.330 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.330 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 5: conflicting requests 2024-02-09T07:57:14.330 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.330 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 6: conflicting requests 2024-02-09T07:57:14.330 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.330 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 7: conflicting requests 2024-02-09T07:57:14.331 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.331 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 8: conflicting requests 2024-02-09T07:57:14.331 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.331 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 9: conflicting requests 2024-02-09T07:57:14.331 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.331 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 10: conflicting requests 2024-02-09T07:57:14.331 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.331 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 11: conflicting requests 2024-02-09T07:57:14.331 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.331 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 12: conflicting requests 2024-02-09T07:57:14.331 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.331 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 13: conflicting requests 2024-02-09T07:57:14.331 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.331 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 14: conflicting requests 2024-02-09T07:57:14.332 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.332 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 15: conflicting requests 2024-02-09T07:57:14.332 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.332 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 16: conflicting requests 2024-02-09T07:57:14.332 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.332 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 17: conflicting requests 2024-02-09T07:57:14.332 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.332 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 18: conflicting requests 2024-02-09T07:57:14.332 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.332 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 19: conflicting requests 2024-02-09T07:57:14.332 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.332 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 20: conflicting requests 2024-02-09T07:57:14.332 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.333 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 21: conflicting requests 2024-02-09T07:57:14.333 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.333 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 22: conflicting requests 2024-02-09T07:57:14.333 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.333 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 23: conflicting requests 2024-02-09T07:57:14.333 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.333 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 24: conflicting requests 2024-02-09T07:57:14.333 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.333 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 25: conflicting requests 2024-02-09T07:57:14.333 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.333 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 26: conflicting requests 2024-02-09T07:57:14.333 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.333 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 27: conflicting requests 2024-02-09T07:57:14.333 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.334 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 28: conflicting requests 2024-02-09T07:57:14.334 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.334 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 29: conflicting requests 2024-02-09T07:57:14.334 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.334 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 30: conflicting requests 2024-02-09T07:57:14.334 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.334 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 31: conflicting requests 2024-02-09T07:57:14.334 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.334 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 32: conflicting requests 2024-02-09T07:57:14.334 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.334 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 33: conflicting requests 2024-02-09T07:57:14.334 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.334 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 34: conflicting requests 2024-02-09T07:57:14.334 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.334 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 35: conflicting requests 2024-02-09T07:57:14.335 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.335 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 36: conflicting requests 2024-02-09T07:57:14.335 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.335 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 37: conflicting requests 2024-02-09T07:57:14.335 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.335 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.335 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.335 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:57:14.335 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.335 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.335 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.335 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.335 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 39: conflicting requests 2024-02-09T07:57:14.336 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.336 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.336 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.336 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.336 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.336 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.336 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:57:14.336 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.336 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.336 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.336 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.337 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:57:14.337 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.337 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.337 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.337 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.337 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:57:14.338 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.338 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.338 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.338 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.338 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:57:14.338 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.338 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.338 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.339 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.339 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:57:14.339 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.339 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.339 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.339 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.339 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:57:14.339 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.339 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.339 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.339 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:57:14.401 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-02-09T07:57:14.401 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:57:14.402 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repo Size 2024-02-09T07:57:14.402 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:57:14.402 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-02-09T07:57:14.402 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mds-debuginfo x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 48 M 2024-02-09T07:57:14.402 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:57:14.402 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-02-09T07:57:14.402 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:57:14.402 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2024-02-09T07:57:14.402 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:57:14.402 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 48 M 2024-02-09T07:57:14.402 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 174 M 2024-02-09T07:57:14.402 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-02-09T07:57:19.505 INFO:teuthology.orchestra.run.smithi062.stdout:ceph-mds-debuginfo-19.0.0-1310.g0089f33e.el9.x8 9.4 MB/s | 48 MB 00:05 2024-02-09T07:57:19.505 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:57:19.506 INFO:teuthology.orchestra.run.smithi062.stdout:Total 9.4 MB/s | 48 MB 00:05 2024-02-09T07:57:19.506 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-02-09T07:57:19.510 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-02-09T07:57:19.510 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-02-09T07:57:19.838 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-02-09T07:57:19.839 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-02-09T07:57:24.889 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-02-09T07:57:24.989 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mds-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_6 1/1 2024-02-09T07:57:26.345 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mds-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_6 1/1 2024-02-09T07:57:26.655 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mds-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_6 1/1 2024-02-09T07:57:26.655 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:57:26.655 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-02-09T07:57:26.655 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mds-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:57:26.655 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:57:26.655 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-02-09T07:57:26.829 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-mon-debuginfo 2024-02-09T07:57:27.447 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:07:33 ago on Fri 09 Feb 2024 07:49:54 AM UTC. 2024-02-09T07:57:27.756 INFO:teuthology.orchestra.run.smithi062.stderr:Modular dependency problems: 2024-02-09T07:57:27.756 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T07:57:27.756 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 1: conflicting requests 2024-02-09T07:57:27.756 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.756 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 2: conflicting requests 2024-02-09T07:57:27.756 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.756 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 3: conflicting requests 2024-02-09T07:57:27.756 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.756 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 4: conflicting requests 2024-02-09T07:57:27.756 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.757 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 5: conflicting requests 2024-02-09T07:57:27.757 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.757 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 6: conflicting requests 2024-02-09T07:57:27.757 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.757 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 7: conflicting requests 2024-02-09T07:57:27.757 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.757 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 8: conflicting requests 2024-02-09T07:57:27.757 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.757 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 9: conflicting requests 2024-02-09T07:57:27.757 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.757 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 10: conflicting requests 2024-02-09T07:57:27.757 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.757 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 11: conflicting requests 2024-02-09T07:57:27.757 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.758 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 12: conflicting requests 2024-02-09T07:57:27.758 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.758 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 13: conflicting requests 2024-02-09T07:57:27.758 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.758 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 14: conflicting requests 2024-02-09T07:57:27.758 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.758 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 15: conflicting requests 2024-02-09T07:57:27.758 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.758 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 16: conflicting requests 2024-02-09T07:57:27.758 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.758 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 17: conflicting requests 2024-02-09T07:57:27.758 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.758 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 18: conflicting requests 2024-02-09T07:57:27.758 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.759 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 19: conflicting requests 2024-02-09T07:57:27.759 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.759 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 20: conflicting requests 2024-02-09T07:57:27.759 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.759 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 21: conflicting requests 2024-02-09T07:57:27.759 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.759 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 22: conflicting requests 2024-02-09T07:57:27.759 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.759 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 23: conflicting requests 2024-02-09T07:57:27.759 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.759 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 24: conflicting requests 2024-02-09T07:57:27.759 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.759 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 25: conflicting requests 2024-02-09T07:57:27.759 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.760 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 26: conflicting requests 2024-02-09T07:57:27.760 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.760 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 27: conflicting requests 2024-02-09T07:57:27.760 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.760 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 28: conflicting requests 2024-02-09T07:57:27.760 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.760 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 29: conflicting requests 2024-02-09T07:57:27.760 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.760 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 30: conflicting requests 2024-02-09T07:57:27.760 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.760 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 31: conflicting requests 2024-02-09T07:57:27.760 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.760 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 32: conflicting requests 2024-02-09T07:57:27.760 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.761 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 33: conflicting requests 2024-02-09T07:57:27.761 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.761 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 34: conflicting requests 2024-02-09T07:57:27.761 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.761 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 35: conflicting requests 2024-02-09T07:57:27.761 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.761 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 36: conflicting requests 2024-02-09T07:57:27.761 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.761 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 37: conflicting requests 2024-02-09T07:57:27.761 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.761 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.761 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.761 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:57:27.762 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.762 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.762 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.762 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.762 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 39: conflicting requests 2024-02-09T07:57:27.762 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.762 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.762 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.762 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.762 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.762 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.762 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:57:27.762 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.762 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.762 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.763 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.763 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:57:27.763 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.763 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.763 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.763 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.763 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:57:27.763 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.763 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.763 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.763 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.763 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:57:27.763 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.764 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.764 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.764 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.764 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:57:27.764 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.764 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.764 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.764 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.764 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:57:27.764 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.764 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.764 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.764 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:57:27.827 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-02-09T07:57:27.827 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:57:27.827 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repo Size 2024-02-09T07:57:27.828 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:57:27.828 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-02-09T07:57:27.828 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mon-debuginfo x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 99 M 2024-02-09T07:57:27.828 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:57:27.828 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-02-09T07:57:27.828 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:57:27.828 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2024-02-09T07:57:27.828 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:57:27.828 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 99 M 2024-02-09T07:57:27.828 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 449 M 2024-02-09T07:57:27.828 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-02-09T07:57:38.956 INFO:teuthology.orchestra.run.smithi062.stdout:ceph-mon-debuginfo-19.0.0-1310.g0089f33e.el9.x8 8.9 MB/s | 99 MB 00:11 2024-02-09T07:57:38.957 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:57:38.958 INFO:teuthology.orchestra.run.smithi062.stdout:Total 8.9 MB/s | 99 MB 00:11 2024-02-09T07:57:38.958 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-02-09T07:57:38.962 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-02-09T07:57:38.962 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-02-09T07:57:39.602 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-02-09T07:57:39.602 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-02-09T07:57:50.480 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-02-09T07:57:50.581 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mon-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_6 1/1 2024-02-09T07:57:53.615 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mon-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_6 1/1 2024-02-09T07:57:53.927 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mon-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_6 1/1 2024-02-09T07:57:53.927 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:57:53.928 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-02-09T07:57:53.928 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mon-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:57:53.928 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:57:53.928 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-02-09T07:57:54.095 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-osd-debuginfo 2024-02-09T07:57:54.693 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-02-09T07:57:54.712 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:08:00 ago on Fri 09 Feb 2024 07:49:54 AM UTC. 2024-02-09T07:57:55.028 INFO:teuthology.orchestra.run.smithi062.stderr:Modular dependency problems: 2024-02-09T07:57:55.029 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T07:57:55.029 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 1: conflicting requests 2024-02-09T07:57:55.029 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.029 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 2: conflicting requests 2024-02-09T07:57:55.031 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.031 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 3: conflicting requests 2024-02-09T07:57:55.031 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.031 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 4: conflicting requests 2024-02-09T07:57:55.031 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.032 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 5: conflicting requests 2024-02-09T07:57:55.032 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.032 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 6: conflicting requests 2024-02-09T07:57:55.032 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.032 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 7: conflicting requests 2024-02-09T07:57:55.032 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.032 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 8: conflicting requests 2024-02-09T07:57:55.032 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.033 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 9: conflicting requests 2024-02-09T07:57:55.033 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.033 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 10: conflicting requests 2024-02-09T07:57:55.033 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.033 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 11: conflicting requests 2024-02-09T07:57:55.033 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.033 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 12: conflicting requests 2024-02-09T07:57:55.033 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.033 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 13: conflicting requests 2024-02-09T07:57:55.033 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.034 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 14: conflicting requests 2024-02-09T07:57:55.034 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.034 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 15: conflicting requests 2024-02-09T07:57:55.034 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.034 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 16: conflicting requests 2024-02-09T07:57:55.034 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.034 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 17: conflicting requests 2024-02-09T07:57:55.034 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.034 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 18: conflicting requests 2024-02-09T07:57:55.034 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.035 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 19: conflicting requests 2024-02-09T07:57:55.035 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.035 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 20: conflicting requests 2024-02-09T07:57:55.035 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.035 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 21: conflicting requests 2024-02-09T07:57:55.035 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.035 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 22: conflicting requests 2024-02-09T07:57:55.035 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.036 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 23: conflicting requests 2024-02-09T07:57:55.036 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.036 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 24: conflicting requests 2024-02-09T07:57:55.036 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.036 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 25: conflicting requests 2024-02-09T07:57:55.036 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.037 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 26: conflicting requests 2024-02-09T07:57:55.037 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.037 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 27: conflicting requests 2024-02-09T07:57:55.037 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.037 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 28: conflicting requests 2024-02-09T07:57:55.037 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.038 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 29: conflicting requests 2024-02-09T07:57:55.038 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.039 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 30: conflicting requests 2024-02-09T07:57:55.040 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.040 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 31: conflicting requests 2024-02-09T07:57:55.040 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.040 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 32: conflicting requests 2024-02-09T07:57:55.040 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.040 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 33: conflicting requests 2024-02-09T07:57:55.040 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.040 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 34: conflicting requests 2024-02-09T07:57:55.040 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.041 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 35: conflicting requests 2024-02-09T07:57:55.041 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.041 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 36: conflicting requests 2024-02-09T07:57:55.041 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.041 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 37: conflicting requests 2024-02-09T07:57:55.041 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.041 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.041 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.041 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:57:55.041 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.042 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.042 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.042 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.042 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 39: conflicting requests 2024-02-09T07:57:55.042 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.042 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.042 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.042 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.042 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.042 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.042 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:57:55.042 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.042 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.042 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.043 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.043 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:57:55.043 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.043 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.043 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.043 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.043 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:57:55.043 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.043 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.043 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.043 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.043 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:57:55.043 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.043 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.044 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.044 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.044 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:57:55.044 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.044 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.044 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.045 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.045 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:57:55.045 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.045 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.045 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.045 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:57:55.100 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-02-09T07:57:55.101 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:57:55.101 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repo Size 2024-02-09T07:57:55.101 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:57:55.102 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-02-09T07:57:55.102 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-osd-debuginfo x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 287 M 2024-02-09T07:57:55.102 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:57:55.102 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-02-09T07:57:55.102 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:57:55.102 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2024-02-09T07:57:55.102 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:57:55.102 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 287 M 2024-02-09T07:57:55.102 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 1.2 G 2024-02-09T07:57:55.102 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-02-09T07:57:55.326 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-test-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_ 1/1 2024-02-09T07:58:04.648 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-test-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_ 1/1 2024-02-09T07:58:04.967 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-test-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_ 1/1 2024-02-09T07:58:04.967 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:58:04.967 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-02-09T07:58:04.967 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-test-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:58:04.967 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:58:04.967 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-02-09T07:58:05.271 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-base-debuginfo 2024-02-09T07:58:05.881 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:08:10 ago on Fri 09 Feb 2024 07:49:55 AM UTC. 2024-02-09T07:58:06.182 INFO:teuthology.orchestra.run.smithi103.stderr:Modular dependency problems: 2024-02-09T07:58:06.182 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T07:58:06.182 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 1: conflicting requests 2024-02-09T07:58:06.183 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.183 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 2: conflicting requests 2024-02-09T07:58:06.183 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.183 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 3: conflicting requests 2024-02-09T07:58:06.183 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.183 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 4: conflicting requests 2024-02-09T07:58:06.183 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.183 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 5: conflicting requests 2024-02-09T07:58:06.183 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.183 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 6: conflicting requests 2024-02-09T07:58:06.183 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.183 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 7: conflicting requests 2024-02-09T07:58:06.184 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.184 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 8: conflicting requests 2024-02-09T07:58:06.184 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.184 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 9: conflicting requests 2024-02-09T07:58:06.184 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.184 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 10: conflicting requests 2024-02-09T07:58:06.184 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.184 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 11: conflicting requests 2024-02-09T07:58:06.184 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.184 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 12: conflicting requests 2024-02-09T07:58:06.184 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.184 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 13: conflicting requests 2024-02-09T07:58:06.184 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.185 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 14: conflicting requests 2024-02-09T07:58:06.185 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.185 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 15: conflicting requests 2024-02-09T07:58:06.185 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.185 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 16: conflicting requests 2024-02-09T07:58:06.185 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.185 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 17: conflicting requests 2024-02-09T07:58:06.185 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.185 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 18: conflicting requests 2024-02-09T07:58:06.185 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.185 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 19: conflicting requests 2024-02-09T07:58:06.185 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.185 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 20: conflicting requests 2024-02-09T07:58:06.185 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.186 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 21: conflicting requests 2024-02-09T07:58:06.186 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.186 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 22: conflicting requests 2024-02-09T07:58:06.186 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.186 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 23: conflicting requests 2024-02-09T07:58:06.186 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.186 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 24: conflicting requests 2024-02-09T07:58:06.186 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.186 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 25: conflicting requests 2024-02-09T07:58:06.186 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.186 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 26: conflicting requests 2024-02-09T07:58:06.186 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.186 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 27: conflicting requests 2024-02-09T07:58:06.187 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.187 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 28: conflicting requests 2024-02-09T07:58:06.187 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.187 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 29: conflicting requests 2024-02-09T07:58:06.187 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.187 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 30: conflicting requests 2024-02-09T07:58:06.187 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.187 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 31: conflicting requests 2024-02-09T07:58:06.187 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.187 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 32: conflicting requests 2024-02-09T07:58:06.187 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.188 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 33: conflicting requests 2024-02-09T07:58:06.188 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.188 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 34: conflicting requests 2024-02-09T07:58:06.188 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.189 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 35: conflicting requests 2024-02-09T07:58:06.189 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.189 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 36: conflicting requests 2024-02-09T07:58:06.189 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.189 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 37: conflicting requests 2024-02-09T07:58:06.189 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.189 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.189 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.189 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:58:06.190 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.190 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.190 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.190 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.190 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 39: conflicting requests 2024-02-09T07:58:06.190 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.190 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.190 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.190 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.191 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.191 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.191 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:58:06.191 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.191 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.191 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.191 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.191 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:58:06.192 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.192 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.192 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.192 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.192 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:58:06.192 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.192 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.192 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.192 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.193 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:58:06.193 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.193 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.193 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.193 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.194 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:58:06.194 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.194 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.194 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.194 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.194 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:58:06.194 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.195 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.195 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.195 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:58:06.195 INFO:teuthology.orchestra.run.smithi103.stdout:Package ceph-base-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 is already installed. 2024-02-09T07:58:06.250 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-02-09T07:58:06.251 INFO:teuthology.orchestra.run.smithi103.stdout:Nothing to do. 2024-02-09T07:58:06.251 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-02-09T07:58:06.327 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-mgr-debuginfo 2024-02-09T07:58:06.971 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:08:11 ago on Fri 09 Feb 2024 07:49:55 AM UTC. 2024-02-09T07:58:07.275 INFO:teuthology.orchestra.run.smithi103.stderr:Modular dependency problems: 2024-02-09T07:58:07.276 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T07:58:07.276 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 1: conflicting requests 2024-02-09T07:58:07.276 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.276 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 2: conflicting requests 2024-02-09T07:58:07.276 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.276 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 3: conflicting requests 2024-02-09T07:58:07.276 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.276 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 4: conflicting requests 2024-02-09T07:58:07.276 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.276 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 5: conflicting requests 2024-02-09T07:58:07.277 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.277 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 6: conflicting requests 2024-02-09T07:58:07.277 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.277 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 7: conflicting requests 2024-02-09T07:58:07.277 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.277 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 8: conflicting requests 2024-02-09T07:58:07.277 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.277 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 9: conflicting requests 2024-02-09T07:58:07.277 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.277 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 10: conflicting requests 2024-02-09T07:58:07.278 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.278 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 11: conflicting requests 2024-02-09T07:58:07.278 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.278 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 12: conflicting requests 2024-02-09T07:58:07.278 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.278 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 13: conflicting requests 2024-02-09T07:58:07.278 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.278 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 14: conflicting requests 2024-02-09T07:58:07.278 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.278 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 15: conflicting requests 2024-02-09T07:58:07.278 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.278 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 16: conflicting requests 2024-02-09T07:58:07.278 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.279 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 17: conflicting requests 2024-02-09T07:58:07.279 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.279 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 18: conflicting requests 2024-02-09T07:58:07.279 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.279 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 19: conflicting requests 2024-02-09T07:58:07.279 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.280 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 20: conflicting requests 2024-02-09T07:58:07.280 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.280 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 21: conflicting requests 2024-02-09T07:58:07.280 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.280 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 22: conflicting requests 2024-02-09T07:58:07.280 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.281 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 23: conflicting requests 2024-02-09T07:58:07.281 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.281 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 24: conflicting requests 2024-02-09T07:58:07.281 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.281 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 25: conflicting requests 2024-02-09T07:58:07.281 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.281 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 26: conflicting requests 2024-02-09T07:58:07.281 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.281 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 27: conflicting requests 2024-02-09T07:58:07.282 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.282 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 28: conflicting requests 2024-02-09T07:58:07.282 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.282 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 29: conflicting requests 2024-02-09T07:58:07.282 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.282 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 30: conflicting requests 2024-02-09T07:58:07.282 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.282 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 31: conflicting requests 2024-02-09T07:58:07.282 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.282 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 32: conflicting requests 2024-02-09T07:58:07.282 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.282 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 33: conflicting requests 2024-02-09T07:58:07.282 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.282 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 34: conflicting requests 2024-02-09T07:58:07.283 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.283 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 35: conflicting requests 2024-02-09T07:58:07.283 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.283 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 36: conflicting requests 2024-02-09T07:58:07.283 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.283 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 37: conflicting requests 2024-02-09T07:58:07.284 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.284 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.284 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.284 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:58:07.284 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.284 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.284 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.285 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.285 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 39: conflicting requests 2024-02-09T07:58:07.285 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.285 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.285 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.285 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.285 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.285 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.285 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:58:07.285 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.285 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.285 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.286 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.286 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:58:07.286 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.286 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.286 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.286 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.286 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:58:07.286 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.286 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.286 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.286 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.286 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:58:07.286 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.286 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.287 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.287 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.287 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:58:07.287 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.287 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.287 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.287 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.287 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:58:07.287 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.287 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.287 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.287 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:58:07.346 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-02-09T07:58:07.347 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:58:07.348 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repo Size 2024-02-09T07:58:07.348 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:58:07.348 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-02-09T07:58:07.348 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-debuginfo x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 20 M 2024-02-09T07:58:07.348 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:58:07.348 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-02-09T07:58:07.349 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:58:07.349 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-02-09T07:58:07.349 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:58:07.349 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 20 M 2024-02-09T07:58:07.349 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 103 M 2024-02-09T07:58:07.349 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-02-09T07:58:10.040 INFO:teuthology.orchestra.run.smithi062.stdout:ceph-osd-debuginfo-19.0.0-1310.g0089f33e.el9.x8 19 MB/s | 287 MB 00:14 2024-02-09T07:58:10.041 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:58:10.041 INFO:teuthology.orchestra.run.smithi062.stdout:Total 19 MB/s | 287 MB 00:14 2024-02-09T07:58:10.042 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-02-09T07:58:10.046 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-02-09T07:58:10.046 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-02-09T07:58:11.839 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-02-09T07:58:11.839 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-02-09T07:58:16.012 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr-debuginfo-19.0.0-1310.g0089f33e.el9.x8 2.3 MB/s | 20 MB 00:08 2024-02-09T07:58:16.013 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:58:16.013 INFO:teuthology.orchestra.run.smithi103.stdout:Total 2.3 MB/s | 20 MB 00:08 2024-02-09T07:58:16.014 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-02-09T07:58:16.019 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-02-09T07:58:16.019 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-02-09T07:58:16.170 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-02-09T07:58:16.170 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-02-09T07:58:18.420 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-02-09T07:58:18.520 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_6 1/1 2024-02-09T07:58:19.545 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_6 1/1 2024-02-09T07:58:19.845 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_6 1/1 2024-02-09T07:58:19.845 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:58:19.845 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-02-09T07:58:19.845 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:58:19.845 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:58:19.846 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-02-09T07:58:20.023 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-mds-debuginfo 2024-02-09T07:58:20.625 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:08:25 ago on Fri 09 Feb 2024 07:49:55 AM UTC. 2024-02-09T07:58:20.919 INFO:teuthology.orchestra.run.smithi103.stderr:Modular dependency problems: 2024-02-09T07:58:20.919 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T07:58:20.919 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 1: conflicting requests 2024-02-09T07:58:20.919 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.919 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 2: conflicting requests 2024-02-09T07:58:20.919 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.919 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 3: conflicting requests 2024-02-09T07:58:20.919 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.919 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 4: conflicting requests 2024-02-09T07:58:20.919 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.920 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 5: conflicting requests 2024-02-09T07:58:20.920 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.920 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 6: conflicting requests 2024-02-09T07:58:20.920 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.920 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 7: conflicting requests 2024-02-09T07:58:20.920 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.920 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 8: conflicting requests 2024-02-09T07:58:20.920 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.920 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 9: conflicting requests 2024-02-09T07:58:20.920 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.920 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 10: conflicting requests 2024-02-09T07:58:20.920 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.920 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 11: conflicting requests 2024-02-09T07:58:20.921 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.921 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 12: conflicting requests 2024-02-09T07:58:20.921 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.921 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 13: conflicting requests 2024-02-09T07:58:20.921 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.921 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 14: conflicting requests 2024-02-09T07:58:20.921 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.921 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 15: conflicting requests 2024-02-09T07:58:20.921 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.921 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 16: conflicting requests 2024-02-09T07:58:20.921 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.921 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 17: conflicting requests 2024-02-09T07:58:20.921 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.922 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 18: conflicting requests 2024-02-09T07:58:20.922 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.922 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 19: conflicting requests 2024-02-09T07:58:20.922 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.922 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 20: conflicting requests 2024-02-09T07:58:20.922 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.922 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 21: conflicting requests 2024-02-09T07:58:20.922 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.922 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 22: conflicting requests 2024-02-09T07:58:20.922 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.922 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 23: conflicting requests 2024-02-09T07:58:20.922 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.922 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 24: conflicting requests 2024-02-09T07:58:20.922 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.923 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 25: conflicting requests 2024-02-09T07:58:20.923 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.923 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 26: conflicting requests 2024-02-09T07:58:20.923 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.923 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 27: conflicting requests 2024-02-09T07:58:20.923 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.923 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 28: conflicting requests 2024-02-09T07:58:20.923 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.923 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 29: conflicting requests 2024-02-09T07:58:20.923 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.923 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 30: conflicting requests 2024-02-09T07:58:20.923 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.923 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 31: conflicting requests 2024-02-09T07:58:20.923 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.924 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 32: conflicting requests 2024-02-09T07:58:20.924 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.924 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 33: conflicting requests 2024-02-09T07:58:20.924 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.924 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 34: conflicting requests 2024-02-09T07:58:20.924 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.924 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 35: conflicting requests 2024-02-09T07:58:20.924 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.924 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 36: conflicting requests 2024-02-09T07:58:20.924 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.924 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 37: conflicting requests 2024-02-09T07:58:20.924 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.924 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.924 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.925 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:58:20.925 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.925 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.925 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.925 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.925 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 39: conflicting requests 2024-02-09T07:58:20.925 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.925 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.925 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.925 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.925 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.925 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.925 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:58:20.925 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.926 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.926 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.926 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.926 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:58:20.926 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.926 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.926 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.926 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.926 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:58:20.926 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.926 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.926 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.926 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.926 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:58:20.927 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.927 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.927 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.927 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.927 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:58:20.927 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.927 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.927 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.927 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.927 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:58:20.927 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.927 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.927 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.927 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:58:20.986 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-02-09T07:58:20.987 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:58:20.987 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repo Size 2024-02-09T07:58:20.987 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:58:20.987 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-02-09T07:58:20.987 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mds-debuginfo x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 48 M 2024-02-09T07:58:20.987 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:58:20.987 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-02-09T07:58:20.987 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:58:20.987 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-02-09T07:58:20.988 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:58:20.988 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 48 M 2024-02-09T07:58:20.988 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 174 M 2024-02-09T07:58:20.988 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-02-09T07:58:23.957 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds-debuginfo-19.0.0-1310.g0089f33e.el9.x8 16 MB/s | 48 MB 00:02 2024-02-09T07:58:23.958 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:58:23.958 INFO:teuthology.orchestra.run.smithi103.stdout:Total 16 MB/s | 48 MB 00:02 2024-02-09T07:58:23.958 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-02-09T07:58:23.962 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-02-09T07:58:23.962 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-02-09T07:58:24.276 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-02-09T07:58:24.277 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-02-09T07:58:29.020 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-02-09T07:58:29.163 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mds-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_6 1/1 2024-02-09T07:58:30.615 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mds-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_6 1/1 2024-02-09T07:58:30.910 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mds-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_6 1/1 2024-02-09T07:58:30.910 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:58:30.910 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-02-09T07:58:30.910 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mds-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:58:30.910 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:58:30.910 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-02-09T07:58:31.105 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-mon-debuginfo 2024-02-09T07:58:31.710 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:08:36 ago on Fri 09 Feb 2024 07:49:55 AM UTC. 2024-02-09T07:58:32.005 INFO:teuthology.orchestra.run.smithi103.stderr:Modular dependency problems: 2024-02-09T07:58:32.005 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T07:58:32.005 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 1: conflicting requests 2024-02-09T07:58:32.005 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.005 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 2: conflicting requests 2024-02-09T07:58:32.006 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.006 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 3: conflicting requests 2024-02-09T07:58:32.006 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.006 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 4: conflicting requests 2024-02-09T07:58:32.006 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.006 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 5: conflicting requests 2024-02-09T07:58:32.006 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.006 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 6: conflicting requests 2024-02-09T07:58:32.006 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.006 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 7: conflicting requests 2024-02-09T07:58:32.006 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.006 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 8: conflicting requests 2024-02-09T07:58:32.006 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.007 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 9: conflicting requests 2024-02-09T07:58:32.007 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.007 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 10: conflicting requests 2024-02-09T07:58:32.007 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.007 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 11: conflicting requests 2024-02-09T07:58:32.007 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.007 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 12: conflicting requests 2024-02-09T07:58:32.007 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.007 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 13: conflicting requests 2024-02-09T07:58:32.007 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.007 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 14: conflicting requests 2024-02-09T07:58:32.007 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.007 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 15: conflicting requests 2024-02-09T07:58:32.008 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.008 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 16: conflicting requests 2024-02-09T07:58:32.008 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.008 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 17: conflicting requests 2024-02-09T07:58:32.008 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.008 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 18: conflicting requests 2024-02-09T07:58:32.008 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.008 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 19: conflicting requests 2024-02-09T07:58:32.008 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.008 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 20: conflicting requests 2024-02-09T07:58:32.008 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.008 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 21: conflicting requests 2024-02-09T07:58:32.009 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.009 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 22: conflicting requests 2024-02-09T07:58:32.009 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.009 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 23: conflicting requests 2024-02-09T07:58:32.009 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.009 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 24: conflicting requests 2024-02-09T07:58:32.009 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.009 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 25: conflicting requests 2024-02-09T07:58:32.009 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.009 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 26: conflicting requests 2024-02-09T07:58:32.009 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.009 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 27: conflicting requests 2024-02-09T07:58:32.009 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.010 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 28: conflicting requests 2024-02-09T07:58:32.010 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.010 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 29: conflicting requests 2024-02-09T07:58:32.010 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.010 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 30: conflicting requests 2024-02-09T07:58:32.011 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.011 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 31: conflicting requests 2024-02-09T07:58:32.011 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.011 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 32: conflicting requests 2024-02-09T07:58:32.011 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.011 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 33: conflicting requests 2024-02-09T07:58:32.011 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.011 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 34: conflicting requests 2024-02-09T07:58:32.011 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.011 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 35: conflicting requests 2024-02-09T07:58:32.011 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.011 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 36: conflicting requests 2024-02-09T07:58:32.011 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.011 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 37: conflicting requests 2024-02-09T07:58:32.012 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.012 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.012 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.012 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:58:32.012 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.012 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.012 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.012 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.012 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 39: conflicting requests 2024-02-09T07:58:32.012 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.012 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.012 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.012 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.013 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.013 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.013 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:58:32.013 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.013 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.013 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.013 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.013 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:58:32.013 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.013 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.013 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.014 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.014 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:58:32.014 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.014 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.014 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.014 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.014 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:58:32.014 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.014 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.014 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.014 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.014 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:58:32.015 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.015 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.015 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.015 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.015 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:58:32.015 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.015 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.015 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.015 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:58:32.079 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-02-09T07:58:32.079 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:58:32.079 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repo Size 2024-02-09T07:58:32.079 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:58:32.080 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-02-09T07:58:32.080 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mon-debuginfo x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 99 M 2024-02-09T07:58:32.081 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:58:32.081 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-02-09T07:58:32.082 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:58:32.082 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-02-09T07:58:32.082 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:58:32.083 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 99 M 2024-02-09T07:58:32.083 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 449 M 2024-02-09T07:58:32.083 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-02-09T07:58:36.818 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon-debuginfo-19.0.0-1310.g0089f33e.el9.x8 21 MB/s | 99 MB 00:04 2024-02-09T07:58:36.818 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:58:36.819 INFO:teuthology.orchestra.run.smithi103.stdout:Total 21 MB/s | 99 MB 00:04 2024-02-09T07:58:36.819 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-02-09T07:58:36.823 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-02-09T07:58:36.824 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-02-09T07:58:37.435 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-02-09T07:58:37.436 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-02-09T07:58:43.323 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-02-09T07:58:43.430 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-osd-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_6 1/1 2024-02-09T07:58:47.748 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-02-09T07:58:47.849 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mon-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_6 1/1 2024-02-09T07:58:50.868 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mon-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_6 1/1 2024-02-09T07:58:50.967 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-osd-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_6 1/1 2024-02-09T07:58:51.162 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mon-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_6 1/1 2024-02-09T07:58:51.163 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:58:51.163 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-02-09T07:58:51.163 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mon-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:58:51.163 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:58:51.163 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-02-09T07:58:51.269 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-osd-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_6 1/1 2024-02-09T07:58:51.269 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:58:51.270 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-02-09T07:58:51.270 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-osd-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:58:51.270 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:58:51.270 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-02-09T07:58:51.349 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-osd-debuginfo 2024-02-09T07:58:51.458 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-fuse-debuginfo 2024-02-09T07:58:51.956 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:08:56 ago on Fri 09 Feb 2024 07:49:55 AM UTC. 2024-02-09T07:58:52.073 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:08:58 ago on Fri 09 Feb 2024 07:49:54 AM UTC. 2024-02-09T07:58:52.259 INFO:teuthology.orchestra.run.smithi103.stderr:Modular dependency problems: 2024-02-09T07:58:52.260 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T07:58:52.260 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 1: conflicting requests 2024-02-09T07:58:52.260 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.260 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 2: conflicting requests 2024-02-09T07:58:52.260 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.260 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 3: conflicting requests 2024-02-09T07:58:52.260 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.260 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 4: conflicting requests 2024-02-09T07:58:52.260 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.260 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 5: conflicting requests 2024-02-09T07:58:52.260 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.260 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 6: conflicting requests 2024-02-09T07:58:52.261 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.261 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 7: conflicting requests 2024-02-09T07:58:52.261 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.261 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 8: conflicting requests 2024-02-09T07:58:52.261 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.261 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 9: conflicting requests 2024-02-09T07:58:52.261 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.261 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 10: conflicting requests 2024-02-09T07:58:52.261 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.261 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 11: conflicting requests 2024-02-09T07:58:52.261 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.261 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 12: conflicting requests 2024-02-09T07:58:52.261 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.261 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 13: conflicting requests 2024-02-09T07:58:52.262 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.262 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 14: conflicting requests 2024-02-09T07:58:52.262 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.262 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 15: conflicting requests 2024-02-09T07:58:52.262 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.262 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 16: conflicting requests 2024-02-09T07:58:52.262 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.262 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 17: conflicting requests 2024-02-09T07:58:52.262 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.262 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 18: conflicting requests 2024-02-09T07:58:52.262 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.262 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 19: conflicting requests 2024-02-09T07:58:52.262 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.263 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 20: conflicting requests 2024-02-09T07:58:52.263 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.263 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 21: conflicting requests 2024-02-09T07:58:52.263 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.263 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 22: conflicting requests 2024-02-09T07:58:52.263 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.263 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 23: conflicting requests 2024-02-09T07:58:52.263 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.263 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 24: conflicting requests 2024-02-09T07:58:52.263 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.263 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 25: conflicting requests 2024-02-09T07:58:52.263 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.263 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 26: conflicting requests 2024-02-09T07:58:52.263 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.263 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 27: conflicting requests 2024-02-09T07:58:52.264 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.264 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 28: conflicting requests 2024-02-09T07:58:52.264 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.264 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 29: conflicting requests 2024-02-09T07:58:52.264 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.264 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 30: conflicting requests 2024-02-09T07:58:52.264 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.264 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 31: conflicting requests 2024-02-09T07:58:52.264 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.265 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 32: conflicting requests 2024-02-09T07:58:52.265 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.265 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 33: conflicting requests 2024-02-09T07:58:52.265 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.265 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 34: conflicting requests 2024-02-09T07:58:52.265 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.265 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 35: conflicting requests 2024-02-09T07:58:52.265 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.265 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 36: conflicting requests 2024-02-09T07:58:52.265 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.265 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 37: conflicting requests 2024-02-09T07:58:52.265 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.265 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.265 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.265 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:58:52.266 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.266 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.266 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.266 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.266 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 39: conflicting requests 2024-02-09T07:58:52.266 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.266 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.266 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.266 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.266 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.266 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.266 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:58:52.267 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.267 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.267 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.267 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.267 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:58:52.267 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.267 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.268 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.268 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.268 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:58:52.268 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.268 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.268 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.268 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.268 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:58:52.268 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.268 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.269 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.269 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.269 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:58:52.269 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.269 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.269 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.269 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.269 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:58:52.269 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.269 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.269 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.269 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.326 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-02-09T07:58:52.327 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:58:52.327 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repo Size 2024-02-09T07:58:52.327 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:58:52.327 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-02-09T07:58:52.328 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-osd-debuginfo x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 287 M 2024-02-09T07:58:52.328 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:58:52.328 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-02-09T07:58:52.328 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T07:58:52.328 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-02-09T07:58:52.328 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T07:58:52.328 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 287 M 2024-02-09T07:58:52.328 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 1.2 G 2024-02-09T07:58:52.328 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-02-09T07:58:52.388 INFO:teuthology.orchestra.run.smithi062.stderr:Modular dependency problems: 2024-02-09T07:58:52.388 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T07:58:52.388 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 1: conflicting requests 2024-02-09T07:58:52.388 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.388 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 2: conflicting requests 2024-02-09T07:58:52.389 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.389 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 3: conflicting requests 2024-02-09T07:58:52.389 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.389 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 4: conflicting requests 2024-02-09T07:58:52.389 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.389 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 5: conflicting requests 2024-02-09T07:58:52.389 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.389 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 6: conflicting requests 2024-02-09T07:58:52.389 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.389 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 7: conflicting requests 2024-02-09T07:58:52.390 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.390 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 8: conflicting requests 2024-02-09T07:58:52.390 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.390 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 9: conflicting requests 2024-02-09T07:58:52.390 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.390 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 10: conflicting requests 2024-02-09T07:58:52.390 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.390 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 11: conflicting requests 2024-02-09T07:58:52.390 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.391 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 12: conflicting requests 2024-02-09T07:58:52.391 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.391 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 13: conflicting requests 2024-02-09T07:58:52.391 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.391 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 14: conflicting requests 2024-02-09T07:58:52.391 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.391 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 15: conflicting requests 2024-02-09T07:58:52.391 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.391 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 16: conflicting requests 2024-02-09T07:58:52.392 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.392 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 17: conflicting requests 2024-02-09T07:58:52.392 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.392 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 18: conflicting requests 2024-02-09T07:58:52.392 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.392 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 19: conflicting requests 2024-02-09T07:58:52.392 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.392 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 20: conflicting requests 2024-02-09T07:58:52.392 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.393 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 21: conflicting requests 2024-02-09T07:58:52.393 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.393 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 22: conflicting requests 2024-02-09T07:58:52.394 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.394 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 23: conflicting requests 2024-02-09T07:58:52.395 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.395 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 24: conflicting requests 2024-02-09T07:58:52.395 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.395 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 25: conflicting requests 2024-02-09T07:58:52.395 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.396 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 26: conflicting requests 2024-02-09T07:58:52.396 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.396 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 27: conflicting requests 2024-02-09T07:58:52.396 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.396 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 28: conflicting requests 2024-02-09T07:58:52.396 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.397 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 29: conflicting requests 2024-02-09T07:58:52.397 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.397 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 30: conflicting requests 2024-02-09T07:58:52.397 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.397 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 31: conflicting requests 2024-02-09T07:58:52.397 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.398 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 32: conflicting requests 2024-02-09T07:58:52.398 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.398 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 33: conflicting requests 2024-02-09T07:58:52.398 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.398 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 34: conflicting requests 2024-02-09T07:58:52.398 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.399 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 35: conflicting requests 2024-02-09T07:58:52.399 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.399 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 36: conflicting requests 2024-02-09T07:58:52.399 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.399 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 37: conflicting requests 2024-02-09T07:58:52.399 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.399 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.400 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.400 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:58:52.400 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.400 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.400 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.401 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.401 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 39: conflicting requests 2024-02-09T07:58:52.401 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.401 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.401 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.401 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.401 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.402 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.402 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:58:52.402 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.402 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.402 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.402 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.403 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:58:52.403 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.403 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.403 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.403 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.403 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:58:52.403 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.404 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.404 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.404 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.405 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:58:52.405 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.405 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.405 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.406 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.406 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:58:52.406 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.406 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.406 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.406 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.406 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:58:52.407 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.407 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.407 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.407 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:58:52.460 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-02-09T07:58:52.461 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:58:52.461 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repo Size 2024-02-09T07:58:52.461 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:58:52.461 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-02-09T07:58:52.461 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-fuse-debuginfo x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 5.9 M 2024-02-09T07:58:52.461 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:58:52.461 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-02-09T07:58:52.461 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:58:52.461 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2024-02-09T07:58:52.461 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:58:52.462 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 5.9 M 2024-02-09T07:58:52.462 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 28 M 2024-02-09T07:58:52.462 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-02-09T07:58:57.348 INFO:teuthology.orchestra.run.smithi062.stdout:ceph-fuse-debuginfo-19.0.0-1310.g0089f33e.el9.x 1.2 MB/s | 5.9 MB 00:04 2024-02-09T07:58:57.495 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:58:57.495 INFO:teuthology.orchestra.run.smithi062.stdout:Total 1.2 MB/s | 5.9 MB 00:04 2024-02-09T07:58:57.495 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-02-09T07:58:57.495 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-02-09T07:58:57.495 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-02-09T07:58:57.496 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-02-09T07:58:57.496 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-02-09T07:58:58.198 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-02-09T07:58:58.292 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-fuse-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_ 1/1 2024-02-09T07:58:58.859 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-fuse-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_ 1/1 2024-02-09T07:58:59.159 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-fuse-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_ 1/1 2024-02-09T07:58:59.159 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:58:59.159 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-02-09T07:58:59.159 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-fuse-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:58:59.159 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:58:59.159 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-02-09T07:58:59.336 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install librados-devel-debuginfo 2024-02-09T07:58:59.954 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:09:05 ago on Fri 09 Feb 2024 07:49:54 AM UTC. 2024-02-09T07:59:00.268 INFO:teuthology.orchestra.run.smithi062.stderr:Modular dependency problems: 2024-02-09T07:59:00.269 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T07:59:00.269 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 1: conflicting requests 2024-02-09T07:59:00.269 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.269 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 2: conflicting requests 2024-02-09T07:59:00.269 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.269 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 3: conflicting requests 2024-02-09T07:59:00.269 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.269 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 4: conflicting requests 2024-02-09T07:59:00.269 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.269 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 5: conflicting requests 2024-02-09T07:59:00.269 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.270 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 6: conflicting requests 2024-02-09T07:59:00.270 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.270 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 7: conflicting requests 2024-02-09T07:59:00.270 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.270 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 8: conflicting requests 2024-02-09T07:59:00.270 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.270 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 9: conflicting requests 2024-02-09T07:59:00.270 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.270 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 10: conflicting requests 2024-02-09T07:59:00.270 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.271 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 11: conflicting requests 2024-02-09T07:59:00.271 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.271 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 12: conflicting requests 2024-02-09T07:59:00.271 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.271 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 13: conflicting requests 2024-02-09T07:59:00.271 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.271 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 14: conflicting requests 2024-02-09T07:59:00.271 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.271 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 15: conflicting requests 2024-02-09T07:59:00.271 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.271 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 16: conflicting requests 2024-02-09T07:59:00.271 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.271 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 17: conflicting requests 2024-02-09T07:59:00.271 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.272 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 18: conflicting requests 2024-02-09T07:59:00.272 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.272 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 19: conflicting requests 2024-02-09T07:59:00.272 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.272 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 20: conflicting requests 2024-02-09T07:59:00.272 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.273 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 21: conflicting requests 2024-02-09T07:59:00.273 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.273 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 22: conflicting requests 2024-02-09T07:59:00.274 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.274 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 23: conflicting requests 2024-02-09T07:59:00.274 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.274 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 24: conflicting requests 2024-02-09T07:59:00.274 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.275 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 25: conflicting requests 2024-02-09T07:59:00.275 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.275 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 26: conflicting requests 2024-02-09T07:59:00.275 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.275 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 27: conflicting requests 2024-02-09T07:59:00.276 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.276 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 28: conflicting requests 2024-02-09T07:59:00.276 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.276 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 29: conflicting requests 2024-02-09T07:59:00.277 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.277 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 30: conflicting requests 2024-02-09T07:59:00.277 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.277 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 31: conflicting requests 2024-02-09T07:59:00.277 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.277 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 32: conflicting requests 2024-02-09T07:59:00.277 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.277 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 33: conflicting requests 2024-02-09T07:59:00.277 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.278 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 34: conflicting requests 2024-02-09T07:59:00.278 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.278 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 35: conflicting requests 2024-02-09T07:59:00.278 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.278 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 36: conflicting requests 2024-02-09T07:59:00.278 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.278 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 37: conflicting requests 2024-02-09T07:59:00.278 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.278 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.278 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.278 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:59:00.278 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.278 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.278 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.279 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.279 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 39: conflicting requests 2024-02-09T07:59:00.279 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.279 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.279 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.280 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.280 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.280 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.280 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:59:00.280 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.280 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.280 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.280 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.280 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:59:00.280 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.280 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.280 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.281 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.281 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:59:00.281 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.281 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.281 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.281 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.281 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:59:00.281 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.281 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.281 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.281 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.281 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:59:00.282 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.282 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.282 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.282 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.282 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:59:00.282 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.283 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.283 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.283 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:59:00.341 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-02-09T07:59:00.341 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:59:00.341 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repo Size 2024-02-09T07:59:00.341 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:59:00.341 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-02-09T07:59:00.341 INFO:teuthology.orchestra.run.smithi062.stdout: librados-devel-debuginfo x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 109 k 2024-02-09T07:59:00.341 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:59:00.341 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-02-09T07:59:00.341 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:59:00.341 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2024-02-09T07:59:00.341 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:59:00.342 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 109 k 2024-02-09T07:59:00.342 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 440 k 2024-02-09T07:59:00.342 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-02-09T07:59:00.751 INFO:teuthology.orchestra.run.smithi062.stdout:librados-devel-debuginfo-19.0.0-1310.g0089f33e. 266 kB/s | 109 kB 00:00 2024-02-09T07:59:00.751 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:59:00.751 INFO:teuthology.orchestra.run.smithi062.stdout:Total 265 kB/s | 109 kB 00:00 2024-02-09T07:59:00.752 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-02-09T07:59:00.755 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-02-09T07:59:00.755 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-02-09T07:59:00.792 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-02-09T07:59:00.792 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-02-09T07:59:00.920 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-02-09T07:59:01.085 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librados-devel-debuginfo-2:19.0.0-1310.g0089f33e.el9 1/1 2024-02-09T07:59:01.400 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librados-devel-debuginfo-2:19.0.0-1310.g0089f33e.el9 1/1 2024-02-09T07:59:01.716 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librados-devel-debuginfo-2:19.0.0-1310.g0089f33e.el9 1/1 2024-02-09T07:59:01.716 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:59:01.716 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-02-09T07:59:01.716 INFO:teuthology.orchestra.run.smithi062.stdout: librados-devel-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:59:01.716 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:59:01.716 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-02-09T07:59:01.896 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install libcephfs2-debuginfo 2024-02-09T07:59:02.516 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:09:08 ago on Fri 09 Feb 2024 07:49:54 AM UTC. 2024-02-09T07:59:02.824 INFO:teuthology.orchestra.run.smithi062.stderr:Modular dependency problems: 2024-02-09T07:59:02.824 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T07:59:02.824 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 1: conflicting requests 2024-02-09T07:59:02.824 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.824 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 2: conflicting requests 2024-02-09T07:59:02.824 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.824 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 3: conflicting requests 2024-02-09T07:59:02.824 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.825 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 4: conflicting requests 2024-02-09T07:59:02.825 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.825 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 5: conflicting requests 2024-02-09T07:59:02.825 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.825 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 6: conflicting requests 2024-02-09T07:59:02.825 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.825 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 7: conflicting requests 2024-02-09T07:59:02.825 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.825 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 8: conflicting requests 2024-02-09T07:59:02.825 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.825 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 9: conflicting requests 2024-02-09T07:59:02.825 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.825 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 10: conflicting requests 2024-02-09T07:59:02.825 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.826 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 11: conflicting requests 2024-02-09T07:59:02.826 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.826 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 12: conflicting requests 2024-02-09T07:59:02.826 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.826 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 13: conflicting requests 2024-02-09T07:59:02.826 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.826 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 14: conflicting requests 2024-02-09T07:59:02.826 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.826 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 15: conflicting requests 2024-02-09T07:59:02.826 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.826 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 16: conflicting requests 2024-02-09T07:59:02.827 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.827 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 17: conflicting requests 2024-02-09T07:59:02.827 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.827 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 18: conflicting requests 2024-02-09T07:59:02.827 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.827 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 19: conflicting requests 2024-02-09T07:59:02.827 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.827 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 20: conflicting requests 2024-02-09T07:59:02.827 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.827 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 21: conflicting requests 2024-02-09T07:59:02.827 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.827 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 22: conflicting requests 2024-02-09T07:59:02.828 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.828 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 23: conflicting requests 2024-02-09T07:59:02.828 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.828 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 24: conflicting requests 2024-02-09T07:59:02.828 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.828 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 25: conflicting requests 2024-02-09T07:59:02.828 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.828 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 26: conflicting requests 2024-02-09T07:59:02.828 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.828 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 27: conflicting requests 2024-02-09T07:59:02.829 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.829 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 28: conflicting requests 2024-02-09T07:59:02.829 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.829 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 29: conflicting requests 2024-02-09T07:59:02.829 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.829 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 30: conflicting requests 2024-02-09T07:59:02.829 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.829 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 31: conflicting requests 2024-02-09T07:59:02.829 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.829 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 32: conflicting requests 2024-02-09T07:59:02.829 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.829 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 33: conflicting requests 2024-02-09T07:59:02.829 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.830 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 34: conflicting requests 2024-02-09T07:59:02.830 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.830 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 35: conflicting requests 2024-02-09T07:59:02.830 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.830 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 36: conflicting requests 2024-02-09T07:59:02.830 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.830 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 37: conflicting requests 2024-02-09T07:59:02.830 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.830 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.830 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.830 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:59:02.831 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.831 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.831 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.831 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.831 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 39: conflicting requests 2024-02-09T07:59:02.831 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.832 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.832 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.832 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.832 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.832 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.832 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:59:02.832 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.832 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.833 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.833 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.833 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:59:02.833 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.833 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.833 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.833 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.833 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:59:02.833 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.833 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.833 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.833 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.833 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:59:02.833 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.834 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.834 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.834 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.834 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:59:02.834 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.834 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.834 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.834 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.834 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:59:02.834 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.834 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.834 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.835 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:59:02.896 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-02-09T07:59:02.897 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:59:02.897 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repo Size 2024-02-09T07:59:02.897 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:59:02.897 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-02-09T07:59:02.897 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs2-debuginfo x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 5.3 M 2024-02-09T07:59:02.897 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:59:02.897 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-02-09T07:59:02.897 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:59:02.897 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2024-02-09T07:59:02.897 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:59:02.897 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 5.3 M 2024-02-09T07:59:02.898 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 25 M 2024-02-09T07:59:02.898 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-02-09T07:59:03.571 INFO:teuthology.orchestra.run.smithi062.stdout:libcephfs2-debuginfo-19.0.0-1310.g0089f33e.el9. 8.0 MB/s | 5.3 MB 00:00 2024-02-09T07:59:03.571 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:59:03.572 INFO:teuthology.orchestra.run.smithi062.stdout:Total 7.9 MB/s | 5.3 MB 00:00 2024-02-09T07:59:03.572 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-02-09T07:59:03.577 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-02-09T07:59:03.577 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-02-09T07:59:03.647 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-02-09T07:59:03.647 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-02-09T07:59:04.342 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-02-09T07:59:04.456 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libcephfs2-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86 1/1 2024-02-09T07:59:04.976 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libcephfs2-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86 1/1 2024-02-09T07:59:05.283 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libcephfs2-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86 1/1 2024-02-09T07:59:05.283 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:59:05.283 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-02-09T07:59:05.284 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs2-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:59:05.284 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:59:05.284 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-02-09T07:59:05.449 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install librados2-debuginfo 2024-02-09T07:59:06.066 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:09:12 ago on Fri 09 Feb 2024 07:49:54 AM UTC. 2024-02-09T07:59:06.376 INFO:teuthology.orchestra.run.smithi062.stderr:Modular dependency problems: 2024-02-09T07:59:06.376 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T07:59:06.377 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 1: conflicting requests 2024-02-09T07:59:06.377 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.377 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 2: conflicting requests 2024-02-09T07:59:06.377 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.377 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 3: conflicting requests 2024-02-09T07:59:06.377 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.377 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 4: conflicting requests 2024-02-09T07:59:06.377 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.377 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 5: conflicting requests 2024-02-09T07:59:06.377 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.377 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 6: conflicting requests 2024-02-09T07:59:06.377 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.377 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 7: conflicting requests 2024-02-09T07:59:06.378 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.378 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 8: conflicting requests 2024-02-09T07:59:06.378 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.378 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 9: conflicting requests 2024-02-09T07:59:06.378 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.378 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 10: conflicting requests 2024-02-09T07:59:06.378 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.378 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 11: conflicting requests 2024-02-09T07:59:06.378 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.378 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 12: conflicting requests 2024-02-09T07:59:06.378 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.378 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 13: conflicting requests 2024-02-09T07:59:06.378 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.379 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 14: conflicting requests 2024-02-09T07:59:06.379 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.379 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 15: conflicting requests 2024-02-09T07:59:06.379 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.379 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 16: conflicting requests 2024-02-09T07:59:06.379 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.379 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 17: conflicting requests 2024-02-09T07:59:06.379 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.379 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 18: conflicting requests 2024-02-09T07:59:06.379 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.379 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 19: conflicting requests 2024-02-09T07:59:06.379 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.379 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 20: conflicting requests 2024-02-09T07:59:06.380 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.380 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 21: conflicting requests 2024-02-09T07:59:06.380 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.380 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 22: conflicting requests 2024-02-09T07:59:06.380 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.380 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 23: conflicting requests 2024-02-09T07:59:06.380 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.380 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 24: conflicting requests 2024-02-09T07:59:06.380 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.380 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 25: conflicting requests 2024-02-09T07:59:06.380 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.380 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 26: conflicting requests 2024-02-09T07:59:06.380 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.381 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 27: conflicting requests 2024-02-09T07:59:06.381 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.381 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 28: conflicting requests 2024-02-09T07:59:06.381 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.381 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 29: conflicting requests 2024-02-09T07:59:06.381 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.381 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 30: conflicting requests 2024-02-09T07:59:06.381 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.381 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 31: conflicting requests 2024-02-09T07:59:06.381 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.381 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 32: conflicting requests 2024-02-09T07:59:06.381 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.381 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 33: conflicting requests 2024-02-09T07:59:06.381 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.382 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 34: conflicting requests 2024-02-09T07:59:06.382 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.382 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 35: conflicting requests 2024-02-09T07:59:06.382 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.382 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 36: conflicting requests 2024-02-09T07:59:06.382 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.382 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 37: conflicting requests 2024-02-09T07:59:06.382 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.382 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.382 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.383 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:59:06.383 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.383 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.383 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.383 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.383 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 39: conflicting requests 2024-02-09T07:59:06.383 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.383 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.383 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.384 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.384 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.384 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.384 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:59:06.384 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.384 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.384 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.384 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.384 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:59:06.384 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.384 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.384 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.384 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.385 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:59:06.385 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.385 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.385 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.385 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.385 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:59:06.385 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.385 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.385 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.385 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.385 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:59:06.385 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.386 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.386 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.386 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.386 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:59:06.386 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.386 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.386 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.387 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:59:06.452 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-02-09T07:59:06.452 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:59:06.452 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repo Size 2024-02-09T07:59:06.452 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:59:06.453 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-02-09T07:59:06.453 INFO:teuthology.orchestra.run.smithi062.stdout: librados2-debuginfo x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 44 M 2024-02-09T07:59:06.453 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:59:06.453 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-02-09T07:59:06.453 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:59:06.453 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2024-02-09T07:59:06.453 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:59:06.453 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 44 M 2024-02-09T07:59:06.453 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 252 M 2024-02-09T07:59:06.453 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-02-09T07:59:10.207 INFO:teuthology.orchestra.run.smithi062.stdout:librados2-debuginfo-19.0.0-1310.g0089f33e.el9.x 12 MB/s | 44 MB 00:03 2024-02-09T07:59:10.207 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:59:10.208 INFO:teuthology.orchestra.run.smithi062.stdout:Total 12 MB/s | 44 MB 00:03 2024-02-09T07:59:10.208 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-02-09T07:59:10.212 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-02-09T07:59:10.212 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-02-09T07:59:10.532 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-02-09T07:59:10.533 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-02-09T07:59:15.872 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-02-09T07:59:15.984 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librados2-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_ 1/1 2024-02-09T07:59:17.753 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librados2-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_ 1/1 2024-02-09T07:59:18.062 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librados2-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_ 1/1 2024-02-09T07:59:18.062 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:59:18.062 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-02-09T07:59:18.062 INFO:teuthology.orchestra.run.smithi062.stdout: librados2-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:59:18.063 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:59:18.063 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-02-09T07:59:18.257 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install librbd1-debuginfo 2024-02-09T07:59:18.880 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:09:24 ago on Fri 09 Feb 2024 07:49:54 AM UTC. 2024-02-09T07:59:19.186 INFO:teuthology.orchestra.run.smithi062.stderr:Modular dependency problems: 2024-02-09T07:59:19.186 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T07:59:19.187 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 1: conflicting requests 2024-02-09T07:59:19.187 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.187 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 2: conflicting requests 2024-02-09T07:59:19.187 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.187 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 3: conflicting requests 2024-02-09T07:59:19.187 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.187 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 4: conflicting requests 2024-02-09T07:59:19.187 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.187 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 5: conflicting requests 2024-02-09T07:59:19.187 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.187 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 6: conflicting requests 2024-02-09T07:59:19.187 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.187 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 7: conflicting requests 2024-02-09T07:59:19.188 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.188 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 8: conflicting requests 2024-02-09T07:59:19.188 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.188 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 9: conflicting requests 2024-02-09T07:59:19.188 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.188 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 10: conflicting requests 2024-02-09T07:59:19.188 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.188 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 11: conflicting requests 2024-02-09T07:59:19.188 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.188 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 12: conflicting requests 2024-02-09T07:59:19.188 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.188 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 13: conflicting requests 2024-02-09T07:59:19.188 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.189 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 14: conflicting requests 2024-02-09T07:59:19.189 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.189 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 15: conflicting requests 2024-02-09T07:59:19.189 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.189 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 16: conflicting requests 2024-02-09T07:59:19.189 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.189 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 17: conflicting requests 2024-02-09T07:59:19.189 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.189 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 18: conflicting requests 2024-02-09T07:59:19.189 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.189 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 19: conflicting requests 2024-02-09T07:59:19.189 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.189 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 20: conflicting requests 2024-02-09T07:59:19.190 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.190 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 21: conflicting requests 2024-02-09T07:59:19.190 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.190 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 22: conflicting requests 2024-02-09T07:59:19.190 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.190 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 23: conflicting requests 2024-02-09T07:59:19.190 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.190 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 24: conflicting requests 2024-02-09T07:59:19.190 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.190 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 25: conflicting requests 2024-02-09T07:59:19.190 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.190 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 26: conflicting requests 2024-02-09T07:59:19.190 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.190 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 27: conflicting requests 2024-02-09T07:59:19.191 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.191 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 28: conflicting requests 2024-02-09T07:59:19.191 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.191 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 29: conflicting requests 2024-02-09T07:59:19.191 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.191 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 30: conflicting requests 2024-02-09T07:59:19.191 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.191 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 31: conflicting requests 2024-02-09T07:59:19.191 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.191 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 32: conflicting requests 2024-02-09T07:59:19.191 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.191 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 33: conflicting requests 2024-02-09T07:59:19.191 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.192 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 34: conflicting requests 2024-02-09T07:59:19.192 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.192 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 35: conflicting requests 2024-02-09T07:59:19.192 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.193 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 36: conflicting requests 2024-02-09T07:59:19.193 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.193 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 37: conflicting requests 2024-02-09T07:59:19.193 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.193 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.193 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.193 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:59:19.193 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.193 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.193 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.193 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.193 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 39: conflicting requests 2024-02-09T07:59:19.194 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.194 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.194 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.194 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.194 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.195 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.195 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:59:19.195 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.195 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.195 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.195 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.196 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:59:19.196 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.196 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.196 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.196 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.196 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:59:19.197 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.197 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.197 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.197 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.197 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:59:19.197 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.197 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.197 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.197 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.197 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:59:19.197 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.197 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.197 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.197 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.198 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:59:19.198 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.198 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.198 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.198 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:59:19.259 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-02-09T07:59:19.259 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:59:19.260 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repo Size 2024-02-09T07:59:19.260 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:59:19.260 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-02-09T07:59:19.260 INFO:teuthology.orchestra.run.smithi062.stdout: librbd1-debuginfo x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 52 M 2024-02-09T07:59:19.260 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:59:19.260 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-02-09T07:59:19.260 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:59:19.261 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2024-02-09T07:59:19.261 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:59:19.261 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 52 M 2024-02-09T07:59:19.261 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 308 M 2024-02-09T07:59:19.261 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-02-09T07:59:26.609 INFO:teuthology.orchestra.run.smithi062.stdout:librbd1-debuginfo-19.0.0-1310.g0089f33e.el9.x86 7.1 MB/s | 52 MB 00:07 2024-02-09T07:59:26.621 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:59:26.621 INFO:teuthology.orchestra.run.smithi062.stdout:Total 7.1 MB/s | 52 MB 00:07 2024-02-09T07:59:26.621 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-02-09T07:59:26.625 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-02-09T07:59:26.625 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-02-09T07:59:26.981 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-02-09T07:59:26.981 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-02-09T07:59:27.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd-debuginfo-19.0.0-1310.g0089f33e.el9.x8 8.2 MB/s | 287 MB 00:35 2024-02-09T07:59:27.459 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:59:27.460 INFO:teuthology.orchestra.run.smithi103.stdout:Total 8.2 MB/s | 287 MB 00:35 2024-02-09T07:59:27.461 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-02-09T07:59:27.464 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-02-09T07:59:27.465 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-02-09T07:59:29.173 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-02-09T07:59:29.173 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-02-09T07:59:33.331 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-02-09T07:59:33.427 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librbd1-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 1/1 2024-02-09T07:59:35.622 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librbd1-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 1/1 2024-02-09T07:59:35.924 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librbd1-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 1/1 2024-02-09T07:59:35.924 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:59:35.924 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-02-09T07:59:35.924 INFO:teuthology.orchestra.run.smithi062.stdout: librbd1-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:59:35.924 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:59:35.924 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-02-09T07:59:36.099 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install python3-cephfs-debuginfo 2024-02-09T07:59:36.722 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:09:42 ago on Fri 09 Feb 2024 07:49:54 AM UTC. 2024-02-09T07:59:37.029 INFO:teuthology.orchestra.run.smithi062.stderr:Modular dependency problems: 2024-02-09T07:59:37.029 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T07:59:37.029 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 1: conflicting requests 2024-02-09T07:59:37.029 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.029 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 2: conflicting requests 2024-02-09T07:59:37.029 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.029 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 3: conflicting requests 2024-02-09T07:59:37.029 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.029 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 4: conflicting requests 2024-02-09T07:59:37.029 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.030 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 5: conflicting requests 2024-02-09T07:59:37.030 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.030 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 6: conflicting requests 2024-02-09T07:59:37.030 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.030 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 7: conflicting requests 2024-02-09T07:59:37.030 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.030 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 8: conflicting requests 2024-02-09T07:59:37.030 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.030 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 9: conflicting requests 2024-02-09T07:59:37.030 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.030 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 10: conflicting requests 2024-02-09T07:59:37.030 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.030 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 11: conflicting requests 2024-02-09T07:59:37.031 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.031 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 12: conflicting requests 2024-02-09T07:59:37.031 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.031 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 13: conflicting requests 2024-02-09T07:59:37.031 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.031 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 14: conflicting requests 2024-02-09T07:59:37.031 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.031 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 15: conflicting requests 2024-02-09T07:59:37.031 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.031 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 16: conflicting requests 2024-02-09T07:59:37.031 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.031 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 17: conflicting requests 2024-02-09T07:59:37.031 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.032 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 18: conflicting requests 2024-02-09T07:59:37.032 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.032 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 19: conflicting requests 2024-02-09T07:59:37.032 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.032 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 20: conflicting requests 2024-02-09T07:59:37.032 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.032 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 21: conflicting requests 2024-02-09T07:59:37.032 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.032 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 22: conflicting requests 2024-02-09T07:59:37.032 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.032 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 23: conflicting requests 2024-02-09T07:59:37.032 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.032 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 24: conflicting requests 2024-02-09T07:59:37.032 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.033 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 25: conflicting requests 2024-02-09T07:59:37.033 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.033 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 26: conflicting requests 2024-02-09T07:59:37.033 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.033 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 27: conflicting requests 2024-02-09T07:59:37.033 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.033 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 28: conflicting requests 2024-02-09T07:59:37.033 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.033 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 29: conflicting requests 2024-02-09T07:59:37.033 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.033 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 30: conflicting requests 2024-02-09T07:59:37.033 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.033 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 31: conflicting requests 2024-02-09T07:59:37.033 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.033 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 32: conflicting requests 2024-02-09T07:59:37.034 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.034 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 33: conflicting requests 2024-02-09T07:59:37.034 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.034 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 34: conflicting requests 2024-02-09T07:59:37.034 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.034 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 35: conflicting requests 2024-02-09T07:59:37.034 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.034 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 36: conflicting requests 2024-02-09T07:59:37.034 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.034 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 37: conflicting requests 2024-02-09T07:59:37.034 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.034 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.034 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.034 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:59:37.034 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.035 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.035 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.035 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.035 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 39: conflicting requests 2024-02-09T07:59:37.035 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.035 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.035 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.035 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.035 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.035 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.035 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:59:37.035 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.035 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.035 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.036 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.036 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:59:37.036 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.036 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.036 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.036 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.036 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:59:37.036 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.036 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.036 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.037 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.037 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:59:37.037 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.037 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.037 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.037 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.037 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:59:37.037 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.037 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.037 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.037 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.037 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:59:37.037 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.038 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.038 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.038 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:59:37.101 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-02-09T07:59:37.102 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:59:37.102 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repo Size 2024-02-09T07:59:37.102 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:59:37.102 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-02-09T07:59:37.102 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cephfs-debuginfo x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 615 k 2024-02-09T07:59:37.102 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:59:37.102 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-02-09T07:59:37.102 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:59:37.102 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2024-02-09T07:59:37.102 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:59:37.102 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 615 k 2024-02-09T07:59:37.102 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 2.1 M 2024-02-09T07:59:37.102 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-02-09T07:59:38.062 INFO:teuthology.orchestra.run.smithi062.stdout:python3-cephfs-debuginfo-19.0.0-1310.g0089f33e. 641 kB/s | 615 kB 00:00 2024-02-09T07:59:38.062 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:59:38.063 INFO:teuthology.orchestra.run.smithi062.stdout:Total 640 kB/s | 615 kB 00:00 2024-02-09T07:59:38.063 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-02-09T07:59:38.067 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-02-09T07:59:38.067 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-02-09T07:59:38.111 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-02-09T07:59:38.111 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-02-09T07:59:38.297 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-02-09T07:59:38.389 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cephfs-debuginfo-2:19.0.0-1310.g0089f33e.el9 1/1 2024-02-09T07:59:38.929 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: python3-cephfs-debuginfo-2:19.0.0-1310.g0089f33e.el9 1/1 2024-02-09T07:59:39.235 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cephfs-debuginfo-2:19.0.0-1310.g0089f33e.el9 1/1 2024-02-09T07:59:39.236 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:59:39.236 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-02-09T07:59:39.236 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cephfs-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:59:39.236 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:59:39.236 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-02-09T07:59:39.392 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install python3-rados-debuginfo 2024-02-09T07:59:40.013 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:09:46 ago on Fri 09 Feb 2024 07:49:54 AM UTC. 2024-02-09T07:59:40.324 INFO:teuthology.orchestra.run.smithi062.stderr:Modular dependency problems: 2024-02-09T07:59:40.324 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T07:59:40.324 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 1: conflicting requests 2024-02-09T07:59:40.324 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.324 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 2: conflicting requests 2024-02-09T07:59:40.324 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.324 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 3: conflicting requests 2024-02-09T07:59:40.324 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.324 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 4: conflicting requests 2024-02-09T07:59:40.324 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.325 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 5: conflicting requests 2024-02-09T07:59:40.325 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.325 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 6: conflicting requests 2024-02-09T07:59:40.325 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.325 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 7: conflicting requests 2024-02-09T07:59:40.325 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.325 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 8: conflicting requests 2024-02-09T07:59:40.325 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.325 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 9: conflicting requests 2024-02-09T07:59:40.325 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.325 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 10: conflicting requests 2024-02-09T07:59:40.325 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.325 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 11: conflicting requests 2024-02-09T07:59:40.325 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.326 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 12: conflicting requests 2024-02-09T07:59:40.326 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.326 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 13: conflicting requests 2024-02-09T07:59:40.326 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.326 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 14: conflicting requests 2024-02-09T07:59:40.326 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.326 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 15: conflicting requests 2024-02-09T07:59:40.326 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.326 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 16: conflicting requests 2024-02-09T07:59:40.326 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.326 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 17: conflicting requests 2024-02-09T07:59:40.326 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.326 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 18: conflicting requests 2024-02-09T07:59:40.327 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.327 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 19: conflicting requests 2024-02-09T07:59:40.327 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.327 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 20: conflicting requests 2024-02-09T07:59:40.327 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.327 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 21: conflicting requests 2024-02-09T07:59:40.327 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.327 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 22: conflicting requests 2024-02-09T07:59:40.327 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.327 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 23: conflicting requests 2024-02-09T07:59:40.327 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.327 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 24: conflicting requests 2024-02-09T07:59:40.327 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.328 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 25: conflicting requests 2024-02-09T07:59:40.328 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.328 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 26: conflicting requests 2024-02-09T07:59:40.328 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.328 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 27: conflicting requests 2024-02-09T07:59:40.328 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.328 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 28: conflicting requests 2024-02-09T07:59:40.328 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.328 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 29: conflicting requests 2024-02-09T07:59:40.328 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.328 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 30: conflicting requests 2024-02-09T07:59:40.328 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.329 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 31: conflicting requests 2024-02-09T07:59:40.329 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.329 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 32: conflicting requests 2024-02-09T07:59:40.329 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.329 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 33: conflicting requests 2024-02-09T07:59:40.329 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.329 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 34: conflicting requests 2024-02-09T07:59:40.329 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.329 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 35: conflicting requests 2024-02-09T07:59:40.329 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.329 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 36: conflicting requests 2024-02-09T07:59:40.329 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.329 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 37: conflicting requests 2024-02-09T07:59:40.329 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.329 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.330 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.330 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:59:40.330 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.330 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.330 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.330 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.330 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 39: conflicting requests 2024-02-09T07:59:40.330 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.330 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.330 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.330 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.330 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.330 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.330 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:59:40.331 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.331 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.331 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.331 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.331 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:59:40.331 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.331 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.331 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.331 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.331 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:59:40.331 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.331 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.331 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.332 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.332 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:59:40.332 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.332 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.332 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.332 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.332 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:59:40.332 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.332 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.332 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.332 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.332 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:59:40.332 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.333 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.333 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.333 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:59:40.400 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-02-09T07:59:40.401 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:59:40.401 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repo Size 2024-02-09T07:59:40.401 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:59:40.402 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-02-09T07:59:40.402 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rados-debuginfo x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 769 k 2024-02-09T07:59:40.402 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:59:40.402 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-02-09T07:59:40.402 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:59:40.403 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2024-02-09T07:59:40.403 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:59:40.403 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 769 k 2024-02-09T07:59:40.403 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 2.7 M 2024-02-09T07:59:40.403 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-02-09T07:59:41.015 INFO:teuthology.orchestra.run.smithi062.stdout:python3-rados-debuginfo-19.0.0-1310.g0089f33e.e 1.2 MB/s | 769 kB 00:00 2024-02-09T07:59:41.016 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:59:41.028 INFO:teuthology.orchestra.run.smithi062.stdout:Total 1.2 MB/s | 769 kB 00:00 2024-02-09T07:59:41.029 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-02-09T07:59:41.029 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-02-09T07:59:41.029 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-02-09T07:59:41.061 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-02-09T07:59:41.061 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-02-09T07:59:41.253 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-02-09T07:59:41.351 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rados-debuginfo-2:19.0.0-1310.g0089f33e.el9. 1/1 2024-02-09T07:59:41.904 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: python3-rados-debuginfo-2:19.0.0-1310.g0089f33e.el9. 1/1 2024-02-09T07:59:42.220 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rados-debuginfo-2:19.0.0-1310.g0089f33e.el9. 1/1 2024-02-09T07:59:42.220 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:59:42.220 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-02-09T07:59:42.220 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rados-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:59:42.221 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:59:42.221 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-02-09T07:59:42.398 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install python3-rbd-debuginfo 2024-02-09T07:59:43.016 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:09:49 ago on Fri 09 Feb 2024 07:49:54 AM UTC. 2024-02-09T07:59:43.324 INFO:teuthology.orchestra.run.smithi062.stderr:Modular dependency problems: 2024-02-09T07:59:43.325 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T07:59:43.325 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 1: conflicting requests 2024-02-09T07:59:43.325 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.325 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 2: conflicting requests 2024-02-09T07:59:43.325 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.325 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 3: conflicting requests 2024-02-09T07:59:43.325 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.325 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 4: conflicting requests 2024-02-09T07:59:43.325 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.325 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 5: conflicting requests 2024-02-09T07:59:43.325 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.326 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 6: conflicting requests 2024-02-09T07:59:43.326 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.326 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 7: conflicting requests 2024-02-09T07:59:43.326 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.326 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 8: conflicting requests 2024-02-09T07:59:43.326 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.326 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 9: conflicting requests 2024-02-09T07:59:43.326 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.326 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 10: conflicting requests 2024-02-09T07:59:43.326 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.326 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 11: conflicting requests 2024-02-09T07:59:43.326 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.326 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 12: conflicting requests 2024-02-09T07:59:43.326 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.327 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 13: conflicting requests 2024-02-09T07:59:43.327 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.327 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 14: conflicting requests 2024-02-09T07:59:43.327 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.327 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 15: conflicting requests 2024-02-09T07:59:43.327 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.327 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 16: conflicting requests 2024-02-09T07:59:43.327 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.327 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 17: conflicting requests 2024-02-09T07:59:43.327 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.327 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 18: conflicting requests 2024-02-09T07:59:43.327 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.328 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 19: conflicting requests 2024-02-09T07:59:43.328 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.328 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 20: conflicting requests 2024-02-09T07:59:43.328 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.328 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 21: conflicting requests 2024-02-09T07:59:43.328 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.328 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 22: conflicting requests 2024-02-09T07:59:43.328 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.328 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 23: conflicting requests 2024-02-09T07:59:43.328 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.329 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 24: conflicting requests 2024-02-09T07:59:43.329 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.329 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 25: conflicting requests 2024-02-09T07:59:43.329 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.329 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 26: conflicting requests 2024-02-09T07:59:43.329 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.329 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 27: conflicting requests 2024-02-09T07:59:43.329 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.329 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 28: conflicting requests 2024-02-09T07:59:43.329 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.329 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 29: conflicting requests 2024-02-09T07:59:43.329 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.329 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 30: conflicting requests 2024-02-09T07:59:43.329 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.330 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 31: conflicting requests 2024-02-09T07:59:43.330 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.330 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 32: conflicting requests 2024-02-09T07:59:43.330 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.330 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 33: conflicting requests 2024-02-09T07:59:43.330 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.330 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 34: conflicting requests 2024-02-09T07:59:43.330 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.330 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 35: conflicting requests 2024-02-09T07:59:43.330 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.330 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 36: conflicting requests 2024-02-09T07:59:43.330 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.330 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 37: conflicting requests 2024-02-09T07:59:43.330 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.331 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.331 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.332 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:59:43.332 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.332 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.332 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.332 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.332 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 39: conflicting requests 2024-02-09T07:59:43.332 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.332 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.333 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.333 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.333 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.333 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.333 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:59:43.333 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.333 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.333 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.333 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.333 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:59:43.334 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.334 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.334 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.334 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.334 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:59:43.334 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.334 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.334 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.334 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.335 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:59:43.335 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.335 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.335 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.335 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.335 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:59:43.335 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.335 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.335 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.335 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.336 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:59:43.336 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.336 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.336 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.336 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:59:43.397 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-02-09T07:59:43.398 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:59:43.398 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repo Size 2024-02-09T07:59:43.398 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:59:43.398 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-02-09T07:59:43.398 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rbd-debuginfo x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 1.1 M 2024-02-09T07:59:43.398 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:59:43.398 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-02-09T07:59:43.399 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:59:43.399 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2024-02-09T07:59:43.399 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:59:43.399 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 1.1 M 2024-02-09T07:59:43.399 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 4.3 M 2024-02-09T07:59:43.399 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-02-09T07:59:44.294 INFO:teuthology.orchestra.run.smithi062.stdout:python3-rbd-debuginfo-19.0.0-1310.g0089f33e.el9 1.3 MB/s | 1.1 MB 00:00 2024-02-09T07:59:44.295 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:59:44.295 INFO:teuthology.orchestra.run.smithi062.stdout:Total 1.3 MB/s | 1.1 MB 00:00 2024-02-09T07:59:44.295 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-02-09T07:59:44.299 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-02-09T07:59:44.299 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-02-09T07:59:44.343 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-02-09T07:59:44.343 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-02-09T07:59:44.603 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-02-09T07:59:44.698 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rbd-debuginfo-2:19.0.0-1310.g0089f33e.el9.x8 1/1 2024-02-09T07:59:45.099 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: python3-rbd-debuginfo-2:19.0.0-1310.g0089f33e.el9.x8 1/1 2024-02-09T07:59:45.520 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rbd-debuginfo-2:19.0.0-1310.g0089f33e.el9.x8 1/1 2024-02-09T07:59:45.520 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:59:45.521 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-02-09T07:59:45.521 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rbd-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:59:45.521 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:59:45.521 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-02-09T07:59:45.668 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install python3-rgw-debuginfo 2024-02-09T07:59:46.284 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:09:52 ago on Fri 09 Feb 2024 07:49:54 AM UTC. 2024-02-09T07:59:46.599 INFO:teuthology.orchestra.run.smithi062.stderr:Modular dependency problems: 2024-02-09T07:59:46.599 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T07:59:46.599 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 1: conflicting requests 2024-02-09T07:59:46.599 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.599 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 2: conflicting requests 2024-02-09T07:59:46.600 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.600 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 3: conflicting requests 2024-02-09T07:59:46.600 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.600 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 4: conflicting requests 2024-02-09T07:59:46.600 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.600 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 5: conflicting requests 2024-02-09T07:59:46.600 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.600 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 6: conflicting requests 2024-02-09T07:59:46.600 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.600 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 7: conflicting requests 2024-02-09T07:59:46.600 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.600 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 8: conflicting requests 2024-02-09T07:59:46.600 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.601 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 9: conflicting requests 2024-02-09T07:59:46.601 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.601 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 10: conflicting requests 2024-02-09T07:59:46.601 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.601 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 11: conflicting requests 2024-02-09T07:59:46.601 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.601 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 12: conflicting requests 2024-02-09T07:59:46.601 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.601 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 13: conflicting requests 2024-02-09T07:59:46.601 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.601 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 14: conflicting requests 2024-02-09T07:59:46.601 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.601 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 15: conflicting requests 2024-02-09T07:59:46.601 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.601 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 16: conflicting requests 2024-02-09T07:59:46.602 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.602 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 17: conflicting requests 2024-02-09T07:59:46.602 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.602 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 18: conflicting requests 2024-02-09T07:59:46.602 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.602 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 19: conflicting requests 2024-02-09T07:59:46.602 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.602 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 20: conflicting requests 2024-02-09T07:59:46.602 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.602 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 21: conflicting requests 2024-02-09T07:59:46.602 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.602 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 22: conflicting requests 2024-02-09T07:59:46.602 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.602 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 23: conflicting requests 2024-02-09T07:59:46.603 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.603 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 24: conflicting requests 2024-02-09T07:59:46.603 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.603 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 25: conflicting requests 2024-02-09T07:59:46.603 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.603 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 26: conflicting requests 2024-02-09T07:59:46.603 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.603 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 27: conflicting requests 2024-02-09T07:59:46.603 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.603 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 28: conflicting requests 2024-02-09T07:59:46.603 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.603 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 29: conflicting requests 2024-02-09T07:59:46.603 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.604 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 30: conflicting requests 2024-02-09T07:59:46.604 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.604 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 31: conflicting requests 2024-02-09T07:59:46.604 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.604 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 32: conflicting requests 2024-02-09T07:59:46.604 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.604 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 33: conflicting requests 2024-02-09T07:59:46.604 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.604 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 34: conflicting requests 2024-02-09T07:59:46.604 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.604 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 35: conflicting requests 2024-02-09T07:59:46.604 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.604 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 36: conflicting requests 2024-02-09T07:59:46.604 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.605 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 37: conflicting requests 2024-02-09T07:59:46.605 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.605 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.605 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.605 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:59:46.605 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.605 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.605 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.605 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.605 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 39: conflicting requests 2024-02-09T07:59:46.605 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.605 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.605 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.605 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.605 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.606 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.606 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:59:46.606 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.606 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.606 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.606 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.606 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:59:46.606 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.606 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.606 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.606 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.606 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:59:46.606 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.606 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.607 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.607 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.607 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:59:46.607 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.607 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.607 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.607 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.607 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:59:46.607 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.607 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.607 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.607 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.607 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:59:46.607 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.608 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.608 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.608 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:59:46.671 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-02-09T07:59:46.672 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:59:46.672 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repo Size 2024-02-09T07:59:46.672 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:59:46.672 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-02-09T07:59:46.673 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rgw-debuginfo x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 337 k 2024-02-09T07:59:46.673 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:59:46.673 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-02-09T07:59:46.673 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:59:46.673 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2024-02-09T07:59:46.673 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:59:46.674 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 337 k 2024-02-09T07:59:46.674 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 1.0 M 2024-02-09T07:59:46.674 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-02-09T07:59:47.063 INFO:teuthology.orchestra.run.smithi062.stdout:python3-rgw-debuginfo-19.0.0-1310.g0089f33e.el9 865 kB/s | 337 kB 00:00 2024-02-09T07:59:47.064 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:59:47.064 INFO:teuthology.orchestra.run.smithi062.stdout:Total 862 kB/s | 337 kB 00:00 2024-02-09T07:59:47.064 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-02-09T07:59:47.068 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-02-09T07:59:47.068 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-02-09T07:59:47.106 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-02-09T07:59:47.106 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-02-09T07:59:47.249 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-02-09T07:59:47.349 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rgw-debuginfo-2:19.0.0-1310.g0089f33e.el9.x8 1/1 2024-02-09T07:59:47.898 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: python3-rgw-debuginfo-2:19.0.0-1310.g0089f33e.el9.x8 1/1 2024-02-09T07:59:48.202 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rgw-debuginfo-2:19.0.0-1310.g0089f33e.el9.x8 1/1 2024-02-09T07:59:48.202 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:59:48.202 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-02-09T07:59:48.202 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rgw-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:59:48.202 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:59:48.202 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-02-09T07:59:48.377 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install rbd-fuse-debuginfo 2024-02-09T07:59:48.994 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:09:54 ago on Fri 09 Feb 2024 07:49:54 AM UTC. 2024-02-09T07:59:49.303 INFO:teuthology.orchestra.run.smithi062.stderr:Modular dependency problems: 2024-02-09T07:59:49.303 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T07:59:49.303 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 1: conflicting requests 2024-02-09T07:59:49.303 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.304 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 2: conflicting requests 2024-02-09T07:59:49.304 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.304 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 3: conflicting requests 2024-02-09T07:59:49.304 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.304 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 4: conflicting requests 2024-02-09T07:59:49.304 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.304 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 5: conflicting requests 2024-02-09T07:59:49.304 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.304 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 6: conflicting requests 2024-02-09T07:59:49.304 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.304 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 7: conflicting requests 2024-02-09T07:59:49.304 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.305 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 8: conflicting requests 2024-02-09T07:59:49.305 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.305 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 9: conflicting requests 2024-02-09T07:59:49.305 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.305 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 10: conflicting requests 2024-02-09T07:59:49.305 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.305 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 11: conflicting requests 2024-02-09T07:59:49.305 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.305 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 12: conflicting requests 2024-02-09T07:59:49.305 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.306 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 13: conflicting requests 2024-02-09T07:59:49.306 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.306 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 14: conflicting requests 2024-02-09T07:59:49.306 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.306 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 15: conflicting requests 2024-02-09T07:59:49.306 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.306 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 16: conflicting requests 2024-02-09T07:59:49.306 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.306 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 17: conflicting requests 2024-02-09T07:59:49.306 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.306 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 18: conflicting requests 2024-02-09T07:59:49.306 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.306 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 19: conflicting requests 2024-02-09T07:59:49.306 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.307 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 20: conflicting requests 2024-02-09T07:59:49.307 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.307 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 21: conflicting requests 2024-02-09T07:59:49.307 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.307 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 22: conflicting requests 2024-02-09T07:59:49.307 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.307 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 23: conflicting requests 2024-02-09T07:59:49.308 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.308 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 24: conflicting requests 2024-02-09T07:59:49.308 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.308 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 25: conflicting requests 2024-02-09T07:59:49.308 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.308 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 26: conflicting requests 2024-02-09T07:59:49.308 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.312 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 27: conflicting requests 2024-02-09T07:59:49.312 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.312 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 28: conflicting requests 2024-02-09T07:59:49.312 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.312 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 29: conflicting requests 2024-02-09T07:59:49.312 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.313 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 30: conflicting requests 2024-02-09T07:59:49.313 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.313 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 31: conflicting requests 2024-02-09T07:59:49.313 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.313 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 32: conflicting requests 2024-02-09T07:59:49.313 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.313 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 33: conflicting requests 2024-02-09T07:59:49.313 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.313 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 34: conflicting requests 2024-02-09T07:59:49.313 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.313 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 35: conflicting requests 2024-02-09T07:59:49.313 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.313 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 36: conflicting requests 2024-02-09T07:59:49.313 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.314 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 37: conflicting requests 2024-02-09T07:59:49.314 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.314 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.314 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.314 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:59:49.314 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.314 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.314 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.314 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.314 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 39: conflicting requests 2024-02-09T07:59:49.314 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.314 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.314 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.315 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.315 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.315 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.315 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:59:49.315 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.315 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.315 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.315 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.315 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:59:49.315 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.315 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.316 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.316 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.316 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:59:49.316 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.316 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.316 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.316 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.316 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:59:49.316 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.316 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.317 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.317 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.317 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:59:49.317 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.317 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.317 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.317 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.317 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:59:49.317 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.318 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.318 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.318 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:59:49.376 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-02-09T07:59:49.377 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:59:49.377 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repo Size 2024-02-09T07:59:49.377 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:59:49.377 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-02-09T07:59:49.377 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-fuse-debuginfo x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 509 k 2024-02-09T07:59:49.377 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:59:49.377 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-02-09T07:59:49.377 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:59:49.377 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2024-02-09T07:59:49.377 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:59:49.377 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 509 k 2024-02-09T07:59:49.377 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 2.5 M 2024-02-09T07:59:49.377 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-02-09T07:59:49.809 INFO:teuthology.orchestra.run.smithi062.stdout:rbd-fuse-debuginfo-19.0.0-1310.g0089f33e.el9.x8 1.2 MB/s | 509 kB 00:00 2024-02-09T07:59:49.810 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:59:49.810 INFO:teuthology.orchestra.run.smithi062.stdout:Total 1.1 MB/s | 509 kB 00:00 2024-02-09T07:59:49.810 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-02-09T07:59:49.813 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-02-09T07:59:49.813 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-02-09T07:59:49.853 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-02-09T07:59:49.853 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-02-09T07:59:50.023 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-02-09T07:59:50.118 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : rbd-fuse-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_6 1/1 2024-02-09T07:59:50.651 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: rbd-fuse-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_6 1/1 2024-02-09T07:59:50.951 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : rbd-fuse-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_6 1/1 2024-02-09T07:59:50.952 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:59:50.952 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-02-09T07:59:50.952 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-fuse-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T07:59:50.952 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:59:50.952 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-02-09T07:59:51.156 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install rbd-mirror-debuginfo 2024-02-09T07:59:51.776 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:09:57 ago on Fri 09 Feb 2024 07:49:54 AM UTC. 2024-02-09T07:59:52.085 INFO:teuthology.orchestra.run.smithi062.stderr:Modular dependency problems: 2024-02-09T07:59:52.085 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T07:59:52.085 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 1: conflicting requests 2024-02-09T07:59:52.085 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.085 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 2: conflicting requests 2024-02-09T07:59:52.086 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.086 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 3: conflicting requests 2024-02-09T07:59:52.086 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.086 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 4: conflicting requests 2024-02-09T07:59:52.086 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.086 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 5: conflicting requests 2024-02-09T07:59:52.086 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.086 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 6: conflicting requests 2024-02-09T07:59:52.086 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.086 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 7: conflicting requests 2024-02-09T07:59:52.086 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.086 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 8: conflicting requests 2024-02-09T07:59:52.086 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.087 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 9: conflicting requests 2024-02-09T07:59:52.087 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.087 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 10: conflicting requests 2024-02-09T07:59:52.087 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.087 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 11: conflicting requests 2024-02-09T07:59:52.087 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.087 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 12: conflicting requests 2024-02-09T07:59:52.087 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.087 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 13: conflicting requests 2024-02-09T07:59:52.087 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.087 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 14: conflicting requests 2024-02-09T07:59:52.087 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.087 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 15: conflicting requests 2024-02-09T07:59:52.087 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.088 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 16: conflicting requests 2024-02-09T07:59:52.088 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.088 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 17: conflicting requests 2024-02-09T07:59:52.088 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.088 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 18: conflicting requests 2024-02-09T07:59:52.088 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.088 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 19: conflicting requests 2024-02-09T07:59:52.088 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.088 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 20: conflicting requests 2024-02-09T07:59:52.088 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.088 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 21: conflicting requests 2024-02-09T07:59:52.088 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.088 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 22: conflicting requests 2024-02-09T07:59:52.089 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.089 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 23: conflicting requests 2024-02-09T07:59:52.089 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.089 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 24: conflicting requests 2024-02-09T07:59:52.089 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.089 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 25: conflicting requests 2024-02-09T07:59:52.089 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.089 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 26: conflicting requests 2024-02-09T07:59:52.089 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.089 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 27: conflicting requests 2024-02-09T07:59:52.090 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.090 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 28: conflicting requests 2024-02-09T07:59:52.090 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.090 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 29: conflicting requests 2024-02-09T07:59:52.090 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.090 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 30: conflicting requests 2024-02-09T07:59:52.090 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.090 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 31: conflicting requests 2024-02-09T07:59:52.090 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.090 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 32: conflicting requests 2024-02-09T07:59:52.090 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.090 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 33: conflicting requests 2024-02-09T07:59:52.090 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.090 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 34: conflicting requests 2024-02-09T07:59:52.091 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.091 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 35: conflicting requests 2024-02-09T07:59:52.091 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.091 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 36: conflicting requests 2024-02-09T07:59:52.091 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.091 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 37: conflicting requests 2024-02-09T07:59:52.091 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.091 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.091 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.091 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T07:59:52.091 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.091 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.091 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.091 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.092 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 39: conflicting requests 2024-02-09T07:59:52.092 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.092 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.092 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.092 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.092 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.092 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.092 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T07:59:52.092 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.092 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.092 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.092 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.092 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T07:59:52.092 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.093 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.093 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.093 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.093 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T07:59:52.093 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.093 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.093 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.093 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.093 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T07:59:52.093 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.093 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.093 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.093 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.093 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T07:59:52.094 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.094 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.094 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.094 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.094 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T07:59:52.094 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.094 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.094 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.094 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T07:59:52.158 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-02-09T07:59:52.158 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:59:52.158 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repo Size 2024-02-09T07:59:52.159 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:59:52.159 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-02-09T07:59:52.159 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-mirror-debuginfo x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 52 M 2024-02-09T07:59:52.159 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:59:52.159 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-02-09T07:59:52.159 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T07:59:52.159 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2024-02-09T07:59:52.159 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T07:59:52.159 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 52 M 2024-02-09T07:59:52.159 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 298 M 2024-02-09T07:59:52.159 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-02-09T07:59:57.028 INFO:teuthology.orchestra.run.smithi062.stdout:rbd-mirror-debuginfo-19.0.0-1310.g0089f33e.el9. 11 MB/s | 52 MB 00:04 2024-02-09T07:59:57.029 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-02-09T07:59:57.029 INFO:teuthology.orchestra.run.smithi062.stdout:Total 11 MB/s | 52 MB 00:04 2024-02-09T07:59:57.029 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-02-09T07:59:57.033 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-02-09T07:59:57.034 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-02-09T07:59:57.387 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-02-09T07:59:57.388 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-02-09T07:59:58.535 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-02-09T07:59:58.638 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-osd-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_6 1/1 2024-02-09T08:00:03.641 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-02-09T08:00:03.737 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : rbd-mirror-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86 1/1 2024-02-09T08:00:05.954 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: rbd-mirror-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86 1/1 2024-02-09T08:00:06.248 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : rbd-mirror-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86 1/1 2024-02-09T08:00:06.248 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T08:00:06.248 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-02-09T08:00:06.248 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-mirror-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T08:00:06.248 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T08:00:06.248 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-02-09T08:00:06.397 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-osd-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_6 1/1 2024-02-09T08:00:06.494 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install rbd-nbd-debuginfo 2024-02-09T08:00:06.697 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-osd-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_6 1/1 2024-02-09T08:00:06.697 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:00:06.697 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-02-09T08:00:06.697 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-osd-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T08:00:06.697 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:00:06.697 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-02-09T08:00:06.918 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-fuse-debuginfo 2024-02-09T08:00:07.119 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:10:13 ago on Fri 09 Feb 2024 07:49:54 AM UTC. 2024-02-09T08:00:07.433 INFO:teuthology.orchestra.run.smithi062.stderr:Modular dependency problems: 2024-02-09T08:00:07.433 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:00:07.433 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 1: conflicting requests 2024-02-09T08:00:07.433 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.433 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 2: conflicting requests 2024-02-09T08:00:07.434 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.434 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 3: conflicting requests 2024-02-09T08:00:07.434 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.434 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 4: conflicting requests 2024-02-09T08:00:07.434 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.434 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 5: conflicting requests 2024-02-09T08:00:07.434 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.434 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 6: conflicting requests 2024-02-09T08:00:07.434 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.434 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 7: conflicting requests 2024-02-09T08:00:07.434 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.434 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 8: conflicting requests 2024-02-09T08:00:07.434 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.434 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 9: conflicting requests 2024-02-09T08:00:07.435 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.435 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 10: conflicting requests 2024-02-09T08:00:07.435 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.435 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 11: conflicting requests 2024-02-09T08:00:07.435 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.435 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 12: conflicting requests 2024-02-09T08:00:07.435 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.435 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 13: conflicting requests 2024-02-09T08:00:07.435 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.435 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 14: conflicting requests 2024-02-09T08:00:07.435 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.435 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 15: conflicting requests 2024-02-09T08:00:07.435 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.436 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 16: conflicting requests 2024-02-09T08:00:07.436 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.436 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 17: conflicting requests 2024-02-09T08:00:07.436 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.436 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 18: conflicting requests 2024-02-09T08:00:07.436 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.436 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 19: conflicting requests 2024-02-09T08:00:07.436 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.436 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 20: conflicting requests 2024-02-09T08:00:07.436 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.436 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 21: conflicting requests 2024-02-09T08:00:07.436 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.436 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 22: conflicting requests 2024-02-09T08:00:07.437 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.437 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 23: conflicting requests 2024-02-09T08:00:07.437 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.437 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 24: conflicting requests 2024-02-09T08:00:07.437 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.437 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 25: conflicting requests 2024-02-09T08:00:07.437 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.437 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 26: conflicting requests 2024-02-09T08:00:07.437 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.437 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 27: conflicting requests 2024-02-09T08:00:07.437 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.437 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 28: conflicting requests 2024-02-09T08:00:07.437 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.437 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 29: conflicting requests 2024-02-09T08:00:07.438 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.438 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 30: conflicting requests 2024-02-09T08:00:07.438 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.438 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 31: conflicting requests 2024-02-09T08:00:07.438 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.438 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 32: conflicting requests 2024-02-09T08:00:07.438 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.438 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 33: conflicting requests 2024-02-09T08:00:07.438 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.438 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 34: conflicting requests 2024-02-09T08:00:07.438 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.438 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 35: conflicting requests 2024-02-09T08:00:07.438 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.438 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 36: conflicting requests 2024-02-09T08:00:07.439 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.439 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 37: conflicting requests 2024-02-09T08:00:07.439 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.439 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.439 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.439 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T08:00:07.439 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.439 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.439 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.439 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.439 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 39: conflicting requests 2024-02-09T08:00:07.439 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.439 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.439 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.440 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.440 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.440 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.441 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T08:00:07.441 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.442 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.442 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.442 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.442 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T08:00:07.442 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.442 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.442 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.442 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.442 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T08:00:07.442 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.443 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.443 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.443 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.443 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T08:00:07.443 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.443 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.443 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.443 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.443 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T08:00:07.443 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.443 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.443 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.443 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.443 INFO:teuthology.orchestra.run.smithi062.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T08:00:07.444 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.444 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.444 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.444 INFO:teuthology.orchestra.run.smithi062.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.506 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-02-09T08:00:07.508 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T08:00:07.508 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repo Size 2024-02-09T08:00:07.508 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T08:00:07.509 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-02-09T08:00:07.509 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-nbd-debuginfo x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 1.3 M 2024-02-09T08:00:07.509 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T08:00:07.509 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-02-09T08:00:07.509 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-09T08:00:07.509 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2024-02-09T08:00:07.510 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T08:00:07.510 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 1.3 M 2024-02-09T08:00:07.510 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 5.5 M 2024-02-09T08:00:07.510 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-02-09T08:00:07.530 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:10:12 ago on Fri 09 Feb 2024 07:49:55 AM UTC. 2024-02-09T08:00:07.825 INFO:teuthology.orchestra.run.smithi103.stderr:Modular dependency problems: 2024-02-09T08:00:07.825 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:00:07.825 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 1: conflicting requests 2024-02-09T08:00:07.825 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.825 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 2: conflicting requests 2024-02-09T08:00:07.825 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.825 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 3: conflicting requests 2024-02-09T08:00:07.825 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.825 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 4: conflicting requests 2024-02-09T08:00:07.826 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.826 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 5: conflicting requests 2024-02-09T08:00:07.826 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.826 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 6: conflicting requests 2024-02-09T08:00:07.826 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.826 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 7: conflicting requests 2024-02-09T08:00:07.826 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.826 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 8: conflicting requests 2024-02-09T08:00:07.826 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.826 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 9: conflicting requests 2024-02-09T08:00:07.826 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.826 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 10: conflicting requests 2024-02-09T08:00:07.826 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.826 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 11: conflicting requests 2024-02-09T08:00:07.827 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.827 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 12: conflicting requests 2024-02-09T08:00:07.827 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.827 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 13: conflicting requests 2024-02-09T08:00:07.827 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.827 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 14: conflicting requests 2024-02-09T08:00:07.827 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.827 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 15: conflicting requests 2024-02-09T08:00:07.827 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.827 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 16: conflicting requests 2024-02-09T08:00:07.827 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.827 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 17: conflicting requests 2024-02-09T08:00:07.827 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.827 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 18: conflicting requests 2024-02-09T08:00:07.828 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.828 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 19: conflicting requests 2024-02-09T08:00:07.828 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.828 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 20: conflicting requests 2024-02-09T08:00:07.828 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.828 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 21: conflicting requests 2024-02-09T08:00:07.828 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.828 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 22: conflicting requests 2024-02-09T08:00:07.828 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.828 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 23: conflicting requests 2024-02-09T08:00:07.828 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.828 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 24: conflicting requests 2024-02-09T08:00:07.828 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.828 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 25: conflicting requests 2024-02-09T08:00:07.829 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.829 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 26: conflicting requests 2024-02-09T08:00:07.829 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.829 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 27: conflicting requests 2024-02-09T08:00:07.829 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.829 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 28: conflicting requests 2024-02-09T08:00:07.829 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.829 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 29: conflicting requests 2024-02-09T08:00:07.829 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.829 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 30: conflicting requests 2024-02-09T08:00:07.829 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.829 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 31: conflicting requests 2024-02-09T08:00:07.829 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.829 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 32: conflicting requests 2024-02-09T08:00:07.830 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.830 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 33: conflicting requests 2024-02-09T08:00:07.830 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.830 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 34: conflicting requests 2024-02-09T08:00:07.830 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.830 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 35: conflicting requests 2024-02-09T08:00:07.830 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.830 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 36: conflicting requests 2024-02-09T08:00:07.830 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.830 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 37: conflicting requests 2024-02-09T08:00:07.830 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.830 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.830 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.830 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T08:00:07.830 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.831 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.831 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.831 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.831 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 39: conflicting requests 2024-02-09T08:00:07.831 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.831 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.831 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.831 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.831 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.831 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.831 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T08:00:07.831 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.832 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.832 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.832 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.832 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T08:00:07.832 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.832 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.832 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.832 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.832 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T08:00:07.832 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.833 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.833 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.833 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.833 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T08:00:07.833 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.833 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.833 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.833 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.833 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T08:00:07.833 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.833 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.833 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.833 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.833 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T08:00:07.833 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.834 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.834 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.834 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T08:00:07.893 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-02-09T08:00:07.893 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T08:00:07.893 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repo Size 2024-02-09T08:00:07.893 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T08:00:07.893 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-02-09T08:00:07.894 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-fuse-debuginfo x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 5.9 M 2024-02-09T08:00:07.894 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:00:07.894 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-02-09T08:00:07.894 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T08:00:07.894 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-02-09T08:00:07.894 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:00:07.895 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 5.9 M 2024-02-09T08:00:07.895 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 28 M 2024-02-09T08:00:07.896 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-02-09T08:00:08.224 INFO:teuthology.orchestra.run.smithi062.stdout:rbd-nbd-debuginfo-19.0.0-1310.g0089f33e.el9.x86 1.8 MB/s | 1.3 MB 00:00 2024-02-09T08:00:08.224 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-02-09T08:00:08.224 INFO:teuthology.orchestra.run.smithi062.stdout:Total 1.7 MB/s | 1.3 MB 00:00 2024-02-09T08:00:08.224 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-02-09T08:00:08.227 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-02-09T08:00:08.227 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-02-09T08:00:08.273 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-02-09T08:00:08.274 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-02-09T08:00:08.518 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-02-09T08:00:08.608 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : rbd-nbd-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 1/1 2024-02-09T08:00:09.023 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: rbd-nbd-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 1/1 2024-02-09T08:00:09.325 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : rbd-nbd-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 1/1 2024-02-09T08:00:09.325 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T08:00:09.325 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-02-09T08:00:09.326 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-nbd-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T08:00:09.326 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T08:00:09.327 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-02-09T08:00:09.499 DEBUG:teuthology.parallel:result is None 2024-02-09T08:00:09.734 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse-debuginfo-19.0.0-1310.g0089f33e.el9.x 3.2 MB/s | 5.9 MB 00:01 2024-02-09T08:00:09.735 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-02-09T08:00:09.735 INFO:teuthology.orchestra.run.smithi103.stdout:Total 3.2 MB/s | 5.9 MB 00:01 2024-02-09T08:00:09.736 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-02-09T08:00:09.740 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-02-09T08:00:09.740 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-02-09T08:00:09.812 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-02-09T08:00:09.813 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-02-09T08:00:10.541 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-02-09T08:00:10.649 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-fuse-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_ 1/1 2024-02-09T08:00:11.227 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-fuse-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_ 1/1 2024-02-09T08:00:11.520 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-fuse-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_ 1/1 2024-02-09T08:00:11.521 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:00:11.521 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-02-09T08:00:11.521 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-fuse-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T08:00:11.521 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:00:11.521 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-02-09T08:00:11.712 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install librados-devel-debuginfo 2024-02-09T08:00:12.317 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:10:17 ago on Fri 09 Feb 2024 07:49:55 AM UTC. 2024-02-09T08:00:12.609 INFO:teuthology.orchestra.run.smithi103.stderr:Modular dependency problems: 2024-02-09T08:00:12.609 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:00:12.609 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 1: conflicting requests 2024-02-09T08:00:12.609 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.609 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 2: conflicting requests 2024-02-09T08:00:12.609 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.609 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 3: conflicting requests 2024-02-09T08:00:12.610 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.610 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 4: conflicting requests 2024-02-09T08:00:12.610 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.610 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 5: conflicting requests 2024-02-09T08:00:12.610 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.610 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 6: conflicting requests 2024-02-09T08:00:12.610 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.610 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 7: conflicting requests 2024-02-09T08:00:12.610 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.610 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 8: conflicting requests 2024-02-09T08:00:12.610 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.610 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 9: conflicting requests 2024-02-09T08:00:12.610 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.611 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 10: conflicting requests 2024-02-09T08:00:12.611 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.611 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 11: conflicting requests 2024-02-09T08:00:12.611 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.611 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 12: conflicting requests 2024-02-09T08:00:12.611 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.611 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 13: conflicting requests 2024-02-09T08:00:12.611 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.611 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 14: conflicting requests 2024-02-09T08:00:12.611 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.611 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 15: conflicting requests 2024-02-09T08:00:12.611 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.611 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 16: conflicting requests 2024-02-09T08:00:12.611 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.612 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 17: conflicting requests 2024-02-09T08:00:12.612 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.612 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 18: conflicting requests 2024-02-09T08:00:12.612 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.612 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 19: conflicting requests 2024-02-09T08:00:12.612 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.612 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 20: conflicting requests 2024-02-09T08:00:12.612 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.612 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 21: conflicting requests 2024-02-09T08:00:12.612 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.612 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 22: conflicting requests 2024-02-09T08:00:12.612 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.613 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 23: conflicting requests 2024-02-09T08:00:12.613 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.613 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 24: conflicting requests 2024-02-09T08:00:12.613 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.613 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 25: conflicting requests 2024-02-09T08:00:12.613 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.613 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 26: conflicting requests 2024-02-09T08:00:12.613 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.613 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 27: conflicting requests 2024-02-09T08:00:12.613 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.613 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 28: conflicting requests 2024-02-09T08:00:12.613 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.614 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 29: conflicting requests 2024-02-09T08:00:12.614 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.614 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 30: conflicting requests 2024-02-09T08:00:12.614 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.614 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 31: conflicting requests 2024-02-09T08:00:12.614 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.614 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 32: conflicting requests 2024-02-09T08:00:12.614 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.614 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 33: conflicting requests 2024-02-09T08:00:12.614 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.614 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 34: conflicting requests 2024-02-09T08:00:12.614 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.614 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 35: conflicting requests 2024-02-09T08:00:12.614 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.615 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 36: conflicting requests 2024-02-09T08:00:12.615 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.615 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 37: conflicting requests 2024-02-09T08:00:12.615 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.615 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.615 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.615 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T08:00:12.615 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.615 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.615 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.615 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.615 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 39: conflicting requests 2024-02-09T08:00:12.615 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.616 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.616 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.616 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.616 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.616 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.616 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T08:00:12.616 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.616 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.616 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.616 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.616 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T08:00:12.616 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.617 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.617 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.617 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.617 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T08:00:12.617 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.617 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.617 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.617 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.617 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T08:00:12.617 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.617 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.617 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.617 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.617 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T08:00:12.618 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.618 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.618 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.618 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.618 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T08:00:12.618 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.618 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.618 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.618 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T08:00:12.677 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-02-09T08:00:12.677 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T08:00:12.677 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repo Size 2024-02-09T08:00:12.677 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T08:00:12.678 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-02-09T08:00:12.678 INFO:teuthology.orchestra.run.smithi103.stdout: librados-devel-debuginfo x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 109 k 2024-02-09T08:00:12.678 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:00:12.678 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-02-09T08:00:12.678 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T08:00:12.678 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-02-09T08:00:12.678 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:00:12.678 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 109 k 2024-02-09T08:00:12.679 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 440 k 2024-02-09T08:00:12.679 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-02-09T08:00:13.004 INFO:teuthology.orchestra.run.smithi103.stdout:librados-devel-debuginfo-19.0.0-1310.g0089f33e. 334 kB/s | 109 kB 00:00 2024-02-09T08:00:13.005 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-02-09T08:00:13.005 INFO:teuthology.orchestra.run.smithi103.stdout:Total 332 kB/s | 109 kB 00:00 2024-02-09T08:00:13.005 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-02-09T08:00:13.008 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-02-09T08:00:13.008 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-02-09T08:00:13.043 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-02-09T08:00:13.044 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-02-09T08:00:13.161 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-02-09T08:00:13.260 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librados-devel-debuginfo-2:19.0.0-1310.g0089f33e.el9 1/1 2024-02-09T08:00:13.652 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librados-devel-debuginfo-2:19.0.0-1310.g0089f33e.el9 1/1 2024-02-09T08:00:13.958 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librados-devel-debuginfo-2:19.0.0-1310.g0089f33e.el9 1/1 2024-02-09T08:00:13.958 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:00:13.958 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-02-09T08:00:13.958 INFO:teuthology.orchestra.run.smithi103.stdout: librados-devel-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T08:00:13.958 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:00:13.959 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-02-09T08:00:14.145 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install libcephfs2-debuginfo 2024-02-09T08:00:14.753 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:10:19 ago on Fri 09 Feb 2024 07:49:55 AM UTC. 2024-02-09T08:00:15.046 INFO:teuthology.orchestra.run.smithi103.stderr:Modular dependency problems: 2024-02-09T08:00:15.047 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:00:15.047 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 1: conflicting requests 2024-02-09T08:00:15.047 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.047 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 2: conflicting requests 2024-02-09T08:00:15.047 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.047 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 3: conflicting requests 2024-02-09T08:00:15.047 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.047 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 4: conflicting requests 2024-02-09T08:00:15.047 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.047 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 5: conflicting requests 2024-02-09T08:00:15.048 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.048 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 6: conflicting requests 2024-02-09T08:00:15.048 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.048 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 7: conflicting requests 2024-02-09T08:00:15.048 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.048 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 8: conflicting requests 2024-02-09T08:00:15.048 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.048 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 9: conflicting requests 2024-02-09T08:00:15.048 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.048 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 10: conflicting requests 2024-02-09T08:00:15.048 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.048 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 11: conflicting requests 2024-02-09T08:00:15.048 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.049 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 12: conflicting requests 2024-02-09T08:00:15.049 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.049 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 13: conflicting requests 2024-02-09T08:00:15.049 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.049 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 14: conflicting requests 2024-02-09T08:00:15.049 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.049 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 15: conflicting requests 2024-02-09T08:00:15.049 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.049 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 16: conflicting requests 2024-02-09T08:00:15.049 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.049 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 17: conflicting requests 2024-02-09T08:00:15.049 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.049 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 18: conflicting requests 2024-02-09T08:00:15.050 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.050 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 19: conflicting requests 2024-02-09T08:00:15.050 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.050 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 20: conflicting requests 2024-02-09T08:00:15.050 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.050 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 21: conflicting requests 2024-02-09T08:00:15.050 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.050 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 22: conflicting requests 2024-02-09T08:00:15.050 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.050 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 23: conflicting requests 2024-02-09T08:00:15.050 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.050 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 24: conflicting requests 2024-02-09T08:00:15.050 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.051 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 25: conflicting requests 2024-02-09T08:00:15.051 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.051 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 26: conflicting requests 2024-02-09T08:00:15.051 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.051 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 27: conflicting requests 2024-02-09T08:00:15.051 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.051 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 28: conflicting requests 2024-02-09T08:00:15.051 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.051 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 29: conflicting requests 2024-02-09T08:00:15.051 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.051 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 30: conflicting requests 2024-02-09T08:00:15.051 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.051 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 31: conflicting requests 2024-02-09T08:00:15.051 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.052 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 32: conflicting requests 2024-02-09T08:00:15.052 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.052 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 33: conflicting requests 2024-02-09T08:00:15.052 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.052 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 34: conflicting requests 2024-02-09T08:00:15.052 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.052 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 35: conflicting requests 2024-02-09T08:00:15.052 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.052 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 36: conflicting requests 2024-02-09T08:00:15.052 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.052 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 37: conflicting requests 2024-02-09T08:00:15.052 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.052 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.053 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.053 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T08:00:15.053 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.053 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.053 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.053 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.053 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 39: conflicting requests 2024-02-09T08:00:15.053 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.053 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.053 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.053 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.053 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.053 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.053 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T08:00:15.054 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.054 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.054 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.054 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.054 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T08:00:15.054 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.054 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.054 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.054 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.054 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T08:00:15.054 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.054 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.054 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.055 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.055 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T08:00:15.055 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.055 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.055 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.055 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.055 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T08:00:15.055 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.055 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.055 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.055 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.055 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T08:00:15.055 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.055 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.056 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.056 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T08:00:15.114 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-02-09T08:00:15.115 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T08:00:15.115 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repo Size 2024-02-09T08:00:15.115 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T08:00:15.115 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-02-09T08:00:15.115 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs2-debuginfo x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 5.3 M 2024-02-09T08:00:15.115 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:00:15.115 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-02-09T08:00:15.115 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T08:00:15.116 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-02-09T08:00:15.116 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:00:15.116 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 5.3 M 2024-02-09T08:00:15.116 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 25 M 2024-02-09T08:00:15.116 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-02-09T08:00:15.858 INFO:teuthology.orchestra.run.smithi103.stdout:libcephfs2-debuginfo-19.0.0-1310.g0089f33e.el9. 7.2 MB/s | 5.3 MB 00:00 2024-02-09T08:00:15.858 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-02-09T08:00:15.859 INFO:teuthology.orchestra.run.smithi103.stdout:Total 7.2 MB/s | 5.3 MB 00:00 2024-02-09T08:00:15.859 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-02-09T08:00:15.862 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-02-09T08:00:15.862 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-02-09T08:00:15.928 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-02-09T08:00:15.928 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-02-09T08:00:16.590 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-02-09T08:00:16.699 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libcephfs2-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86 1/1 2024-02-09T08:00:17.240 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libcephfs2-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86 1/1 2024-02-09T08:00:17.546 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libcephfs2-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86 1/1 2024-02-09T08:00:17.546 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:00:17.546 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-02-09T08:00:17.547 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs2-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T08:00:17.547 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:00:17.547 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-02-09T08:00:17.737 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install librados2-debuginfo 2024-02-09T08:00:18.342 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:10:23 ago on Fri 09 Feb 2024 07:49:55 AM UTC. 2024-02-09T08:00:18.635 INFO:teuthology.orchestra.run.smithi103.stderr:Modular dependency problems: 2024-02-09T08:00:18.635 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:00:18.636 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 1: conflicting requests 2024-02-09T08:00:18.636 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.636 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 2: conflicting requests 2024-02-09T08:00:18.636 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.636 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 3: conflicting requests 2024-02-09T08:00:18.636 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.636 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 4: conflicting requests 2024-02-09T08:00:18.636 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.636 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 5: conflicting requests 2024-02-09T08:00:18.636 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.636 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 6: conflicting requests 2024-02-09T08:00:18.636 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.636 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 7: conflicting requests 2024-02-09T08:00:18.637 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.637 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 8: conflicting requests 2024-02-09T08:00:18.637 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.637 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 9: conflicting requests 2024-02-09T08:00:18.637 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.637 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 10: conflicting requests 2024-02-09T08:00:18.637 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.637 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 11: conflicting requests 2024-02-09T08:00:18.637 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.637 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 12: conflicting requests 2024-02-09T08:00:18.637 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.637 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 13: conflicting requests 2024-02-09T08:00:18.637 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.638 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 14: conflicting requests 2024-02-09T08:00:18.638 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.638 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 15: conflicting requests 2024-02-09T08:00:18.638 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.638 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 16: conflicting requests 2024-02-09T08:00:18.638 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.638 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 17: conflicting requests 2024-02-09T08:00:18.638 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.638 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 18: conflicting requests 2024-02-09T08:00:18.638 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.638 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 19: conflicting requests 2024-02-09T08:00:18.638 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.638 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 20: conflicting requests 2024-02-09T08:00:18.639 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.639 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 21: conflicting requests 2024-02-09T08:00:18.639 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.639 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 22: conflicting requests 2024-02-09T08:00:18.639 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.639 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 23: conflicting requests 2024-02-09T08:00:18.639 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.639 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 24: conflicting requests 2024-02-09T08:00:18.639 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.639 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 25: conflicting requests 2024-02-09T08:00:18.639 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.639 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 26: conflicting requests 2024-02-09T08:00:18.639 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.640 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 27: conflicting requests 2024-02-09T08:00:18.640 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.640 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 28: conflicting requests 2024-02-09T08:00:18.640 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.640 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 29: conflicting requests 2024-02-09T08:00:18.640 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.640 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 30: conflicting requests 2024-02-09T08:00:18.640 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.640 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 31: conflicting requests 2024-02-09T08:00:18.640 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.640 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 32: conflicting requests 2024-02-09T08:00:18.640 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.640 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 33: conflicting requests 2024-02-09T08:00:18.641 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.641 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 34: conflicting requests 2024-02-09T08:00:18.641 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.641 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 35: conflicting requests 2024-02-09T08:00:18.641 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.641 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 36: conflicting requests 2024-02-09T08:00:18.641 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.641 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 37: conflicting requests 2024-02-09T08:00:18.641 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.641 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.641 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.641 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T08:00:18.641 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.641 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.642 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.642 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.642 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 39: conflicting requests 2024-02-09T08:00:18.642 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.642 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.642 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.642 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.642 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.642 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.642 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T08:00:18.642 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.642 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.642 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.643 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.643 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T08:00:18.643 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.643 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.643 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.643 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.643 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T08:00:18.643 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.643 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.643 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.643 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.643 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T08:00:18.643 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.643 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.644 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.644 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.644 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T08:00:18.644 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.644 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.644 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.644 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.644 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T08:00:18.644 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.644 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.644 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.644 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T08:00:18.703 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-02-09T08:00:18.703 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T08:00:18.703 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repo Size 2024-02-09T08:00:18.703 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T08:00:18.703 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-02-09T08:00:18.703 INFO:teuthology.orchestra.run.smithi103.stdout: librados2-debuginfo x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 44 M 2024-02-09T08:00:18.703 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:00:18.703 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-02-09T08:00:18.704 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T08:00:18.704 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-02-09T08:00:18.704 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:00:18.704 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 44 M 2024-02-09T08:00:18.704 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 252 M 2024-02-09T08:00:18.704 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-02-09T08:00:21.236 INFO:teuthology.orchestra.run.smithi103.stdout:librados2-debuginfo-19.0.0-1310.g0089f33e.el9.x 17 MB/s | 44 MB 00:02 2024-02-09T08:00:21.237 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-02-09T08:00:21.237 INFO:teuthology.orchestra.run.smithi103.stdout:Total 17 MB/s | 44 MB 00:02 2024-02-09T08:00:21.238 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-02-09T08:00:21.242 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-02-09T08:00:21.242 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-02-09T08:00:21.545 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-02-09T08:00:21.546 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-02-09T08:00:26.602 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-02-09T08:00:26.719 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librados2-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_ 1/1 2024-02-09T08:00:28.581 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librados2-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_ 1/1 2024-02-09T08:00:28.891 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librados2-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_ 1/1 2024-02-09T08:00:28.892 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:00:28.892 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-02-09T08:00:28.892 INFO:teuthology.orchestra.run.smithi103.stdout: librados2-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T08:00:28.892 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:00:28.892 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-02-09T08:00:29.118 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install librbd1-debuginfo 2024-02-09T08:00:29.730 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:10:34 ago on Fri 09 Feb 2024 07:49:55 AM UTC. 2024-02-09T08:00:30.025 INFO:teuthology.orchestra.run.smithi103.stderr:Modular dependency problems: 2024-02-09T08:00:30.025 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:00:30.025 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 1: conflicting requests 2024-02-09T08:00:30.025 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.026 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 2: conflicting requests 2024-02-09T08:00:30.026 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.026 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 3: conflicting requests 2024-02-09T08:00:30.026 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.026 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 4: conflicting requests 2024-02-09T08:00:30.026 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.026 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 5: conflicting requests 2024-02-09T08:00:30.026 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.026 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 6: conflicting requests 2024-02-09T08:00:30.026 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.026 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 7: conflicting requests 2024-02-09T08:00:30.026 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.027 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 8: conflicting requests 2024-02-09T08:00:30.027 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.027 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 9: conflicting requests 2024-02-09T08:00:30.027 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.027 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 10: conflicting requests 2024-02-09T08:00:30.027 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.027 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 11: conflicting requests 2024-02-09T08:00:30.027 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.027 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 12: conflicting requests 2024-02-09T08:00:30.027 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.027 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 13: conflicting requests 2024-02-09T08:00:30.027 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.027 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 14: conflicting requests 2024-02-09T08:00:30.027 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.028 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 15: conflicting requests 2024-02-09T08:00:30.028 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.028 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 16: conflicting requests 2024-02-09T08:00:30.028 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.028 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 17: conflicting requests 2024-02-09T08:00:30.028 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.028 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 18: conflicting requests 2024-02-09T08:00:30.028 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.028 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 19: conflicting requests 2024-02-09T08:00:30.028 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.028 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 20: conflicting requests 2024-02-09T08:00:30.028 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.029 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 21: conflicting requests 2024-02-09T08:00:30.029 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.029 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 22: conflicting requests 2024-02-09T08:00:30.029 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.029 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 23: conflicting requests 2024-02-09T08:00:30.029 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.029 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 24: conflicting requests 2024-02-09T08:00:30.029 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.029 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 25: conflicting requests 2024-02-09T08:00:30.029 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.029 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 26: conflicting requests 2024-02-09T08:00:30.029 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.029 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 27: conflicting requests 2024-02-09T08:00:30.030 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.030 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 28: conflicting requests 2024-02-09T08:00:30.030 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.030 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 29: conflicting requests 2024-02-09T08:00:30.030 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.030 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 30: conflicting requests 2024-02-09T08:00:30.030 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.030 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 31: conflicting requests 2024-02-09T08:00:30.030 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.030 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 32: conflicting requests 2024-02-09T08:00:30.030 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.030 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 33: conflicting requests 2024-02-09T08:00:30.030 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.030 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 34: conflicting requests 2024-02-09T08:00:30.031 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.031 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 35: conflicting requests 2024-02-09T08:00:30.031 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.031 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 36: conflicting requests 2024-02-09T08:00:30.031 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.031 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 37: conflicting requests 2024-02-09T08:00:30.031 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.031 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.031 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.031 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T08:00:30.031 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.031 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.031 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.031 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.032 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 39: conflicting requests 2024-02-09T08:00:30.032 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.032 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.032 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.032 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.032 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.032 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.032 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T08:00:30.032 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.033 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.033 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.033 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.033 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T08:00:30.033 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.033 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.033 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.033 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.033 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T08:00:30.033 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.033 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.033 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.034 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.034 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T08:00:30.034 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.034 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.034 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.034 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.034 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T08:00:30.034 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.034 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.034 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.034 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.034 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T08:00:30.034 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.034 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.035 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.035 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T08:00:30.093 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-02-09T08:00:30.093 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T08:00:30.094 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repo Size 2024-02-09T08:00:30.094 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T08:00:30.094 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-02-09T08:00:30.094 INFO:teuthology.orchestra.run.smithi103.stdout: librbd1-debuginfo x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 52 M 2024-02-09T08:00:30.094 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:00:30.094 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-02-09T08:00:30.094 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T08:00:30.094 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-02-09T08:00:30.094 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:00:30.094 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 52 M 2024-02-09T08:00:30.094 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 308 M 2024-02-09T08:00:30.095 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-02-09T08:00:32.839 INFO:teuthology.orchestra.run.smithi103.stdout:librbd1-debuginfo-19.0.0-1310.g0089f33e.el9.x86 19 MB/s | 52 MB 00:02 2024-02-09T08:00:32.840 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-02-09T08:00:32.840 INFO:teuthology.orchestra.run.smithi103.stdout:Total 19 MB/s | 52 MB 00:02 2024-02-09T08:00:32.841 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-02-09T08:00:32.845 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-02-09T08:00:32.845 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-02-09T08:00:33.195 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-02-09T08:00:33.195 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-02-09T08:00:39.233 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-02-09T08:00:39.340 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librbd1-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 1/1 2024-02-09T08:00:41.637 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librbd1-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 1/1 2024-02-09T08:00:41.957 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librbd1-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 1/1 2024-02-09T08:00:41.957 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:00:41.957 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-02-09T08:00:41.957 INFO:teuthology.orchestra.run.smithi103.stdout: librbd1-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T08:00:41.957 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:00:41.957 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-02-09T08:00:42.170 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install python3-cephfs-debuginfo 2024-02-09T08:00:42.774 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:10:47 ago on Fri 09 Feb 2024 07:49:55 AM UTC. 2024-02-09T08:00:43.069 INFO:teuthology.orchestra.run.smithi103.stderr:Modular dependency problems: 2024-02-09T08:00:43.069 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:00:43.069 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 1: conflicting requests 2024-02-09T08:00:43.069 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.069 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 2: conflicting requests 2024-02-09T08:00:43.069 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.069 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 3: conflicting requests 2024-02-09T08:00:43.069 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.069 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 4: conflicting requests 2024-02-09T08:00:43.070 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.070 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 5: conflicting requests 2024-02-09T08:00:43.070 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.070 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 6: conflicting requests 2024-02-09T08:00:43.070 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.070 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 7: conflicting requests 2024-02-09T08:00:43.070 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.070 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 8: conflicting requests 2024-02-09T08:00:43.070 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.070 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 9: conflicting requests 2024-02-09T08:00:43.070 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.071 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 10: conflicting requests 2024-02-09T08:00:43.071 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.071 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 11: conflicting requests 2024-02-09T08:00:43.071 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.071 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 12: conflicting requests 2024-02-09T08:00:43.071 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.071 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 13: conflicting requests 2024-02-09T08:00:43.071 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.071 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 14: conflicting requests 2024-02-09T08:00:43.071 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.071 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 15: conflicting requests 2024-02-09T08:00:43.071 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.072 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 16: conflicting requests 2024-02-09T08:00:43.072 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.072 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 17: conflicting requests 2024-02-09T08:00:43.072 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.072 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 18: conflicting requests 2024-02-09T08:00:43.072 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.072 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 19: conflicting requests 2024-02-09T08:00:43.072 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.072 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 20: conflicting requests 2024-02-09T08:00:43.072 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.073 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 21: conflicting requests 2024-02-09T08:00:43.073 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.073 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 22: conflicting requests 2024-02-09T08:00:43.073 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.073 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 23: conflicting requests 2024-02-09T08:00:43.073 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.073 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 24: conflicting requests 2024-02-09T08:00:43.073 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.073 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 25: conflicting requests 2024-02-09T08:00:43.073 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.074 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 26: conflicting requests 2024-02-09T08:00:43.074 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.074 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 27: conflicting requests 2024-02-09T08:00:43.074 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.074 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 28: conflicting requests 2024-02-09T08:00:43.074 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.074 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 29: conflicting requests 2024-02-09T08:00:43.074 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.074 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 30: conflicting requests 2024-02-09T08:00:43.074 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.074 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 31: conflicting requests 2024-02-09T08:00:43.074 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.075 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 32: conflicting requests 2024-02-09T08:00:43.075 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.075 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 33: conflicting requests 2024-02-09T08:00:43.075 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.075 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 34: conflicting requests 2024-02-09T08:00:43.075 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.075 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 35: conflicting requests 2024-02-09T08:00:43.075 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.075 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 36: conflicting requests 2024-02-09T08:00:43.075 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.075 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 37: conflicting requests 2024-02-09T08:00:43.076 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.076 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.076 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.076 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T08:00:43.076 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.076 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.076 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.076 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.076 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 39: conflicting requests 2024-02-09T08:00:43.076 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.076 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.077 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.077 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.077 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.077 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.077 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T08:00:43.077 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.077 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.077 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.077 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.077 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T08:00:43.077 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.078 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.078 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.078 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.078 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T08:00:43.078 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.078 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.078 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.078 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.078 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T08:00:43.078 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.078 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.078 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.079 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.079 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T08:00:43.079 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.079 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.079 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.079 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.079 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T08:00:43.079 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.079 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.079 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.079 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T08:00:43.137 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-02-09T08:00:43.138 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T08:00:43.138 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repo Size 2024-02-09T08:00:43.138 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T08:00:43.138 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-02-09T08:00:43.138 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cephfs-debuginfo x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 615 k 2024-02-09T08:00:43.138 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:00:43.139 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-02-09T08:00:43.139 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T08:00:43.139 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-02-09T08:00:43.139 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:00:43.139 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 615 k 2024-02-09T08:00:43.139 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 2.1 M 2024-02-09T08:00:43.139 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-02-09T08:00:43.567 INFO:teuthology.orchestra.run.smithi103.stdout:python3-cephfs-debuginfo-19.0.0-1310.g0089f33e. 1.4 MB/s | 615 kB 00:00 2024-02-09T08:00:43.568 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-02-09T08:00:43.568 INFO:teuthology.orchestra.run.smithi103.stdout:Total 1.4 MB/s | 615 kB 00:00 2024-02-09T08:00:43.568 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-02-09T08:00:43.572 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-02-09T08:00:43.572 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-02-09T08:00:43.610 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-02-09T08:00:43.611 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-02-09T08:00:43.773 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-02-09T08:00:43.866 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cephfs-debuginfo-2:19.0.0-1310.g0089f33e.el9 1/1 2024-02-09T08:00:44.254 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: python3-cephfs-debuginfo-2:19.0.0-1310.g0089f33e.el9 1/1 2024-02-09T08:00:44.564 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cephfs-debuginfo-2:19.0.0-1310.g0089f33e.el9 1/1 2024-02-09T08:00:44.564 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:00:44.564 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-02-09T08:00:44.564 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cephfs-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T08:00:44.564 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:00:44.564 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-02-09T08:00:44.746 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install python3-rados-debuginfo 2024-02-09T08:00:45.353 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:10:50 ago on Fri 09 Feb 2024 07:49:55 AM UTC. 2024-02-09T08:00:45.683 INFO:teuthology.orchestra.run.smithi103.stderr:Modular dependency problems: 2024-02-09T08:00:45.683 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:00:45.683 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 1: conflicting requests 2024-02-09T08:00:45.684 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.684 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 2: conflicting requests 2024-02-09T08:00:45.684 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.684 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 3: conflicting requests 2024-02-09T08:00:45.684 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.684 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 4: conflicting requests 2024-02-09T08:00:45.684 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.684 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 5: conflicting requests 2024-02-09T08:00:45.684 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.684 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 6: conflicting requests 2024-02-09T08:00:45.684 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.684 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 7: conflicting requests 2024-02-09T08:00:45.685 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.685 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 8: conflicting requests 2024-02-09T08:00:45.685 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.685 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 9: conflicting requests 2024-02-09T08:00:45.685 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.685 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 10: conflicting requests 2024-02-09T08:00:45.685 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.685 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 11: conflicting requests 2024-02-09T08:00:45.685 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.685 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 12: conflicting requests 2024-02-09T08:00:45.685 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.685 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 13: conflicting requests 2024-02-09T08:00:45.685 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.686 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 14: conflicting requests 2024-02-09T08:00:45.686 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.686 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 15: conflicting requests 2024-02-09T08:00:45.686 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.686 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 16: conflicting requests 2024-02-09T08:00:45.686 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.686 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 17: conflicting requests 2024-02-09T08:00:45.686 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.686 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 18: conflicting requests 2024-02-09T08:00:45.686 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.686 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 19: conflicting requests 2024-02-09T08:00:45.686 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.686 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 20: conflicting requests 2024-02-09T08:00:45.687 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.687 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 21: conflicting requests 2024-02-09T08:00:45.687 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.687 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 22: conflicting requests 2024-02-09T08:00:45.687 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.687 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 23: conflicting requests 2024-02-09T08:00:45.687 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.687 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 24: conflicting requests 2024-02-09T08:00:45.687 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.687 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 25: conflicting requests 2024-02-09T08:00:45.687 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.687 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 26: conflicting requests 2024-02-09T08:00:45.687 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.688 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 27: conflicting requests 2024-02-09T08:00:45.688 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.688 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 28: conflicting requests 2024-02-09T08:00:45.688 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.688 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 29: conflicting requests 2024-02-09T08:00:45.688 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.688 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 30: conflicting requests 2024-02-09T08:00:45.688 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.688 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 31: conflicting requests 2024-02-09T08:00:45.688 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.688 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 32: conflicting requests 2024-02-09T08:00:45.688 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.688 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 33: conflicting requests 2024-02-09T08:00:45.689 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.689 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 34: conflicting requests 2024-02-09T08:00:45.689 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.689 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 35: conflicting requests 2024-02-09T08:00:45.689 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.689 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 36: conflicting requests 2024-02-09T08:00:45.689 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.689 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 37: conflicting requests 2024-02-09T08:00:45.689 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.689 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.689 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.689 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T08:00:45.689 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.689 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.690 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.690 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.690 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 39: conflicting requests 2024-02-09T08:00:45.690 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.690 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.690 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.690 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.690 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.690 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.690 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T08:00:45.690 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.690 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.690 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.691 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.691 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T08:00:45.691 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.691 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.691 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.691 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.691 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T08:00:45.691 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.691 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.691 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.691 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.691 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T08:00:45.691 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.691 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.691 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.692 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.692 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T08:00:45.692 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.692 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.692 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.692 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.692 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T08:00:45.692 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.692 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.692 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.692 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T08:00:45.752 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-02-09T08:00:45.753 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T08:00:45.753 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repo Size 2024-02-09T08:00:45.753 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T08:00:45.753 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-02-09T08:00:45.753 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rados-debuginfo x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 769 k 2024-02-09T08:00:45.753 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:00:45.753 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-02-09T08:00:45.753 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T08:00:45.753 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-02-09T08:00:45.753 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:00:45.754 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 769 k 2024-02-09T08:00:45.754 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 2.7 M 2024-02-09T08:00:45.754 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-02-09T08:00:46.179 INFO:teuthology.orchestra.run.smithi103.stdout:python3-rados-debuginfo-19.0.0-1310.g0089f33e.e 1.8 MB/s | 769 kB 00:00 2024-02-09T08:00:46.180 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-02-09T08:00:46.180 INFO:teuthology.orchestra.run.smithi103.stdout:Total 1.8 MB/s | 769 kB 00:00 2024-02-09T08:00:46.181 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-02-09T08:00:46.184 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-02-09T08:00:46.184 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-02-09T08:00:46.222 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-02-09T08:00:46.223 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-02-09T08:00:46.406 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-02-09T08:00:46.503 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rados-debuginfo-2:19.0.0-1310.g0089f33e.el9. 1/1 2024-02-09T08:00:46.919 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: python3-rados-debuginfo-2:19.0.0-1310.g0089f33e.el9. 1/1 2024-02-09T08:00:47.222 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rados-debuginfo-2:19.0.0-1310.g0089f33e.el9. 1/1 2024-02-09T08:00:47.222 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:00:47.222 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-02-09T08:00:47.222 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rados-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T08:00:47.222 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:00:47.222 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-02-09T08:00:47.423 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install python3-rbd-debuginfo 2024-02-09T08:00:48.032 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:10:53 ago on Fri 09 Feb 2024 07:49:55 AM UTC. 2024-02-09T08:00:48.325 INFO:teuthology.orchestra.run.smithi103.stderr:Modular dependency problems: 2024-02-09T08:00:48.325 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:00:48.326 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 1: conflicting requests 2024-02-09T08:00:48.326 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.326 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 2: conflicting requests 2024-02-09T08:00:48.326 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.326 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 3: conflicting requests 2024-02-09T08:00:48.326 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.326 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 4: conflicting requests 2024-02-09T08:00:48.326 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.326 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 5: conflicting requests 2024-02-09T08:00:48.326 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.326 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 6: conflicting requests 2024-02-09T08:00:48.326 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.326 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 7: conflicting requests 2024-02-09T08:00:48.327 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.327 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 8: conflicting requests 2024-02-09T08:00:48.327 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.327 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 9: conflicting requests 2024-02-09T08:00:48.327 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.327 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 10: conflicting requests 2024-02-09T08:00:48.327 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.327 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 11: conflicting requests 2024-02-09T08:00:48.327 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.327 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 12: conflicting requests 2024-02-09T08:00:48.327 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.327 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 13: conflicting requests 2024-02-09T08:00:48.327 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.328 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 14: conflicting requests 2024-02-09T08:00:48.328 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.328 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 15: conflicting requests 2024-02-09T08:00:48.328 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.328 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 16: conflicting requests 2024-02-09T08:00:48.328 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.328 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 17: conflicting requests 2024-02-09T08:00:48.328 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.328 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 18: conflicting requests 2024-02-09T08:00:48.328 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.328 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 19: conflicting requests 2024-02-09T08:00:48.328 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.329 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 20: conflicting requests 2024-02-09T08:00:48.329 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.329 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 21: conflicting requests 2024-02-09T08:00:48.329 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.329 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 22: conflicting requests 2024-02-09T08:00:48.329 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.329 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 23: conflicting requests 2024-02-09T08:00:48.329 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.329 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 24: conflicting requests 2024-02-09T08:00:48.329 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.329 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 25: conflicting requests 2024-02-09T08:00:48.329 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.329 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 26: conflicting requests 2024-02-09T08:00:48.329 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.330 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 27: conflicting requests 2024-02-09T08:00:48.330 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.330 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 28: conflicting requests 2024-02-09T08:00:48.330 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.330 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 29: conflicting requests 2024-02-09T08:00:48.330 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.330 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 30: conflicting requests 2024-02-09T08:00:48.330 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.330 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 31: conflicting requests 2024-02-09T08:00:48.330 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.330 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 32: conflicting requests 2024-02-09T08:00:48.330 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.330 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 33: conflicting requests 2024-02-09T08:00:48.330 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.331 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 34: conflicting requests 2024-02-09T08:00:48.331 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.331 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 35: conflicting requests 2024-02-09T08:00:48.331 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.331 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 36: conflicting requests 2024-02-09T08:00:48.331 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.331 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 37: conflicting requests 2024-02-09T08:00:48.331 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.331 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.331 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.331 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T08:00:48.331 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.331 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.332 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.332 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.332 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 39: conflicting requests 2024-02-09T08:00:48.332 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.332 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.332 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.332 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.332 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.332 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.332 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T08:00:48.332 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.332 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.332 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.333 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.333 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T08:00:48.333 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.333 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.333 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.333 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.333 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T08:00:48.333 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.333 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.333 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.333 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.333 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T08:00:48.333 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.333 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.334 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.334 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.334 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T08:00:48.334 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.334 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.334 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.334 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.334 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T08:00:48.334 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.334 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.334 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.334 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T08:00:48.393 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-02-09T08:00:48.394 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T08:00:48.394 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repo Size 2024-02-09T08:00:48.394 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T08:00:48.394 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-02-09T08:00:48.394 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rbd-debuginfo x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 1.1 M 2024-02-09T08:00:48.395 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:00:48.395 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-02-09T08:00:48.395 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T08:00:48.395 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-02-09T08:00:48.395 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:00:48.395 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 1.1 M 2024-02-09T08:00:48.395 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 4.3 M 2024-02-09T08:00:48.395 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-02-09T08:00:48.858 INFO:teuthology.orchestra.run.smithi103.stdout:python3-rbd-debuginfo-19.0.0-1310.g0089f33e.el9 2.4 MB/s | 1.1 MB 00:00 2024-02-09T08:00:48.859 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-02-09T08:00:48.859 INFO:teuthology.orchestra.run.smithi103.stdout:Total 2.4 MB/s | 1.1 MB 00:00 2024-02-09T08:00:48.859 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-02-09T08:00:48.863 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-02-09T08:00:48.863 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-02-09T08:00:48.904 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-02-09T08:00:48.904 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-02-09T08:00:49.127 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-02-09T08:00:49.232 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rbd-debuginfo-2:19.0.0-1310.g0089f33e.el9.x8 1/1 2024-02-09T08:00:49.656 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: python3-rbd-debuginfo-2:19.0.0-1310.g0089f33e.el9.x8 1/1 2024-02-09T08:00:49.958 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rbd-debuginfo-2:19.0.0-1310.g0089f33e.el9.x8 1/1 2024-02-09T08:00:49.959 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:00:49.959 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-02-09T08:00:49.959 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rbd-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T08:00:49.959 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:00:49.959 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-02-09T08:00:50.164 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install python3-rgw-debuginfo 2024-02-09T08:00:50.771 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:10:55 ago on Fri 09 Feb 2024 07:49:55 AM UTC. 2024-02-09T08:00:51.064 INFO:teuthology.orchestra.run.smithi103.stderr:Modular dependency problems: 2024-02-09T08:00:51.065 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:00:51.065 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 1: conflicting requests 2024-02-09T08:00:51.065 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.065 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 2: conflicting requests 2024-02-09T08:00:51.065 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.065 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 3: conflicting requests 2024-02-09T08:00:51.065 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.065 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 4: conflicting requests 2024-02-09T08:00:51.065 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.065 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 5: conflicting requests 2024-02-09T08:00:51.065 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.065 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 6: conflicting requests 2024-02-09T08:00:51.065 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.066 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 7: conflicting requests 2024-02-09T08:00:51.066 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.066 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 8: conflicting requests 2024-02-09T08:00:51.066 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.066 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 9: conflicting requests 2024-02-09T08:00:51.066 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.066 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 10: conflicting requests 2024-02-09T08:00:51.067 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.067 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 11: conflicting requests 2024-02-09T08:00:51.067 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.067 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 12: conflicting requests 2024-02-09T08:00:51.067 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.067 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 13: conflicting requests 2024-02-09T08:00:51.067 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.068 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 14: conflicting requests 2024-02-09T08:00:51.068 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.068 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 15: conflicting requests 2024-02-09T08:00:51.068 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.068 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 16: conflicting requests 2024-02-09T08:00:51.068 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.069 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 17: conflicting requests 2024-02-09T08:00:51.069 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.069 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 18: conflicting requests 2024-02-09T08:00:51.069 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.069 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 19: conflicting requests 2024-02-09T08:00:51.069 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.069 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 20: conflicting requests 2024-02-09T08:00:51.070 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.070 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 21: conflicting requests 2024-02-09T08:00:51.070 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.070 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 22: conflicting requests 2024-02-09T08:00:51.070 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.070 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 23: conflicting requests 2024-02-09T08:00:51.071 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.071 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 24: conflicting requests 2024-02-09T08:00:51.071 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.071 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 25: conflicting requests 2024-02-09T08:00:51.071 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.072 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 26: conflicting requests 2024-02-09T08:00:51.072 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.072 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 27: conflicting requests 2024-02-09T08:00:51.072 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.072 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 28: conflicting requests 2024-02-09T08:00:51.072 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.073 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 29: conflicting requests 2024-02-09T08:00:51.073 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.073 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 30: conflicting requests 2024-02-09T08:00:51.073 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.073 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 31: conflicting requests 2024-02-09T08:00:51.073 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.073 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 32: conflicting requests 2024-02-09T08:00:51.074 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.074 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 33: conflicting requests 2024-02-09T08:00:51.074 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.074 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 34: conflicting requests 2024-02-09T08:00:51.074 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.074 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 35: conflicting requests 2024-02-09T08:00:51.074 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.075 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 36: conflicting requests 2024-02-09T08:00:51.075 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.075 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 37: conflicting requests 2024-02-09T08:00:51.075 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.075 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.075 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.076 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T08:00:51.076 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.076 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.076 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.076 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.076 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 39: conflicting requests 2024-02-09T08:00:51.077 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.077 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.077 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.077 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.077 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.077 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.077 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T08:00:51.078 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.078 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.078 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.078 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.078 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T08:00:51.078 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.078 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.079 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.079 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.079 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T08:00:51.079 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.079 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.079 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.079 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.079 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T08:00:51.080 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.080 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.080 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.080 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.080 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T08:00:51.080 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.080 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.081 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.081 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.081 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T08:00:51.081 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.081 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.081 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.082 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T08:00:51.133 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-02-09T08:00:51.134 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T08:00:51.134 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repo Size 2024-02-09T08:00:51.134 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T08:00:51.134 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-02-09T08:00:51.134 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rgw-debuginfo x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 337 k 2024-02-09T08:00:51.135 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:00:51.135 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-02-09T08:00:51.135 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T08:00:51.135 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-02-09T08:00:51.135 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:00:51.135 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 337 k 2024-02-09T08:00:51.135 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 1.0 M 2024-02-09T08:00:51.135 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-02-09T08:00:51.521 INFO:teuthology.orchestra.run.smithi103.stdout:python3-rgw-debuginfo-19.0.0-1310.g0089f33e.el9 875 kB/s | 337 kB 00:00 2024-02-09T08:00:51.590 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-02-09T08:00:51.592 INFO:teuthology.orchestra.run.smithi103.stdout:Total 872 kB/s | 337 kB 00:00 2024-02-09T08:00:51.592 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-02-09T08:00:51.592 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-02-09T08:00:51.593 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-02-09T08:00:51.593 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-02-09T08:00:51.593 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-02-09T08:00:51.694 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-02-09T08:00:51.802 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rgw-debuginfo-2:19.0.0-1310.g0089f33e.el9.x8 1/1 2024-02-09T08:00:52.170 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: python3-rgw-debuginfo-2:19.0.0-1310.g0089f33e.el9.x8 1/1 2024-02-09T08:00:52.466 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rgw-debuginfo-2:19.0.0-1310.g0089f33e.el9.x8 1/1 2024-02-09T08:00:52.466 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:00:52.466 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-02-09T08:00:52.466 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rgw-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T08:00:52.466 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:00:52.466 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-02-09T08:00:52.658 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install rbd-fuse-debuginfo 2024-02-09T08:00:53.264 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:10:58 ago on Fri 09 Feb 2024 07:49:55 AM UTC. 2024-02-09T08:00:53.558 INFO:teuthology.orchestra.run.smithi103.stderr:Modular dependency problems: 2024-02-09T08:00:53.558 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:00:53.558 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 1: conflicting requests 2024-02-09T08:00:53.558 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.558 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 2: conflicting requests 2024-02-09T08:00:53.558 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.558 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 3: conflicting requests 2024-02-09T08:00:53.559 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.559 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 4: conflicting requests 2024-02-09T08:00:53.559 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.559 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 5: conflicting requests 2024-02-09T08:00:53.559 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.559 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 6: conflicting requests 2024-02-09T08:00:53.559 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.559 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 7: conflicting requests 2024-02-09T08:00:53.559 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.559 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 8: conflicting requests 2024-02-09T08:00:53.559 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.559 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 9: conflicting requests 2024-02-09T08:00:53.559 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.560 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 10: conflicting requests 2024-02-09T08:00:53.560 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.560 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 11: conflicting requests 2024-02-09T08:00:53.560 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.560 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 12: conflicting requests 2024-02-09T08:00:53.560 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.560 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 13: conflicting requests 2024-02-09T08:00:53.560 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.560 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 14: conflicting requests 2024-02-09T08:00:53.560 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.560 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 15: conflicting requests 2024-02-09T08:00:53.560 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.560 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 16: conflicting requests 2024-02-09T08:00:53.560 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.561 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 17: conflicting requests 2024-02-09T08:00:53.561 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.561 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 18: conflicting requests 2024-02-09T08:00:53.561 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.561 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 19: conflicting requests 2024-02-09T08:00:53.561 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.561 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 20: conflicting requests 2024-02-09T08:00:53.561 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.561 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 21: conflicting requests 2024-02-09T08:00:53.561 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.561 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 22: conflicting requests 2024-02-09T08:00:53.561 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.561 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 23: conflicting requests 2024-02-09T08:00:53.562 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.562 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 24: conflicting requests 2024-02-09T08:00:53.562 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.562 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 25: conflicting requests 2024-02-09T08:00:53.562 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.562 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 26: conflicting requests 2024-02-09T08:00:53.562 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.562 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 27: conflicting requests 2024-02-09T08:00:53.562 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.562 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 28: conflicting requests 2024-02-09T08:00:53.562 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.562 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 29: conflicting requests 2024-02-09T08:00:53.562 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.562 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 30: conflicting requests 2024-02-09T08:00:53.563 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.563 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 31: conflicting requests 2024-02-09T08:00:53.563 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.563 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 32: conflicting requests 2024-02-09T08:00:53.563 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.563 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 33: conflicting requests 2024-02-09T08:00:53.563 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.563 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 34: conflicting requests 2024-02-09T08:00:53.563 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.563 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 35: conflicting requests 2024-02-09T08:00:53.563 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.563 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 36: conflicting requests 2024-02-09T08:00:53.563 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.563 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 37: conflicting requests 2024-02-09T08:00:53.564 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.564 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.564 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.564 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T08:00:53.564 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.564 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.564 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.564 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.564 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 39: conflicting requests 2024-02-09T08:00:53.564 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.564 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.564 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.564 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.564 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.565 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.565 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T08:00:53.565 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.565 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.565 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.565 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.565 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T08:00:53.565 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.565 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.565 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.565 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.565 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T08:00:53.565 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.565 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.566 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.566 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.566 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T08:00:53.566 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.566 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.566 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.566 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.566 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T08:00:53.566 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.566 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.566 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.566 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.566 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T08:00:53.566 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.567 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.567 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.567 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T08:00:53.628 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-02-09T08:00:53.629 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T08:00:53.629 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repo Size 2024-02-09T08:00:53.629 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T08:00:53.629 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-02-09T08:00:53.629 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-fuse-debuginfo x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 509 k 2024-02-09T08:00:53.629 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:00:53.629 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-02-09T08:00:53.629 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T08:00:53.629 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-02-09T08:00:53.629 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:00:53.630 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 509 k 2024-02-09T08:00:53.630 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 2.5 M 2024-02-09T08:00:53.630 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-02-09T08:00:54.084 INFO:teuthology.orchestra.run.smithi103.stdout:rbd-fuse-debuginfo-19.0.0-1310.g0089f33e.el9.x8 1.1 MB/s | 509 kB 00:00 2024-02-09T08:00:54.084 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-02-09T08:00:54.085 INFO:teuthology.orchestra.run.smithi103.stdout:Total 1.1 MB/s | 509 kB 00:00 2024-02-09T08:00:54.085 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-02-09T08:00:54.088 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-02-09T08:00:54.088 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-02-09T08:00:54.127 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-02-09T08:00:54.127 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-02-09T08:00:54.285 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-02-09T08:00:54.398 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-fuse-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_6 1/1 2024-02-09T08:00:54.775 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: rbd-fuse-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_6 1/1 2024-02-09T08:00:55.073 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-fuse-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_6 1/1 2024-02-09T08:00:55.073 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:00:55.073 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-02-09T08:00:55.073 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-fuse-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T08:00:55.073 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:00:55.073 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-02-09T08:00:55.287 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install rbd-mirror-debuginfo 2024-02-09T08:00:55.887 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:11:00 ago on Fri 09 Feb 2024 07:49:55 AM UTC. 2024-02-09T08:00:56.182 INFO:teuthology.orchestra.run.smithi103.stderr:Modular dependency problems: 2024-02-09T08:00:56.182 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:00:56.182 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 1: conflicting requests 2024-02-09T08:00:56.183 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.183 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 2: conflicting requests 2024-02-09T08:00:56.183 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.183 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 3: conflicting requests 2024-02-09T08:00:56.183 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.183 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 4: conflicting requests 2024-02-09T08:00:56.183 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.183 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 5: conflicting requests 2024-02-09T08:00:56.183 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.183 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 6: conflicting requests 2024-02-09T08:00:56.183 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.183 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 7: conflicting requests 2024-02-09T08:00:56.183 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.184 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 8: conflicting requests 2024-02-09T08:00:56.184 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.184 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 9: conflicting requests 2024-02-09T08:00:56.184 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.184 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 10: conflicting requests 2024-02-09T08:00:56.184 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.184 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 11: conflicting requests 2024-02-09T08:00:56.184 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.184 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 12: conflicting requests 2024-02-09T08:00:56.184 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.184 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 13: conflicting requests 2024-02-09T08:00:56.184 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.184 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 14: conflicting requests 2024-02-09T08:00:56.185 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.185 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 15: conflicting requests 2024-02-09T08:00:56.185 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.185 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 16: conflicting requests 2024-02-09T08:00:56.185 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.185 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 17: conflicting requests 2024-02-09T08:00:56.185 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.185 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 18: conflicting requests 2024-02-09T08:00:56.185 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.185 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 19: conflicting requests 2024-02-09T08:00:56.185 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.185 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 20: conflicting requests 2024-02-09T08:00:56.185 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.185 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 21: conflicting requests 2024-02-09T08:00:56.186 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.186 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 22: conflicting requests 2024-02-09T08:00:56.186 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.186 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 23: conflicting requests 2024-02-09T08:00:56.186 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.186 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 24: conflicting requests 2024-02-09T08:00:56.186 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.186 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 25: conflicting requests 2024-02-09T08:00:56.186 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.186 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 26: conflicting requests 2024-02-09T08:00:56.186 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.186 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 27: conflicting requests 2024-02-09T08:00:56.186 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.186 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 28: conflicting requests 2024-02-09T08:00:56.187 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.187 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 29: conflicting requests 2024-02-09T08:00:56.187 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.187 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 30: conflicting requests 2024-02-09T08:00:56.187 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.187 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 31: conflicting requests 2024-02-09T08:00:56.187 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.187 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 32: conflicting requests 2024-02-09T08:00:56.187 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.187 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 33: conflicting requests 2024-02-09T08:00:56.187 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.187 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 34: conflicting requests 2024-02-09T08:00:56.187 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.187 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 35: conflicting requests 2024-02-09T08:00:56.188 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.188 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 36: conflicting requests 2024-02-09T08:00:56.188 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.188 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 37: conflicting requests 2024-02-09T08:00:56.188 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.188 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.188 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.188 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T08:00:56.188 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.188 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.188 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.188 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.188 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 39: conflicting requests 2024-02-09T08:00:56.188 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.189 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.189 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.189 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.189 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.189 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.189 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T08:00:56.189 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.189 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.189 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.189 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.189 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T08:00:56.189 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.189 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.190 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.190 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.190 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T08:00:56.190 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.190 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.190 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.190 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.190 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T08:00:56.190 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.190 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.190 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.191 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.191 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T08:00:56.191 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.191 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.191 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.191 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.191 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T08:00:56.191 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.191 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.191 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.191 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T08:00:56.249 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-02-09T08:00:56.250 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T08:00:56.250 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repo Size 2024-02-09T08:00:56.250 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T08:00:56.250 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-02-09T08:00:56.250 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-mirror-debuginfo x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 52 M 2024-02-09T08:00:56.250 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:00:56.250 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-02-09T08:00:56.250 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T08:00:56.251 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-02-09T08:00:56.251 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:00:56.251 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 52 M 2024-02-09T08:00:56.251 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 298 M 2024-02-09T08:00:56.251 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-02-09T08:01:00.269 INFO:teuthology.orchestra.run.smithi103.stdout:rbd-mirror-debuginfo-19.0.0-1310.g0089f33e.el9. 13 MB/s | 52 MB 00:04 2024-02-09T08:01:00.269 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-02-09T08:01:00.270 INFO:teuthology.orchestra.run.smithi103.stdout:Total 13 MB/s | 52 MB 00:04 2024-02-09T08:01:00.270 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-02-09T08:01:00.274 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-02-09T08:01:00.274 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-02-09T08:01:00.610 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-02-09T08:01:00.611 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-02-09T08:01:06.574 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-02-09T08:01:06.674 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-mirror-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86 1/1 2024-02-09T08:01:08.852 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: rbd-mirror-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86 1/1 2024-02-09T08:01:09.135 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-mirror-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86 1/1 2024-02-09T08:01:09.135 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:01:09.135 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-02-09T08:01:09.136 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-mirror-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T08:01:09.136 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:01:09.136 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-02-09T08:01:09.339 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install rbd-nbd-debuginfo 2024-02-09T08:01:09.939 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:11:14 ago on Fri 09 Feb 2024 07:49:55 AM UTC. 2024-02-09T08:01:10.236 INFO:teuthology.orchestra.run.smithi103.stderr:Modular dependency problems: 2024-02-09T08:01:10.237 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:01:10.237 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 1: conflicting requests 2024-02-09T08:01:10.237 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240206092359:20125149.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.237 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 2: conflicting requests 2024-02-09T08:01:10.237 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.237 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 3: conflicting requests 2024-02-09T08:01:10.237 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.238 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 4: conflicting requests 2024-02-09T08:01:10.238 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.238 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 5: conflicting requests 2024-02-09T08:01:10.238 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.238 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 6: conflicting requests 2024-02-09T08:01:10.238 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.238 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 7: conflicting requests 2024-02-09T08:01:10.239 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.239 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 8: conflicting requests 2024-02-09T08:01:10.239 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.239 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 9: conflicting requests 2024-02-09T08:01:10.239 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.240 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 10: conflicting requests 2024-02-09T08:01:10.240 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.240 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 11: conflicting requests 2024-02-09T08:01:10.240 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.240 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 12: conflicting requests 2024-02-09T08:01:10.240 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.241 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 13: conflicting requests 2024-02-09T08:01:10.241 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.241 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 14: conflicting requests 2024-02-09T08:01:10.241 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.241 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 15: conflicting requests 2024-02-09T08:01:10.241 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.241 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 16: conflicting requests 2024-02-09T08:01:10.241 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.241 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 17: conflicting requests 2024-02-09T08:01:10.241 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.241 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 18: conflicting requests 2024-02-09T08:01:10.241 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.241 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 19: conflicting requests 2024-02-09T08:01:10.242 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.242 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 20: conflicting requests 2024-02-09T08:01:10.242 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.242 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 21: conflicting requests 2024-02-09T08:01:10.242 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.242 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 22: conflicting requests 2024-02-09T08:01:10.242 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.242 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 23: conflicting requests 2024-02-09T08:01:10.242 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240202092102:182f7c73.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.242 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 24: conflicting requests 2024-02-09T08:01:10.242 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.242 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 25: conflicting requests 2024-02-09T08:01:10.242 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.242 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 26: conflicting requests 2024-02-09T08:01:10.243 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240207141750:17377f89.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.243 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 27: conflicting requests 2024-02-09T08:01:10.243 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.243 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 28: conflicting requests 2024-02-09T08:01:10.243 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.244 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 29: conflicting requests 2024-02-09T08:01:10.244 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.244 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 30: conflicting requests 2024-02-09T08:01:10.244 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.244 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 31: conflicting requests 2024-02-09T08:01:10.244 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.244 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 32: conflicting requests 2024-02-09T08:01:10.244 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.244 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 33: conflicting requests 2024-02-09T08:01:10.245 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.245 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 34: conflicting requests 2024-02-09T08:01:10.245 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.245 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 35: conflicting requests 2024-02-09T08:01:10.245 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.245 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 36: conflicting requests 2024-02-09T08:01:10.245 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.245 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 37: conflicting requests 2024-02-09T08:01:10.245 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.245 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.245 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.245 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 38: cannot install the best candidate for the job 2024-02-09T08:01:10.245 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.246 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.246 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.246 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.246 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 39: conflicting requests 2024-02-09T08:01:10.246 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.246 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.246 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.246 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.246 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.246 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.246 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 40: cannot install the best candidate for the job 2024-02-09T08:01:10.246 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.247 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.247 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.247 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.247 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 41: cannot install the best candidate for the job 2024-02-09T08:01:10.247 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.247 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.247 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.247 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.247 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 42: cannot install the best candidate for the job 2024-02-09T08:01:10.247 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.248 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.248 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.248 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.248 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 43: cannot install the best candidate for the job 2024-02-09T08:01:10.248 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.248 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.248 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.248 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.248 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 44: cannot install the best candidate for the job 2024-02-09T08:01:10.248 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.248 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.248 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.248 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.249 INFO:teuthology.orchestra.run.smithi103.stderr: Problem 45: cannot install the best candidate for the job 2024-02-09T08:01:10.249 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.249 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.249 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.249 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-09T08:01:10.303 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-02-09T08:01:10.304 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T08:01:10.305 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repo Size 2024-02-09T08:01:10.305 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T08:01:10.305 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-02-09T08:01:10.305 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-nbd-debuginfo x86_64 2:19.0.0-1310.g0089f33e.el9 ceph 1.3 M 2024-02-09T08:01:10.305 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:01:10.305 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-02-09T08:01:10.305 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-02-09T08:01:10.306 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-02-09T08:01:10.306 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:01:10.306 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 1.3 M 2024-02-09T08:01:10.306 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 5.5 M 2024-02-09T08:01:10.306 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-02-09T08:01:10.796 INFO:teuthology.orchestra.run.smithi103.stdout:rbd-nbd-debuginfo-19.0.0-1310.g0089f33e.el9.x86 2.5 MB/s | 1.3 MB 00:00 2024-02-09T08:01:10.796 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-02-09T08:01:10.797 INFO:teuthology.orchestra.run.smithi103.stdout:Total 2.5 MB/s | 1.3 MB 00:00 2024-02-09T08:01:10.797 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-02-09T08:01:10.801 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-02-09T08:01:10.801 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-02-09T08:01:10.843 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-02-09T08:01:10.843 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-02-09T08:01:11.078 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-02-09T08:01:11.195 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-nbd-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 1/1 2024-02-09T08:01:11.619 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: rbd-nbd-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 1/1 2024-02-09T08:01:11.916 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-nbd-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 1/1 2024-02-09T08:01:11.917 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:01:11.917 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-02-09T08:01:11.917 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-nbd-debuginfo-2:19.0.0-1310.g0089f33e.el9.x86_64 2024-02-09T08:01:11.917 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:01:11.917 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-02-09T08:01:12.123 DEBUG:teuthology.parallel:result is None 2024-02-09T08:01:12.124 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=0089f33ec7e39da1a9e0f281bf62a5b44e1951f6 2024-02-09T08:01:12.432 DEBUG:teuthology.orchestra.run.smithi062:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-09T08:01:12.457 INFO:teuthology.orchestra.run.smithi062.stdout:19.0.0-1310.g0089f33e.el9 2024-02-09T08:01:12.458 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1310.g0089f33e.el9 2024-02-09T08:01:12.458 INFO:teuthology.task.install:The correct ceph version 19.0.0-1310.g0089f33e is installed. 2024-02-09T08:01:12.459 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=0089f33ec7e39da1a9e0f281bf62a5b44e1951f6 2024-02-09T08:01:12.682 DEBUG:teuthology.orchestra.run.smithi103:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-09T08:01:12.704 INFO:teuthology.orchestra.run.smithi103.stdout:19.0.0-1310.g0089f33e.el9 2024-02-09T08:01:12.705 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1310.g0089f33e.el9 2024-02-09T08:01:12.705 INFO:teuthology.task.install:The correct ceph version 19.0.0-1310.g0089f33e is installed. 2024-02-09T08:01:12.707 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-02-09T08:01:12.707 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-02-09T08:01:12.707 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-09T08:01:12.741 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-02-09T08:01:12.741 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-09T08:01:12.774 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-02-09T08:01:12.774 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-02-09T08:01:12.774 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/daemon-helper 2024-02-09T08:01:12.813 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-09T08:01:12.883 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-02-09T08:01:12.883 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/daemon-helper 2024-02-09T08:01:12.911 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-09T08:01:12.979 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-02-09T08:01:12.979 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-02-09T08:01:12.979 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-09T08:01:13.007 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-09T08:01:13.075 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-02-09T08:01:13.075 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-09T08:01:13.103 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-09T08:01:13.169 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-02-09T08:01:13.170 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-02-09T08:01:13.170 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/stdin-killer 2024-02-09T08:01:13.197 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-09T08:01:13.265 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-02-09T08:01:13.265 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/stdin-killer 2024-02-09T08:01:13.293 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-09T08:01:13.361 INFO:teuthology.run_tasks:Running task ceph... 2024-02-09T08:01:13.481 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-02-09T08:01:13.482 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 777 /var/log/ceph 2024-02-09T08:01:13.484 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 777 /var/log/ceph 2024-02-09T08:01:13.511 INFO:tasks.ceph:Disabling ceph logrotate... 2024-02-09T08:01:13.512 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /etc/logrotate.d/ceph 2024-02-09T08:01:13.552 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f -- /etc/logrotate.d/ceph 2024-02-09T08:01:13.578 INFO:tasks.ceph:Creating extra log directories... 2024-02-09T08:01:13.579 DEBUG:teuthology.orchestra.run.smithi062:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-02-09T08:01:13.620 DEBUG:teuthology.orchestra.run.smithi103:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-02-09T08:01:13.659 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-02-09T08:01:13.659 INFO:tasks.ceph:config {'conf': {'client': {'debug monc': 20, 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 80}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd client watch timeout': 120, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'reached quota', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(SLOW_OPS\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(OBJECT_MISPLACED\\)', 'slow request', 'overall HEALTH_', '\\(PG_', '\\(MON_DOWN\\)', '\\(SLOW_OPS\\)', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-02-09T08:01:13.659 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2024-02-09_00:15:46-rados-wip-yuri2-testing-2024-02-08-0727-distro-default-smithi/7553275', 'branch': 'wip-yuri2-testing-2024-02-08-0727', 'description': 'rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7553275', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yuriw-2024-02-09_00:15:46-rados-wip-yuri2-testing-2024-02-08-0727-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}, {'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-yuri2-testing-2024-02-08-0727'}, 'ceph': {'conf': {'client': {'debug monc': 20, 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 80}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd client watch timeout': 120, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'reached quota', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(SLOW_OPS\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(OBJECT_MISPLACED\\)', 'slow request', 'overall HEALTH_', '\\(PG_', '\\(MON_DOWN\\)', '\\(SLOW_OPS\\)', 'slow request'], 'sha1': '0089f33ec7e39da1a9e0f281bf62a5b44e1951f6', 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes'], 'osd': ['--tool=memcheck']}}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '0089f33ec7e39da1a9e0f281bf62a5b44e1951f6'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri2-testing-2024-02-08-0727', 'sha1': '0089f33ec7e39da1a9e0f281bf62a5b44e1951f6'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 71, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 5695, 'sha1': '0089f33ec7e39da1a9e0f281bf62a5b44e1951f6', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-yuri2-testing-2024-02-08-0727', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_0089f33ec7e39da1a9e0f281bf62a5b44e1951f6/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '0089f33ec7e39da1a9e0f281bf62a5b44e1951f6', 'targets': {'smithi062.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAhTwqhJJJycTelWYyHioxLcOZaijtvo91ZWyeIZH2roP0Z5mXpO5wFEEzVJusAXqkxtvan3OatqrN/S3EgMnlM=', 'smithi103.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHC5JilHHP1xcqOPDFLRQETYuFAlpEWmBmSeVD1yvz/xk66Zegel9L9JuyOngn02Xa2iak8K3yFMbjcDp7OW4KA='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'workunit': {'clients': {'client.0': ['rados/test.sh']}, 'env': {'ALLOW_TIMEOUTS': '1'}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'd9fdb2209e15b39d9f061fd85399f352ce0f0894', 'timestamp': '2024-02-09_00:15:46', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-02-09T08:01:13.660 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-02-09T08:01:13.687 DEBUG:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-02-09T08:01:13.703 DEBUG:teuthology.orchestra.run.smithi062:> sudo install -d -m0777 -- /var/run/ceph 2024-02-09T08:01:13.742 DEBUG:teuthology.orchestra.run.smithi103:> sudo install -d -m0777 -- /var/run/ceph 2024-02-09T08:01:13.771 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-02-09T08:01:13.771 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/scratch_devs of=/dev/stdout 2024-02-09T08:01:13.822 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-09T08:01:13.822 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_1 2024-02-09T08:01:13.876 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-09T08:01:13.877 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-09T08:01:13.877 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-02-09T08:01:13.877 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-09T08:01:13.877 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-02-09T08:01:13.877 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-02-09 07:52:30.407470757 +0000 2024-02-09T08:01:13.877 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-02-09 07:48:38.463874214 +0000 2024-02-09T08:01:13.878 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-02-09 07:48:38.463874214 +0000 2024-02-09T08:01:13.878 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2024-02-09 07:48:38.463874214 +0000 2024-02-09T08:01:13.878 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-09T08:01:13.942 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-02-09T08:01:13.942 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-02-09T08:01:13.943 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000251904 s, 2.0 MB/s 2024-02-09T08:01:13.944 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-09T08:01:13.999 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_2 2024-02-09T08:01:14.053 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-09T08:01:14.054 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-09T08:01:14.054 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-02-09T08:01:14.054 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-09T08:01:14.054 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-02-09T08:01:14.054 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-02-09 07:52:30.408470741 +0000 2024-02-09T08:01:14.054 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-02-09 07:48:38.809868463 +0000 2024-02-09T08:01:14.054 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-02-09 07:48:38.809868463 +0000 2024-02-09T08:01:14.054 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2024-02-09 07:48:38.809868463 +0000 2024-02-09T08:01:14.054 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-09T08:01:14.118 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-02-09T08:01:14.119 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-02-09T08:01:14.119 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000186218 s, 2.7 MB/s 2024-02-09T08:01:14.120 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-09T08:01:14.176 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_3 2024-02-09T08:01:14.231 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-09T08:01:14.231 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-09T08:01:14.231 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-02-09T08:01:14.231 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-09T08:01:14.232 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-02-09T08:01:14.232 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-02-09 07:52:30.408470741 +0000 2024-02-09T08:01:14.232 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-02-09 07:48:39.146862861 +0000 2024-02-09T08:01:14.232 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-02-09 07:48:39.146862861 +0000 2024-02-09T08:01:14.232 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2024-02-09 07:48:39.146862861 +0000 2024-02-09T08:01:14.232 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-09T08:01:14.296 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-02-09T08:01:14.296 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-02-09T08:01:14.296 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000171617 s, 3.0 MB/s 2024-02-09T08:01:14.298 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-09T08:01:14.353 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_4 2024-02-09T08:01:14.408 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-09T08:01:14.408 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-09T08:01:14.408 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-02-09T08:01:14.410 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-09T08:01:14.410 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-02-09T08:01:14.411 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-02-09 07:52:30.409470724 +0000 2024-02-09T08:01:14.411 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-02-09 07:48:39.491857127 +0000 2024-02-09T08:01:14.411 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-02-09 07:48:39.491857127 +0000 2024-02-09T08:01:14.411 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2024-02-09 07:48:39.491857127 +0000 2024-02-09T08:01:14.412 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-09T08:01:14.473 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-02-09T08:01:14.474 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-02-09T08:01:14.474 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000175648 s, 2.9 MB/s 2024-02-09T08:01:14.476 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-09T08:01:14.534 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-09T08:01:14.642 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-02-09T08:01:14.642 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/scratch_devs of=/dev/stdout 2024-02-09T08:01:14.662 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-09T08:01:14.662 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_1 2024-02-09T08:01:14.720 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-09T08:01:14.720 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-09T08:01:14.720 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-02-09T08:01:14.721 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-09T08:01:14.721 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-02-09T08:01:14.721 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-02-09 07:53:16.150121594 +0000 2024-02-09T08:01:14.721 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-02-09 07:48:35.960907599 +0000 2024-02-09T08:01:14.721 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-02-09 07:48:35.960907599 +0000 2024-02-09T08:01:14.721 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-02-09 07:48:35.960907599 +0000 2024-02-09T08:01:14.721 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-09T08:01:14.793 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-02-09T08:01:14.793 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-02-09T08:01:14.793 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000199331 s, 2.6 MB/s 2024-02-09T08:01:14.794 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-09T08:01:14.855 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_2 2024-02-09T08:01:16.875 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-09T08:01:16.875 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-09T08:01:16.875 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-02-09T08:01:16.875 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-09T08:01:16.875 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-02-09T08:01:16.876 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-02-09 07:53:16.151121574 +0000 2024-02-09T08:01:16.876 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-02-09 07:48:36.299900971 +0000 2024-02-09T08:01:16.876 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-02-09 07:48:36.299900971 +0000 2024-02-09T08:01:16.876 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-02-09 07:48:36.299900971 +0000 2024-02-09T08:01:16.877 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-09T08:01:16.945 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-02-09T08:01:16.945 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-02-09T08:01:16.946 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000199772 s, 2.6 MB/s 2024-02-09T08:01:16.947 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-09T08:01:17.008 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_3 2024-02-09T08:01:17.067 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-09T08:01:17.067 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-09T08:01:17.067 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-02-09T08:01:17.067 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-09T08:01:17.067 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-02-09T08:01:17.067 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-02-09 07:53:16.151121574 +0000 2024-02-09T08:01:17.067 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-02-09 07:48:36.653894049 +0000 2024-02-09T08:01:17.067 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-02-09 07:48:36.653894049 +0000 2024-02-09T08:01:17.067 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-02-09 07:48:36.653894049 +0000 2024-02-09T08:01:17.068 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-09T08:01:17.137 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-02-09T08:01:17.138 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-02-09T08:01:17.138 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.00021995 s, 2.3 MB/s 2024-02-09T08:01:17.139 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-09T08:01:17.200 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_4 2024-02-09T08:01:17.260 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-09T08:01:17.261 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-09T08:01:17.261 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-02-09T08:01:17.261 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-09T08:01:17.261 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-02-09T08:01:17.261 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-02-09 07:53:16.151121574 +0000 2024-02-09T08:01:17.261 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-02-09 07:48:37.162884096 +0000 2024-02-09T08:01:17.262 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-02-09 07:48:37.162884096 +0000 2024-02-09T08:01:17.262 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-02-09 07:48:37.162884096 +0000 2024-02-09T08:01:17.262 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-09T08:01:17.333 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-02-09T08:01:17.334 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-02-09T08:01:17.334 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000224733 s, 2.3 MB/s 2024-02-09T08:01:17.338 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-09T08:01:17.397 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-09T08:01:17.397 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi062.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi103.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-02-09T08:01:17.397 INFO:tasks.ceph:Generating config... 2024-02-09T08:01:17.401 INFO:tasks.ceph:[client] debug monc = 20 2024-02-09T08:01:17.401 INFO:tasks.ceph:[client] debug ms = 1 2024-02-09T08:01:17.401 INFO:tasks.ceph:[client] debug objecter = 20 2024-02-09T08:01:17.402 INFO:tasks.ceph:[client] debug rados = 20 2024-02-09T08:01:17.402 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-02-09T08:01:17.402 INFO:tasks.ceph:[global] mon election default strategy = 1 2024-02-09T08:01:17.402 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-02-09T08:01:17.403 INFO:tasks.ceph:[global] ms type = async 2024-02-09T08:01:17.403 INFO:tasks.ceph:[global] osd heartbeat grace = 80 2024-02-09T08:01:17.403 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-02-09T08:01:17.403 INFO:tasks.ceph:[mgr] debug ms = 1 2024-02-09T08:01:17.403 INFO:tasks.ceph:[mon] debug mon = 20 2024-02-09T08:01:17.403 INFO:tasks.ceph:[mon] debug ms = 1 2024-02-09T08:01:17.403 INFO:tasks.ceph:[mon] debug paxos = 20 2024-02-09T08:01:17.403 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2024-02-09T08:01:17.404 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-02-09T08:01:17.404 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2024-02-09T08:01:17.404 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2024-02-09T08:01:17.404 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2024-02-09T08:01:17.404 INFO:tasks.ceph:[mon] mon scrub interval = 300 2024-02-09T08:01:17.404 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-02-09T08:01:17.404 INFO:tasks.ceph:[mon] paxos service trim min = 10 2024-02-09T08:01:17.404 INFO:tasks.ceph:[osd] bdev async discard = True 2024-02-09T08:01:17.404 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-02-09T08:01:17.405 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-02-09T08:01:17.405 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-02-09T08:01:17.405 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-02-09T08:01:17.405 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2024-02-09T08:01:17.405 INFO:tasks.ceph:[osd] debug bluefs = 1 2024-02-09T08:01:17.405 INFO:tasks.ceph:[osd] debug bluestore = 1 2024-02-09T08:01:17.405 INFO:tasks.ceph:[osd] debug monc = 20 2024-02-09T08:01:17.405 INFO:tasks.ceph:[osd] debug ms = 1 2024-02-09T08:01:17.405 INFO:tasks.ceph:[osd] debug osd = 20 2024-02-09T08:01:17.406 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-02-09T08:01:17.406 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-02-09T08:01:17.406 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-02-09T08:01:17.406 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-02-09T08:01:17.406 INFO:tasks.ceph:[osd] osd class default list = * 2024-02-09T08:01:17.406 INFO:tasks.ceph:[osd] osd class load list = * 2024-02-09T08:01:17.406 INFO:tasks.ceph:[osd] osd client watch timeout = 120 2024-02-09T08:01:17.406 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2024-02-09T08:01:17.406 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2024-02-09T08:01:17.407 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-02-09T08:01:17.407 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-02-09T08:01:17.407 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2024-02-09T08:01:17.407 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2024-02-09T08:01:17.407 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-02-09T08:01:17.407 INFO:tasks.ceph:[osd] osd op queue = debug_random 2024-02-09T08:01:17.407 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2024-02-09T08:01:17.408 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-02-09T08:01:17.409 INFO:tasks.ceph:Setting up mon.a... 2024-02-09T08:01:17.409 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-02-09T08:01:17.466 INFO:teuthology.orchestra.run.smithi062.stdout:creating /etc/ceph/ceph.keyring 2024-02-09T08:01:17.469 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-02-09T08:01:17.516 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-09T08:01:17.544 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.62'), ('mon.c', '[v2:172.21.15.62:3301,v1:172.21.15.62:6790]'), ('mon.b', '172.21.15.103')] 2024-02-09T08:01:17.545 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.62,[v2:172.21.15.62:3301,v1:172.21.15.62:6790],172.21.15.103', 'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 80}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd client watch timeout': 120, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug monc': 20, 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-02-09T08:01:17.546 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-02-09T08:01:17.546 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-02-09T08:01:17.599 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.62 --addv c '[v2:172.21.15.62:3301,v1:172.21.15.62:6790]' --add b 172.21.15.103 --print /home/ubuntu/cephtest/ceph.monmap 2024-02-09T08:01:17.687 INFO:teuthology.orchestra.run.smithi062.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-02-09T08:01:17.687 INFO:teuthology.orchestra.run.smithi062.stdout:monmaptool: generated fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:01:17.687 INFO:teuthology.orchestra.run.smithi062.stdout:setting min_mon_release = quincy 2024-02-09T08:01:17.687 INFO:teuthology.orchestra.run.smithi062.stdout:epoch 0 2024-02-09T08:01:17.687 INFO:teuthology.orchestra.run.smithi062.stdout:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:01:17.687 INFO:teuthology.orchestra.run.smithi062.stdout:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:01:17.687 INFO:teuthology.orchestra.run.smithi062.stdout:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:01:17.687 INFO:teuthology.orchestra.run.smithi062.stdout:min_mon_release 17 (quincy) 2024-02-09T08:01:17.687 INFO:teuthology.orchestra.run.smithi062.stdout:election_strategy: 1 2024-02-09T08:01:17.687 INFO:teuthology.orchestra.run.smithi062.stdout:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:01:17.688 INFO:teuthology.orchestra.run.smithi062.stdout:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:01:17.688 INFO:teuthology.orchestra.run.smithi062.stdout:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:01:17.688 INFO:teuthology.orchestra.run.smithi062.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-02-09T08:01:17.689 DEBUG:teuthology.orchestra.run.smithi062:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-02-09T08:01:17.704 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 981c5564-eb76-49a1-80ab-97c7647bc34a... 2024-02-09T08:01:17.705 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-02-09T08:01:17.746 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-02-09T08:01:17.794 INFO:teuthology.orchestra.run.smithi062.stdout:[global] 2024-02-09T08:01:17.794 INFO:teuthology.orchestra.run.smithi062.stdout: chdir = "" 2024-02-09T08:01:17.794 INFO:teuthology.orchestra.run.smithi062.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-02-09T08:01:17.795 INFO:teuthology.orchestra.run.smithi062.stdout: auth supported = cephx 2024-02-09T08:01:17.795 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T08:01:17.795 INFO:teuthology.orchestra.run.smithi062.stdout: filestore xattr use omap = true 2024-02-09T08:01:17.795 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T08:01:17.795 INFO:teuthology.orchestra.run.smithi062.stdout: mon clock drift allowed = 1.000 2024-02-09T08:01:17.795 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T08:01:17.796 INFO:teuthology.orchestra.run.smithi062.stdout: osd crush chooseleaf type = 0 2024-02-09T08:01:17.796 INFO:teuthology.orchestra.run.smithi062.stdout: auth debug = true 2024-02-09T08:01:17.796 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T08:01:17.796 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on old message = true 2024-02-09T08:01:17.796 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on bug = true 2024-02-09T08:01:17.797 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T08:01:17.797 INFO:teuthology.orchestra.run.smithi062.stdout: mon max pg per osd = 10000 # >= luminous 2024-02-09T08:01:17.797 INFO:teuthology.orchestra.run.smithi062.stdout: mon pg warn max object skew = 0 2024-02-09T08:01:17.797 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T08:01:17.797 INFO:teuthology.orchestra.run.smithi062.stdout: # disable pg_autoscaler by default for new pools 2024-02-09T08:01:17.797 INFO:teuthology.orchestra.run.smithi062.stdout: osd_pool_default_pg_autoscale_mode = off 2024-02-09T08:01:17.798 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T08:01:17.798 INFO:teuthology.orchestra.run.smithi062.stdout: osd pool default size = 2 2024-02-09T08:01:17.798 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T08:01:17.798 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd allow primary affinity = true 2024-02-09T08:01:17.798 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd allow pg remap = true 2024-02-09T08:01:17.798 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on legacy crush tunables = false 2024-02-09T08:01:17.799 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on crush straw calc version zero = false 2024-02-09T08:01:17.799 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on no sortbitwise = false 2024-02-09T08:01:17.799 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on osd down out interval zero = false 2024-02-09T08:01:17.799 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on too few osds = false 2024-02-09T08:01:17.799 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-02-09T08:01:17.799 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_pool_no_redundancy = false 2024-02-09T08:01:17.800 INFO:teuthology.orchestra.run.smithi062.stdout: mon_allow_pool_size_one = true 2024-02-09T08:01:17.800 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T08:01:17.800 INFO:teuthology.orchestra.run.smithi062.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-02-09T08:01:17.800 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T08:01:17.800 INFO:teuthology.orchestra.run.smithi062.stdout: osd default data pool replay window = 5 2024-02-09T08:01:17.800 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T08:01:17.801 INFO:teuthology.orchestra.run.smithi062.stdout: mon allow pool delete = true 2024-02-09T08:01:17.801 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T08:01:17.801 INFO:teuthology.orchestra.run.smithi062.stdout: mon cluster log file level = debug 2024-02-09T08:01:17.801 INFO:teuthology.orchestra.run.smithi062.stdout: debug asserts on shutdown = true 2024-02-09T08:01:17.801 INFO:teuthology.orchestra.run.smithi062.stdout: mon health detail to clog = false 2024-02-09T08:01:17.801 INFO:teuthology.orchestra.run.smithi062.stdout: mon host = "172.21.15.62,[v2:172.21.15.62:3301,v1:172.21.15.62:6790],172.21.15.103" 2024-02-09T08:01:17.802 INFO:teuthology.orchestra.run.smithi062.stdout: mon client directed command retry = 5 2024-02-09T08:01:17.802 INFO:teuthology.orchestra.run.smithi062.stdout: mon election default strategy = 1 2024-02-09T08:01:17.802 INFO:teuthology.orchestra.run.smithi062.stdout: ms inject socket failures = 5000 2024-02-09T08:01:17.802 INFO:teuthology.orchestra.run.smithi062.stdout: ms type = async 2024-02-09T08:01:17.802 INFO:teuthology.orchestra.run.smithi062.stdout: osd heartbeat grace = 80 2024-02-09T08:01:17.803 INFO:teuthology.orchestra.run.smithi062.stdout: fsid = 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:01:17.803 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T08:01:17.803 INFO:teuthology.orchestra.run.smithi062.stdout:[osd] 2024-02-09T08:01:17.803 INFO:teuthology.orchestra.run.smithi062.stdout: osd journal size = 100 2024-02-09T08:01:17.803 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T08:01:17.804 INFO:teuthology.orchestra.run.smithi062.stdout: osd scrub load threshold = 5.0 2024-02-09T08:01:17.804 INFO:teuthology.orchestra.run.smithi062.stdout: osd scrub max interval = 600 2024-02-09T08:01:17.804 INFO:teuthology.orchestra.run.smithi062.stdout: osd mclock profile = high_recovery_ops 2024-02-09T08:01:17.804 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T08:01:17.804 INFO:teuthology.orchestra.run.smithi062.stdout: osd recover clone overlap = true 2024-02-09T08:01:17.804 INFO:teuthology.orchestra.run.smithi062.stdout: osd recovery max chunk = 1048576 2024-02-09T08:01:17.805 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T08:01:17.805 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug shutdown = true 2024-02-09T08:01:17.805 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug op order = true 2024-02-09T08:01:17.805 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug verify stray on activate = true 2024-02-09T08:01:17.805 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug trim objects = true 2024-02-09T08:01:17.805 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T08:01:17.806 INFO:teuthology.orchestra.run.smithi062.stdout: osd open classes on start = true 2024-02-09T08:01:17.806 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug pg log writeout = true 2024-02-09T08:01:17.806 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T08:01:17.806 INFO:teuthology.orchestra.run.smithi062.stdout: osd deep scrub update digest min age = 30 2024-02-09T08:01:17.806 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T08:01:17.807 INFO:teuthology.orchestra.run.smithi062.stdout: osd map max advance = 10 2024-02-09T08:01:17.807 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T08:01:17.807 INFO:teuthology.orchestra.run.smithi062.stdout: journal zero on create = true 2024-02-09T08:01:17.807 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T08:01:17.807 INFO:teuthology.orchestra.run.smithi062.stdout: filestore ondisk finisher threads = 3 2024-02-09T08:01:17.808 INFO:teuthology.orchestra.run.smithi062.stdout: filestore apply finisher threads = 3 2024-02-09T08:01:17.808 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T08:01:17.808 INFO:teuthology.orchestra.run.smithi062.stdout: bdev debug aio = true 2024-02-09T08:01:17.808 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug misdirected ops = true 2024-02-09T08:01:17.808 INFO:teuthology.orchestra.run.smithi062.stdout: bdev async discard = True 2024-02-09T08:01:17.808 INFO:teuthology.orchestra.run.smithi062.stdout: bdev enable discard = True 2024-02-09T08:01:17.809 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore allocator = bitmap 2024-02-09T08:01:17.809 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore block size = 96636764160 2024-02-09T08:01:17.809 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore fsck on mount = True 2024-02-09T08:01:17.809 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore zero block detection = True 2024-02-09T08:01:17.809 INFO:teuthology.orchestra.run.smithi062.stdout: debug bluefs = 1 2024-02-09T08:01:17.809 INFO:teuthology.orchestra.run.smithi062.stdout: debug bluestore = 1 2024-02-09T08:01:17.810 INFO:teuthology.orchestra.run.smithi062.stdout: debug monc = 20 2024-02-09T08:01:17.810 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2024-02-09T08:01:17.810 INFO:teuthology.orchestra.run.smithi062.stdout: debug osd = 20 2024-02-09T08:01:17.810 INFO:teuthology.orchestra.run.smithi062.stdout: debug rocksdb = 10 2024-02-09T08:01:17.810 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd backfillfull_ratio = 0.85 2024-02-09T08:01:17.810 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd full ratio = 0.9 2024-02-09T08:01:17.811 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd nearfull ratio = 0.8 2024-02-09T08:01:17.811 INFO:teuthology.orchestra.run.smithi062.stdout: osd class default list = * 2024-02-09T08:01:17.811 INFO:teuthology.orchestra.run.smithi062.stdout: osd class load list = * 2024-02-09T08:01:17.811 INFO:teuthology.orchestra.run.smithi062.stdout: osd client watch timeout = 120 2024-02-09T08:01:17.811 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug verify cached snaps = True 2024-02-09T08:01:17.811 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug verify missing on start = True 2024-02-09T08:01:17.812 INFO:teuthology.orchestra.run.smithi062.stdout: osd failsafe full ratio = 0.95 2024-02-09T08:01:17.812 INFO:teuthology.orchestra.run.smithi062.stdout: osd fast shutdown = False 2024-02-09T08:01:17.812 INFO:teuthology.orchestra.run.smithi062.stdout: osd mclock override recovery settings = True 2024-02-09T08:01:17.812 INFO:teuthology.orchestra.run.smithi062.stdout: osd objectstore = bluestore 2024-02-09T08:01:17.812 INFO:teuthology.orchestra.run.smithi062.stdout: osd op queue = debug_random 2024-02-09T08:01:17.812 INFO:teuthology.orchestra.run.smithi062.stdout: osd op queue cut off = debug_random 2024-02-09T08:01:17.813 INFO:teuthology.orchestra.run.smithi062.stdout: osd shutdown pgref assert = True 2024-02-09T08:01:17.813 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T08:01:17.813 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr] 2024-02-09T08:01:17.813 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2024-02-09T08:01:17.813 INFO:teuthology.orchestra.run.smithi062.stdout: debug mgr = 20 2024-02-09T08:01:17.813 INFO:teuthology.orchestra.run.smithi062.stdout: debug mon = 20 2024-02-09T08:01:17.814 INFO:teuthology.orchestra.run.smithi062.stdout: debug auth = 20 2024-02-09T08:01:17.814 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min pgs per osd = 4 2024-02-09T08:01:17.814 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min bytes per osd = 10 2024-02-09T08:01:17.814 INFO:teuthology.orchestra.run.smithi062.stdout: mgr/telemetry/nag = false 2024-02-09T08:01:17.814 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T08:01:17.815 INFO:teuthology.orchestra.run.smithi062.stdout:[mon] 2024-02-09T08:01:17.815 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2024-02-09T08:01:17.815 INFO:teuthology.orchestra.run.smithi062.stdout: debug mon = 20 2024-02-09T08:01:17.815 INFO:teuthology.orchestra.run.smithi062.stdout: debug paxos = 20 2024-02-09T08:01:17.815 INFO:teuthology.orchestra.run.smithi062.stdout: debug auth = 20 2024-02-09T08:01:17.815 INFO:teuthology.orchestra.run.smithi062.stdout: mon data avail warn = 5 2024-02-09T08:01:17.815 INFO:teuthology.orchestra.run.smithi062.stdout: mon mgr mkfs grace = 240 2024-02-09T08:01:17.816 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min pgs per osd = 4 2024-02-09T08:01:17.816 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd reporter subtree level = osd 2024-02-09T08:01:17.816 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd prime pg temp = true 2024-02-09T08:01:17.816 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min bytes per osd = 10 2024-02-09T08:01:17.816 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T08:01:17.817 INFO:teuthology.orchestra.run.smithi062.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-02-09T08:01:17.817 INFO:teuthology.orchestra.run.smithi062.stdout: auth mon ticket ttl = 660 # 11m 2024-02-09T08:01:17.817 INFO:teuthology.orchestra.run.smithi062.stdout: auth service ticket ttl = 240 # 4m 2024-02-09T08:01:17.817 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T08:01:17.817 INFO:teuthology.orchestra.run.smithi062.stdout: # don't complain about insecure global_id in the test suite 2024-02-09T08:01:17.817 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-02-09T08:01:17.818 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-02-09T08:01:17.818 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T08:01:17.818 INFO:teuthology.orchestra.run.smithi062.stdout: # 1m isn't quite enough 2024-02-09T08:01:17.818 INFO:teuthology.orchestra.run.smithi062.stdout: mon_down_mkfs_grace = 2m 2024-02-09T08:01:17.818 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T08:01:17.819 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_filestore_osds = false 2024-02-09T08:01:17.819 INFO:teuthology.orchestra.run.smithi062.stdout: mon min osdmap epochs = 50 2024-02-09T08:01:17.819 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd crush smoke test = False 2024-02-09T08:01:17.819 INFO:teuthology.orchestra.run.smithi062.stdout: mon osdmap full prune interval = 2 2024-02-09T08:01:17.819 INFO:teuthology.orchestra.run.smithi062.stdout: mon osdmap full prune min = 15 2024-02-09T08:01:17.819 INFO:teuthology.orchestra.run.smithi062.stdout: mon osdmap full prune txsize = 2 2024-02-09T08:01:17.820 INFO:teuthology.orchestra.run.smithi062.stdout: mon scrub interval = 300 2024-02-09T08:01:17.820 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on pool no app = False 2024-02-09T08:01:17.820 INFO:teuthology.orchestra.run.smithi062.stdout: paxos service trim min = 10 2024-02-09T08:01:17.820 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T08:01:17.820 INFO:teuthology.orchestra.run.smithi062.stdout:[client] 2024-02-09T08:01:17.820 INFO:teuthology.orchestra.run.smithi062.stdout: rgw cache enabled = true 2024-02-09T08:01:17.821 INFO:teuthology.orchestra.run.smithi062.stdout: rgw enable ops log = true 2024-02-09T08:01:17.821 INFO:teuthology.orchestra.run.smithi062.stdout: rgw enable usage log = true 2024-02-09T08:01:17.821 INFO:teuthology.orchestra.run.smithi062.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-02-09T08:01:17.821 INFO:teuthology.orchestra.run.smithi062.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-02-09T08:01:17.821 INFO:teuthology.orchestra.run.smithi062.stdout: debug monc = 20 2024-02-09T08:01:17.821 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2024-02-09T08:01:17.822 INFO:teuthology.orchestra.run.smithi062.stdout: debug objecter = 20 2024-02-09T08:01:17.822 INFO:teuthology.orchestra.run.smithi062.stdout: debug rados = 20 2024-02-09T08:01:17.822 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.a] 2024-02-09T08:01:17.822 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.c] 2024-02-09T08:01:17.822 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.b] 2024-02-09T08:01:17.825 INFO:teuthology.orchestra.run.smithi103.stdout:[global] 2024-02-09T08:01:17.825 INFO:teuthology.orchestra.run.smithi103.stdout: chdir = "" 2024-02-09T08:01:17.826 INFO:teuthology.orchestra.run.smithi103.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-02-09T08:01:17.826 INFO:teuthology.orchestra.run.smithi103.stdout: auth supported = cephx 2024-02-09T08:01:17.826 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:01:17.826 INFO:teuthology.orchestra.run.smithi103.stdout: filestore xattr use omap = true 2024-02-09T08:01:17.826 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:01:17.826 INFO:teuthology.orchestra.run.smithi103.stdout: mon clock drift allowed = 1.000 2024-02-09T08:01:17.827 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:01:17.827 INFO:teuthology.orchestra.run.smithi103.stdout: osd crush chooseleaf type = 0 2024-02-09T08:01:17.827 INFO:teuthology.orchestra.run.smithi103.stdout: auth debug = true 2024-02-09T08:01:17.827 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:01:17.827 INFO:teuthology.orchestra.run.smithi103.stdout: ms die on old message = true 2024-02-09T08:01:17.827 INFO:teuthology.orchestra.run.smithi103.stdout: ms die on bug = true 2024-02-09T08:01:17.828 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:01:17.828 INFO:teuthology.orchestra.run.smithi103.stdout: mon max pg per osd = 10000 # >= luminous 2024-02-09T08:01:17.828 INFO:teuthology.orchestra.run.smithi103.stdout: mon pg warn max object skew = 0 2024-02-09T08:01:17.828 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:01:17.828 INFO:teuthology.orchestra.run.smithi103.stdout: # disable pg_autoscaler by default for new pools 2024-02-09T08:01:17.829 INFO:teuthology.orchestra.run.smithi103.stdout: osd_pool_default_pg_autoscale_mode = off 2024-02-09T08:01:17.829 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:01:17.829 INFO:teuthology.orchestra.run.smithi103.stdout: osd pool default size = 2 2024-02-09T08:01:17.829 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:01:17.829 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd allow primary affinity = true 2024-02-09T08:01:17.829 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd allow pg remap = true 2024-02-09T08:01:17.830 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on legacy crush tunables = false 2024-02-09T08:01:17.830 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on crush straw calc version zero = false 2024-02-09T08:01:17.830 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on no sortbitwise = false 2024-02-09T08:01:17.830 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on osd down out interval zero = false 2024-02-09T08:01:17.830 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on too few osds = false 2024-02-09T08:01:17.830 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-02-09T08:01:17.831 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_pool_no_redundancy = false 2024-02-09T08:01:17.831 INFO:teuthology.orchestra.run.smithi103.stdout: mon_allow_pool_size_one = true 2024-02-09T08:01:17.831 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:01:17.831 INFO:teuthology.orchestra.run.smithi103.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-02-09T08:01:17.831 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:01:17.831 INFO:teuthology.orchestra.run.smithi103.stdout: osd default data pool replay window = 5 2024-02-09T08:01:17.832 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:01:17.832 INFO:teuthology.orchestra.run.smithi103.stdout: mon allow pool delete = true 2024-02-09T08:01:17.832 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:01:17.832 INFO:teuthology.orchestra.run.smithi103.stdout: mon cluster log file level = debug 2024-02-09T08:01:17.832 INFO:teuthology.orchestra.run.smithi103.stdout: debug asserts on shutdown = true 2024-02-09T08:01:17.832 INFO:teuthology.orchestra.run.smithi103.stdout: mon health detail to clog = false 2024-02-09T08:01:17.833 INFO:teuthology.orchestra.run.smithi103.stdout: mon host = "172.21.15.62,[v2:172.21.15.62:3301,v1:172.21.15.62:6790],172.21.15.103" 2024-02-09T08:01:17.833 INFO:teuthology.orchestra.run.smithi103.stdout: mon client directed command retry = 5 2024-02-09T08:01:17.833 INFO:teuthology.orchestra.run.smithi103.stdout: mon election default strategy = 1 2024-02-09T08:01:17.833 INFO:teuthology.orchestra.run.smithi103.stdout: ms inject socket failures = 5000 2024-02-09T08:01:17.833 INFO:teuthology.orchestra.run.smithi103.stdout: ms type = async 2024-02-09T08:01:17.833 INFO:teuthology.orchestra.run.smithi103.stdout: osd heartbeat grace = 80 2024-02-09T08:01:17.834 INFO:teuthology.orchestra.run.smithi103.stdout: fsid = 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:01:17.834 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:01:17.834 INFO:teuthology.orchestra.run.smithi103.stdout:[osd] 2024-02-09T08:01:17.834 INFO:teuthology.orchestra.run.smithi103.stdout: osd journal size = 100 2024-02-09T08:01:17.834 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:01:17.834 INFO:teuthology.orchestra.run.smithi103.stdout: osd scrub load threshold = 5.0 2024-02-09T08:01:17.835 INFO:teuthology.orchestra.run.smithi103.stdout: osd scrub max interval = 600 2024-02-09T08:01:17.835 INFO:teuthology.orchestra.run.smithi103.stdout: osd mclock profile = high_recovery_ops 2024-02-09T08:01:17.835 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:01:17.835 INFO:teuthology.orchestra.run.smithi103.stdout: osd recover clone overlap = true 2024-02-09T08:01:17.836 INFO:teuthology.orchestra.run.smithi103.stdout: osd recovery max chunk = 1048576 2024-02-09T08:01:17.836 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:01:17.836 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug shutdown = true 2024-02-09T08:01:17.836 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug op order = true 2024-02-09T08:01:17.836 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug verify stray on activate = true 2024-02-09T08:01:17.836 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug trim objects = true 2024-02-09T08:01:17.837 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:01:17.837 INFO:teuthology.orchestra.run.smithi103.stdout: osd open classes on start = true 2024-02-09T08:01:17.837 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug pg log writeout = true 2024-02-09T08:01:17.837 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:01:17.837 INFO:teuthology.orchestra.run.smithi103.stdout: osd deep scrub update digest min age = 30 2024-02-09T08:01:17.837 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:01:17.838 INFO:teuthology.orchestra.run.smithi103.stdout: osd map max advance = 10 2024-02-09T08:01:17.838 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:01:17.838 INFO:teuthology.orchestra.run.smithi103.stdout: journal zero on create = true 2024-02-09T08:01:17.838 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:01:17.838 INFO:teuthology.orchestra.run.smithi103.stdout: filestore ondisk finisher threads = 3 2024-02-09T08:01:17.838 INFO:teuthology.orchestra.run.smithi103.stdout: filestore apply finisher threads = 3 2024-02-09T08:01:17.839 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:01:17.839 INFO:teuthology.orchestra.run.smithi103.stdout: bdev debug aio = true 2024-02-09T08:01:17.839 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug misdirected ops = true 2024-02-09T08:01:17.839 INFO:teuthology.orchestra.run.smithi103.stdout: bdev async discard = True 2024-02-09T08:01:17.839 INFO:teuthology.orchestra.run.smithi103.stdout: bdev enable discard = True 2024-02-09T08:01:17.840 INFO:teuthology.orchestra.run.smithi103.stdout: bluestore allocator = bitmap 2024-02-09T08:01:17.840 INFO:teuthology.orchestra.run.smithi103.stdout: bluestore block size = 96636764160 2024-02-09T08:01:17.840 INFO:teuthology.orchestra.run.smithi103.stdout: bluestore fsck on mount = True 2024-02-09T08:01:17.840 INFO:teuthology.orchestra.run.smithi103.stdout: bluestore zero block detection = True 2024-02-09T08:01:17.841 INFO:teuthology.orchestra.run.smithi103.stdout: debug bluefs = 1 2024-02-09T08:01:17.841 INFO:teuthology.orchestra.run.smithi103.stdout: debug bluestore = 1 2024-02-09T08:01:17.841 INFO:teuthology.orchestra.run.smithi103.stdout: debug monc = 20 2024-02-09T08:01:17.841 INFO:teuthology.orchestra.run.smithi103.stdout: debug ms = 1 2024-02-09T08:01:17.841 INFO:teuthology.orchestra.run.smithi103.stdout: debug osd = 20 2024-02-09T08:01:17.841 INFO:teuthology.orchestra.run.smithi103.stdout: debug rocksdb = 10 2024-02-09T08:01:17.842 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd backfillfull_ratio = 0.85 2024-02-09T08:01:17.842 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd full ratio = 0.9 2024-02-09T08:01:17.842 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd nearfull ratio = 0.8 2024-02-09T08:01:17.842 INFO:teuthology.orchestra.run.smithi103.stdout: osd class default list = * 2024-02-09T08:01:17.842 INFO:teuthology.orchestra.run.smithi103.stdout: osd class load list = * 2024-02-09T08:01:17.842 INFO:teuthology.orchestra.run.smithi103.stdout: osd client watch timeout = 120 2024-02-09T08:01:17.843 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug verify cached snaps = True 2024-02-09T08:01:17.843 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug verify missing on start = True 2024-02-09T08:01:17.843 INFO:teuthology.orchestra.run.smithi103.stdout: osd failsafe full ratio = 0.95 2024-02-09T08:01:17.843 INFO:teuthology.orchestra.run.smithi103.stdout: osd fast shutdown = False 2024-02-09T08:01:17.843 INFO:teuthology.orchestra.run.smithi103.stdout: osd mclock override recovery settings = True 2024-02-09T08:01:17.843 INFO:teuthology.orchestra.run.smithi103.stdout: osd objectstore = bluestore 2024-02-09T08:01:17.844 INFO:teuthology.orchestra.run.smithi103.stdout: osd op queue = debug_random 2024-02-09T08:01:17.844 INFO:teuthology.orchestra.run.smithi103.stdout: osd op queue cut off = debug_random 2024-02-09T08:01:17.844 INFO:teuthology.orchestra.run.smithi103.stdout: osd shutdown pgref assert = True 2024-02-09T08:01:17.844 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:01:17.844 INFO:teuthology.orchestra.run.smithi103.stdout:[mgr] 2024-02-09T08:01:17.845 INFO:teuthology.orchestra.run.smithi103.stdout: debug ms = 1 2024-02-09T08:01:17.845 INFO:teuthology.orchestra.run.smithi103.stdout: debug mgr = 20 2024-02-09T08:01:17.845 INFO:teuthology.orchestra.run.smithi103.stdout: debug mon = 20 2024-02-09T08:01:17.845 INFO:teuthology.orchestra.run.smithi103.stdout: debug auth = 20 2024-02-09T08:01:17.845 INFO:teuthology.orchestra.run.smithi103.stdout: mon reweight min pgs per osd = 4 2024-02-09T08:01:17.845 INFO:teuthology.orchestra.run.smithi103.stdout: mon reweight min bytes per osd = 10 2024-02-09T08:01:17.845 INFO:teuthology.orchestra.run.smithi103.stdout: mgr/telemetry/nag = false 2024-02-09T08:01:17.846 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:01:17.846 INFO:teuthology.orchestra.run.smithi103.stdout:[mon] 2024-02-09T08:01:17.846 INFO:teuthology.orchestra.run.smithi103.stdout: debug ms = 1 2024-02-09T08:01:17.846 INFO:teuthology.orchestra.run.smithi103.stdout: debug mon = 20 2024-02-09T08:01:17.846 INFO:teuthology.orchestra.run.smithi103.stdout: debug paxos = 20 2024-02-09T08:01:17.847 INFO:teuthology.orchestra.run.smithi103.stdout: debug auth = 20 2024-02-09T08:01:17.847 INFO:teuthology.orchestra.run.smithi103.stdout: mon data avail warn = 5 2024-02-09T08:01:17.847 INFO:teuthology.orchestra.run.smithi103.stdout: mon mgr mkfs grace = 240 2024-02-09T08:01:17.847 INFO:teuthology.orchestra.run.smithi103.stdout: mon reweight min pgs per osd = 4 2024-02-09T08:01:17.847 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd reporter subtree level = osd 2024-02-09T08:01:17.847 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd prime pg temp = true 2024-02-09T08:01:17.848 INFO:teuthology.orchestra.run.smithi103.stdout: mon reweight min bytes per osd = 10 2024-02-09T08:01:17.848 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:01:17.848 INFO:teuthology.orchestra.run.smithi103.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-02-09T08:01:17.848 INFO:teuthology.orchestra.run.smithi103.stdout: auth mon ticket ttl = 660 # 11m 2024-02-09T08:01:17.848 INFO:teuthology.orchestra.run.smithi103.stdout: auth service ticket ttl = 240 # 4m 2024-02-09T08:01:17.848 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:01:17.849 INFO:teuthology.orchestra.run.smithi103.stdout: # don't complain about insecure global_id in the test suite 2024-02-09T08:01:17.849 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-02-09T08:01:17.849 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-02-09T08:01:17.849 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:01:17.849 INFO:teuthology.orchestra.run.smithi103.stdout: # 1m isn't quite enough 2024-02-09T08:01:17.849 INFO:teuthology.orchestra.run.smithi103.stdout: mon_down_mkfs_grace = 2m 2024-02-09T08:01:17.850 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:01:17.850 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_filestore_osds = false 2024-02-09T08:01:17.850 INFO:teuthology.orchestra.run.smithi103.stdout: mon min osdmap epochs = 50 2024-02-09T08:01:17.851 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd crush smoke test = False 2024-02-09T08:01:17.851 INFO:teuthology.orchestra.run.smithi103.stdout: mon osdmap full prune interval = 2 2024-02-09T08:01:17.851 INFO:teuthology.orchestra.run.smithi103.stdout: mon osdmap full prune min = 15 2024-02-09T08:01:17.851 INFO:teuthology.orchestra.run.smithi103.stdout: mon osdmap full prune txsize = 2 2024-02-09T08:01:17.851 INFO:teuthology.orchestra.run.smithi103.stdout: mon scrub interval = 300 2024-02-09T08:01:17.852 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on pool no app = False 2024-02-09T08:01:17.852 INFO:teuthology.orchestra.run.smithi103.stdout: paxos service trim min = 10 2024-02-09T08:01:17.852 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-09T08:01:17.852 INFO:teuthology.orchestra.run.smithi103.stdout:[client] 2024-02-09T08:01:17.852 INFO:teuthology.orchestra.run.smithi103.stdout: rgw cache enabled = true 2024-02-09T08:01:17.852 INFO:teuthology.orchestra.run.smithi103.stdout: rgw enable ops log = true 2024-02-09T08:01:17.853 INFO:teuthology.orchestra.run.smithi103.stdout: rgw enable usage log = true 2024-02-09T08:01:17.853 INFO:teuthology.orchestra.run.smithi103.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-02-09T08:01:17.853 INFO:teuthology.orchestra.run.smithi103.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-02-09T08:01:17.853 INFO:teuthology.orchestra.run.smithi103.stdout: debug monc = 20 2024-02-09T08:01:17.853 INFO:teuthology.orchestra.run.smithi103.stdout: debug ms = 1 2024-02-09T08:01:17.853 INFO:teuthology.orchestra.run.smithi103.stdout: debug objecter = 20 2024-02-09T08:01:17.854 INFO:teuthology.orchestra.run.smithi103.stdout: debug rados = 20 2024-02-09T08:01:17.854 INFO:teuthology.orchestra.run.smithi103.stdout:[mon.a] 2024-02-09T08:01:17.854 INFO:teuthology.orchestra.run.smithi103.stdout:[mon.c] 2024-02-09T08:01:17.854 INFO:teuthology.orchestra.run.smithi103.stdout:[mon.b] 2024-02-09T08:01:17.855 INFO:tasks.ceph:Creating admin key on mon.a... 2024-02-09T08:01:17.855 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-02-09T08:01:17.921 INFO:tasks.ceph:Copying monmap to all nodes... 2024-02-09T08:01:17.921 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-02-09T08:01:17.921 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-02-09T08:01:17.936 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-02-09T08:01:17.936 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-02-09T08:01:17.991 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi062.front.sepia.ceph.com 2024-02-09T08:01:17.991 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-02-09T08:01:17.991 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/ceph/ceph.keyring 2024-02-09T08:01:17.991 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-09T08:01:18.070 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-02-09T08:01:18.070 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-02-09T08:01:18.125 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi103.front.sepia.ceph.com 2024-02-09T08:01:18.125 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-02-09T08:01:18.125 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/ceph/ceph.keyring 2024-02-09T08:01:18.125 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-09T08:01:18.171 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-02-09T08:01:18.171 DEBUG:teuthology.orchestra.run.smithi103:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-02-09T08:01:18.227 INFO:tasks.ceph:Setting up mon nodes... 2024-02-09T08:01:18.227 INFO:tasks.ceph:Setting up mgr nodes... 2024-02-09T08:01:18.228 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-02-09T08:01:18.282 INFO:teuthology.orchestra.run.smithi062.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-02-09T08:01:18.284 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-02-09T08:01:18.348 INFO:teuthology.orchestra.run.smithi103.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-02-09T08:01:18.350 INFO:tasks.ceph:Setting up mds nodes... 2024-02-09T08:01:18.350 INFO:tasks.ceph_client:Setting up client nodes... 2024-02-09T08:01:18.351 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-02-09T08:01:18.393 INFO:teuthology.orchestra.run.smithi062.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-02-09T08:01:18.408 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-02-09T08:01:18.452 INFO:teuthology.orchestra.run.smithi103.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-02-09T08:01:18.468 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-02-09T08:01:18.468 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi062.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi103.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-02-09T08:01:18.469 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-02-09T08:01:18.496 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-09T08:01:18.496 INFO:tasks.ceph:role: osd.0 2024-02-09T08:01:18.496 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi062.front.sepia.ceph.com 2024-02-09T08:01:18.496 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-02-09T08:01:18.570 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-02-09T08:01:18.570 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-09T08:01:18.571 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-09T08:01:18.571 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-09T08:01:18.571 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-09T08:01:18.571 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2024-02-09T08:01:18.571 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-09T08:01:18.571 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-09T08:01:18.571 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-09T08:01:18.571 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-09T08:01:19.072 INFO:teuthology.orchestra.run.smithi062.stdout:Discarding blocks...Done. 2024-02-09T08:01:19.074 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2024-02-09T08:01:19.074 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-02-09T08:01:19.197 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-02-09T08:01:19.231 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-02-09T08:01:19.299 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-09T08:01:19.299 INFO:tasks.ceph:role: osd.1 2024-02-09T08:01:19.299 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi062.front.sepia.ceph.com 2024-02-09T08:01:19.299 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-02-09T08:01:19.373 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-02-09T08:01:19.374 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-09T08:01:19.374 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-09T08:01:19.374 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-09T08:01:19.374 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-09T08:01:19.375 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2024-02-09T08:01:19.375 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-09T08:01:19.375 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-09T08:01:19.375 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-09T08:01:19.375 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-09T08:01:19.834 INFO:teuthology.orchestra.run.smithi062.stdout:Discarding blocks...Done. 2024-02-09T08:01:19.835 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2024-02-09T08:01:19.836 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-02-09T08:01:19.932 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-02-09T08:01:19.964 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-02-09T08:01:20.033 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-09T08:01:20.033 INFO:tasks.ceph:role: osd.2 2024-02-09T08:01:20.033 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi062.front.sepia.ceph.com 2024-02-09T08:01:20.033 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-02-09T08:01:20.108 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-02-09T08:01:20.108 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-09T08:01:20.108 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-09T08:01:20.108 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-09T08:01:20.108 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-09T08:01:20.108 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2024-02-09T08:01:20.108 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-09T08:01:20.108 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-09T08:01:20.108 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-09T08:01:20.109 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-09T08:01:20.595 INFO:teuthology.orchestra.run.smithi062.stdout:Discarding blocks...Done. 2024-02-09T08:01:20.597 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2024-02-09T08:01:20.597 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-02-09T08:01:20.736 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-02-09T08:01:20.770 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-02-09T08:01:20.837 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-09T08:01:20.837 INFO:tasks.ceph:role: osd.3 2024-02-09T08:01:20.837 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi062.front.sepia.ceph.com 2024-02-09T08:01:20.837 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-02-09T08:01:20.910 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-02-09T08:01:20.911 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-09T08:01:20.911 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-09T08:01:20.911 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-09T08:01:20.911 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-09T08:01:20.911 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2024-02-09T08:01:20.911 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-09T08:01:20.911 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-09T08:01:20.911 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-09T08:01:20.911 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-09T08:01:21.445 INFO:teuthology.orchestra.run.smithi062.stdout:Discarding blocks...Done. 2024-02-09T08:01:21.448 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2024-02-09T08:01:21.448 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-02-09T08:01:21.573 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-02-09T08:01:21.608 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-09T08:01:21.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:21.702+0000 7f4b8e411640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-02-09T08:01:21.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:21.702+0000 7f4b8e411640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-02-09T08:01:21.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:21.703+0000 7f4b8e411640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-09T08:01:21.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:21.703+0000 7f4b8e411640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-09T08:01:21.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:21.703+0000 7f4b8e411640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-09T08:01:21.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:21.703+0000 7f4b8e411640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-02-09T08:01:24.557 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-09T08:01:24.588 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-09T08:01:24.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:24.678+0000 7fc197aae640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-02-09T08:01:24.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:24.679+0000 7fc197aae640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-02-09T08:01:24.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:24.679+0000 7fc197aae640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-09T08:01:24.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:24.679+0000 7fc197aae640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-09T08:01:24.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:24.679+0000 7fc197aae640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-09T08:01:24.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:24.679+0000 7fc197aae640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-02-09T08:01:27.522 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-09T08:01:27.555 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-09T08:01:27.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:27.643+0000 7f1b00c48640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-02-09T08:01:27.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:27.644+0000 7f1b00c48640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-02-09T08:01:27.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:27.644+0000 7f1b00c48640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-09T08:01:27.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:27.644+0000 7f1b00c48640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-09T08:01:27.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:27.644+0000 7f1b00c48640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-09T08:01:27.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:27.644+0000 7f1b00c48640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-02-09T08:01:30.491 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-09T08:01:30.523 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-09T08:01:30.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:30.611+0000 7f9510e13640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-02-09T08:01:30.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:30.612+0000 7f9510e13640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-02-09T08:01:30.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:30.612+0000 7f9510e13640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-09T08:01:30.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:30.612+0000 7f9510e13640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-09T08:01:30.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:30.612+0000 7f9510e13640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-09T08:01:30.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:30.612+0000 7f9510e13640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-02-09T08:01:33.463 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-09T08:01:33.495 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-02-09T08:01:33.527 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-09T08:01:33.527 INFO:tasks.ceph:role: osd.4 2024-02-09T08:01:33.527 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi103.front.sepia.ceph.com 2024-02-09T08:01:33.527 DEBUG:teuthology.orchestra.run.smithi103:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-02-09T08:01:33.606 INFO:teuthology.orchestra.run.smithi103.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-02-09T08:01:33.606 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-09T08:01:33.606 INFO:teuthology.orchestra.run.smithi103.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-09T08:01:33.606 INFO:teuthology.orchestra.run.smithi103.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-09T08:01:33.606 INFO:teuthology.orchestra.run.smithi103.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-09T08:01:33.607 INFO:teuthology.orchestra.run.smithi103.stdout: = sunit=0 swidth=0 blks 2024-02-09T08:01:33.607 INFO:teuthology.orchestra.run.smithi103.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-09T08:01:33.607 INFO:teuthology.orchestra.run.smithi103.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-09T08:01:33.607 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-09T08:01:33.607 INFO:teuthology.orchestra.run.smithi103.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-09T08:01:34.119 INFO:teuthology.orchestra.run.smithi103.stdout:Discarding blocks...Done. 2024-02-09T08:01:34.122 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi103.front.sepia.ceph.com -o noatime 2024-02-09T08:01:34.122 DEBUG:teuthology.orchestra.run.smithi103:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-02-09T08:01:34.272 DEBUG:teuthology.orchestra.run.smithi103:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-02-09T08:01:34.309 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-02-09T08:01:34.379 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-09T08:01:34.379 INFO:tasks.ceph:role: osd.5 2024-02-09T08:01:34.379 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi103.front.sepia.ceph.com 2024-02-09T08:01:34.380 DEBUG:teuthology.orchestra.run.smithi103:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-02-09T08:01:34.456 INFO:teuthology.orchestra.run.smithi103.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-02-09T08:01:34.456 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-09T08:01:34.456 INFO:teuthology.orchestra.run.smithi103.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-09T08:01:34.456 INFO:teuthology.orchestra.run.smithi103.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-09T08:01:34.456 INFO:teuthology.orchestra.run.smithi103.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-09T08:01:34.456 INFO:teuthology.orchestra.run.smithi103.stdout: = sunit=0 swidth=0 blks 2024-02-09T08:01:34.456 INFO:teuthology.orchestra.run.smithi103.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-09T08:01:34.456 INFO:teuthology.orchestra.run.smithi103.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-09T08:01:34.457 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-09T08:01:34.457 INFO:teuthology.orchestra.run.smithi103.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-09T08:01:34.900 INFO:teuthology.orchestra.run.smithi103.stdout:Discarding blocks...Done. 2024-02-09T08:01:34.902 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi103.front.sepia.ceph.com -o noatime 2024-02-09T08:01:34.902 DEBUG:teuthology.orchestra.run.smithi103:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-02-09T08:01:35.002 DEBUG:teuthology.orchestra.run.smithi103:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-02-09T08:01:35.038 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-02-09T08:01:35.106 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-09T08:01:35.106 INFO:tasks.ceph:role: osd.6 2024-02-09T08:01:35.107 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi103.front.sepia.ceph.com 2024-02-09T08:01:35.107 DEBUG:teuthology.orchestra.run.smithi103:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-02-09T08:01:35.183 INFO:teuthology.orchestra.run.smithi103.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-02-09T08:01:35.183 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-09T08:01:35.184 INFO:teuthology.orchestra.run.smithi103.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-09T08:01:35.184 INFO:teuthology.orchestra.run.smithi103.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-09T08:01:35.184 INFO:teuthology.orchestra.run.smithi103.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-09T08:01:35.184 INFO:teuthology.orchestra.run.smithi103.stdout: = sunit=0 swidth=0 blks 2024-02-09T08:01:35.184 INFO:teuthology.orchestra.run.smithi103.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-09T08:01:35.184 INFO:teuthology.orchestra.run.smithi103.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-09T08:01:35.184 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-09T08:01:35.184 INFO:teuthology.orchestra.run.smithi103.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-09T08:01:35.658 INFO:teuthology.orchestra.run.smithi103.stdout:Discarding blocks...Done. 2024-02-09T08:01:35.660 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi103.front.sepia.ceph.com -o noatime 2024-02-09T08:01:35.660 DEBUG:teuthology.orchestra.run.smithi103:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-02-09T08:01:35.778 DEBUG:teuthology.orchestra.run.smithi103:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-02-09T08:01:35.811 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-02-09T08:01:35.880 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-09T08:01:35.880 INFO:tasks.ceph:role: osd.7 2024-02-09T08:01:35.880 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi103.front.sepia.ceph.com 2024-02-09T08:01:35.880 DEBUG:teuthology.orchestra.run.smithi103:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-02-09T08:01:35.953 INFO:teuthology.orchestra.run.smithi103.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-02-09T08:01:35.953 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-09T08:01:35.954 INFO:teuthology.orchestra.run.smithi103.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-09T08:01:35.954 INFO:teuthology.orchestra.run.smithi103.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-09T08:01:35.954 INFO:teuthology.orchestra.run.smithi103.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-09T08:01:35.954 INFO:teuthology.orchestra.run.smithi103.stdout: = sunit=0 swidth=0 blks 2024-02-09T08:01:35.954 INFO:teuthology.orchestra.run.smithi103.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-09T08:01:35.954 INFO:teuthology.orchestra.run.smithi103.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-09T08:01:35.954 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-09T08:01:35.954 INFO:teuthology.orchestra.run.smithi103.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-09T08:01:36.441 INFO:teuthology.orchestra.run.smithi103.stdout:Discarding blocks...Done. 2024-02-09T08:01:36.443 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi103.front.sepia.ceph.com -o noatime 2024-02-09T08:01:36.443 DEBUG:teuthology.orchestra.run.smithi103:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-02-09T08:01:36.571 DEBUG:teuthology.orchestra.run.smithi103:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-02-09T08:01:36.607 DEBUG:teuthology.orchestra.run.smithi103:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-09T08:01:36.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:01:36.711+0000 7f4f5e268640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-02-09T08:01:36.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:01:36.712+0000 7f4f5e268640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-02-09T08:01:36.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:01:36.712+0000 7f4f5e268640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-02-09T08:01:36.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:01:36.712+0000 7f4f5e268640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-02-09T08:01:36.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:01:36.712+0000 7f4f5e268640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-02-09T08:01:36.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:01:36.712+0000 7f4f5e268640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-02-09T08:01:39.568 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-09T08:01:39.597 DEBUG:teuthology.orchestra.run.smithi103:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-09T08:01:39.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:01:39.685+0000 7f43d760f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-02-09T08:01:39.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:01:39.685+0000 7f43d760f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-02-09T08:01:39.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:01:39.685+0000 7f43d760f640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-02-09T08:01:39.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:01:39.685+0000 7f43d760f640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-02-09T08:01:39.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:01:39.685+0000 7f43d760f640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-02-09T08:01:39.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:01:39.686+0000 7f43d760f640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-02-09T08:01:42.522 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-09T08:01:42.552 DEBUG:teuthology.orchestra.run.smithi103:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-09T08:01:42.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:01:42.639+0000 7fca8f96b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-02-09T08:01:42.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:01:42.640+0000 7fca8f96b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-02-09T08:01:42.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:01:42.640+0000 7fca8f96b640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-02-09T08:01:42.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:01:42.640+0000 7fca8f96b640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-02-09T08:01:42.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:01:42.640+0000 7fca8f96b640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-02-09T08:01:42.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:01:42.640+0000 7fca8f96b640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-02-09T08:01:45.487 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-02-09T08:01:45.516 DEBUG:teuthology.orchestra.run.smithi103:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-09T08:01:45.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:01:45.602+0000 7facf3c8b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-02-09T08:01:45.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:01:45.602+0000 7facf3c8b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-02-09T08:01:45.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:01:45.602+0000 7facf3c8b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-02-09T08:01:45.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:01:45.602+0000 7facf3c8b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-02-09T08:01:45.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:01:45.602+0000 7facf3c8b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-02-09T08:01:45.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:01:45.603+0000 7facf3c8b640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-02-09T08:01:48.442 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-02-09T08:01:48.471 INFO:tasks.ceph:Reading keys from all nodes... 2024-02-09T08:01:48.471 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-02-09T08:01:48.471 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-02-09T08:01:48.502 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-02-09T08:01:48.502 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-02-09T08:01:48.573 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-02-09T08:01:48.573 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-02-09T08:01:48.642 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-02-09T08:01:48.642 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-02-09T08:01:48.711 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-02-09T08:01:48.711 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-02-09T08:01:48.779 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-02-09T08:01:48.779 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-02-09T08:01:48.808 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-02-09T08:01:48.808 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-02-09T08:01:48.876 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-02-09T08:01:48.877 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-02-09T08:01:48.944 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-02-09T08:01:48.945 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-02-09T08:01:49.012 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-02-09T08:01:49.012 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-02-09T08:01:49.079 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-02-09T08:01:49.080 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-02-09T08:01:49.096 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-02-09T08:01:49.097 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-02-09T08:01:49.134 INFO:tasks.ceph:Adding keys to all mons... 2024-02-09T08:01:49.134 DEBUG:teuthology.orchestra.run.smithi062:> sudo tee -a /etc/ceph/ceph.keyring 2024-02-09T08:01:49.139 DEBUG:teuthology.orchestra.run.smithi103:> sudo tee -a /etc/ceph/ceph.keyring 2024-02-09T08:01:49.177 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr.y] 2024-02-09T08:01:49.178 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQDO28VlPQ2+EBAA2fU24UgBzavGhz4VRQpxzg== 2024-02-09T08:01:49.178 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.0] 2024-02-09T08:01:49.178 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQDR28Vl4T7wKRAAEc7/FbeOTHDKMjYfSZBjMg== 2024-02-09T08:01:49.178 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.1] 2024-02-09T08:01:49.178 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQDU28VlhB6HKBAAeQZJIjJQyrnvOYJlU1I1ig== 2024-02-09T08:01:49.178 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.2] 2024-02-09T08:01:49.178 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQDX28Vl8DBwJhAABn9WIUAWLRzN4U9IMOOIRg== 2024-02-09T08:01:49.178 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.3] 2024-02-09T08:01:49.178 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQDa28VlhgqKJBAA0tUuHV9um23WuIYBxh4sIQ== 2024-02-09T08:01:49.178 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr.x] 2024-02-09T08:01:49.178 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQDO28Vl1LywFBAANAKP4OcxygAoRb31QhuB2g== 2024-02-09T08:01:49.178 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.4] 2024-02-09T08:01:49.179 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQDg28Vlw413KhAA+h/U9qt2VsgPSalhK9sCiQ== 2024-02-09T08:01:49.179 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.5] 2024-02-09T08:01:49.179 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQDj28Vl70HfKBAAbgRIi7YADVKMVo3U5X+kPg== 2024-02-09T08:01:49.179 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.6] 2024-02-09T08:01:49.179 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQDm28Vlh3gqJhAA11Wk+lMI+oZgn5I9tCQntA== 2024-02-09T08:01:49.179 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.7] 2024-02-09T08:01:49.179 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQDp28Vl4O77IxAAlfd9CrRZtMfeYvqsIRWK0Q== 2024-02-09T08:01:49.179 INFO:teuthology.orchestra.run.smithi062.stdout:[client.0] 2024-02-09T08:01:49.179 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQDO28Vlk1BeFxAATknRtRFbFH0e/JgwvdjKug== 2024-02-09T08:01:49.179 INFO:teuthology.orchestra.run.smithi062.stdout:[client.1] 2024-02-09T08:01:49.179 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQDO28VlLJfrGhAApQM3ekazGA7f+VNLuwQOIQ== 2024-02-09T08:01:49.199 INFO:teuthology.orchestra.run.smithi103.stdout:[mgr.y] 2024-02-09T08:01:49.200 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDO28VlPQ2+EBAA2fU24UgBzavGhz4VRQpxzg== 2024-02-09T08:01:49.200 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.0] 2024-02-09T08:01:49.200 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDR28Vl4T7wKRAAEc7/FbeOTHDKMjYfSZBjMg== 2024-02-09T08:01:49.200 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.1] 2024-02-09T08:01:49.200 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDU28VlhB6HKBAAeQZJIjJQyrnvOYJlU1I1ig== 2024-02-09T08:01:49.200 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.2] 2024-02-09T08:01:49.201 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDX28Vl8DBwJhAABn9WIUAWLRzN4U9IMOOIRg== 2024-02-09T08:01:49.201 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.3] 2024-02-09T08:01:49.201 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDa28VlhgqKJBAA0tUuHV9um23WuIYBxh4sIQ== 2024-02-09T08:01:49.201 INFO:teuthology.orchestra.run.smithi103.stdout:[mgr.x] 2024-02-09T08:01:49.201 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDO28Vl1LywFBAANAKP4OcxygAoRb31QhuB2g== 2024-02-09T08:01:49.201 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.4] 2024-02-09T08:01:49.201 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDg28Vlw413KhAA+h/U9qt2VsgPSalhK9sCiQ== 2024-02-09T08:01:49.201 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.5] 2024-02-09T08:01:49.201 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDj28Vl70HfKBAAbgRIi7YADVKMVo3U5X+kPg== 2024-02-09T08:01:49.201 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.6] 2024-02-09T08:01:49.201 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDm28Vlh3gqJhAA11Wk+lMI+oZgn5I9tCQntA== 2024-02-09T08:01:49.202 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.7] 2024-02-09T08:01:49.202 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDp28Vl4O77IxAAlfd9CrRZtMfeYvqsIRWK0Q== 2024-02-09T08:01:49.202 INFO:teuthology.orchestra.run.smithi103.stdout:[client.0] 2024-02-09T08:01:49.202 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDO28Vlk1BeFxAATknRtRFbFH0e/JgwvdjKug== 2024-02-09T08:01:49.202 INFO:teuthology.orchestra.run.smithi103.stdout:[client.1] 2024-02-09T08:01:49.202 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDO28VlLJfrGhAApQM3ekazGA7f+VNLuwQOIQ== 2024-02-09T08:01:49.203 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-09T08:01:49.224 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-09T08:01:49.297 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-09T08:01:49.300 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-09T08:01:49.351 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-09T08:01:49.353 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-09T08:01:49.404 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-09T08:01:49.407 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-09T08:01:49.458 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-09T08:01:49.460 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-09T08:01:49.511 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-09T08:01:49.513 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-09T08:01:49.565 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-09T08:01:49.568 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-09T08:01:49.620 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-09T08:01:49.625 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-09T08:01:49.681 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-09T08:01:49.683 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-09T08:01:49.736 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-09T08:01:49.738 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-09T08:01:49.789 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-09T08:01:49.791 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-09T08:01:49.846 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-09T08:01:49.848 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-09T08:01:49.904 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-02-09T08:01:49.905 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-02-09T08:01:49.932 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-02-09T08:01:50.028 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-02-09T08:01:50.055 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-02-09T08:01:50.123 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-02-09T08:01:50.219 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-02-09T08:01:50.246 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-02-09T08:01:50.273 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-02-09T08:01:50.369 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-02-09T08:01:50.396 DEBUG:teuthology.orchestra.run.smithi062:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-02-09T08:01:50.398 DEBUG:teuthology.orchestra.run.smithi103:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-02-09T08:01:50.450 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-02-09T08:01:50.451 DEBUG:tasks.ceph_manager:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-02-09T08:01:50.451 INFO:tasks.ceph.mon.a:Restarting daemon 2024-02-09T08:01:50.451 DEBUG:teuthology.orchestra.run.smithi062:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2024-02-09T08:01:50.453 INFO:tasks.ceph.mon.a:Started 2024-02-09T08:01:50.453 DEBUG:tasks.ceph_manager:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-02-09T08:01:50.453 INFO:tasks.ceph.mon.c:Restarting daemon 2024-02-09T08:01:50.454 DEBUG:teuthology.orchestra.run.smithi062:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2024-02-09T08:01:50.456 INFO:tasks.ceph.mon.c:Started 2024-02-09T08:01:50.456 DEBUG:tasks.ceph_manager:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-02-09T08:01:50.457 INFO:tasks.ceph.mon.b:Restarting daemon 2024-02-09T08:01:50.457 DEBUG:teuthology.orchestra.run.smithi103:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2024-02-09T08:01:50.493 INFO:tasks.ceph.mon.b:Started 2024-02-09T08:01:50.493 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-02-09T08:01:50.494 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-02-09T08:01:50.494 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2024-02-09T08:01:50.497 INFO:tasks.ceph.mgr.y:Started 2024-02-09T08:01:50.497 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-02-09T08:01:50.497 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2024-02-09T08:01:50.499 INFO:tasks.ceph.mgr.x:Started 2024-02-09T08:01:50.499 INFO:tasks.ceph:Setting crush tunables to default 2024-02-09T08:01:50.499 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd crush tunables default 2024-02-09T08:01:50.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:50.601+0000 7fd88252a640 10 monclient: get_monmap_and_config 2024-02-09T08:01:50.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:50.601+0000 7fd88252a640 10 monclient: build_initial_monmap 2024-02-09T08:01:50.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:50.601+0000 7fd88252a640 10 monclient: monmap: 2024-02-09T08:01:50.603 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:01:50.603 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:01:50.603 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:50.601255+0000 2024-02-09T08:01:50.603 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:50.601255+0000 2024-02-09T08:01:50.603 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:01:50.603 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:01:50.603 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:01:50.603 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:01:50.604 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:01:50.604 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:01:50.604 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:01:50.604 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:01:50.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:50.601+0000 7fd88252a640 1 Processor -- start 2024-02-09T08:01:50.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:50.602+0000 7fd88252a640 1 -- start start 2024-02-09T08:01:50.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:50.602+0000 7fd88252a640 10 monclient: init 2024-02-09T08:01:50.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:50.602+0000 7fd88252a640 10 monclient: _reopen_session rank -1 2024-02-09T08:01:50.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:50.602+0000 7fd88252a640 10 monclient: _add_conns ranks=[2,0,3,1,4] 2024-02-09T08:01:50.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:50.602+0000 7fd88252a640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd87c06be10 0x7fd87c0a9670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:01:50.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:50.602+0000 7fd88252a640 10 monclient(hunting): picked mon.noname-b con 0x7fd87c06be10 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:01:50.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:50.602+0000 7fd88252a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd87c0b44c0 addr v1:172.21.15.62:6789/0 2024-02-09T08:01:50.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:50.602+0000 7fd88252a640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd87c13ff40 0x7fd87c145a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:01:50.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:50.602+0000 7fd88252a640 10 monclient(hunting): picked mon.noname-a con 0x7fd87c13ff40 addr v2:172.21.15.62:3300/0 2024-02-09T08:01:50.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:50.602+0000 7fd88252a640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd87c0a9e90 con 0x7fd87c0b44c0 2024-02-09T08:01:50.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:50.603+0000 7fd88252a640 10 monclient(hunting): start opening mon connection 2024-02-09T08:01:50.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:50.603+0000 7fd88252a640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd87c06c1f0 con 0x7fd87c13ff40 2024-02-09T08:01:50.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:50.603+0000 7fd88252a640 10 monclient(hunting): start opening mon connection 2024-02-09T08:01:50.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:50.603+0000 7fd88252a640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c0a9bb0 con 0x7fd87c06be10 2024-02-09T08:01:50.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:50.603+0000 7fd88252a640 10 monclient(hunting): _renew_subs 2024-02-09T08:01:50.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:50.603+0000 7fd88252a640 10 monclient(hunting): authenticate will time out at 1353.962246s 2024-02-09T08:01:50.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:50.603+0000 7fd87b7fe640 1 -- >> v1:172.21.15.62:6789/0 conn(0x7fd87c0b44c0 legacy=0x7fd87c13f830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.62:6789/0 2024-02-09T08:01:50.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:50.603+0000 7fd880ac7640 1 -- >> v2:172.21.15.62:3300/0 conn(0x7fd87c13ff40 msgr2=0x7fd87c145a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.62:3300/0 2024-02-09T08:01:50.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:50.603+0000 7fd87bfff640 1 -- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd87c06be10 msgr2=0x7fd87c0a9670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.62:3301/0 2024-02-09T08:01:50.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:50.603+0000 7fd880ac7640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd87c13ff40 0x7fd87c145a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-09T08:01:50.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:50.603+0000 7fd87bfff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd87c06be10 0x7fd87c0a9670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-09T08:01:50.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:50.804+0000 7fd87b7fe640 1 -- >> v1:172.21.15.62:6789/0 conn(0x7fd87c0b44c0 legacy=0x7fd87c13f830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.62:6789/0 2024-02-09T08:01:50.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:50.804+0000 7fd87bfff640 1 -- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd87c06be10 msgr2=0x7fd87c0a9670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.62:3301/0 2024-02-09T08:01:50.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:50.804+0000 7fd880ac7640 1 -- >> v2:172.21.15.62:3300/0 conn(0x7fd87c13ff40 msgr2=0x7fd87c145a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.62:3300/0 2024-02-09T08:01:50.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:50.804+0000 7fd87bfff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd87c06be10 0x7fd87c0a9670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-09T08:01:50.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:50.804+0000 7fd880ac7640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd87c13ff40 0x7fd87c145a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-09T08:01:51.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:51.205+0000 7fd87bfff640 1 -- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd87c06be10 msgr2=0x7fd87c0a9670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.62:3301/0 2024-02-09T08:01:51.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:51.205+0000 7fd87b7fe640 1 -- >> v1:172.21.15.62:6789/0 conn(0x7fd87c0b44c0 legacy=0x7fd87c13f830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.62:6789/0 2024-02-09T08:01:51.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:51.205+0000 7fd880ac7640 1 -- >> v2:172.21.15.62:3300/0 conn(0x7fd87c13ff40 msgr2=0x7fd87c145a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.62:3300/0 2024-02-09T08:01:51.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:51.205+0000 7fd87bfff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd87c06be10 0x7fd87c0a9670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-09T08:01:51.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:51.205+0000 7fd880ac7640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd87c13ff40 0x7fd87c145a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-09T08:01:52.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:52.005+0000 7fd87bfff640 1 -- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd87c06be10 msgr2=0x7fd87c0a9670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.62:3301/0 2024-02-09T08:01:52.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:52.005+0000 7fd880ac7640 1 -- >> v2:172.21.15.62:3300/0 conn(0x7fd87c13ff40 msgr2=0x7fd87c145a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.62:3300/0 2024-02-09T08:01:52.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:52.005+0000 7fd87b7fe640 1 -- >> v1:172.21.15.62:6789/0 conn(0x7fd87c0b44c0 legacy=0x7fd87c13f830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.62:6789/0 2024-02-09T08:01:52.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:52.005+0000 7fd87bfff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd87c06be10 0x7fd87c0a9670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-09T08:01:52.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:52.005+0000 7fd880ac7640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd87c13ff40 0x7fd87c145a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-09T08:01:53.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:53.601+0000 7fd879ffb640 10 monclient(hunting): tick 2024-02-09T08:01:53.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:53.601+0000 7fd879ffb640 10 monclient(hunting): _check_auth_tickets 2024-02-09T08:01:53.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:53.602+0000 7fd879ffb640 1 monclient(hunting): continuing hunt 2024-02-09T08:01:53.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:53.602+0000 7fd879ffb640 10 monclient(hunting): _reopen_session rank -1 2024-02-09T08:01:53.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:53.602+0000 7fd879ffb640 1 -- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd87c06be10 msgr2=0x7fd87c0a9670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-09T08:01:53.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:53.602+0000 7fd879ffb640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd87c06be10 0x7fd87c0a9670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:01:53.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:53.602+0000 7fd879ffb640 1 -- >> v2:172.21.15.62:3300/0 conn(0x7fd87c13ff40 msgr2=0x7fd87c145a50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-09T08:01:53.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:53.602+0000 7fd879ffb640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd87c13ff40 0x7fd87c145a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:01:53.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:53.602+0000 7fd879ffb640 1 -- >> v1:172.21.15.62:6789/0 conn(0x7fd87c0b44c0 legacy=0x7fd87c13f830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-09T08:01:53.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:53.602+0000 7fd879ffb640 10 monclient: _add_conns ranks=[1,4] 2024-02-09T08:01:53.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:53.602+0000 7fd879ffb640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fd8680036c0 addr v1:172.21.15.103:6789/0 2024-02-09T08:01:53.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:53.602+0000 7fd879ffb640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd868007370 0x7fd868009830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:01:53.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:53.602+0000 7fd879ffb640 10 monclient(hunting): picked mon.noname-c con 0x7fd868007370 addr v2:172.21.15.103:3300/0 2024-02-09T08:01:53.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:53.602+0000 7fd879ffb640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd87c145f90 con 0x7fd8680036c0 2024-02-09T08:01:53.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:53.602+0000 7fd879ffb640 10 monclient(hunting): start opening mon connection 2024-02-09T08:01:53.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:53.602+0000 7fd879ffb640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd87c06c1f0 con 0x7fd868007370 2024-02-09T08:01:53.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:53.602+0000 7fd879ffb640 10 monclient(hunting): _renew_subs 2024-02-09T08:01:53.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:53.602+0000 7fd87bfff640 1 -- >> v1:172.21.15.103:6789/0 conn(0x7fd8680036c0 legacy=0x7fd868005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.103:6789/0 2024-02-09T08:01:53.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:53.602+0000 7fd87b7fe640 1 -- >> v2:172.21.15.103:3300/0 conn(0x7fd868007370 msgr2=0x7fd868009830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.103:3300/0 2024-02-09T08:01:53.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:53.602+0000 7fd87b7fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd868007370 0x7fd868009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-09T08:01:53.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:53.803+0000 7fd87b7fe640 1 -- >> v2:172.21.15.103:3300/0 conn(0x7fd868007370 msgr2=0x7fd868009830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.103:3300/0 2024-02-09T08:01:53.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:53.803+0000 7fd87bfff640 1 -- >> v1:172.21.15.103:6789/0 conn(0x7fd8680036c0 legacy=0x7fd868005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.103:6789/0 2024-02-09T08:01:53.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:53.803+0000 7fd87b7fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd868007370 0x7fd868009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-09T08:01:54.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:54.204+0000 7fd87bfff640 1 -- >> v1:172.21.15.103:6789/0 conn(0x7fd8680036c0 legacy=0x7fd868005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.103:6789/0 2024-02-09T08:01:54.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:54.204+0000 7fd87b7fe640 1 -- >> v2:172.21.15.103:3300/0 conn(0x7fd868007370 msgr2=0x7fd868009830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.103:3300/0 2024-02-09T08:01:54.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:54.204+0000 7fd87b7fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd868007370 0x7fd868009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-09T08:01:55.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:55.005+0000 7fd87b7fe640 1 -- >> v2:172.21.15.103:3300/0 conn(0x7fd868007370 msgr2=0x7fd868009830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.103:3300/0 2024-02-09T08:01:55.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:55.005+0000 7fd87bfff640 1 -- >> v1:172.21.15.103:6789/0 conn(0x7fd8680036c0 legacy=0x7fd868005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.103:6789/0 2024-02-09T08:01:55.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:55.005+0000 7fd87b7fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd868007370 0x7fd868009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-09T08:01:56.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:56.602+0000 7fd879ffb640 10 monclient(hunting): tick 2024-02-09T08:01:56.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:56.602+0000 7fd879ffb640 10 monclient(hunting): _check_auth_tickets 2024-02-09T08:01:56.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:56.602+0000 7fd879ffb640 1 monclient(hunting): continuing hunt 2024-02-09T08:01:56.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:56.602+0000 7fd879ffb640 10 monclient(hunting): _reopen_session rank -1 2024-02-09T08:01:56.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:56.602+0000 7fd879ffb640 1 -- >> v2:172.21.15.103:3300/0 conn(0x7fd868007370 msgr2=0x7fd868009830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-09T08:01:56.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:56.602+0000 7fd879ffb640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd868007370 0x7fd868009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:01:56.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:56.602+0000 7fd879ffb640 1 -- >> v1:172.21.15.103:6789/0 conn(0x7fd8680036c0 legacy=0x7fd868005b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-09T08:01:56.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:56.602+0000 7fd880ac7640 1 -- reap_dead start 2024-02-09T08:01:56.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:56.602+0000 7fd879ffb640 10 monclient: _add_conns ranks=[1,0,4,2,3] 2024-02-09T08:01:56.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:56.602+0000 7fd879ffb640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fd868009ee0 addr v1:172.21.15.103:6789/0 2024-02-09T08:01:56.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:56.602+0000 7fd879ffb640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd86800aa70 addr v1:172.21.15.62:6789/0 2024-02-09T08:01:56.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:56.602+0000 7fd879ffb640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd8680098d0 0x7fd86800e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:01:56.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:56.602+0000 7fd879ffb640 10 monclient(hunting): picked mon.noname-c con 0x7fd8680098d0 addr v2:172.21.15.103:3300/0 2024-02-09T08:01:56.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:56.602+0000 7fd879ffb640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd87c0a9e90 con 0x7fd86800aa70 2024-02-09T08:01:56.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:56.602+0000 7fd879ffb640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd87c145f90 con 0x7fd868009ee0 2024-02-09T08:01:56.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:56.602+0000 7fd879ffb640 10 monclient(hunting): start opening mon connection 2024-02-09T08:01:56.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:56.602+0000 7fd879ffb640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd87c06c1f0 con 0x7fd8680098d0 2024-02-09T08:01:56.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:56.602+0000 7fd879ffb640 10 monclient(hunting): _renew_subs 2024-02-09T08:01:56.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:56.602+0000 7fd87b7fe640 1 -- >> v1:172.21.15.62:6789/0 conn(0x7fd86800aa70 legacy=0x7fd868005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.62:6789/0 2024-02-09T08:01:56.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:56.602+0000 7fd880ac7640 1 -- >> v2:172.21.15.103:3300/0 conn(0x7fd8680098d0 msgr2=0x7fd86800e1a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.103:3300/0 2024-02-09T08:01:56.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:56.602+0000 7fd87bfff640 1 -- >> v1:172.21.15.103:6789/0 conn(0x7fd868009ee0 legacy=0x7fd86800a2c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.103:6789/0 2024-02-09T08:01:56.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:56.602+0000 7fd880ac7640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd8680098d0 0x7fd86800e1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-09T08:01:56.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:56.803+0000 7fd87b7fe640 1 -- >> v1:172.21.15.62:6789/0 conn(0x7fd86800aa70 legacy=0x7fd868005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.62:6789/0 2024-02-09T08:01:56.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:56.803+0000 7fd87bfff640 1 -- >> v1:172.21.15.103:6789/0 conn(0x7fd868009ee0 legacy=0x7fd86800a2c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.103:6789/0 2024-02-09T08:01:56.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:56.803+0000 7fd880ac7640 1 -- >> v2:172.21.15.103:3300/0 conn(0x7fd8680098d0 msgr2=0x7fd86800e1a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.103:3300/0 2024-02-09T08:01:56.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:56.803+0000 7fd880ac7640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd8680098d0 0x7fd86800e1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-09T08:01:57.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:57.204+0000 7fd87b7fe640 1 -- >> v1:172.21.15.62:6789/0 conn(0x7fd86800aa70 legacy=0x7fd868005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.62:6789/0 2024-02-09T08:01:57.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:57.204+0000 7fd880ac7640 1 -- >> v2:172.21.15.103:3300/0 conn(0x7fd8680098d0 msgr2=0x7fd86800e1a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.103:3300/0 2024-02-09T08:01:57.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:57.204+0000 7fd87bfff640 1 -- >> v1:172.21.15.103:6789/0 conn(0x7fd868009ee0 legacy=0x7fd86800a2c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.103:6789/0 2024-02-09T08:01:57.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:57.204+0000 7fd880ac7640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd8680098d0 0x7fd86800e1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-09T08:01:57.486 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:00:06.882 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:01:57.793 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:00:07.190 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:01:57.960 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:00:07.367 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:01:57.962 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:00:07.370 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:01:58.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:58.005+0000 7fd87b7fe640 1 -- >> v1:172.21.15.62:6789/0 conn(0x7fd86800aa70 legacy=0x7fd868005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.62:6789/0 2024-02-09T08:01:58.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:58.005+0000 7fd880ac7640 1 -- >> v2:172.21.15.103:3300/0 conn(0x7fd8680098d0 msgr2=0x7fd86800e1a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.103:3300/0 2024-02-09T08:01:58.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:58.005+0000 7fd87bfff640 1 -- >> v1:172.21.15.103:6789/0 conn(0x7fd868009ee0 legacy=0x7fd86800a2c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.103:6789/0 2024-02-09T08:01:58.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:58.005+0000 7fd880ac7640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd8680098d0 0x7fd86800e1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-09T08:01:58.288 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:00:07.695 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:01:58.291 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:00:07.698 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:01:59.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:59.602+0000 7fd879ffb640 10 monclient(hunting): tick 2024-02-09T08:01:59.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:59.602+0000 7fd879ffb640 10 monclient(hunting): _check_auth_tickets 2024-02-09T08:01:59.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:59.602+0000 7fd879ffb640 1 monclient(hunting): continuing hunt 2024-02-09T08:01:59.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:59.602+0000 7fd879ffb640 10 monclient(hunting): _reopen_session rank -1 2024-02-09T08:01:59.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:59.602+0000 7fd879ffb640 1 -- >> v2:172.21.15.103:3300/0 conn(0x7fd8680098d0 msgr2=0x7fd86800e1a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-09T08:01:59.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:59.602+0000 7fd879ffb640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd8680098d0 0x7fd86800e1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:01:59.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:59.602+0000 7fd879ffb640 1 -- >> v1:172.21.15.103:6789/0 conn(0x7fd868009ee0 legacy=0x7fd86800a2c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-09T08:01:59.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:59.602+0000 7fd879ffb640 1 -- >> v1:172.21.15.62:6789/0 conn(0x7fd86800aa70 legacy=0x7fd868005b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-09T08:01:59.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:59.602+0000 7fd879ffb640 10 monclient: _add_conns ranks=[2,3] 2024-02-09T08:01:59.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:59.602+0000 7fd879ffb640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd86800e8c0 0x7fd86800eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:01:59.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:59.602+0000 7fd879ffb640 10 monclient(hunting): picked mon.noname-b con 0x7fd86800e8c0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:01:59.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:59.602+0000 7fd879ffb640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd86800f310 0x7fd86800f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:01:59.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:59.602+0000 7fd879ffb640 10 monclient(hunting): picked mon.noname-a con 0x7fd86800f310 addr v2:172.21.15.62:3300/0 2024-02-09T08:01:59.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:59.602+0000 7fd879ffb640 10 monclient(hunting): start opening mon connection 2024-02-09T08:01:59.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:59.602+0000 7fd879ffb640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd87c06c1f0 con 0x7fd86800f310 2024-02-09T08:01:59.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:59.602+0000 7fd879ffb640 10 monclient(hunting): start opening mon connection 2024-02-09T08:01:59.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:59.602+0000 7fd879ffb640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c0a9bb0 con 0x7fd86800e8c0 2024-02-09T08:01:59.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:59.602+0000 7fd879ffb640 10 monclient(hunting): _renew_subs 2024-02-09T08:01:59.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:59.863+0000 7fd87bfff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd86800e8c0 0x7fd86800eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:01:59.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:59.950+0000 7fd87b7fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd86800f310 0x7fd86800f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:01:59.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:59.958+0000 7fd87bfff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd86800e8c0 0x7fd86800eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:48770/0 (socket says 172.21.15.62:48770) 2024-02-09T08:01:59.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:59.958+0000 7fd87bfff640 1 -- 172.21.15.62:0/520762151 learned_addr learned my addr 172.21.15.62:0/520762151 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:01:59.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:59.958+0000 7fd87bfff640 10 monclient(hunting): get_auth_request con 0x7fd86800e8c0 auth_method 0 2024-02-09T08:01:59.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:59.958+0000 7fd87bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:01:59.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:59.958+0000 7fd87bfff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:01:59.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:01:59.958+0000 7fd87bfff640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:00.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:00.020+0000 7fd87bfff640 1 -- 172.21.15.62:0/520762151 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd86800e8c0 msgr2=0x7fd86800eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-09T08:02:00.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:00.021+0000 7fd87bfff640 1 -- 172.21.15.62:0/520762151 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd86800e8c0 msgr2=0x7fd86800eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-09T08:02:00.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:00.021+0000 7fd87bfff640 1 --2- 172.21.15.62:0/520762151 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd86800e8c0 0x7fd86800eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-09T08:02:00.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:00.021+0000 7fd87bfff640 1 --2- 172.21.15.62:0/520762151 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd86800e8c0 0x7fd86800eca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-09T08:02:00.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:00.072+0000 7fd87b7fe640 10 monclient(hunting): get_auth_request con 0x7fd86800f310 auth_method 0 2024-02-09T08:02:00.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:00.072+0000 7fd87b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:00.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:00.072+0000 7fd87b7fe640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:00.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:00.072+0000 7fd87b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:00.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:00.222+0000 7fd87bfff640 1 --2- 172.21.15.62:0/520762151 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd86800e8c0 0x7fd86800eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:00.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:00.223+0000 7fd87bfff640 10 monclient(hunting): get_auth_request con 0x7fd86800e8c0 auth_method 0 2024-02-09T08:02:00.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:00.223+0000 7fd87bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:00.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:00.223+0000 7fd87bfff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:00.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:00.223+0000 7fd87bfff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-02-09T08:02:00.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:00.223+0000 7fd87bfff640 1 -- 172.21.15.62:0/520762151 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd86800e8c0 msgr2=0x7fd86800eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-09T08:02:00.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:00.223+0000 7fd87bfff640 1 -- 172.21.15.62:0/520762151 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd86800e8c0 msgr2=0x7fd86800eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-09T08:02:00.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:00.223+0000 7fd87bfff640 1 --2- 172.21.15.62:0/520762151 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd86800e8c0 0x7fd86800eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-09T08:02:00.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:00.223+0000 7fd87bfff640 1 --2- 172.21.15.62:0/520762151 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd86800e8c0 0x7fd86800eca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-09T08:02:00.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:00.471+0000 7fd87b7fe640 1 -- 172.21.15.62:0/520762151 >> v2:172.21.15.62:3300/0 conn(0x7fd86800f310 msgr2=0x7fd86800f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-02-09T08:02:00.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:00.471+0000 7fd87b7fe640 1 -- 172.21.15.62:0/520762151 >> v2:172.21.15.62:3300/0 conn(0x7fd86800f310 msgr2=0x7fd86800f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-09T08:02:00.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:00.471+0000 7fd87b7fe640 1 --2- 172.21.15.62:0/520762151 >> v2:172.21.15.62:3300/0 conn(0x7fd86800f310 0x7fd86800f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-09T08:02:00.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:00.471+0000 7fd87b7fe640 1 --2- 172.21.15.62:0/520762151 >> v2:172.21.15.62:3300/0 conn(0x7fd86800f310 0x7fd86800f930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-09T08:02:00.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:00.715+0000 7fd87b7fe640 1 --2- 172.21.15.62:0/520762151 >> v2:172.21.15.62:3300/0 conn(0x7fd86800f310 0x7fd86800f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:00.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:00.736+0000 7fd87bfff640 1 --2- 172.21.15.62:0/520762151 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd86800e8c0 0x7fd86800eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:00.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:00.736+0000 7fd87b7fe640 10 monclient(hunting): get_auth_request con 0x7fd86800f310 auth_method 0 2024-02-09T08:02:00.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:00.736+0000 7fd87b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:00.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:00.736+0000 7fd87b7fe640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:00.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:00.736+0000 7fd87b7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-02-09T08:02:00.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:00.738+0000 7fd87bfff640 10 monclient(hunting): get_auth_request con 0x7fd86800e8c0 auth_method 0 2024-02-09T08:02:00.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:00.738+0000 7fd87bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:00.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:00.738+0000 7fd87bfff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:00.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:00.738+0000 7fd87bfff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-02-09T08:02:00.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:00.738+0000 7fd87bfff640 1 -- 172.21.15.62:0/520762151 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd86800e8c0 msgr2=0x7fd86800eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-09T08:02:00.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:00.738+0000 7fd87bfff640 1 -- 172.21.15.62:0/520762151 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd86800e8c0 msgr2=0x7fd86800eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-09T08:02:00.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:00.738+0000 7fd87bfff640 1 --2- 172.21.15.62:0/520762151 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd86800e8c0 0x7fd86800eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-09T08:02:00.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:00.738+0000 7fd87bfff640 1 --2- 172.21.15.62:0/520762151 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd86800e8c0 0x7fd86800eca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-09T08:02:00.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:00.771+0000 7fd87b7fe640 1 -- 172.21.15.62:0/520762151 >> v2:172.21.15.62:3300/0 conn(0x7fd86800f310 msgr2=0x7fd86800f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-02-09T08:02:00.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:00.771+0000 7fd87b7fe640 1 -- 172.21.15.62:0/520762151 >> v2:172.21.15.62:3300/0 conn(0x7fd86800f310 msgr2=0x7fd86800f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-09T08:02:00.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:00.771+0000 7fd87b7fe640 1 --2- 172.21.15.62:0/520762151 >> v2:172.21.15.62:3300/0 conn(0x7fd86800f310 0x7fd86800f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-09T08:02:00.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:00.771+0000 7fd87b7fe640 1 --2- 172.21.15.62:0/520762151 >> v2:172.21.15.62:3300/0 conn(0x7fd86800f310 0x7fd86800f930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-09T08:02:01.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:01.172+0000 7fd87b7fe640 1 --2- 172.21.15.62:0/520762151 >> v2:172.21.15.62:3300/0 conn(0x7fd86800f310 0x7fd86800f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:01.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:01.172+0000 7fd87b7fe640 10 monclient(hunting): get_auth_request con 0x7fd86800f310 auth_method 0 2024-02-09T08:02:01.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:01.172+0000 7fd87b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:01.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:01.172+0000 7fd87b7fe640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:01.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:01.172+0000 7fd87b7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-02-09T08:02:01.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:01.173+0000 7fd87b7fe640 1 -- 172.21.15.62:0/520762151 >> v2:172.21.15.62:3300/0 conn(0x7fd86800f310 msgr2=0x7fd86800f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-09T08:02:01.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:01.173+0000 7fd87b7fe640 1 -- 172.21.15.62:0/520762151 >> v2:172.21.15.62:3300/0 conn(0x7fd86800f310 msgr2=0x7fd86800f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-09T08:02:01.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:01.173+0000 7fd87b7fe640 1 --2- 172.21.15.62:0/520762151 >> v2:172.21.15.62:3300/0 conn(0x7fd86800f310 0x7fd86800f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-09T08:02:01.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:01.173+0000 7fd87b7fe640 1 --2- 172.21.15.62:0/520762151 >> v2:172.21.15.62:3300/0 conn(0x7fd86800f310 0x7fd86800f930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-09T08:02:01.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:01.541+0000 7fd87bfff640 1 --2- 172.21.15.62:0/520762151 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd86800e8c0 0x7fd86800eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:01.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:01.541+0000 7fd87bfff640 10 monclient(hunting): get_auth_request con 0x7fd86800e8c0 auth_method 0 2024-02-09T08:02:01.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:01.541+0000 7fd87bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:01.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:01.541+0000 7fd87bfff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:01.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:01.541+0000 7fd87bfff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-02-09T08:02:01.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:01.542+0000 7fd87bfff640 1 -- 172.21.15.62:0/520762151 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd86800e8c0 msgr2=0x7fd86800eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-09T08:02:01.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:01.542+0000 7fd87bfff640 1 -- 172.21.15.62:0/520762151 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd86800e8c0 msgr2=0x7fd86800eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-09T08:02:01.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:01.542+0000 7fd87bfff640 1 --2- 172.21.15.62:0/520762151 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd86800e8c0 0x7fd86800eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-09T08:02:01.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:01.542+0000 7fd87bfff640 1 --2- 172.21.15.62:0/520762151 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd86800e8c0 0x7fd86800eca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-09T08:02:02.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.294+0000 7fd87b7fe640 1 --2- 172.21.15.62:0/520762151 >> v2:172.21.15.62:3300/0 conn(0x7fd86800f310 0x7fd86800f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:02.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.296+0000 7fd87b7fe640 10 monclient(hunting): get_auth_request con 0x7fd86800f310 auth_method 0 2024-02-09T08:02:02.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.296+0000 7fd87b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:02.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.296+0000 7fd87b7fe640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:02.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.296+0000 7fd87b7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-02-09T08:02:02.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.297+0000 7fd87b7fe640 1 -- 172.21.15.62:0/520762151 >> v2:172.21.15.62:3300/0 conn(0x7fd86800f310 msgr2=0x7fd86800f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-09T08:02:02.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.297+0000 7fd87b7fe640 1 -- 172.21.15.62:0/520762151 >> v2:172.21.15.62:3300/0 conn(0x7fd86800f310 msgr2=0x7fd86800f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-09T08:02:02.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.297+0000 7fd87b7fe640 1 --2- 172.21.15.62:0/520762151 >> v2:172.21.15.62:3300/0 conn(0x7fd86800f310 0x7fd86800f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-09T08:02:02.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.297+0000 7fd87b7fe640 1 --2- 172.21.15.62:0/520762151 >> v2:172.21.15.62:3300/0 conn(0x7fd86800f310 0x7fd86800f930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-09T08:02:02.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.602+0000 7fd879ffb640 10 monclient(hunting): tick 2024-02-09T08:02:02.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.602+0000 7fd879ffb640 10 monclient(hunting): _check_auth_tickets 2024-02-09T08:02:02.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.602+0000 7fd879ffb640 1 monclient(hunting): continuing hunt 2024-02-09T08:02:02.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.602+0000 7fd879ffb640 10 monclient(hunting): _reopen_session rank -1 2024-02-09T08:02:02.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.602+0000 7fd879ffb640 1 -- 172.21.15.62:0/520762151 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd86800e8c0 msgr2=0x7fd86800eca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-09T08:02:02.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.602+0000 7fd879ffb640 1 --2- 172.21.15.62:0/520762151 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd86800e8c0 0x7fd86800eca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:02.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.602+0000 7fd879ffb640 1 -- 172.21.15.62:0/520762151 >> v2:172.21.15.62:3300/0 conn(0x7fd86800f310 msgr2=0x7fd86800f930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-09T08:02:02.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.602+0000 7fd879ffb640 1 --2- 172.21.15.62:0/520762151 >> v2:172.21.15.62:3300/0 conn(0x7fd86800f310 0x7fd86800f930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:02.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.602+0000 7fd879ffb640 10 monclient: _add_conns ranks=[0,3,4,2,1] 2024-02-09T08:02:02.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.602+0000 7fd880ac7640 1 -- 172.21.15.62:0/520762151 reap_dead start 2024-02-09T08:02:02.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.602+0000 7fd879ffb640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd86800aa70 addr v1:172.21.15.62:6789/0 2024-02-09T08:02:02.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.602+0000 7fd879ffb640 1 --2- 172.21.15.62:0/520762151 >> v2:172.21.15.62:3300/0 conn(0x7fd8680098d0 0x7fd86800eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:02.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.602+0000 7fd879ffb640 10 monclient(hunting): picked mon.noname-a con 0x7fd8680098d0 addr v2:172.21.15.62:3300/0 2024-02-09T08:02:02.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.602+0000 7fd879ffb640 1 --2- 172.21.15.62:0/520762151 >> v2:172.21.15.103:3300/0 conn(0x7fd86800f930 0x7fd86800e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:02.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.602+0000 7fd879ffb640 10 monclient(hunting): picked mon.noname-c con 0x7fd86800f930 addr v2:172.21.15.103:3300/0 2024-02-09T08:02:02.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.602+0000 7fd879ffb640 1 -- 172.21.15.62:0/520762151 --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8680109a0 con 0x7fd86800aa70 2024-02-09T08:02:02.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.602+0000 7fd879ffb640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:02.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.602+0000 7fd879ffb640 1 -- 172.21.15.62:0/520762151 --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd87c06c1f0 con 0x7fd8680098d0 2024-02-09T08:02:02.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.602+0000 7fd879ffb640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:02.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.602+0000 7fd879ffb640 1 -- 172.21.15.62:0/520762151 --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd87c0a9bb0 con 0x7fd86800f930 2024-02-09T08:02:02.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.602+0000 7fd879ffb640 10 monclient(hunting): _renew_subs 2024-02-09T08:02:02.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.603+0000 7fd87b7fe640 1 --2- 172.21.15.62:0/520762151 >> v2:172.21.15.62:3300/0 conn(0x7fd8680098d0 0x7fd86800eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:02.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.603+0000 7fd87b7fe640 10 monclient(hunting): get_auth_request con 0x7fd8680098d0 auth_method 0 2024-02-09T08:02:02.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.603+0000 7fd87b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:02.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.603+0000 7fd87b7fe640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:02.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.603+0000 7fd87b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:02.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.603+0000 7fd880ac7640 1 --2- 172.21.15.62:0/520762151 >> v2:172.21.15.103:3300/0 conn(0x7fd86800f930 0x7fd86800e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:02.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.603+0000 7fd880ac7640 10 monclient(hunting): get_auth_request con 0x7fd86800f930 auth_method 0 2024-02-09T08:02:02.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.603+0000 7fd880ac7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:02.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.603+0000 7fd880ac7640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:02.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.603+0000 7fd880ac7640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:02.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.605+0000 7fd880ac7640 1 -- 172.21.15.62:0/520762151 >> v2:172.21.15.103:3300/0 conn(0x7fd86800f930 msgr2=0x7fd86800e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-02-09T08:02:02.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.605+0000 7fd880ac7640 1 -- 172.21.15.62:0/520762151 >> v2:172.21.15.103:3300/0 conn(0x7fd86800f930 msgr2=0x7fd86800e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-09T08:02:02.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.605+0000 7fd880ac7640 1 --2- 172.21.15.62:0/520762151 >> v2:172.21.15.103:3300/0 conn(0x7fd86800f930 0x7fd86800e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-09T08:02:02.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.605+0000 7fd880ac7640 1 --2- 172.21.15.62:0/520762151 >> v2:172.21.15.103:3300/0 conn(0x7fd86800f930 0x7fd86800e180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-09T08:02:02.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.605+0000 7fd87b7fe640 1 -- 172.21.15.62:0/520762151 >> v2:172.21.15.62:3300/0 conn(0x7fd8680098d0 msgr2=0x7fd86800eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-02-09T08:02:02.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.605+0000 7fd87b7fe640 1 -- 172.21.15.62:0/520762151 >> v2:172.21.15.62:3300/0 conn(0x7fd8680098d0 msgr2=0x7fd86800eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-09T08:02:02.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.605+0000 7fd87b7fe640 1 --2- 172.21.15.62:0/520762151 >> v2:172.21.15.62:3300/0 conn(0x7fd8680098d0 0x7fd86800eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-09T08:02:02.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.605+0000 7fd87b7fe640 1 --2- 172.21.15.62:0/520762151 >> v2:172.21.15.62:3300/0 conn(0x7fd8680098d0 0x7fd86800eca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-09T08:02:02.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.806+0000 7fd87b7fe640 1 --2- 172.21.15.62:0/520762151 >> v2:172.21.15.62:3300/0 conn(0x7fd8680098d0 0x7fd86800eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:02.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.806+0000 7fd880ac7640 1 --2- 172.21.15.62:0/520762151 >> v2:172.21.15.103:3300/0 conn(0x7fd86800f930 0x7fd86800e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:02.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.806+0000 7fd87b7fe640 10 monclient(hunting): get_auth_request con 0x7fd8680098d0 auth_method 0 2024-02-09T08:02:02.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.806+0000 7fd87b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:02.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.806+0000 7fd87b7fe640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:02.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.806+0000 7fd87b7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-02-09T08:02:02.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.806+0000 7fd880ac7640 10 monclient(hunting): get_auth_request con 0x7fd86800f930 auth_method 0 2024-02-09T08:02:02.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.806+0000 7fd880ac7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:02.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.806+0000 7fd880ac7640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:02.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.806+0000 7fd880ac7640 10 monclient(hunting): _init_auth already have auth, reseting 2024-02-09T08:02:02.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.807+0000 7fd87b7fe640 1 -- 172.21.15.62:0/520762151 >> v2:172.21.15.62:3300/0 conn(0x7fd8680098d0 msgr2=0x7fd86800eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-02-09T08:02:02.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.807+0000 7fd87b7fe640 1 -- 172.21.15.62:0/520762151 >> v2:172.21.15.62:3300/0 conn(0x7fd8680098d0 msgr2=0x7fd86800eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-09T08:02:02.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.807+0000 7fd87b7fe640 1 --2- 172.21.15.62:0/520762151 >> v2:172.21.15.62:3300/0 conn(0x7fd8680098d0 0x7fd86800eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-09T08:02:02.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.807+0000 7fd87b7fe640 1 --2- 172.21.15.62:0/520762151 >> v2:172.21.15.62:3300/0 conn(0x7fd8680098d0 0x7fd86800eca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-09T08:02:02.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.807+0000 7fd880ac7640 1 -- 172.21.15.62:0/520762151 >> v2:172.21.15.103:3300/0 conn(0x7fd86800f930 msgr2=0x7fd86800e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-02-09T08:02:02.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.807+0000 7fd880ac7640 1 -- 172.21.15.62:0/520762151 >> v2:172.21.15.103:3300/0 conn(0x7fd86800f930 msgr2=0x7fd86800e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-09T08:02:02.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.807+0000 7fd880ac7640 1 --2- 172.21.15.62:0/520762151 >> v2:172.21.15.103:3300/0 conn(0x7fd86800f930 0x7fd86800e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-09T08:02:02.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:02.807+0000 7fd880ac7640 1 --2- 172.21.15.62:0/520762151 >> v2:172.21.15.103:3300/0 conn(0x7fd86800f930 0x7fd86800e180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-09T08:02:03.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:03.208+0000 7fd87b7fe640 1 --2- 172.21.15.62:0/520762151 >> v2:172.21.15.62:3300/0 conn(0x7fd8680098d0 0x7fd86800eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:03.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:03.209+0000 7fd87b7fe640 10 monclient(hunting): get_auth_request con 0x7fd8680098d0 auth_method 0 2024-02-09T08:02:03.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:03.209+0000 7fd87b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:03.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:03.209+0000 7fd87b7fe640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:03.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:03.209+0000 7fd87b7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-02-09T08:02:03.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:03.209+0000 7fd880ac7640 1 --2- 172.21.15.62:0/520762151 >> v2:172.21.15.103:3300/0 conn(0x7fd86800f930 0x7fd86800e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:03.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:03.209+0000 7fd880ac7640 10 monclient(hunting): get_auth_request con 0x7fd86800f930 auth_method 0 2024-02-09T08:02:03.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:03.209+0000 7fd880ac7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:03.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:03.209+0000 7fd880ac7640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:03.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:03.209+0000 7fd880ac7640 10 monclient(hunting): _init_auth already have auth, reseting 2024-02-09T08:02:03.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:03.210+0000 7fd880ac7640 1 -- 172.21.15.62:0/520762151 >> v2:172.21.15.103:3300/0 conn(0x7fd86800f930 msgr2=0x7fd86800e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-02-09T08:02:03.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:03.210+0000 7fd880ac7640 1 -- 172.21.15.62:0/520762151 >> v2:172.21.15.103:3300/0 conn(0x7fd86800f930 msgr2=0x7fd86800e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-09T08:02:03.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:03.210+0000 7fd880ac7640 1 --2- 172.21.15.62:0/520762151 >> v2:172.21.15.103:3300/0 conn(0x7fd86800f930 0x7fd86800e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-09T08:02:03.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:03.210+0000 7fd87b7fe640 1 -- 172.21.15.62:0/520762151 >> v2:172.21.15.62:3300/0 conn(0x7fd8680098d0 msgr2=0x7fd86800eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-02-09T08:02:03.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:03.210+0000 7fd87b7fe640 1 -- 172.21.15.62:0/520762151 >> v2:172.21.15.62:3300/0 conn(0x7fd8680098d0 msgr2=0x7fd86800eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-09T08:02:03.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:03.210+0000 7fd87b7fe640 1 --2- 172.21.15.62:0/520762151 >> v2:172.21.15.62:3300/0 conn(0x7fd8680098d0 0x7fd86800eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-09T08:02:03.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:03.210+0000 7fd880ac7640 1 --2- 172.21.15.62:0/520762151 >> v2:172.21.15.103:3300/0 conn(0x7fd86800f930 0x7fd86800e180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-09T08:02:03.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:03.210+0000 7fd87b7fe640 1 --2- 172.21.15.62:0/520762151 >> v2:172.21.15.62:3300/0 conn(0x7fd8680098d0 0x7fd86800eca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-09T08:02:04.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:04.011+0000 7fd87b7fe640 1 --2- 172.21.15.62:0/520762151 >> v2:172.21.15.62:3300/0 conn(0x7fd8680098d0 0x7fd86800eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:04.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:04.011+0000 7fd87b7fe640 10 monclient(hunting): get_auth_request con 0x7fd8680098d0 auth_method 0 2024-02-09T08:02:04.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:04.011+0000 7fd87b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:04.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:04.011+0000 7fd87b7fe640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:04.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:04.011+0000 7fd87b7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-02-09T08:02:04.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:04.012+0000 7fd880ac7640 1 --2- 172.21.15.62:0/520762151 >> v2:172.21.15.103:3300/0 conn(0x7fd86800f930 0x7fd86800e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:04.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:04.012+0000 7fd880ac7640 10 monclient(hunting): get_auth_request con 0x7fd86800f930 auth_method 0 2024-02-09T08:02:04.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:04.012+0000 7fd880ac7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:04.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:04.012+0000 7fd880ac7640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:04.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:04.012+0000 7fd880ac7640 10 monclient(hunting): _init_auth already have auth, reseting 2024-02-09T08:02:04.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:04.012+0000 7fd87b7fe640 1 -- 172.21.15.62:0/520762151 >> v2:172.21.15.62:3300/0 conn(0x7fd8680098d0 msgr2=0x7fd86800eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-02-09T08:02:04.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:04.012+0000 7fd87b7fe640 1 -- 172.21.15.62:0/520762151 >> v2:172.21.15.62:3300/0 conn(0x7fd8680098d0 msgr2=0x7fd86800eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-09T08:02:04.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:04.012+0000 7fd87b7fe640 1 --2- 172.21.15.62:0/520762151 >> v2:172.21.15.62:3300/0 conn(0x7fd8680098d0 0x7fd86800eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-09T08:02:04.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:04.012+0000 7fd87b7fe640 1 --2- 172.21.15.62:0/520762151 >> v2:172.21.15.62:3300/0 conn(0x7fd8680098d0 0x7fd86800eca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-09T08:02:04.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:04.013+0000 7fd880ac7640 1 -- 172.21.15.62:0/520762151 >> v2:172.21.15.103:3300/0 conn(0x7fd86800f930 msgr2=0x7fd86800e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-02-09T08:02:04.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:04.013+0000 7fd880ac7640 1 -- 172.21.15.62:0/520762151 >> v2:172.21.15.103:3300/0 conn(0x7fd86800f930 msgr2=0x7fd86800e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-09T08:02:04.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:04.013+0000 7fd880ac7640 1 --2- 172.21.15.62:0/520762151 >> v2:172.21.15.103:3300/0 conn(0x7fd86800f930 0x7fd86800e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-09T08:02:04.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:04.013+0000 7fd880ac7640 1 --2- 172.21.15.62:0/520762151 >> v2:172.21.15.103:3300/0 conn(0x7fd86800f930 0x7fd86800e180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-09T08:02:05.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:05.603+0000 7fd879ffb640 10 monclient(hunting): tick 2024-02-09T08:02:05.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:05.603+0000 7fd879ffb640 10 monclient(hunting): _check_auth_tickets 2024-02-09T08:02:05.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:05.603+0000 7fd879ffb640 1 monclient(hunting): continuing hunt 2024-02-09T08:02:05.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:05.603+0000 7fd879ffb640 10 monclient(hunting): _reopen_session rank -1 2024-02-09T08:02:05.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:05.603+0000 7fd879ffb640 1 -- 172.21.15.62:0/520762151 >> v2:172.21.15.103:3300/0 conn(0x7fd86800f930 msgr2=0x7fd86800e180 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-09T08:02:05.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:05.603+0000 7fd879ffb640 1 --2- 172.21.15.62:0/520762151 >> v2:172.21.15.103:3300/0 conn(0x7fd86800f930 0x7fd86800e180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:05.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:05.603+0000 7fd879ffb640 1 -- 172.21.15.62:0/520762151 >> v2:172.21.15.62:3300/0 conn(0x7fd8680098d0 msgr2=0x7fd86800eca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-09T08:02:05.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:05.603+0000 7fd879ffb640 1 --2- 172.21.15.62:0/520762151 >> v2:172.21.15.62:3300/0 conn(0x7fd8680098d0 0x7fd86800eca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:05.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:05.603+0000 7fd879ffb640 1 -- 172.21.15.62:0/520762151 >> v1:172.21.15.62:6789/0 conn(0x7fd86800aa70 legacy=0x7fd868005ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:05.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:05.603+0000 7fd879ffb640 10 monclient: _add_conns ranks=[2,1] 2024-02-09T08:02:05.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:05.603+0000 7fd879ffb640 1 --2- 172.21.15.62:0/520762151 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd868010020 0x7fd868010400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:05.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:05.603+0000 7fd879ffb640 10 monclient(hunting): picked mon.noname-b con 0x7fd868010020 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:02:05.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:05.603+0000 7fd879ffb640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fd86800a0b0 addr v1:172.21.15.103:6789/0 2024-02-09T08:02:05.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:05.603+0000 7fd879ffb640 1 -- 172.21.15.62:0/520762151 --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd87c0a9e90 con 0x7fd86800a0b0 2024-02-09T08:02:05.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:05.603+0000 7fd879ffb640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:05.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:05.603+0000 7fd879ffb640 1 -- 172.21.15.62:0/520762151 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c06c1f0 con 0x7fd868010020 2024-02-09T08:02:05.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:05.603+0000 7fd879ffb640 10 monclient(hunting): _renew_subs 2024-02-09T08:02:05.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:05.603+0000 7fd87bfff640 1 --2- 172.21.15.62:0/520762151 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd868010020 0x7fd868010400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:05.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:05.604+0000 7fd87bfff640 10 monclient(hunting): get_auth_request con 0x7fd868010020 auth_method 0 2024-02-09T08:02:05.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:05.604+0000 7fd87bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:05.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:05.604+0000 7fd87bfff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:05.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:05.604+0000 7fd87bfff640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:05.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:05.605+0000 7fd87bfff640 1 -- 172.21.15.62:0/520762151 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd868010020 msgr2=0x7fd868010400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-02-09T08:02:05.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:05.605+0000 7fd87bfff640 1 -- 172.21.15.62:0/520762151 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd868010020 msgr2=0x7fd868010400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-09T08:02:05.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:05.605+0000 7fd87bfff640 1 --2- 172.21.15.62:0/520762151 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd868010020 0x7fd868010400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-09T08:02:05.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:05.605+0000 7fd87bfff640 1 --2- 172.21.15.62:0/520762151 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd868010020 0x7fd868010400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-09T08:02:05.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:05.806+0000 7fd87bfff640 1 --2- 172.21.15.62:0/520762151 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd868010020 0x7fd868010400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:05.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:05.806+0000 7fd87bfff640 10 monclient(hunting): get_auth_request con 0x7fd868010020 auth_method 0 2024-02-09T08:02:05.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:05.806+0000 7fd87bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:05.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:05.806+0000 7fd87bfff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:05.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:05.806+0000 7fd87bfff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-02-09T08:02:05.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:05.807+0000 7fd87bfff640 1 -- 172.21.15.62:0/520762151 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd868010020 msgr2=0x7fd868010400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-02-09T08:02:05.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:05.807+0000 7fd87bfff640 1 -- 172.21.15.62:0/520762151 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd868010020 msgr2=0x7fd868010400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-09T08:02:05.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:05.807+0000 7fd87bfff640 1 --2- 172.21.15.62:0/520762151 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd868010020 0x7fd868010400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-09T08:02:05.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:05.807+0000 7fd87bfff640 1 --2- 172.21.15.62:0/520762151 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd868010020 0x7fd868010400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-09T08:02:06.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:06.208+0000 7fd87bfff640 1 --2- 172.21.15.62:0/520762151 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd868010020 0x7fd868010400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:06.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:06.209+0000 7fd87bfff640 10 monclient(hunting): get_auth_request con 0x7fd868010020 auth_method 0 2024-02-09T08:02:06.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:06.209+0000 7fd87bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:06.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:06.209+0000 7fd87bfff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:06.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:06.209+0000 7fd87bfff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-02-09T08:02:06.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:06.210+0000 7fd87bfff640 1 -- 172.21.15.62:0/520762151 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd868010020 msgr2=0x7fd868010400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-02-09T08:02:06.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:06.210+0000 7fd87bfff640 1 -- 172.21.15.62:0/520762151 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd868010020 msgr2=0x7fd868010400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-09T08:02:06.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:06.210+0000 7fd87bfff640 1 --2- 172.21.15.62:0/520762151 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd868010020 0x7fd868010400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-09T08:02:06.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:06.210+0000 7fd87bfff640 1 --2- 172.21.15.62:0/520762151 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd868010020 0x7fd868010400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-09T08:02:07.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:07.011+0000 7fd87bfff640 1 --2- 172.21.15.62:0/520762151 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd868010020 0x7fd868010400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:07.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:07.012+0000 7fd87bfff640 10 monclient(hunting): get_auth_request con 0x7fd868010020 auth_method 0 2024-02-09T08:02:07.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:07.012+0000 7fd87bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:07.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:07.012+0000 7fd87bfff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:07.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:07.012+0000 7fd87bfff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-02-09T08:02:07.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:07.013+0000 7fd87bfff640 1 -- 172.21.15.62:0/520762151 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd868010020 msgr2=0x7fd868010400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-02-09T08:02:07.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:07.013+0000 7fd87bfff640 1 -- 172.21.15.62:0/520762151 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd868010020 msgr2=0x7fd868010400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-09T08:02:07.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:07.013+0000 7fd87bfff640 1 --2- 172.21.15.62:0/520762151 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd868010020 0x7fd868010400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-09T08:02:07.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:07.013+0000 7fd87bfff640 1 --2- 172.21.15.62:0/520762151 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd868010020 0x7fd868010400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-09T08:02:08.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.603+0000 7fd879ffb640 10 monclient(hunting): tick 2024-02-09T08:02:08.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.603+0000 7fd879ffb640 10 monclient(hunting): _check_auth_tickets 2024-02-09T08:02:08.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.603+0000 7fd879ffb640 1 monclient(hunting): continuing hunt 2024-02-09T08:02:08.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.603+0000 7fd879ffb640 10 monclient(hunting): _reopen_session rank -1 2024-02-09T08:02:08.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.603+0000 7fd879ffb640 1 -- 172.21.15.62:0/520762151 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd868010020 msgr2=0x7fd868010400 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-09T08:02:08.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.603+0000 7fd879ffb640 1 --2- 172.21.15.62:0/520762151 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd868010020 0x7fd868010400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:08.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.603+0000 7fd879ffb640 1 -- 172.21.15.62:0/520762151 >> v1:172.21.15.103:6789/0 conn(0x7fd86800a0b0 legacy=0x7fd8680061f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:08.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.603+0000 7fd880ac7640 1 -- 172.21.15.62:0/520762151 reap_dead start 2024-02-09T08:02:08.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.603+0000 7fd879ffb640 10 monclient: _add_conns ranks=[0,3,1,4,2] 2024-02-09T08:02:08.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.603+0000 7fd879ffb640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd86800f930 addr v1:172.21.15.62:6789/0 2024-02-09T08:02:08.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.603+0000 7fd879ffb640 1 --2- 172.21.15.62:0/520762151 >> v2:172.21.15.62:3300/0 conn(0x7fd86800eca0 0x7fd86800a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:08.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.603+0000 7fd879ffb640 10 monclient(hunting): picked mon.noname-a con 0x7fd86800eca0 addr v2:172.21.15.62:3300/0 2024-02-09T08:02:08.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.603+0000 7fd879ffb640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fd868010020 addr v1:172.21.15.103:6789/0 2024-02-09T08:02:08.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.603+0000 7fd879ffb640 1 -- 172.21.15.62:0/520762151 --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd87c145f90 con 0x7fd86800f930 2024-02-09T08:02:08.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.603+0000 7fd879ffb640 1 -- 172.21.15.62:0/520762151 --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd86800acc0 con 0x7fd868010020 2024-02-09T08:02:08.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.603+0000 7fd879ffb640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:08.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.603+0000 7fd879ffb640 1 -- 172.21.15.62:0/520762151 --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd87c06c1f0 con 0x7fd86800eca0 2024-02-09T08:02:08.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.603+0000 7fd879ffb640 10 monclient(hunting): _renew_subs 2024-02-09T08:02:08.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.605+0000 7fd880ac7640 1 -- 172.21.15.62:0/520762151 >> v1:172.21.15.103:6789/0 conn(0x7fd868010020 legacy=0x7fd868005ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-02-09T08:02:08.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.605+0000 7fd880ac7640 1 -- 172.21.15.62:0/520762151 >> v1:172.21.15.103:6789/0 conn(0x7fd868010020 legacy=0x7fd868005ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-09T08:02:08.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.605+0000 7fd880ac7640 1 --1- 172.21.15.62:0/520762151 >> v1:172.21.15.103:6789/0 conn(0x7fd868010020 0x7fd868005ab0 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=0).handle_connect_reply_1 read connect reply failed 2024-02-09T08:02:08.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.645+0000 7fd87b7fe640 1 --2- 172.21.15.62:0/520762151 >> v2:172.21.15.62:3300/0 conn(0x7fd86800eca0 0x7fd86800a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:08.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.648+0000 7fd87b7fe640 10 monclient(hunting): get_auth_request con 0x7fd86800eca0 auth_method 0 2024-02-09T08:02:08.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.648+0000 7fd87b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:08.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.648+0000 7fd87b7fe640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:08.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.648+0000 7fd87b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:08.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.670+0000 7fd87b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:08.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.670+0000 7fd87b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:08.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.670+0000 7fd87b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:08.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.712+0000 7fd87b7fe640 10 monclient(hunting): handle_auth_done global_id 4101 payload 274 2024-02-09T08:02:08.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.712+0000 7fd87b7fe640 1 -- 172.21.15.62:0/520762151 >> v1:172.21.15.103:6789/0 conn(0x7fd868010020 legacy=0x7fd868005ab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-09T08:02:08.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.712+0000 7fd87b7fe640 1 -- 172.21.15.62:0/520762151 >> v1:172.21.15.62:6789/0 conn(0x7fd86800f930 legacy=0x7fd868006900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:02:08.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.712+0000 7fd87b7fe640 10 monclient: _finish_hunting 0 2024-02-09T08:02:08.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.712+0000 7fd87b7fe640 1 monclient: found mon.noname-a 2024-02-09T08:02:08.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.712+0000 7fd87b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:02:08.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.712+0000 7fd87b7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-02-09T08:02:08.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.712+0000 7fd87b7fe640 1 -- 172.21.15.62:0/520762151 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd86800f0d0 con 0x7fd86800eca0 2024-02-09T08:02:08.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.725+0000 7fd87b7fe640 1 --2- 172.21.15.62:0/520762151 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd86800eca0 0x7fd86800a780 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd86800a560 tx=0x7fd87002e430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2afde4e559864a3d server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:02:08.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.773+0000 7fd87affd640 1 -- 172.21.15.62:0/520762151 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd870034480 con 0x7fd86800eca0 2024-02-09T08:02:08.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.773+0000 7fd87affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:08.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.773+0000 7fd87affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-09T08:02:08.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.773+0000 7fd87affd640 10 monclient: dump: 2024-02-09T08:02:08.778 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:02:08.778 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:08.778 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:08.778 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:08.778 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:08.778 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:02:08.778 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:08.778 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:08.778 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:08.778 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:02:08.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.773+0000 7fd87affd640 10 monclient: _finish_auth 0 2024-02-09T08:02:08.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.773+0000 7fd87affd640 10 monclient: _check_auth_tickets 2024-02-09T08:02:08.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.773+0000 7fd87affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:02:08.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.773+0000 7fd87affd640 1 -- 172.21.15.62:0/520762151 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd870031030 con 0x7fd86800eca0 2024-02-09T08:02:08.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.773+0000 7fd87affd640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:02:08.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.773+0000 7fd87affd640 1 -- 172.21.15.62:0/520762151 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd870034600 con 0x7fd86800eca0 2024-02-09T08:02:08.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.773+0000 7fd88252a640 5 monclient: authenticate success, global_id 4101 2024-02-09T08:02:08.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.773+0000 7fd88252a640 10 monclient: get_monmap_and_config success 2024-02-09T08:02:08.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.773+0000 7fd88252a640 4 set_mon_vals no callback set 2024-02-09T08:02:08.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.773+0000 7fd87affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:08.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.773+0000 7fd87affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-09T08:02:08.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.773+0000 7fd87affd640 10 monclient: dump: 2024-02-09T08:02:08.779 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:02:08.779 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:08.780 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:08.780 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:08.780 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:08.780 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:02:08.780 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:08.780 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:08.780 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:08.780 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:02:08.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.774+0000 7fd88252a640 10 monclient: shutdown 2024-02-09T08:02:08.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.774+0000 7fd88252a640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:02:08.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.774+0000 7fd88252a640 1 -- 172.21.15.62:0/520762151 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd86800eca0 msgr2=0x7fd86800a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:08.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.774+0000 7fd88252a640 1 --2- 172.21.15.62:0/520762151 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd86800eca0 0x7fd86800a780 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd86800a560 tx=0x7fd87002e430 comp rx=0 tx=0).stop 2024-02-09T08:02:08.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.774+0000 7fd88252a640 1 -- 172.21.15.62:0/520762151 shutdown_connections 2024-02-09T08:02:08.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.774+0000 7fd88252a640 1 --2- 172.21.15.62:0/520762151 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd86800eca0 0x7fd86800a780 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:08.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.774+0000 7fd88252a640 1 -- 172.21.15.62:0/520762151 >> 172.21.15.62:0/520762151 conn(0x7fd87c0b8070 msgr2=0x7fd87c0b8480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:02:08.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.774+0000 7fd88252a640 1 -- 172.21.15.62:0/520762151 shutdown_connections 2024-02-09T08:02:08.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.774+0000 7fd88252a640 1 -- 172.21.15.62:0/520762151 wait complete. 2024-02-09T08:02:08.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.775+0000 7fd88252a640 10 monclient: build_initial_monmap 2024-02-09T08:02:08.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.775+0000 7fd88252a640 10 monclient: monmap: 2024-02-09T08:02:08.781 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:02:08.781 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:02:08.781 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:02:08.781 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:02:08.781 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:02:08.781 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:02:08.781 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:02:08.781 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:02:08.782 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:02:08.782 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:02:08.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.775+0000 7fd88252a640 1 librados: starting msgr at 2024-02-09T08:02:08.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.775+0000 7fd88252a640 1 librados: starting objecter 2024-02-09T08:02:08.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.775+0000 7fd88252a640 1 Processor -- start 2024-02-09T08:02:08.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.775+0000 7fd88252a640 1 -- start start 2024-02-09T08:02:08.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.775+0000 7fd88252a640 1 librados: setting wanted keys 2024-02-09T08:02:08.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.775+0000 7fd88252a640 1 librados: calling monclient init 2024-02-09T08:02:08.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.775+0000 7fd88252a640 10 monclient: init 2024-02-09T08:02:08.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.776+0000 7fd88252a640 10 monclient: _reopen_session rank -1 2024-02-09T08:02:08.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.776+0000 7fd88252a640 10 monclient: _add_conns ranks=[0,2,1] 2024-02-09T08:02:08.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.776+0000 7fd88252a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd86800eca0 0x7fd87c137030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:08.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.776+0000 7fd88252a640 10 monclient(hunting): picked mon.noname-a con 0x7fd86800eca0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:02:08.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.776+0000 7fd88252a640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd86800f930 0x7fd87c1daaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:08.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.776+0000 7fd88252a640 10 monclient(hunting): picked mon.noname-c con 0x7fd86800f930 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:02:08.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.776+0000 7fd88252a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd868010020 0x7fd87c1db030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:08.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.776+0000 7fd88252a640 10 monclient(hunting): picked mon.noname-b con 0x7fd868010020 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:02:08.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.776+0000 7fd88252a640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:08.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.776+0000 7fd88252a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c1cbf60 con 0x7fd86800eca0 2024-02-09T08:02:08.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.776+0000 7fd88252a640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:08.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.776+0000 7fd88252a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c1cb0a0 con 0x7fd868010020 2024-02-09T08:02:08.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.776+0000 7fd88252a640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:08.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.776+0000 7fd88252a640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c1cc140 con 0x7fd86800f930 2024-02-09T08:02:08.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.776+0000 7fd88252a640 10 monclient(hunting): _renew_subs 2024-02-09T08:02:08.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.776+0000 7fd88252a640 10 monclient(hunting): authenticate will time out at 1372.137004s 2024-02-09T08:02:08.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.777+0000 7fd87b7fe640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd86800f930 0x7fd87c1daaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:08.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.777+0000 7fd880ac7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd868010020 0x7fd87c1db030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:08.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.777+0000 7fd880ac7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd868010020 0x7fd87c1db030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.62:39342/0 (socket says 172.21.15.62:39342) 2024-02-09T08:02:08.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.777+0000 7fd880ac7640 1 -- 172.21.15.62:0/2298804716 learned_addr learned my addr 172.21.15.62:0/2298804716 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:02:08.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.777+0000 7fd880ac7640 10 monclient(hunting): get_auth_request con 0x7fd868010020 auth_method 0 2024-02-09T08:02:08.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.777+0000 7fd880ac7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:08.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.777+0000 7fd880ac7640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:08.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.777+0000 7fd880ac7640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:08.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.777+0000 7fd87b7fe640 10 monclient(hunting): get_auth_request con 0x7fd86800f930 auth_method 0 2024-02-09T08:02:08.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.777+0000 7fd87b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:08.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.777+0000 7fd87b7fe640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:08.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.777+0000 7fd87b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:08.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.779+0000 7fd880ac7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:08.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.779+0000 7fd880ac7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:08.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.779+0000 7fd880ac7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:08.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.784+0000 7fd87b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:08.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.784+0000 7fd87b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:08.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.784+0000 7fd87b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:08.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.818+0000 7fd87bfff640 1 --2- 172.21.15.62:0/2298804716 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd86800eca0 0x7fd87c137030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:08.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.818+0000 7fd87bfff640 10 monclient(hunting): get_auth_request con 0x7fd86800eca0 auth_method 0 2024-02-09T08:02:08.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.818+0000 7fd87bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:08.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.818+0000 7fd87bfff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:08.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.818+0000 7fd87bfff640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:08.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.821+0000 7fd87bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:08.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.821+0000 7fd87bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:08.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.821+0000 7fd87bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:08.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.828+0000 7fd880ac7640 10 monclient(hunting): handle_auth_done global_id 4105 payload 824 2024-02-09T08:02:08.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.828+0000 7fd880ac7640 1 -- 172.21.15.62:0/2298804716 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd86800f930 msgr2=0x7fd87c1daaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:08.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.828+0000 7fd880ac7640 1 --2- 172.21.15.62:0/2298804716 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd86800f930 0x7fd87c1daaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:08.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.828+0000 7fd880ac7640 1 -- 172.21.15.62:0/2298804716 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd86800eca0 msgr2=0x7fd87c137030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:08.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.828+0000 7fd880ac7640 1 --2- 172.21.15.62:0/2298804716 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd86800eca0 0x7fd87c137030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:08.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.828+0000 7fd880ac7640 10 monclient: _finish_hunting 0 2024-02-09T08:02:08.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.828+0000 7fd880ac7640 1 monclient: found mon.noname-b 2024-02-09T08:02:08.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.828+0000 7fd880ac7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:02:08.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.828+0000 7fd880ac7640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.103:3300/0 2024-02-09T08:02:08.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.828+0000 7fd880ac7640 1 -- 172.21.15.62:0/2298804716 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd87c0a9e90 con 0x7fd868010020 2024-02-09T08:02:08.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.834+0000 7fd880ac7640 1 --2- 172.21.15.62:0/2298804716 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd868010020 0x7fd87c1db030 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd87c0ab4a0 tx=0x7fd87400b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:02:08.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.834+0000 7fd878ff9640 10 client.?.objecter ms_handle_connect 0x7fd868010020 2024-02-09T08:02:08.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.834+0000 7fd878ff9640 10 client.?.objecter resend_mon_ops 2024-02-09T08:02:08.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.900+0000 7fd878ff9640 1 -- 172.21.15.62:0/2298804716 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd874014070 con 0x7fd868010020 2024-02-09T08:02:08.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.900+0000 7fd878ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:08.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.900+0000 7fd878ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:02:08.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.900+0000 7fd878ff9640 10 monclient: dump: 2024-02-09T08:02:08.904 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:02:08.904 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:08.904 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:08.904 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:08.904 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:08.904 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:02:08.904 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:08.904 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:08.905 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:08.905 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:02:08.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.900+0000 7fd878ff9640 10 monclient: _finish_auth 0 2024-02-09T08:02:08.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.900+0000 7fd878ff9640 10 monclient: _check_auth_tickets 2024-02-09T08:02:08.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.900+0000 7fd878ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:02:08.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.900+0000 7fd878ff9640 1 -- 172.21.15.62:0/2298804716 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd87400f0d0 con 0x7fd868010020 2024-02-09T08:02:08.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.900+0000 7fd878ff9640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:02:08.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.900+0000 7fd878ff9640 1 -- 172.21.15.62:0/2298804716 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87400d450 con 0x7fd868010020 2024-02-09T08:02:08.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.900+0000 7fd878ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:08.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.900+0000 7fd878ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:02:08.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.900+0000 7fd878ff9640 10 monclient: dump: 2024-02-09T08:02:08.906 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:02:08.906 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:08.906 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:08.906 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:08.906 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:08.906 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:02:08.906 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:08.906 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:08.906 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:08.906 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:02:08.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.900+0000 7fd88252a640 5 monclient: authenticate success, global_id 4105 2024-02-09T08:02:08.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.900+0000 7fd88252a640 10 monclient: _renew_subs 2024-02-09T08:02:08.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.900+0000 7fd88252a640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:02:08.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.900+0000 7fd87a7fc640 4 set_mon_vals no callback set 2024-02-09T08:02:08.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.900+0000 7fd88252a640 1 -- 172.21.15.62:0/2298804716 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd87c1cc420 con 0x7fd868010020 2024-02-09T08:02:08.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.901+0000 7fd88252a640 10 client.4105.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:02:08.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.901+0000 7fd88252a640 10 monclient: _renew_subs 2024-02-09T08:02:08.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.901+0000 7fd88252a640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:02:08.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.901+0000 7fd88252a640 1 -- 172.21.15.62:0/2298804716 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd87c1db750 con 0x7fd868010020 2024-02-09T08:02:08.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.901+0000 7fd88252a640 1 librados: init done 2024-02-09T08:02:08.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.901+0000 7fd88252a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:02:08.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.901+0000 7fd88252a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:02:08.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.901+0000 7fd88252a640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:02:08.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:08.901+0000 7fd88252a640 1 -- 172.21.15.62:0/2298804716 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd87c1cb1e0 con 0x7fd868010020 2024-02-09T08:02:09.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:09.124+0000 7fd878ff9640 1 -- 172.21.15.62:0/2298804716 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fd87400d5b0 con 0x7fd868010020 2024-02-09T08:02:09.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:09.165+0000 7fd878ff9640 1 -- 172.21.15.62:0/2298804716 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fd874023d40 con 0x7fd868010020 2024-02-09T08:02:09.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:09.165+0000 7fd878ff9640 10 client.4105.objecter ms_dispatch 0x7fd87c000b90 osd_map(1..1 src has 1..1) v4 2024-02-09T08:02:09.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:09.165+0000 7fd878ff9640 3 client.4105.objecter handle_osd_map got epochs [1,1] > 0 2024-02-09T08:02:09.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:09.165+0000 7fd878ff9640 3 client.4105.objecter handle_osd_map decoding full epoch 1 2024-02-09T08:02:09.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:09.165+0000 7fd878ff9640 20 client.4105.objecter dump_active .. 0 homeless 2024-02-09T08:02:09.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:09.177+0000 7fd878ff9640 1 -- 172.21.15.62:0/2298804716 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fd87c1cb1e0 con 0x7fd868010020 2024-02-09T08:02:09.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:09.177+0000 7fd878ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:02:09.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:09.177+0000 7fd878ff9640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:02:09.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:09.295+0000 7fd88252a640 10 start_mon_command cmd=[{"prefix": "osd crush tunables", "profile": "default"}] 2024-02-09T08:02:09.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:09.295+0000 7fd88252a640 10 monclient: _send_command 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2024-02-09T08:02:09.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:09.295+0000 7fd88252a640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:02:09.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:09.295+0000 7fd88252a640 1 -- 172.21.15.62:0/2298804716 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fd87c1cb510 con 0x7fd868010020 2024-02-09T08:02:09.522 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-02-09T08:02:09.519+0000 7fa0f91f1040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-09T08:02:09.577 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-02-09T08:02:09.574+0000 7fa0f91f1040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-09T08:02:09.592 INFO:tasks.ceph.mgr.y.smithi062.stderr:2024-02-09T08:02:09.588+0000 7f96d1c3f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-09T08:02:09.650 INFO:tasks.ceph.mgr.y.smithi062.stderr:2024-02-09T08:02:09.647+0000 7f96d1c3f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-09T08:02:09.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:09.757+0000 7fd878ff9640 1 -- 172.21.15.62:0/2298804716 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fd87401e060 con 0x7fd868010020 2024-02-09T08:02:09.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:09.757+0000 7fd878ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2024-02-09T08:02:09.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:09.757+0000 7fd878ff9640 10 monclient: _finish_command 2 = system:0 adjusted tunables profile to default 2024-02-09T08:02:09.760 INFO:teuthology.orchestra.run.smithi062.stderr:adjusted tunables profile to default 2024-02-09T08:02:09.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:09.758+0000 7fd88252a640 10 librados: watch_flush enter 2024-02-09T08:02:09.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:09.758+0000 7fd88252a640 10 librados: watch_flush exit 2024-02-09T08:02:09.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:09.758+0000 7fd88252a640 20 client.4105.objecter shutdown clearing up homeless session... 2024-02-09T08:02:09.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:09.758+0000 7fd88252a640 10 client.4105.objecter successfully canceled tick 2024-02-09T08:02:09.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:09.758+0000 7fd88252a640 10 monclient: shutdown 2024-02-09T08:02:09.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:09.758+0000 7fd88252a640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:02:09.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:09.758+0000 7fd88252a640 1 -- 172.21.15.62:0/2298804716 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd868010020 msgr2=0x7fd87c1db030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:09.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:09.758+0000 7fd88252a640 1 --2- 172.21.15.62:0/2298804716 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd868010020 0x7fd87c1db030 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd87c0ab4a0 tx=0x7fd87400b7a0 comp rx=0 tx=0).stop 2024-02-09T08:02:09.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:09.758+0000 7fd88252a640 1 -- 172.21.15.62:0/2298804716 shutdown_connections 2024-02-09T08:02:09.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:09.758+0000 7fd88252a640 1 --2- 172.21.15.62:0/2298804716 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd868010020 0x7fd87c1db030 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:09.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:09.758+0000 7fd88252a640 1 --2- 172.21.15.62:0/2298804716 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd86800f930 0x7fd87c1daaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:09.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:09.758+0000 7fd88252a640 1 --2- 172.21.15.62:0/2298804716 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd86800eca0 0x7fd87c137030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:09.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:09.758+0000 7fd88252a640 1 -- 172.21.15.62:0/2298804716 >> 172.21.15.62:0/2298804716 conn(0x7fd87c0b8070 msgr2=0x7fd87c13cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:02:09.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:09.758+0000 7fd88252a640 1 -- 172.21.15.62:0/2298804716 shutdown_connections 2024-02-09T08:02:09.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:09.758+0000 7fd88252a640 1 -- 172.21.15.62:0/2298804716 wait complete. 2024-02-09T08:02:09.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:09.758+0000 7fd88252a640 1 librados: shutdown 2024-02-09T08:02:09.772 INFO:tasks.ceph:check_enable_crimson: False 2024-02-09T08:02:09.772 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-02-09T08:02:09.772 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-02-09T08:02:09.772 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-02-09T08:02:09.800 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-02-09T08:02:09.800 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-02-09T08:02:09.869 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-02-09T08:02:09.869 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-02-09T08:02:09.937 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-02-09T08:02:09.937 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-02-09T08:02:10.005 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-02-09T08:02:10.006 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-02-09T08:02:10.033 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-02-09T08:02:10.033 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-02-09T08:02:10.100 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-02-09T08:02:10.100 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-02-09T08:02:10.150 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-02-09T08:02:10.147+0000 7fa0f91f1040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-09T08:02:10.167 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-02-09T08:02:10.167 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-02-09T08:02:10.207 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-02-09T08:02:10.204+0000 7fa0f91f1040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-09T08:02:10.216 INFO:tasks.ceph.mgr.y.smithi062.stderr:2024-02-09T08:02:10.214+0000 7f96d1c3f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-09T08:02:10.233 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph osd new 0e3b17d4-a50f-41d9-b455-0bc1606a5c86 0 2024-02-09T08:02:10.254 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-02-09T08:02:10.253+0000 7fa0f91f1040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-09T08:02:10.275 INFO:tasks.ceph.mgr.y.smithi062.stderr:2024-02-09T08:02:10.273+0000 7f96d1c3f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-09T08:02:10.312 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-02-09T08:02:10.310+0000 7fa0f91f1040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-09T08:02:10.323 INFO:tasks.ceph.mgr.y.smithi062.stderr:2024-02-09T08:02:10.321+0000 7f96d1c3f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-09T08:02:10.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.353+0000 7f86fa108640 10 monclient: get_monmap_and_config 2024-02-09T08:02:10.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.353+0000 7f86fa108640 10 monclient: build_initial_monmap 2024-02-09T08:02:10.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.353+0000 7f86fa108640 10 monclient: monmap: 2024-02-09T08:02:10.355 INFO:teuthology.orchestra.run.smithi103.stderr:epoch 0 2024-02-09T08:02:10.355 INFO:teuthology.orchestra.run.smithi103.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:10.355 INFO:teuthology.orchestra.run.smithi103.stderr:last_changed 2024-02-09T08:02:10.353671+0000 2024-02-09T08:02:10.355 INFO:teuthology.orchestra.run.smithi103.stderr:created 2024-02-09T08:02:10.353671+0000 2024-02-09T08:02:10.355 INFO:teuthology.orchestra.run.smithi103.stderr:min_mon_release 0 (unknown) 2024-02-09T08:02:10.355 INFO:teuthology.orchestra.run.smithi103.stderr:election_strategy: 1 2024-02-09T08:02:10.355 INFO:teuthology.orchestra.run.smithi103.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:02:10.355 INFO:teuthology.orchestra.run.smithi103.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:02:10.355 INFO:teuthology.orchestra.run.smithi103.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:02:10.355 INFO:teuthology.orchestra.run.smithi103.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:02:10.356 INFO:teuthology.orchestra.run.smithi103.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:02:10.356 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:02:10.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.353+0000 7f86fa108640 1 Processor -- start 2024-02-09T08:02:10.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.353+0000 7f86fa108640 1 -- start start 2024-02-09T08:02:10.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.353+0000 7f86fa108640 10 monclient: init 2024-02-09T08:02:10.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.354+0000 7f86fa108640 10 monclient: _reopen_session rank -1 2024-02-09T08:02:10.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.354+0000 7f86fa108640 10 monclient: _add_conns ranks=[1,2,3,0,4] 2024-02-09T08:02:10.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.354+0000 7f86fa108640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f86f406c320 addr v1:172.21.15.103:6789/0 2024-02-09T08:02:10.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.354+0000 7f86fa108640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f86f40a9be0 0x7f86f4145ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:10.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.354+0000 7f86fa108640 10 monclient(hunting): picked mon.noname-b con 0x7f86f40a9be0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:02:10.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.354+0000 7f86fa108640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f86f40b2280 0x7f86f4146000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:10.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.354+0000 7f86fa108640 10 monclient(hunting): picked mon.noname-a con 0x7f86f40b2280 addr v2:172.21.15.62:3300/0 2024-02-09T08:02:10.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.354+0000 7f86fa108640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86f40aa130 con 0x7f86f406c320 2024-02-09T08:02:10.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.354+0000 7f86fa108640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:10.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.354+0000 7f86fa108640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86f406c700 con 0x7f86f40b2280 2024-02-09T08:02:10.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.354+0000 7f86fa108640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:10.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.354+0000 7f86fa108640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f40aa5c0 con 0x7f86f40a9be0 2024-02-09T08:02:10.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.354+0000 7f86fa108640 10 monclient(hunting): _renew_subs 2024-02-09T08:02:10.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.354+0000 7f86fa108640 10 monclient(hunting): authenticate will time out at 1453.551809s 2024-02-09T08:02:10.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.355+0000 7f86f3fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f86f40b2280 0x7f86f4146000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:10.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.355+0000 7f86f37fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f86f406c320 0x7f86f413f7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46788/0 (socket says 172.21.15.103:46788) 2024-02-09T08:02:10.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.355+0000 7f86f37fe640 1 -- 172.21.15.103:0/3054910703 learned_addr learned my addr 172.21.15.103:0/3054910703 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-02-09T08:02:10.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.355+0000 7f86f2ffd640 1 --2- 172.21.15.103:0/3054910703 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f86f40a9be0 0x7f86f4145ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:10.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.355+0000 7f86f3fff640 10 monclient(hunting): get_auth_request con 0x7f86f40b2280 auth_method 0 2024-02-09T08:02:10.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.355+0000 7f86f3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:10.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.355+0000 7f86f3fff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:10.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.355+0000 7f86f3fff640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:10.360 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-02-09T08:02:10.355+0000 7fa0f91f1040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-09T08:02:10.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.355+0000 7f86f2ffd640 10 monclient(hunting): get_auth_request con 0x7f86f40a9be0 auth_method 0 2024-02-09T08:02:10.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.355+0000 7f86f2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:10.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.355+0000 7f86f2ffd640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:10.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.355+0000 7f86f2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:10.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.356+0000 7f86f3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:10.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.356+0000 7f86f3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:10.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.356+0000 7f86f3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:10.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.356+0000 7f86f2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:10.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.356+0000 7f86f2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:10.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.356+0000 7f86f2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:10.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.357+0000 7f86f27fc640 1 -- 172.21.15.103:0/3054910703 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3537848123 0 0) 0x7f86f40aa130 con 0x7f86f406c320 2024-02-09T08:02:10.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.357+0000 7f86f27fc640 10 monclient(hunting): _negotiate 2024-02-09T08:02:10.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.357+0000 7f86f27fc640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:10.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.357+0000 7f86f27fc640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:10.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.357+0000 7f86f27fc640 10 monclient(hunting): my global_id is 4111 2024-02-09T08:02:10.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.357+0000 7f86f27fc640 1 -- 172.21.15.103:0/3054910703 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86dc003520 con 0x7f86f406c320 2024-02-09T08:02:10.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.358+0000 7f86f3fff640 10 monclient(hunting): handle_auth_done global_id 4110 payload 274 2024-02-09T08:02:10.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.358+0000 7f86f3fff640 1 -- 172.21.15.103:0/3054910703 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f86f40a9be0 msgr2=0x7f86f4145ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:02:10.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.358+0000 7f86f3fff640 1 --2- 172.21.15.103:0/3054910703 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f86f40a9be0 0x7f86f4145ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:10.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.358+0000 7f86f3fff640 1 -- 172.21.15.103:0/3054910703 >> v1:172.21.15.103:6789/0 conn(0x7f86f406c320 legacy=0x7f86f413f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:10.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.358+0000 7f86f3fff640 10 monclient: _finish_hunting 0 2024-02-09T08:02:10.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.358+0000 7f86f3fff640 1 monclient: found mon.noname-a 2024-02-09T08:02:10.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.358+0000 7f86f3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:02:10.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.358+0000 7f86f3fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-02-09T08:02:10.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.358+0000 7f86f3fff640 1 -- 172.21.15.103:0/3054910703 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f40ab5f0 con 0x7f86f40b2280 2024-02-09T08:02:10.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.361+0000 7f86f3fff640 1 --2- 172.21.15.103:0/3054910703 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86f40b2280 0x7f86f4146000 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f86ec009d90 tx=0x7f86ec02bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cae59e6e2688707 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:02:10.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.366+0000 7f86f27fc640 1 -- 172.21.15.103:0/3054910703 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec02cb30 con 0x7f86f40b2280 2024-02-09T08:02:10.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.366+0000 7f86f27fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:10.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.366+0000 7f86f27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-09T08:02:10.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.366+0000 7f86f27fc640 10 monclient: dump: 2024-02-09T08:02:10.368 INFO:teuthology.orchestra.run.smithi103.stderr:epoch 1 2024-02-09T08:02:10.368 INFO:teuthology.orchestra.run.smithi103.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:10.368 INFO:teuthology.orchestra.run.smithi103.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:10.368 INFO:teuthology.orchestra.run.smithi103.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:10.369 INFO:teuthology.orchestra.run.smithi103.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:10.369 INFO:teuthology.orchestra.run.smithi103.stderr:election_strategy: 1 2024-02-09T08:02:10.369 INFO:teuthology.orchestra.run.smithi103.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:10.369 INFO:teuthology.orchestra.run.smithi103.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:10.369 INFO:teuthology.orchestra.run.smithi103.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:10.369 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:02:10.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.366+0000 7f86f27fc640 10 monclient: _finish_auth 0 2024-02-09T08:02:10.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.366+0000 7f86f27fc640 10 monclient: _check_auth_tickets 2024-02-09T08:02:10.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.366+0000 7f86f27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:02:10.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.366+0000 7f86f27fc640 1 -- 172.21.15.103:0/3054910703 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86ec02cc90 con 0x7f86f40b2280 2024-02-09T08:02:10.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.366+0000 7f86f27fc640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:02:10.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.366+0000 7f86f27fc640 1 -- 172.21.15.103:0/3054910703 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec034440 con 0x7f86f40b2280 2024-02-09T08:02:10.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.366+0000 7f86fa108640 5 monclient: authenticate success, global_id 4110 2024-02-09T08:02:10.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.366+0000 7f86fa108640 10 monclient: get_monmap_and_config success 2024-02-09T08:02:10.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.366+0000 7f86fa108640 4 set_mon_vals no callback set 2024-02-09T08:02:10.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.366+0000 7f86f27fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:10.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.366+0000 7f86f27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-09T08:02:10.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.366+0000 7f86f27fc640 10 monclient: dump: 2024-02-09T08:02:10.370 INFO:teuthology.orchestra.run.smithi103.stderr:epoch 1 2024-02-09T08:02:10.370 INFO:teuthology.orchestra.run.smithi103.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:10.371 INFO:teuthology.orchestra.run.smithi103.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:10.371 INFO:teuthology.orchestra.run.smithi103.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:10.371 INFO:teuthology.orchestra.run.smithi103.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:10.371 INFO:teuthology.orchestra.run.smithi103.stderr:election_strategy: 1 2024-02-09T08:02:10.371 INFO:teuthology.orchestra.run.smithi103.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:10.371 INFO:teuthology.orchestra.run.smithi103.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:10.371 INFO:teuthology.orchestra.run.smithi103.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:10.371 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:02:10.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.367+0000 7f86fa108640 10 monclient: shutdown 2024-02-09T08:02:10.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.367+0000 7f86fa108640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:02:10.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.367+0000 7f86fa108640 1 -- 172.21.15.103:0/3054910703 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86f40b2280 msgr2=0x7f86f4146000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:10.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.367+0000 7f86fa108640 1 --2- 172.21.15.103:0/3054910703 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86f40b2280 0x7f86f4146000 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f86ec009d90 tx=0x7f86ec02bd80 comp rx=0 tx=0).stop 2024-02-09T08:02:10.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.367+0000 7f86fa108640 1 -- 172.21.15.103:0/3054910703 shutdown_connections 2024-02-09T08:02:10.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.367+0000 7f86fa108640 1 --2- 172.21.15.103:0/3054910703 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86f40b2280 0x7f86f4146000 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:10.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.367+0000 7f86fa108640 1 --2- 172.21.15.103:0/3054910703 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f86f40a9be0 0x7f86f4145ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:10.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.367+0000 7f86fa108640 1 -- 172.21.15.103:0/3054910703 >> 172.21.15.103:0/3054910703 conn(0x7f86f40b4db0 msgr2=0x7f86f40b51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:02:10.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.367+0000 7f86fa108640 1 -- 172.21.15.103:0/3054910703 shutdown_connections 2024-02-09T08:02:10.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.367+0000 7f86fa108640 1 -- 172.21.15.103:0/3054910703 wait complete. 2024-02-09T08:02:10.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.367+0000 7f86fa108640 10 monclient: build_initial_monmap 2024-02-09T08:02:10.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.367+0000 7f86fa108640 10 monclient: monmap: 2024-02-09T08:02:10.378 INFO:teuthology.orchestra.run.smithi103.stderr:epoch 0 2024-02-09T08:02:10.378 INFO:teuthology.orchestra.run.smithi103.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:02:10.378 INFO:teuthology.orchestra.run.smithi103.stderr:last_changed 0.000000 2024-02-09T08:02:10.378 INFO:teuthology.orchestra.run.smithi103.stderr:created 0.000000 2024-02-09T08:02:10.378 INFO:teuthology.orchestra.run.smithi103.stderr:min_mon_release 0 (unknown) 2024-02-09T08:02:10.378 INFO:teuthology.orchestra.run.smithi103.stderr:election_strategy: 1 2024-02-09T08:02:10.378 INFO:teuthology.orchestra.run.smithi103.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:02:10.378 INFO:teuthology.orchestra.run.smithi103.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:02:10.378 INFO:teuthology.orchestra.run.smithi103.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:02:10.378 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:02:10.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.368+0000 7f86fa108640 1 librados: starting msgr at 2024-02-09T08:02:10.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.368+0000 7f86fa108640 1 librados: starting objecter 2024-02-09T08:02:10.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.368+0000 7f86fa108640 1 Processor -- start 2024-02-09T08:02:10.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.368+0000 7f86fa108640 1 -- start start 2024-02-09T08:02:10.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.368+0000 7f86fa108640 1 librados: setting wanted keys 2024-02-09T08:02:10.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.368+0000 7f86fa108640 1 librados: calling monclient init 2024-02-09T08:02:10.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.368+0000 7f86fa108640 10 monclient: init 2024-02-09T08:02:10.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.368+0000 7f86fa108640 10 monclient: _reopen_session rank -1 2024-02-09T08:02:10.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.368+0000 7f86fa108640 10 monclient: _add_conns ranks=[1,2,0] 2024-02-09T08:02:10.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.368+0000 7f86fa108640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86f406c320 0x7f86f4142080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:10.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.368+0000 7f86fa108640 10 monclient(hunting): picked mon.noname-b con 0x7f86f406c320 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:02:10.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.368+0000 7f86fa108640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f86f40a9be0 0x7f86f413a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:10.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.368+0000 7f86fa108640 10 monclient(hunting): picked mon.noname-c con 0x7f86f40a9be0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:02:10.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.368+0000 7f86fa108640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86f40b2280 0x7f86f4142a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:10.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.368+0000 7f86fa108640 10 monclient(hunting): picked mon.noname-a con 0x7f86f40b2280 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:02:10.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.368+0000 7f86fa108640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:10.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.368+0000 7f86fa108640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f413a690 con 0x7f86f40b2280 2024-02-09T08:02:10.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.368+0000 7f86fa108640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:10.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.368+0000 7f86fa108640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f40b6680 con 0x7f86f406c320 2024-02-09T08:02:10.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.368+0000 7f86fa108640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:10.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.368+0000 7f86fa108640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f40b6960 con 0x7f86f40a9be0 2024-02-09T08:02:10.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.368+0000 7f86fa108640 10 monclient(hunting): _renew_subs 2024-02-09T08:02:10.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.368+0000 7f86fa108640 10 monclient(hunting): authenticate will time out at 1453.566209s 2024-02-09T08:02:10.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.369+0000 7f86f37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86f406c320 0x7f86f4142080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:10.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.369+0000 7f86f2ffd640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f86f40a9be0 0x7f86f413a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:10.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.369+0000 7f86f3fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86f40b2280 0x7f86f4142a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:10.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.369+0000 7f86f37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86f406c320 0x7f86f4142080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:32790/0 (socket says 172.21.15.103:32790) 2024-02-09T08:02:10.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.369+0000 7f86f37fe640 1 -- 172.21.15.103:0/4139672682 learned_addr learned my addr 172.21.15.103:0/4139672682 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-02-09T08:02:10.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.369+0000 7f86f37fe640 10 monclient(hunting): get_auth_request con 0x7f86f406c320 auth_method 0 2024-02-09T08:02:10.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.369+0000 7f86f37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:10.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.369+0000 7f86f37fe640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:10.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.369+0000 7f86f37fe640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:10.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.369+0000 7f86f2ffd640 10 monclient(hunting): get_auth_request con 0x7f86f40a9be0 auth_method 0 2024-02-09T08:02:10.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.369+0000 7f86f2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:10.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.369+0000 7f86f2ffd640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:10.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.369+0000 7f86f2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:10.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.370+0000 7f86f3fff640 10 monclient(hunting): get_auth_request con 0x7f86f40b2280 auth_method 0 2024-02-09T08:02:10.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.370+0000 7f86f3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:10.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.370+0000 7f86f3fff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:10.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.370+0000 7f86f3fff640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:10.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.370+0000 7f86f37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:10.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.370+0000 7f86f37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:10.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.370+0000 7f86f37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:10.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.370+0000 7f86f2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:10.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.370+0000 7f86f2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:10.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.370+0000 7f86f2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:10.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.370+0000 7f86f3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:10.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.370+0000 7f86f3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:10.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.370+0000 7f86f3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:10.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.373+0000 7f86f37fe640 10 monclient(hunting): handle_auth_done global_id 4114 payload 824 2024-02-09T08:02:10.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.373+0000 7f86f37fe640 1 -- 172.21.15.103:0/4139672682 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f86f40a9be0 msgr2=0x7f86f413a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:10.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.373+0000 7f86f37fe640 1 --2- 172.21.15.103:0/4139672682 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f86f40a9be0 0x7f86f413a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:10.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.373+0000 7f86f37fe640 1 -- 172.21.15.103:0/4139672682 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86f40b2280 msgr2=0x7f86f4142a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:10.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.373+0000 7f86f37fe640 1 --2- 172.21.15.103:0/4139672682 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86f40b2280 0x7f86f4142a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:10.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.373+0000 7f86f37fe640 10 monclient: _finish_hunting 0 2024-02-09T08:02:10.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.373+0000 7f86f37fe640 1 monclient: found mon.noname-b 2024-02-09T08:02:10.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.373+0000 7f86f37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:02:10.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.373+0000 7f86f37fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.103:3300/0 2024-02-09T08:02:10.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.373+0000 7f86f37fe640 1 -- 172.21.15.103:0/4139672682 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ec009a70 con 0x7f86f406c320 2024-02-09T08:02:10.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.375+0000 7f86f37fe640 1 --2- 172.21.15.103:0/4139672682 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86f406c320 0x7f86f4142080 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f86e800c430 tx=0x7f86e800c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:02:10.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.375+0000 7f86dbfff640 10 client.?.objecter ms_handle_connect 0x7f86f406c320 2024-02-09T08:02:10.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.375+0000 7f86dbfff640 10 client.?.objecter resend_mon_ops 2024-02-09T08:02:10.384 INFO:tasks.ceph.mgr.y.smithi062.stderr:2024-02-09T08:02:10.381+0000 7f96d1c3f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-09T08:02:10.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.381+0000 7f86dbfff640 1 -- 172.21.15.103:0/4139672682 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e8005ce0 con 0x7f86f406c320 2024-02-09T08:02:10.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.381+0000 7f86dbfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:10.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.381+0000 7f86dbfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:02:10.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.381+0000 7f86dbfff640 10 monclient: dump: 2024-02-09T08:02:10.385 INFO:teuthology.orchestra.run.smithi103.stderr:epoch 1 2024-02-09T08:02:10.386 INFO:teuthology.orchestra.run.smithi103.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:10.386 INFO:teuthology.orchestra.run.smithi103.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:10.386 INFO:teuthology.orchestra.run.smithi103.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:10.386 INFO:teuthology.orchestra.run.smithi103.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:10.386 INFO:teuthology.orchestra.run.smithi103.stderr:election_strategy: 1 2024-02-09T08:02:10.386 INFO:teuthology.orchestra.run.smithi103.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:10.387 INFO:teuthology.orchestra.run.smithi103.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:10.387 INFO:teuthology.orchestra.run.smithi103.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:10.387 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:02:10.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.381+0000 7f86dbfff640 10 monclient: _finish_auth 0 2024-02-09T08:02:10.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.381+0000 7f86dbfff640 10 monclient: _check_auth_tickets 2024-02-09T08:02:10.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.381+0000 7f86dbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:02:10.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.381+0000 7f86dbfff640 1 -- 172.21.15.103:0/4139672682 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e8005e40 con 0x7f86f406c320 2024-02-09T08:02:10.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.381+0000 7f86dbfff640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:02:10.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.381+0000 7f86dbfff640 1 -- 172.21.15.103:0/4139672682 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e80072f0 con 0x7f86f406c320 2024-02-09T08:02:10.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.381+0000 7f86dbfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:10.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.381+0000 7f86dbfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:02:10.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.381+0000 7f86dbfff640 10 monclient: dump: 2024-02-09T08:02:10.387 INFO:teuthology.orchestra.run.smithi103.stderr:epoch 1 2024-02-09T08:02:10.388 INFO:teuthology.orchestra.run.smithi103.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:10.388 INFO:teuthology.orchestra.run.smithi103.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:10.388 INFO:teuthology.orchestra.run.smithi103.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:10.388 INFO:teuthology.orchestra.run.smithi103.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:10.388 INFO:teuthology.orchestra.run.smithi103.stderr:election_strategy: 1 2024-02-09T08:02:10.388 INFO:teuthology.orchestra.run.smithi103.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:10.388 INFO:teuthology.orchestra.run.smithi103.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:10.388 INFO:teuthology.orchestra.run.smithi103.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:10.389 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:02:10.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.381+0000 7f86fa108640 5 monclient: authenticate success, global_id 4114 2024-02-09T08:02:10.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.381+0000 7f86fa108640 10 monclient: _renew_subs 2024-02-09T08:02:10.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.381+0000 7f86fa108640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:02:10.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.381+0000 7f86fa108640 1 -- 172.21.15.103:0/4139672682 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86f4142fa0 con 0x7f86f406c320 2024-02-09T08:02:10.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.381+0000 7f86f1ffb640 4 set_mon_vals no callback set 2024-02-09T08:02:10.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.381+0000 7f86fa108640 10 client.4114.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:02:10.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.381+0000 7f86fa108640 10 monclient: _renew_subs 2024-02-09T08:02:10.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.381+0000 7f86fa108640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:02:10.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.381+0000 7f86fa108640 1 -- 172.21.15.103:0/4139672682 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86f41405a0 con 0x7f86f406c320 2024-02-09T08:02:10.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.381+0000 7f86fa108640 1 librados: init done 2024-02-09T08:02:10.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.382+0000 7f86fa108640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:02:10.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.382+0000 7f86fa108640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:02:10.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.382+0000 7f86fa108640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:02:10.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.382+0000 7f86fa108640 1 -- 172.21.15.103:0/4139672682 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86f41428b0 con 0x7f86f406c320 2024-02-09T08:02:10.428 INFO:tasks.ceph.mgr.y.smithi062.stderr:2024-02-09T08:02:10.426+0000 7f96d1c3f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-09T08:02:10.482 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-02-09T08:02:10.480+0000 7fa0f91f1040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-02-09T08:02:10.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.487+0000 7f86dbfff640 1 -- 172.21.15.103:0/4139672682 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f86e8007450 con 0x7f86f406c320 2024-02-09T08:02:10.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.487+0000 7f86dbfff640 1 -- 172.21.15.103:0/4139672682 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f86e80127f0 con 0x7f86f406c320 2024-02-09T08:02:10.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.487+0000 7f86dbfff640 10 client.4114.objecter ms_dispatch 0x7f86f4000b90 osd_map(2..2 src has 1..2) v4 2024-02-09T08:02:10.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.487+0000 7f86dbfff640 3 client.4114.objecter handle_osd_map got epochs [2,2] > 0 2024-02-09T08:02:10.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.487+0000 7f86dbfff640 3 client.4114.objecter handle_osd_map decoding full epoch 2 2024-02-09T08:02:10.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.487+0000 7f86dbfff640 20 client.4114.objecter dump_active .. 0 homeless 2024-02-09T08:02:10.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.487+0000 7f86dbfff640 1 -- 172.21.15.103:0/4139672682 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f86e8017070 con 0x7f86f406c320 2024-02-09T08:02:10.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.488+0000 7f86dbfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:02:10.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.488+0000 7f86dbfff640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:02:10.552 INFO:tasks.ceph.mgr.y.smithi062.stderr:2024-02-09T08:02:10.550+0000 7f96d1c3f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-02-09T08:02:10.558 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-02-09T08:02:10.556+0000 7fa0f91f1040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-09T08:02:10.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.561+0000 7f86fa108640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "0e3b17d4-a50f-41d9-b455-0bc1606a5c86", "id": 0}] 2024-02-09T08:02:10.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.561+0000 7f86fa108640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "0e3b17d4-a50f-41d9-b455-0bc1606a5c86", "id": 0}] 2024-02-09T08:02:10.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.561+0000 7f86fa108640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:02:10.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.561+0000 7f86fa108640 1 -- 172.21.15.103:0/4139672682 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0e3b17d4-a50f-41d9-b455-0bc1606a5c86", "id": 0} v 0) v1 -- 0x7f86f404ef90 con 0x7f86f406c320 2024-02-09T08:02:10.606 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-02-09T08:02:10.604+0000 7fa0f91f1040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-09T08:02:10.627 INFO:tasks.ceph.mgr.y.smithi062.stderr:2024-02-09T08:02:10.625+0000 7f96d1c3f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-09T08:02:10.658 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-02-09T08:02:10.657+0000 7fa0f91f1040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-09T08:02:10.677 INFO:tasks.ceph.mgr.y.smithi062.stderr:2024-02-09T08:02:10.675+0000 7f96d1c3f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-09T08:02:10.707 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-02-09T08:02:10.706+0000 7fa0f91f1040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-09T08:02:10.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.727+0000 7f86dbfff640 1 -- 172.21.15.103:0/4139672682 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0e3b17d4-a50f-41d9-b455-0bc1606a5c86", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f86e8012b90 con 0x7f86f406c320 2024-02-09T08:02:10.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.727+0000 7f86dbfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "0e3b17d4-a50f-41d9-b455-0bc1606a5c86", "id": 0}] 2024-02-09T08:02:10.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.727+0000 7f86dbfff640 10 monclient: _finish_command 2 = system:0 2024-02-09T08:02:10.730 INFO:teuthology.orchestra.run.smithi103.stdout:0 2024-02-09T08:02:10.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.728+0000 7f86fa108640 10 librados: watch_flush enter 2024-02-09T08:02:10.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.728+0000 7f86fa108640 10 librados: watch_flush exit 2024-02-09T08:02:10.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.728+0000 7f86fa108640 20 client.4114.objecter shutdown clearing up homeless session... 2024-02-09T08:02:10.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.728+0000 7f86fa108640 10 client.4114.objecter successfully canceled tick 2024-02-09T08:02:10.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.728+0000 7f86fa108640 10 monclient: shutdown 2024-02-09T08:02:10.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.728+0000 7f86fa108640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:02:10.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.728+0000 7f86fa108640 1 -- 172.21.15.103:0/4139672682 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86f406c320 msgr2=0x7f86f4142080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:10.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.728+0000 7f86fa108640 1 --2- 172.21.15.103:0/4139672682 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86f406c320 0x7f86f4142080 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f86e800c430 tx=0x7f86e800c8f0 comp rx=0 tx=0).stop 2024-02-09T08:02:10.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.728+0000 7f86fa108640 1 -- 172.21.15.103:0/4139672682 shutdown_connections 2024-02-09T08:02:10.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.728+0000 7f86fa108640 1 --2- 172.21.15.103:0/4139672682 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86f40b2280 0x7f86f4142a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:10.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.728+0000 7f86fa108640 1 --2- 172.21.15.103:0/4139672682 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f86f40a9be0 0x7f86f413a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:10.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.728+0000 7f86fa108640 1 --2- 172.21.15.103:0/4139672682 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86f406c320 0x7f86f4142080 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:10.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.728+0000 7f86fa108640 1 -- 172.21.15.103:0/4139672682 >> 172.21.15.103:0/4139672682 conn(0x7f86f40b4db0 msgr2=0x7f86f413e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:02:10.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.729+0000 7f86fa108640 1 -- 172.21.15.103:0/4139672682 shutdown_connections 2024-02-09T08:02:10.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.729+0000 7f86fa108640 1 -- 172.21.15.103:0/4139672682 wait complete. 2024-02-09T08:02:10.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.729+0000 7f86fa108640 1 librados: shutdown 2024-02-09T08:02:10.734 INFO:tasks.ceph.mgr.y.smithi062.stderr:2024-02-09T08:02:10.732+0000 7f96d1c3f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-09T08:02:10.741 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph osd new a0077e6c-220d-46f4-9be2-a707d1710890 1 2024-02-09T08:02:10.786 INFO:tasks.ceph.mgr.y.smithi062.stderr:2024-02-09T08:02:10.784+0000 7f96d1c3f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-09T08:02:10.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.839+0000 7fa84ac66640 10 monclient: get_monmap_and_config 2024-02-09T08:02:10.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.839+0000 7fa84ac66640 10 monclient: build_initial_monmap 2024-02-09T08:02:10.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.839+0000 7fa84ac66640 10 monclient: monmap: 2024-02-09T08:02:10.841 INFO:teuthology.orchestra.run.smithi103.stderr:epoch 0 2024-02-09T08:02:10.842 INFO:teuthology.orchestra.run.smithi103.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:10.842 INFO:teuthology.orchestra.run.smithi103.stderr:last_changed 2024-02-09T08:02:10.840022+0000 2024-02-09T08:02:10.842 INFO:teuthology.orchestra.run.smithi103.stderr:created 2024-02-09T08:02:10.840022+0000 2024-02-09T08:02:10.842 INFO:teuthology.orchestra.run.smithi103.stderr:min_mon_release 0 (unknown) 2024-02-09T08:02:10.842 INFO:teuthology.orchestra.run.smithi103.stderr:election_strategy: 1 2024-02-09T08:02:10.842 INFO:teuthology.orchestra.run.smithi103.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:02:10.842 INFO:teuthology.orchestra.run.smithi103.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:02:10.842 INFO:teuthology.orchestra.run.smithi103.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:02:10.842 INFO:teuthology.orchestra.run.smithi103.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:02:10.842 INFO:teuthology.orchestra.run.smithi103.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:02:10.842 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:02:10.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.840+0000 7fa84ac66640 1 Processor -- start 2024-02-09T08:02:10.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.840+0000 7fa84ac66640 1 -- start start 2024-02-09T08:02:10.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.840+0000 7fa84ac66640 10 monclient: init 2024-02-09T08:02:10.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.840+0000 7fa84ac66640 10 monclient: _reopen_session rank -1 2024-02-09T08:02:10.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.840+0000 7fa84ac66640 10 monclient: _add_conns ranks=[1,4,2,3,0] 2024-02-09T08:02:10.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.840+0000 7fa84ac66640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fa84406c320 addr v1:172.21.15.103:6789/0 2024-02-09T08:02:10.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.840+0000 7fa84ac66640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa8440a9be0 0x7fa844145ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:10.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.840+0000 7fa84ac66640 10 monclient(hunting): picked mon.noname-c con 0x7fa8440a9be0 addr v2:172.21.15.103:3300/0 2024-02-09T08:02:10.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.840+0000 7fa84ac66640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa8440b2280 0x7fa844146000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:10.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.840+0000 7fa84ac66640 10 monclient(hunting): picked mon.noname-b con 0x7fa8440b2280 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:02:10.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.840+0000 7fa84ac66640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8440aa130 con 0x7fa84406c320 2024-02-09T08:02:10.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.840+0000 7fa84ac66640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:10.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.840+0000 7fa84ac66640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa84406c700 con 0x7fa8440a9be0 2024-02-09T08:02:10.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.840+0000 7fa84ac66640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:10.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.840+0000 7fa84ac66640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8440aa5c0 con 0x7fa8440b2280 2024-02-09T08:02:10.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.840+0000 7fa84ac66640 10 monclient(hunting): _renew_subs 2024-02-09T08:02:10.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.840+0000 7fa84ac66640 10 monclient(hunting): authenticate will time out at 1454.038161s 2024-02-09T08:02:10.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.841+0000 7fa843fff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa8440a9be0 0x7fa844145ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:10.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.841+0000 7fa849203640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa8440b2280 0x7fa844146000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:10.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.841+0000 7fa849203640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa8440b2280 0x7fa844146000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.103:59080/0 (socket says 172.21.15.103:59080) 2024-02-09T08:02:10.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.841+0000 7fa849203640 1 -- 172.21.15.103:0/333742440 learned_addr learned my addr 172.21.15.103:0/333742440 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-02-09T08:02:10.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.841+0000 7fa849203640 10 monclient(hunting): get_auth_request con 0x7fa8440b2280 auth_method 0 2024-02-09T08:02:10.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.841+0000 7fa849203640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:10.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.841+0000 7fa849203640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:10.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.841+0000 7fa849203640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:10.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.842+0000 7fa849203640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:10.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.842+0000 7fa849203640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:10.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.842+0000 7fa849203640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:10.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.842+0000 7fa843fff640 10 monclient(hunting): get_auth_request con 0x7fa8440a9be0 auth_method 0 2024-02-09T08:02:10.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.842+0000 7fa843fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:10.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.842+0000 7fa843fff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:10.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.842+0000 7fa843fff640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:10.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.843+0000 7fa843fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:10.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.843+0000 7fa843fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:10.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.843+0000 7fa843fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:10.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.844+0000 7fa849203640 10 monclient(hunting): handle_auth_done global_id 4118 payload 274 2024-02-09T08:02:10.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.844+0000 7fa849203640 1 -- 172.21.15.103:0/333742440 >> v2:172.21.15.103:3300/0 conn(0x7fa8440a9be0 msgr2=0x7fa844145ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:02:10.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.844+0000 7fa849203640 1 --2- 172.21.15.103:0/333742440 >> v2:172.21.15.103:3300/0 conn(0x7fa8440a9be0 0x7fa844145ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:10.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.844+0000 7fa849203640 1 -- 172.21.15.103:0/333742440 >> v1:172.21.15.103:6789/0 conn(0x7fa84406c320 legacy=0x7fa84413f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:10.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.844+0000 7fa849203640 10 monclient: _finish_hunting 0 2024-02-09T08:02:10.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.844+0000 7fa849203640 1 monclient: found mon.noname-b 2024-02-09T08:02:10.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.844+0000 7fa849203640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:02:10.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.844+0000 7fa849203640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.62:3301/0 2024-02-09T08:02:10.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.844+0000 7fa849203640 1 -- 172.21.15.103:0/333742440 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8440ab5f0 con 0x7fa8440b2280 2024-02-09T08:02:10.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.846+0000 7fa849203640 1 --2- 172.21.15.103:0/333742440 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa8440b2280 0x7fa844146000 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa83c009e50 tx=0x7fa83c02be40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aae40b9217d9caaf server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:02:10.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.850+0000 7fa8437fe640 1 -- 172.21.15.103:0/333742440 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83c02c9e0 con 0x7fa8440b2280 2024-02-09T08:02:10.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.850+0000 7fa8437fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:10.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.850+0000 7fa8437fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:02:10.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.850+0000 7fa8437fe640 10 monclient: dump: 2024-02-09T08:02:10.852 INFO:teuthology.orchestra.run.smithi103.stderr:epoch 1 2024-02-09T08:02:10.852 INFO:teuthology.orchestra.run.smithi103.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:10.853 INFO:teuthology.orchestra.run.smithi103.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:10.853 INFO:teuthology.orchestra.run.smithi103.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:10.853 INFO:teuthology.orchestra.run.smithi103.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:10.853 INFO:teuthology.orchestra.run.smithi103.stderr:election_strategy: 1 2024-02-09T08:02:10.853 INFO:teuthology.orchestra.run.smithi103.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:10.853 INFO:teuthology.orchestra.run.smithi103.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:10.853 INFO:teuthology.orchestra.run.smithi103.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:10.854 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:02:10.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.850+0000 7fa8437fe640 10 monclient: _finish_auth 0 2024-02-09T08:02:10.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.850+0000 7fa8437fe640 10 monclient: _check_auth_tickets 2024-02-09T08:02:10.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.850+0000 7fa8437fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:02:10.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.850+0000 7fa8437fe640 1 -- 172.21.15.103:0/333742440 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa83c02cb40 con 0x7fa8440b2280 2024-02-09T08:02:10.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.850+0000 7fa8437fe640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:02:10.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.850+0000 7fa8437fe640 1 -- 172.21.15.103:0/333742440 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83c0343f0 con 0x7fa8440b2280 2024-02-09T08:02:10.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.850+0000 7fa84ac66640 5 monclient: authenticate success, global_id 4118 2024-02-09T08:02:10.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.850+0000 7fa84ac66640 10 monclient: get_monmap_and_config success 2024-02-09T08:02:10.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.850+0000 7fa84ac66640 4 set_mon_vals no callback set 2024-02-09T08:02:10.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.850+0000 7fa8437fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:10.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.850+0000 7fa8437fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-09T08:02:10.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.850+0000 7fa8437fe640 10 monclient: dump: 2024-02-09T08:02:10.854 INFO:teuthology.orchestra.run.smithi103.stderr:epoch 1 2024-02-09T08:02:10.855 INFO:teuthology.orchestra.run.smithi103.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:10.855 INFO:teuthology.orchestra.run.smithi103.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:10.855 INFO:teuthology.orchestra.run.smithi103.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:10.855 INFO:teuthology.orchestra.run.smithi103.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:10.855 INFO:teuthology.orchestra.run.smithi103.stderr:election_strategy: 1 2024-02-09T08:02:10.855 INFO:teuthology.orchestra.run.smithi103.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:10.855 INFO:teuthology.orchestra.run.smithi103.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:10.855 INFO:teuthology.orchestra.run.smithi103.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:10.855 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:02:10.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.851+0000 7fa84ac66640 10 monclient: shutdown 2024-02-09T08:02:10.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.851+0000 7fa84ac66640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:02:10.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.851+0000 7fa84ac66640 1 -- 172.21.15.103:0/333742440 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa8440b2280 msgr2=0x7fa844146000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:10.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.851+0000 7fa84ac66640 1 --2- 172.21.15.103:0/333742440 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa8440b2280 0x7fa844146000 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa83c009e50 tx=0x7fa83c02be40 comp rx=0 tx=0).stop 2024-02-09T08:02:10.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.851+0000 7fa84ac66640 1 -- 172.21.15.103:0/333742440 shutdown_connections 2024-02-09T08:02:10.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.851+0000 7fa84ac66640 1 --2- 172.21.15.103:0/333742440 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa8440b2280 0x7fa844146000 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:10.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.851+0000 7fa84ac66640 1 --2- 172.21.15.103:0/333742440 >> v2:172.21.15.103:3300/0 conn(0x7fa8440a9be0 0x7fa844145ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:10.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.851+0000 7fa84ac66640 1 -- 172.21.15.103:0/333742440 >> 172.21.15.103:0/333742440 conn(0x7fa8440b4db0 msgr2=0x7fa8440b51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:02:10.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.851+0000 7fa84ac66640 1 -- 172.21.15.103:0/333742440 shutdown_connections 2024-02-09T08:02:10.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.851+0000 7fa84ac66640 1 -- 172.21.15.103:0/333742440 wait complete. 2024-02-09T08:02:10.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.852+0000 7fa84ac66640 10 monclient: build_initial_monmap 2024-02-09T08:02:10.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.852+0000 7fa84ac66640 10 monclient: monmap: 2024-02-09T08:02:10.861 INFO:teuthology.orchestra.run.smithi103.stderr:epoch 0 2024-02-09T08:02:10.861 INFO:teuthology.orchestra.run.smithi103.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:02:10.861 INFO:teuthology.orchestra.run.smithi103.stderr:last_changed 0.000000 2024-02-09T08:02:10.861 INFO:teuthology.orchestra.run.smithi103.stderr:created 0.000000 2024-02-09T08:02:10.862 INFO:teuthology.orchestra.run.smithi103.stderr:min_mon_release 0 (unknown) 2024-02-09T08:02:10.862 INFO:teuthology.orchestra.run.smithi103.stderr:election_strategy: 1 2024-02-09T08:02:10.862 INFO:teuthology.orchestra.run.smithi103.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:02:10.862 INFO:teuthology.orchestra.run.smithi103.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:02:10.862 INFO:teuthology.orchestra.run.smithi103.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:02:10.862 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:02:10.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.852+0000 7fa84ac66640 1 librados: starting msgr at 2024-02-09T08:02:10.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.852+0000 7fa84ac66640 1 librados: starting objecter 2024-02-09T08:02:10.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.852+0000 7fa84ac66640 1 Processor -- start 2024-02-09T08:02:10.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.852+0000 7fa84ac66640 1 -- start start 2024-02-09T08:02:10.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.852+0000 7fa84ac66640 1 librados: setting wanted keys 2024-02-09T08:02:10.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.852+0000 7fa84ac66640 1 librados: calling monclient init 2024-02-09T08:02:10.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.852+0000 7fa84ac66640 10 monclient: init 2024-02-09T08:02:10.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.853+0000 7fa84ac66640 10 monclient: _reopen_session rank -1 2024-02-09T08:02:10.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.853+0000 7fa84ac66640 10 monclient: _add_conns ranks=[2,1,0] 2024-02-09T08:02:10.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.853+0000 7fa84ac66640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa84406c320 0x7fa84413a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:10.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.853+0000 7fa84ac66640 10 monclient(hunting): picked mon.noname-c con 0x7fa84406c320 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:02:10.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.853+0000 7fa84ac66640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8440a9be0 0x7fa8441da930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:10.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.853+0000 7fa84ac66640 10 monclient(hunting): picked mon.noname-b con 0x7fa8440a9be0 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:02:10.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.853+0000 7fa84ac66640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8440b2280 0x7fa8441dae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:10.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.853+0000 7fa84ac66640 10 monclient(hunting): picked mon.noname-a con 0x7fa8440b2280 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:02:10.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.853+0000 7fa84ac66640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:10.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.853+0000 7fa84ac66640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8441db610 con 0x7fa8440b2280 2024-02-09T08:02:10.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.853+0000 7fa84ac66640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:10.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.853+0000 7fa84ac66640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8441d7430 con 0x7fa8440a9be0 2024-02-09T08:02:10.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.853+0000 7fa84ac66640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:10.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.853+0000 7fa84ac66640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8441d75a0 con 0x7fa84406c320 2024-02-09T08:02:10.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.853+0000 7fa84ac66640 10 monclient(hunting): _renew_subs 2024-02-09T08:02:10.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.853+0000 7fa84ac66640 10 monclient(hunting): authenticate will time out at 1454.050770s 2024-02-09T08:02:10.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.854+0000 7fa843fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8440a9be0 0x7fa8441da930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:10.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.854+0000 7fa848a02640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa84406c320 0x7fa84413a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:10.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.854+0000 7fa849203640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8440b2280 0x7fa8441dae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:10.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.854+0000 7fa848a02640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa84406c320 0x7fa84413a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.103:59094/0 (socket says 172.21.15.103:59094) 2024-02-09T08:02:10.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.854+0000 7fa848a02640 1 -- 172.21.15.103:0/2996053022 learned_addr learned my addr 172.21.15.103:0/2996053022 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-02-09T08:02:10.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.854+0000 7fa848a02640 10 monclient(hunting): get_auth_request con 0x7fa84406c320 auth_method 0 2024-02-09T08:02:10.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.854+0000 7fa848a02640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:10.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.854+0000 7fa848a02640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:10.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.854+0000 7fa848a02640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:10.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.854+0000 7fa843fff640 10 monclient(hunting): get_auth_request con 0x7fa8440a9be0 auth_method 0 2024-02-09T08:02:10.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.854+0000 7fa843fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:10.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.854+0000 7fa843fff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:10.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.854+0000 7fa843fff640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:10.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.854+0000 7fa849203640 10 monclient(hunting): get_auth_request con 0x7fa8440b2280 auth_method 0 2024-02-09T08:02:10.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.854+0000 7fa849203640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:10.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.854+0000 7fa849203640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:10.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.854+0000 7fa849203640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:10.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.855+0000 7fa848a02640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:10.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.855+0000 7fa848a02640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:10.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.855+0000 7fa848a02640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:10.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.855+0000 7fa843fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:10.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.855+0000 7fa843fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:10.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.855+0000 7fa843fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:10.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.855+0000 7fa849203640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:10.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.855+0000 7fa849203640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:10.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.855+0000 7fa849203640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:10.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.858+0000 7fa848a02640 10 monclient(hunting): handle_auth_done global_id 4121 payload 824 2024-02-09T08:02:10.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.858+0000 7fa848a02640 1 -- 172.21.15.103:0/2996053022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8440a9be0 msgr2=0x7fa8441da930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:10.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.858+0000 7fa848a02640 1 --2- 172.21.15.103:0/2996053022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8440a9be0 0x7fa8441da930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:10.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.858+0000 7fa848a02640 1 -- 172.21.15.103:0/2996053022 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8440b2280 msgr2=0x7fa8441dae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:10.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.858+0000 7fa848a02640 1 --2- 172.21.15.103:0/2996053022 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8440b2280 0x7fa8441dae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:10.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.858+0000 7fa848a02640 10 monclient: _finish_hunting 0 2024-02-09T08:02:10.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.858+0000 7fa848a02640 1 monclient: found mon.noname-c 2024-02-09T08:02:10.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.858+0000 7fa848a02640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:02:10.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.858+0000 7fa848a02640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-02-09T08:02:10.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.858+0000 7fa848a02640 1 -- 172.21.15.103:0/2996053022 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa83c009b30 con 0x7fa84406c320 2024-02-09T08:02:10.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.860+0000 7fa848a02640 1 --2- 172.21.15.103:0/2996053022 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa84406c320 0x7fa84413a740 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa83800c400 tx=0x7fa83800c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:02:10.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.860+0000 7fa8417fa640 10 client.?.objecter ms_handle_connect 0x7fa84406c320 2024-02-09T08:02:10.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.860+0000 7fa8417fa640 10 client.?.objecter resend_mon_ops 2024-02-09T08:02:10.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.865+0000 7fa8417fa640 1 -- 172.21.15.103:0/2996053022 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8380052d0 con 0x7fa84406c320 2024-02-09T08:02:10.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.865+0000 7fa8417fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:10.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.865+0000 7fa8417fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-09T08:02:10.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.865+0000 7fa8417fa640 10 monclient: dump: 2024-02-09T08:02:10.870 INFO:teuthology.orchestra.run.smithi103.stderr:epoch 1 2024-02-09T08:02:10.870 INFO:teuthology.orchestra.run.smithi103.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:10.870 INFO:teuthology.orchestra.run.smithi103.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:10.870 INFO:teuthology.orchestra.run.smithi103.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:10.870 INFO:teuthology.orchestra.run.smithi103.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:10.870 INFO:teuthology.orchestra.run.smithi103.stderr:election_strategy: 1 2024-02-09T08:02:10.870 INFO:teuthology.orchestra.run.smithi103.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:10.870 INFO:teuthology.orchestra.run.smithi103.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:10.870 INFO:teuthology.orchestra.run.smithi103.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:10.870 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:02:10.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.865+0000 7fa8417fa640 10 monclient: _finish_auth 0 2024-02-09T08:02:10.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.865+0000 7fa8417fa640 10 monclient: _check_auth_tickets 2024-02-09T08:02:10.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.865+0000 7fa8417fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:02:10.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.865+0000 7fa8417fa640 1 -- 172.21.15.103:0/2996053022 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa838005450 con 0x7fa84406c320 2024-02-09T08:02:10.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.865+0000 7fa8417fa640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:02:10.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.865+0000 7fa8417fa640 1 -- 172.21.15.103:0/2996053022 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa838007260 con 0x7fa84406c320 2024-02-09T08:02:10.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.865+0000 7fa84ac66640 5 monclient: authenticate success, global_id 4121 2024-02-09T08:02:10.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.865+0000 7fa84ac66640 10 monclient: _renew_subs 2024-02-09T08:02:10.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.865+0000 7fa84ac66640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:02:10.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.865+0000 7fa84ac66640 1 -- 172.21.15.103:0/2996053022 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8441d7760 con 0x7fa84406c320 2024-02-09T08:02:10.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.865+0000 7fa842ffd640 4 set_mon_vals no callback set 2024-02-09T08:02:10.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.865+0000 7fa8417fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:10.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.865+0000 7fa8417fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-09T08:02:10.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.865+0000 7fa8417fa640 10 monclient: dump: 2024-02-09T08:02:10.871 INFO:teuthology.orchestra.run.smithi103.stderr:epoch 1 2024-02-09T08:02:10.871 INFO:teuthology.orchestra.run.smithi103.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:10.871 INFO:teuthology.orchestra.run.smithi103.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:10.871 INFO:teuthology.orchestra.run.smithi103.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:10.871 INFO:teuthology.orchestra.run.smithi103.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:10.872 INFO:teuthology.orchestra.run.smithi103.stderr:election_strategy: 1 2024-02-09T08:02:10.872 INFO:teuthology.orchestra.run.smithi103.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:10.872 INFO:teuthology.orchestra.run.smithi103.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:10.873 INFO:teuthology.orchestra.run.smithi103.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:10.873 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:02:10.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.865+0000 7fa84ac66640 10 client.4121.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:02:10.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.865+0000 7fa84ac66640 10 monclient: _renew_subs 2024-02-09T08:02:10.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.865+0000 7fa84ac66640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:02:10.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.865+0000 7fa84ac66640 1 -- 172.21.15.103:0/2996053022 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8441d7c40 con 0x7fa84406c320 2024-02-09T08:02:10.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.865+0000 7fa84ac66640 1 librados: init done 2024-02-09T08:02:10.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.866+0000 7fa84ac66640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:02:10.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.866+0000 7fa84ac66640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:02:10.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.866+0000 7fa84ac66640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:02:10.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:10.866+0000 7fa84ac66640 1 -- 172.21.15.103:0/2996053022 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa84404ef90 con 0x7fa84406c320 2024-02-09T08:02:11.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.054+0000 7fa8417fa640 1 -- 172.21.15.103:0/2996053022 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fa8380073c0 con 0x7fa84406c320 2024-02-09T08:02:11.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.061+0000 7fa8417fa640 1 -- 172.21.15.103:0/2996053022 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fa838003940 con 0x7fa84406c320 2024-02-09T08:02:11.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.061+0000 7fa8417fa640 10 client.4121.objecter ms_dispatch 0x7fa844000b90 osd_map(3..3 src has 1..3) v4 2024-02-09T08:02:11.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.061+0000 7fa8417fa640 3 client.4121.objecter handle_osd_map got epochs [3,3] > 0 2024-02-09T08:02:11.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.061+0000 7fa8417fa640 3 client.4121.objecter handle_osd_map decoding full epoch 3 2024-02-09T08:02:11.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.061+0000 7fa8417fa640 20 client.4121.objecter dump_active .. 0 homeless 2024-02-09T08:02:11.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.061+0000 7fa8417fa640 1 -- 172.21.15.103:0/2996053022 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fa838020060 con 0x7fa84406c320 2024-02-09T08:02:11.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.061+0000 7fa8417fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:02:11.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.061+0000 7fa8417fa640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:02:11.110 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-02-09T08:02:11.108+0000 7fa0f91f1040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-09T08:02:11.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.134+0000 7fa84ac66640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "a0077e6c-220d-46f4-9be2-a707d1710890", "id": 1}] 2024-02-09T08:02:11.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.134+0000 7fa84ac66640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "a0077e6c-220d-46f4-9be2-a707d1710890", "id": 1}] 2024-02-09T08:02:11.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.134+0000 7fa84ac66640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:02:11.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.134+0000 7fa84ac66640 1 -- 172.21.15.103:0/2996053022 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a0077e6c-220d-46f4-9be2-a707d1710890", "id": 1} v 0) v1 -- 0x7fa844071270 con 0x7fa84406c320 2024-02-09T08:02:11.204 INFO:tasks.ceph.mgr.y.smithi062.stderr:2024-02-09T08:02:11.201+0000 7f96d1c3f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-09T08:02:11.246 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-02-09T08:02:11.244+0000 7fa0f91f1040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-09T08:02:11.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.281+0000 7fa8417fa640 1 -- 172.21.15.103:0/2996053022 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a0077e6c-220d-46f4-9be2-a707d1710890", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa838003b00 con 0x7fa84406c320 2024-02-09T08:02:11.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.281+0000 7fa8417fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "a0077e6c-220d-46f4-9be2-a707d1710890", "id": 1}] 2024-02-09T08:02:11.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.281+0000 7fa8417fa640 10 monclient: _finish_command 2 = system:0 2024-02-09T08:02:11.284 INFO:teuthology.orchestra.run.smithi103.stdout:1 2024-02-09T08:02:11.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.282+0000 7fa84ac66640 10 librados: watch_flush enter 2024-02-09T08:02:11.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.282+0000 7fa84ac66640 10 librados: watch_flush exit 2024-02-09T08:02:11.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.282+0000 7fa84ac66640 20 client.4121.objecter shutdown clearing up homeless session... 2024-02-09T08:02:11.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.282+0000 7fa84ac66640 10 client.4121.objecter successfully canceled tick 2024-02-09T08:02:11.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.282+0000 7fa84ac66640 10 monclient: shutdown 2024-02-09T08:02:11.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.282+0000 7fa84ac66640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:02:11.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.282+0000 7fa84ac66640 1 -- 172.21.15.103:0/2996053022 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa84406c320 msgr2=0x7fa84413a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:11.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.282+0000 7fa84ac66640 1 --2- 172.21.15.103:0/2996053022 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa84406c320 0x7fa84413a740 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa83800c400 tx=0x7fa83800c8c0 comp rx=0 tx=0).stop 2024-02-09T08:02:11.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.282+0000 7fa84ac66640 1 -- 172.21.15.103:0/2996053022 shutdown_connections 2024-02-09T08:02:11.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.282+0000 7fa84ac66640 1 --2- 172.21.15.103:0/2996053022 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8440b2280 0x7fa8441dae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:11.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.282+0000 7fa84ac66640 1 --2- 172.21.15.103:0/2996053022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8440a9be0 0x7fa8441da930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:11.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.282+0000 7fa84ac66640 1 --2- 172.21.15.103:0/2996053022 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa84406c320 0x7fa84413a740 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:11.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.282+0000 7fa84ac66640 1 -- 172.21.15.103:0/2996053022 >> 172.21.15.103:0/2996053022 conn(0x7fa8440b4db0 msgr2=0x7fa84413eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:02:11.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.282+0000 7fa84ac66640 1 -- 172.21.15.103:0/2996053022 shutdown_connections 2024-02-09T08:02:11.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.282+0000 7fa84ac66640 1 -- 172.21.15.103:0/2996053022 wait complete. 2024-02-09T08:02:11.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.282+0000 7fa84ac66640 1 librados: shutdown 2024-02-09T08:02:11.294 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph osd new 3739882a-5263-4113-840a-afd6acdcf15e 2 2024-02-09T08:02:11.351 INFO:tasks.ceph.mgr.y.smithi062.stderr:2024-02-09T08:02:11.348+0000 7f96d1c3f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-09T08:02:11.369 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-02-09T08:02:11.367+0000 7fa0f91f1040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-09T08:02:11.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.393+0000 7f9c97677640 10 monclient: get_monmap_and_config 2024-02-09T08:02:11.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.393+0000 7f9c97677640 10 monclient: build_initial_monmap 2024-02-09T08:02:11.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.393+0000 7f9c97677640 10 monclient: monmap: 2024-02-09T08:02:11.395 INFO:teuthology.orchestra.run.smithi103.stderr:epoch 0 2024-02-09T08:02:11.395 INFO:teuthology.orchestra.run.smithi103.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:11.395 INFO:teuthology.orchestra.run.smithi103.stderr:last_changed 2024-02-09T08:02:11.393574+0000 2024-02-09T08:02:11.395 INFO:teuthology.orchestra.run.smithi103.stderr:created 2024-02-09T08:02:11.393574+0000 2024-02-09T08:02:11.395 INFO:teuthology.orchestra.run.smithi103.stderr:min_mon_release 0 (unknown) 2024-02-09T08:02:11.395 INFO:teuthology.orchestra.run.smithi103.stderr:election_strategy: 1 2024-02-09T08:02:11.395 INFO:teuthology.orchestra.run.smithi103.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:02:11.395 INFO:teuthology.orchestra.run.smithi103.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:02:11.395 INFO:teuthology.orchestra.run.smithi103.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:02:11.395 INFO:teuthology.orchestra.run.smithi103.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:02:11.395 INFO:teuthology.orchestra.run.smithi103.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:02:11.396 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:02:11.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.393+0000 7f9c97677640 1 Processor -- start 2024-02-09T08:02:11.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.393+0000 7f9c97677640 1 -- start start 2024-02-09T08:02:11.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.393+0000 7f9c97677640 10 monclient: init 2024-02-09T08:02:11.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.394+0000 7f9c97677640 10 monclient: _reopen_session rank -1 2024-02-09T08:02:11.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.394+0000 7f9c97677640 10 monclient: _add_conns ranks=[0,1,3,2,4] 2024-02-09T08:02:11.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.394+0000 7f9c97677640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f9c9006c320 addr v1:172.21.15.62:6789/0 2024-02-09T08:02:11.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.394+0000 7f9c97677640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f9c900a9be0 addr v1:172.21.15.103:6789/0 2024-02-09T08:02:11.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.394+0000 7f9c97677640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9c900b2280 0x7f9c901461d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:11.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.394+0000 7f9c97677640 10 monclient(hunting): picked mon.noname-a con 0x7f9c900b2280 addr v2:172.21.15.62:3300/0 2024-02-09T08:02:11.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.394+0000 7f9c97677640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c900aa130 con 0x7f9c9006c320 2024-02-09T08:02:11.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.394+0000 7f9c97677640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c900aa5c0 con 0x7f9c900a9be0 2024-02-09T08:02:11.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.394+0000 7f9c97677640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:11.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.394+0000 7f9c97677640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c9006c700 con 0x7f9c900b2280 2024-02-09T08:02:11.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.394+0000 7f9c97677640 10 monclient(hunting): _renew_subs 2024-02-09T08:02:11.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.394+0000 7f9c97677640 10 monclient(hunting): authenticate will time out at 1454.591727s 2024-02-09T08:02:11.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.395+0000 7f9c95c14640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9c900b2280 0x7f9c901461d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:11.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.395+0000 7f9c94c12640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f9c900a9be0 0x7f9c90145ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46812/0 (socket says 172.21.15.103:46812) 2024-02-09T08:02:11.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.395+0000 7f9c94c12640 1 -- 172.21.15.103:0/593772796 learned_addr learned my addr 172.21.15.103:0/593772796 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-02-09T08:02:11.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.395+0000 7f9c95c14640 10 monclient(hunting): get_auth_request con 0x7f9c900b2280 auth_method 0 2024-02-09T08:02:11.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.395+0000 7f9c95c14640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:11.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.395+0000 7f9c95c14640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:11.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.395+0000 7f9c95c14640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:11.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.396+0000 7f9c95c14640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:11.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.396+0000 7f9c95c14640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:11.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.396+0000 7f9c95c14640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:11.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.398+0000 7f9c87fff640 1 -- 172.21.15.103:0/593772796 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3461972100 0 0) 0x7f9c900aa5c0 con 0x7f9c900a9be0 2024-02-09T08:02:11.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.398+0000 7f9c87fff640 10 monclient(hunting): _negotiate 2024-02-09T08:02:11.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.398+0000 7f9c87fff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:11.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.398+0000 7f9c87fff640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:11.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.398+0000 7f9c87fff640 10 monclient(hunting): my global_id is 4123 2024-02-09T08:02:11.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.398+0000 7f9c87fff640 1 -- 172.21.15.103:0/593772796 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c7c003520 con 0x7f9c900a9be0 2024-02-09T08:02:11.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.398+0000 7f9c95c14640 10 monclient(hunting): handle_auth_done global_id 4119 payload 274 2024-02-09T08:02:11.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.398+0000 7f9c95c14640 1 -- 172.21.15.103:0/593772796 >> v1:172.21.15.103:6789/0 conn(0x7f9c900a9be0 legacy=0x7f9c90145ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:11.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.398+0000 7f9c95c14640 1 -- 172.21.15.103:0/593772796 >> v1:172.21.15.62:6789/0 conn(0x7f9c9006c320 legacy=0x7f9c9013f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:11.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.398+0000 7f9c95c14640 10 monclient: _finish_hunting 0 2024-02-09T08:02:11.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.398+0000 7f9c95c14640 1 monclient: found mon.noname-a 2024-02-09T08:02:11.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.398+0000 7f9c95c14640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:02:11.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.398+0000 7f9c95c14640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-02-09T08:02:11.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.398+0000 7f9c95c14640 1 -- 172.21.15.103:0/593772796 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c900ab5f0 con 0x7f9c900b2280 2024-02-09T08:02:11.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.402+0000 7f9c95c14640 1 --2- 172.21.15.103:0/593772796 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c900b2280 0x7f9c901461d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9c88009dc0 tx=0x7f9c8802be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=829e8fa46558c2ee server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:02:11.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.406+0000 7f9c87fff640 1 -- 172.21.15.103:0/593772796 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8802cbb0 con 0x7f9c900b2280 2024-02-09T08:02:11.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.406+0000 7f9c87fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:11.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.406+0000 7f9c87fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-09T08:02:11.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.406+0000 7f9c87fff640 10 monclient: dump: 2024-02-09T08:02:11.408 INFO:teuthology.orchestra.run.smithi103.stderr:epoch 1 2024-02-09T08:02:11.408 INFO:teuthology.orchestra.run.smithi103.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:11.409 INFO:teuthology.orchestra.run.smithi103.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:11.409 INFO:teuthology.orchestra.run.smithi103.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:11.409 INFO:teuthology.orchestra.run.smithi103.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:11.409 INFO:teuthology.orchestra.run.smithi103.stderr:election_strategy: 1 2024-02-09T08:02:11.409 INFO:teuthology.orchestra.run.smithi103.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:11.409 INFO:teuthology.orchestra.run.smithi103.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:11.409 INFO:teuthology.orchestra.run.smithi103.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:11.409 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:02:11.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.406+0000 7f9c87fff640 10 monclient: _finish_auth 0 2024-02-09T08:02:11.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.406+0000 7f9c87fff640 10 monclient: _check_auth_tickets 2024-02-09T08:02:11.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.406+0000 7f9c87fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:02:11.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.406+0000 7f9c87fff640 1 -- 172.21.15.103:0/593772796 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c8802cd10 con 0x7f9c900b2280 2024-02-09T08:02:11.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.406+0000 7f9c87fff640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:02:11.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.406+0000 7f9c87fff640 1 -- 172.21.15.103:0/593772796 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c88034660 con 0x7f9c900b2280 2024-02-09T08:02:11.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.406+0000 7f9c97677640 5 monclient: authenticate success, global_id 4119 2024-02-09T08:02:11.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.406+0000 7f9c97677640 10 monclient: get_monmap_and_config success 2024-02-09T08:02:11.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.406+0000 7f9c97677640 4 set_mon_vals no callback set 2024-02-09T08:02:11.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.406+0000 7f9c87fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:11.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.406+0000 7f9c87fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-09T08:02:11.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.406+0000 7f9c87fff640 10 monclient: dump: 2024-02-09T08:02:11.410 INFO:teuthology.orchestra.run.smithi103.stderr:epoch 1 2024-02-09T08:02:11.410 INFO:teuthology.orchestra.run.smithi103.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:11.410 INFO:teuthology.orchestra.run.smithi103.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:11.410 INFO:teuthology.orchestra.run.smithi103.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:11.410 INFO:teuthology.orchestra.run.smithi103.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:11.410 INFO:teuthology.orchestra.run.smithi103.stderr:election_strategy: 1 2024-02-09T08:02:11.410 INFO:teuthology.orchestra.run.smithi103.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:11.410 INFO:teuthology.orchestra.run.smithi103.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:11.410 INFO:teuthology.orchestra.run.smithi103.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:11.410 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:02:11.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.407+0000 7f9c97677640 10 monclient: shutdown 2024-02-09T08:02:11.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.407+0000 7f9c97677640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:02:11.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.407+0000 7f9c97677640 1 -- 172.21.15.103:0/593772796 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c900b2280 msgr2=0x7f9c901461d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:11.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.407+0000 7f9c97677640 1 --2- 172.21.15.103:0/593772796 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c900b2280 0x7f9c901461d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9c88009dc0 tx=0x7f9c8802be00 comp rx=0 tx=0).stop 2024-02-09T08:02:11.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.407+0000 7f9c97677640 1 -- 172.21.15.103:0/593772796 shutdown_connections 2024-02-09T08:02:11.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.407+0000 7f9c97677640 1 --2- 172.21.15.103:0/593772796 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c900b2280 0x7f9c901461d0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:11.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.407+0000 7f9c97677640 1 -- 172.21.15.103:0/593772796 >> 172.21.15.103:0/593772796 conn(0x7f9c900b4db0 msgr2=0x7f9c900b51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:02:11.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.407+0000 7f9c97677640 1 -- 172.21.15.103:0/593772796 shutdown_connections 2024-02-09T08:02:11.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.407+0000 7f9c97677640 1 -- 172.21.15.103:0/593772796 wait complete. 2024-02-09T08:02:11.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.408+0000 7f9c97677640 10 monclient: build_initial_monmap 2024-02-09T08:02:11.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.408+0000 7f9c97677640 10 monclient: monmap: 2024-02-09T08:02:11.415 INFO:teuthology.orchestra.run.smithi103.stderr:epoch 0 2024-02-09T08:02:11.415 INFO:teuthology.orchestra.run.smithi103.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:02:11.415 INFO:teuthology.orchestra.run.smithi103.stderr:last_changed 0.000000 2024-02-09T08:02:11.415 INFO:teuthology.orchestra.run.smithi103.stderr:created 0.000000 2024-02-09T08:02:11.415 INFO:teuthology.orchestra.run.smithi103.stderr:min_mon_release 0 (unknown) 2024-02-09T08:02:11.415 INFO:teuthology.orchestra.run.smithi103.stderr:election_strategy: 1 2024-02-09T08:02:11.415 INFO:teuthology.orchestra.run.smithi103.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:02:11.415 INFO:teuthology.orchestra.run.smithi103.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:02:11.415 INFO:teuthology.orchestra.run.smithi103.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:02:11.415 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:02:11.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.408+0000 7f9c97677640 1 librados: starting msgr at 2024-02-09T08:02:11.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.408+0000 7f9c97677640 1 librados: starting objecter 2024-02-09T08:02:11.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.408+0000 7f9c97677640 1 Processor -- start 2024-02-09T08:02:11.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.408+0000 7f9c97677640 1 -- start start 2024-02-09T08:02:11.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.408+0000 7f9c97677640 1 librados: setting wanted keys 2024-02-09T08:02:11.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.408+0000 7f9c97677640 1 librados: calling monclient init 2024-02-09T08:02:11.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.408+0000 7f9c97677640 10 monclient: init 2024-02-09T08:02:11.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.409+0000 7f9c97677640 10 monclient: _reopen_session rank -1 2024-02-09T08:02:11.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.409+0000 7f9c97677640 10 monclient: _add_conns ranks=[1,0,2] 2024-02-09T08:02:11.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.409+0000 7f9c97677640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c9006c320 0x7f9c901d7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:11.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.409+0000 7f9c97677640 10 monclient(hunting): picked mon.noname-b con 0x7f9c9006c320 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:02:11.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.409+0000 7f9c97677640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c900a9be0 0x7f9c90141370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:11.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.409+0000 7f9c97677640 10 monclient(hunting): picked mon.noname-a con 0x7f9c900a9be0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:02:11.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.409+0000 7f9c97677640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9c900b2280 0x7f9c901418b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:11.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.409+0000 7f9c97677640 10 monclient(hunting): picked mon.noname-c con 0x7f9c900b2280 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:02:11.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.409+0000 7f9c97677640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:11.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.409+0000 7f9c97677640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c90141df0 con 0x7f9c900a9be0 2024-02-09T08:02:11.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.409+0000 7f9c97677640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:11.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.409+0000 7f9c97677640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c901d7530 con 0x7f9c9006c320 2024-02-09T08:02:11.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.409+0000 7f9c97677640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:11.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.409+0000 7f9c97677640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c901403c0 con 0x7f9c900b2280 2024-02-09T08:02:11.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.409+0000 7f9c97677640 10 monclient(hunting): _renew_subs 2024-02-09T08:02:11.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.409+0000 7f9c97677640 10 monclient(hunting): authenticate will time out at 1454.606665s 2024-02-09T08:02:11.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.409+0000 7f9c94c12640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c900a9be0 0x7f9c90141370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:11.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.409+0000 7f9c95413640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c9006c320 0x7f9c901d7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:11.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.410+0000 7f9c95c14640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9c900b2280 0x7f9c901418b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:11.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.410+0000 7f9c94c12640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c900a9be0 0x7f9c90141370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.103:55342/0 (socket says 172.21.15.103:55342) 2024-02-09T08:02:11.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.410+0000 7f9c94c12640 1 -- 172.21.15.103:0/2263875394 learned_addr learned my addr 172.21.15.103:0/2263875394 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-02-09T08:02:11.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.410+0000 7f9c94c12640 10 monclient(hunting): get_auth_request con 0x7f9c900a9be0 auth_method 0 2024-02-09T08:02:11.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.410+0000 7f9c94c12640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:11.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.410+0000 7f9c94c12640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:11.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.410+0000 7f9c94c12640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:11.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.410+0000 7f9c95c14640 10 monclient(hunting): get_auth_request con 0x7f9c900b2280 auth_method 0 2024-02-09T08:02:11.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.410+0000 7f9c95c14640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:11.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.410+0000 7f9c95c14640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:11.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.410+0000 7f9c95c14640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:11.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.410+0000 7f9c95413640 10 monclient(hunting): get_auth_request con 0x7f9c9006c320 auth_method 0 2024-02-09T08:02:11.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.410+0000 7f9c95413640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:11.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.410+0000 7f9c95413640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:11.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.410+0000 7f9c95413640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:11.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.410+0000 7f9c94c12640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:11.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.410+0000 7f9c94c12640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:11.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.410+0000 7f9c94c12640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:11.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.410+0000 7f9c95c14640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:11.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.410+0000 7f9c95c14640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:11.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.410+0000 7f9c95c14640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:11.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.411+0000 7f9c95413640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:11.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.411+0000 7f9c95413640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:11.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.411+0000 7f9c95413640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:11.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.413+0000 7f9c94c12640 10 monclient(hunting): handle_auth_done global_id 4122 payload 824 2024-02-09T08:02:11.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.413+0000 7f9c94c12640 1 -- 172.21.15.103:0/2263875394 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9c900b2280 msgr2=0x7f9c901418b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:11.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.413+0000 7f9c94c12640 1 --2- 172.21.15.103:0/2263875394 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9c900b2280 0x7f9c901418b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:11.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.413+0000 7f9c94c12640 1 -- 172.21.15.103:0/2263875394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c9006c320 msgr2=0x7f9c901d7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:11.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.413+0000 7f9c94c12640 1 --2- 172.21.15.103:0/2263875394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c9006c320 0x7f9c901d7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:11.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.413+0000 7f9c94c12640 10 monclient: _finish_hunting 0 2024-02-09T08:02:11.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.413+0000 7f9c94c12640 1 monclient: found mon.noname-a 2024-02-09T08:02:11.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.413+0000 7f9c94c12640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:02:11.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.413+0000 7f9c94c12640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-02-09T08:02:11.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.413+0000 7f9c94c12640 1 -- 172.21.15.103:0/2263875394 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c88009a70 con 0x7f9c900a9be0 2024-02-09T08:02:11.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.415+0000 7f9c94c12640 1 --2- 172.21.15.103:0/2263875394 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c900a9be0 0x7f9c90141370 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c00c400 tx=0x7f9c8c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:02:11.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.415+0000 7f9c85ffb640 10 client.?.objecter ms_handle_connect 0x7f9c900a9be0 2024-02-09T08:02:11.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.415+0000 7f9c85ffb640 10 client.?.objecter resend_mon_ops 2024-02-09T08:02:11.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.419+0000 7f9c85ffb640 1 -- 172.21.15.103:0/2263875394 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c005ce0 con 0x7f9c900a9be0 2024-02-09T08:02:11.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.419+0000 7f9c85ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:11.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.419+0000 7f9c85ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-09T08:02:11.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.419+0000 7f9c85ffb640 10 monclient: dump: 2024-02-09T08:02:11.421 INFO:teuthology.orchestra.run.smithi103.stderr:epoch 1 2024-02-09T08:02:11.421 INFO:teuthology.orchestra.run.smithi103.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:11.421 INFO:teuthology.orchestra.run.smithi103.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:11.421 INFO:teuthology.orchestra.run.smithi103.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:11.422 INFO:teuthology.orchestra.run.smithi103.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:11.422 INFO:teuthology.orchestra.run.smithi103.stderr:election_strategy: 1 2024-02-09T08:02:11.422 INFO:teuthology.orchestra.run.smithi103.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:11.422 INFO:teuthology.orchestra.run.smithi103.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:11.422 INFO:teuthology.orchestra.run.smithi103.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:11.422 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:02:11.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.419+0000 7f9c85ffb640 10 monclient: _finish_auth 0 2024-02-09T08:02:11.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.419+0000 7f9c85ffb640 10 monclient: _check_auth_tickets 2024-02-09T08:02:11.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.419+0000 7f9c85ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:02:11.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.419+0000 7f9c85ffb640 1 -- 172.21.15.103:0/2263875394 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c8c005e60 con 0x7f9c900a9be0 2024-02-09T08:02:11.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.419+0000 7f9c85ffb640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:02:11.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.419+0000 7f9c85ffb640 1 -- 172.21.15.103:0/2263875394 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c0072f0 con 0x7f9c900a9be0 2024-02-09T08:02:11.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.419+0000 7f9c85ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:11.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.419+0000 7f9c85ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-09T08:02:11.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.419+0000 7f9c85ffb640 10 monclient: dump: 2024-02-09T08:02:11.423 INFO:teuthology.orchestra.run.smithi103.stderr:epoch 1 2024-02-09T08:02:11.423 INFO:teuthology.orchestra.run.smithi103.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:11.423 INFO:teuthology.orchestra.run.smithi103.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:11.423 INFO:teuthology.orchestra.run.smithi103.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:11.423 INFO:teuthology.orchestra.run.smithi103.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:11.423 INFO:teuthology.orchestra.run.smithi103.stderr:election_strategy: 1 2024-02-09T08:02:11.423 INFO:teuthology.orchestra.run.smithi103.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:11.423 INFO:teuthology.orchestra.run.smithi103.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:11.423 INFO:teuthology.orchestra.run.smithi103.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:11.423 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:02:11.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.419+0000 7f9c97677640 5 monclient: authenticate success, global_id 4122 2024-02-09T08:02:11.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.419+0000 7f9c97677640 10 monclient: _renew_subs 2024-02-09T08:02:11.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.419+0000 7f9c97677640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:02:11.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.419+0000 7f9c97677640 1 -- 172.21.15.103:0/2263875394 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c9013a9a0 con 0x7f9c900a9be0 2024-02-09T08:02:11.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.419+0000 7f9c877fe640 4 set_mon_vals no callback set 2024-02-09T08:02:11.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.419+0000 7f9c97677640 10 client.4122.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:02:11.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.419+0000 7f9c97677640 10 monclient: _renew_subs 2024-02-09T08:02:11.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.419+0000 7f9c97677640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:02:11.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.419+0000 7f9c97677640 1 -- 172.21.15.103:0/2263875394 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c901d7f90 con 0x7f9c900a9be0 2024-02-09T08:02:11.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.419+0000 7f9c97677640 1 librados: init done 2024-02-09T08:02:11.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.421+0000 7f9c97677640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:02:11.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.421+0000 7f9c97677640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:02:11.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.421+0000 7f9c97677640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:02:11.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.421+0000 7f9c97677640 1 -- 172.21.15.103:0/2263875394 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c901d7390 con 0x7f9c900a9be0 2024-02-09T08:02:11.425 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-02-09T08:02:11.421+0000 7fa0f91f1040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-09T08:02:11.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.424+0000 7f9c85ffb640 1 -- 172.21.15.103:0/2263875394 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f9c8c007450 con 0x7f9c900a9be0 2024-02-09T08:02:11.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.424+0000 7f9c85ffb640 1 -- 172.21.15.103:0/2263875394 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f9c8c01b7d0 con 0x7f9c900a9be0 2024-02-09T08:02:11.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.424+0000 7f9c85ffb640 10 client.4122.objecter ms_dispatch 0x7f9c90000b90 osd_map(4..4 src has 1..4) v4 2024-02-09T08:02:11.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.424+0000 7f9c85ffb640 3 client.4122.objecter handle_osd_map got epochs [4,4] > 0 2024-02-09T08:02:11.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.424+0000 7f9c85ffb640 3 client.4122.objecter handle_osd_map decoding full epoch 4 2024-02-09T08:02:11.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.424+0000 7f9c85ffb640 20 client.4122.objecter dump_active .. 0 homeless 2024-02-09T08:02:11.474 INFO:tasks.ceph.mgr.y.smithi062.stderr:2024-02-09T08:02:11.471+0000 7f96d1c3f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-09T08:02:11.522 INFO:tasks.ceph.mgr.y.smithi062.stderr:2024-02-09T08:02:11.519+0000 7f96d1c3f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-09T08:02:11.535 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-02-09T08:02:11.534+0000 7fa0f91f1040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-09T08:02:11.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.546+0000 7f9c85ffb640 1 -- 172.21.15.103:0/2263875394 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f9c901d7390 con 0x7f9c900a9be0 2024-02-09T08:02:11.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.546+0000 7f9c85ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:02:11.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.546+0000 7f9c85ffb640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:02:11.644 INFO:tasks.ceph.mgr.y.smithi062.stderr:2024-02-09T08:02:11.639+0000 7f96d1c3f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-09T08:02:11.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.664+0000 7f9c97677640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "3739882a-5263-4113-840a-afd6acdcf15e", "id": 2}] 2024-02-09T08:02:11.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.664+0000 7f9c97677640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "3739882a-5263-4113-840a-afd6acdcf15e", "id": 2}] 2024-02-09T08:02:11.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.664+0000 7f9c97677640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:02:11.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.664+0000 7f9c97677640 1 -- 172.21.15.103:0/2263875394 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3739882a-5263-4113-840a-afd6acdcf15e", "id": 2} v 0) v1 -- 0x7f9c9004ef90 con 0x7f9c900a9be0 2024-02-09T08:02:11.667 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-02-09T08:02:11.666+0000 7fa0f91f1040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-09T08:02:11.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.716+0000 7f9c85ffb640 1 -- 172.21.15.103:0/2263875394 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3739882a-5263-4113-840a-afd6acdcf15e", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9c8c017070 con 0x7f9c900a9be0 2024-02-09T08:02:11.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.716+0000 7f9c85ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "3739882a-5263-4113-840a-afd6acdcf15e", "id": 2}] 2024-02-09T08:02:11.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.716+0000 7f9c85ffb640 10 monclient: _finish_command 2 = system:0 2024-02-09T08:02:11.719 INFO:teuthology.orchestra.run.smithi103.stdout:2 2024-02-09T08:02:11.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.717+0000 7f9c97677640 10 librados: watch_flush enter 2024-02-09T08:02:11.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.717+0000 7f9c97677640 10 librados: watch_flush exit 2024-02-09T08:02:11.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.717+0000 7f9c97677640 20 client.4122.objecter shutdown clearing up homeless session... 2024-02-09T08:02:11.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.717+0000 7f9c97677640 10 client.4122.objecter successfully canceled tick 2024-02-09T08:02:11.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.717+0000 7f9c97677640 10 monclient: shutdown 2024-02-09T08:02:11.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.717+0000 7f9c97677640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:02:11.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.717+0000 7f9c97677640 1 -- 172.21.15.103:0/2263875394 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c900a9be0 msgr2=0x7f9c90141370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:11.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.717+0000 7f9c97677640 1 --2- 172.21.15.103:0/2263875394 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c900a9be0 0x7f9c90141370 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c00c400 tx=0x7f9c8c00c8c0 comp rx=0 tx=0).stop 2024-02-09T08:02:11.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.717+0000 7f9c97677640 1 -- 172.21.15.103:0/2263875394 shutdown_connections 2024-02-09T08:02:11.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.717+0000 7f9c97677640 1 --2- 172.21.15.103:0/2263875394 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9c900b2280 0x7f9c901418b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:11.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.717+0000 7f9c97677640 1 --2- 172.21.15.103:0/2263875394 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c900a9be0 0x7f9c90141370 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:11.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.717+0000 7f9c97677640 1 --2- 172.21.15.103:0/2263875394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c9006c320 0x7f9c901d7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:11.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.717+0000 7f9c97677640 1 -- 172.21.15.103:0/2263875394 >> 172.21.15.103:0/2263875394 conn(0x7f9c900b4db0 msgr2=0x7f9c900b75f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:02:11.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.718+0000 7f9c97677640 1 -- 172.21.15.103:0/2263875394 shutdown_connections 2024-02-09T08:02:11.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.718+0000 7f9c97677640 1 -- 172.21.15.103:0/2263875394 wait complete. 2024-02-09T08:02:11.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.718+0000 7f9c97677640 1 librados: shutdown 2024-02-09T08:02:11.730 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph osd new 3657c103-db3d-46c5-8afc-2b0b9da1e2e3 3 2024-02-09T08:02:11.743 INFO:tasks.ceph.mgr.y.smithi062.stderr:2024-02-09T08:02:11.741+0000 7f96d1c3f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-09T08:02:11.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.829+0000 7fc1b31a6640 10 monclient: get_monmap_and_config 2024-02-09T08:02:11.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.829+0000 7fc1b31a6640 10 monclient: build_initial_monmap 2024-02-09T08:02:11.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.829+0000 7fc1b31a6640 10 monclient: monmap: 2024-02-09T08:02:11.832 INFO:teuthology.orchestra.run.smithi103.stderr:epoch 0 2024-02-09T08:02:11.832 INFO:teuthology.orchestra.run.smithi103.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:11.832 INFO:teuthology.orchestra.run.smithi103.stderr:last_changed 2024-02-09T08:02:11.830385+0000 2024-02-09T08:02:11.832 INFO:teuthology.orchestra.run.smithi103.stderr:created 2024-02-09T08:02:11.830385+0000 2024-02-09T08:02:11.832 INFO:teuthology.orchestra.run.smithi103.stderr:min_mon_release 0 (unknown) 2024-02-09T08:02:11.832 INFO:teuthology.orchestra.run.smithi103.stderr:election_strategy: 1 2024-02-09T08:02:11.832 INFO:teuthology.orchestra.run.smithi103.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:02:11.832 INFO:teuthology.orchestra.run.smithi103.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:02:11.833 INFO:teuthology.orchestra.run.smithi103.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:02:11.833 INFO:teuthology.orchestra.run.smithi103.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:02:11.833 INFO:teuthology.orchestra.run.smithi103.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:02:11.833 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:02:11.833 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-02-09T08:02:11.829+0000 7fa0f91f1040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-09T08:02:11.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.830+0000 7fc1b31a6640 1 Processor -- start 2024-02-09T08:02:11.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.830+0000 7fc1b31a6640 1 -- start start 2024-02-09T08:02:11.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.830+0000 7fc1b31a6640 10 monclient: init 2024-02-09T08:02:11.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.831+0000 7fc1b31a6640 10 monclient: _reopen_session rank -1 2024-02-09T08:02:11.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.831+0000 7fc1b31a6640 10 monclient: _add_conns ranks=[3,4,0,2,1] 2024-02-09T08:02:11.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.831+0000 7fc1b31a6640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc1ac06c320 0x7fc1ac13f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:11.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.831+0000 7fc1b31a6640 10 monclient(hunting): picked mon.noname-a con 0x7fc1ac06c320 addr v2:172.21.15.62:3300/0 2024-02-09T08:02:11.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.831+0000 7fc1b31a6640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc1ac0a9be0 0x7fc1ac13fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:11.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.831+0000 7fc1b31a6640 10 monclient(hunting): picked mon.noname-c con 0x7fc1ac0a9be0 addr v2:172.21.15.103:3300/0 2024-02-09T08:02:11.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.831+0000 7fc1b31a6640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc1ac0b2280 addr v1:172.21.15.62:6789/0 2024-02-09T08:02:11.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.831+0000 7fc1b31a6640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1ac0aa130 con 0x7fc1ac0b2280 2024-02-09T08:02:11.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.831+0000 7fc1b31a6640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:11.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.831+0000 7fc1b31a6640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1ac06c700 con 0x7fc1ac06c320 2024-02-09T08:02:11.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.831+0000 7fc1b31a6640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:11.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.831+0000 7fc1b31a6640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1ac140240 con 0x7fc1ac0a9be0 2024-02-09T08:02:11.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.831+0000 7fc1b31a6640 10 monclient(hunting): _renew_subs 2024-02-09T08:02:11.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.831+0000 7fc1b31a6640 10 monclient(hunting): authenticate will time out at 1455.028607s 2024-02-09T08:02:11.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.833+0000 7fc1abfff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc1ac0a9be0 0x7fc1ac13fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:11.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.833+0000 7fc1abfff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc1ac0a9be0 0x7fc1ac13fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:32812/0 (socket says 172.21.15.103:32812) 2024-02-09T08:02:11.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.833+0000 7fc1abfff640 1 -- 172.21.15.103:0/4188115716 learned_addr learned my addr 172.21.15.103:0/4188115716 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-02-09T08:02:11.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.833+0000 7fc1abfff640 10 monclient(hunting): get_auth_request con 0x7fc1ac0a9be0 auth_method 0 2024-02-09T08:02:11.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.833+0000 7fc1abfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:11.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.833+0000 7fc1abfff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:11.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.833+0000 7fc1abfff640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:11.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.833+0000 7fc1b0f42640 1 --2- 172.21.15.103:0/4188115716 >> v2:172.21.15.62:3300/0 conn(0x7fc1ac06c320 0x7fc1ac13f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:11.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.834+0000 7fc1abfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:11.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.834+0000 7fc1abfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:11.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.834+0000 7fc1abfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:11.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.834+0000 7fc1b0f42640 10 monclient(hunting): get_auth_request con 0x7fc1ac06c320 auth_method 0 2024-02-09T08:02:11.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.834+0000 7fc1b0f42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:11.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.834+0000 7fc1b0f42640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:11.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.834+0000 7fc1b0f42640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:11.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.836+0000 7fc1b0f42640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:11.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.836+0000 7fc1b0f42640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:11.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.836+0000 7fc1b0f42640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:11.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.836+0000 7fc1abfff640 10 monclient(hunting): handle_auth_done global_id 4129 payload 274 2024-02-09T08:02:11.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.836+0000 7fc1abfff640 1 -- 172.21.15.103:0/4188115716 >> v2:172.21.15.62:3300/0 conn(0x7fc1ac06c320 msgr2=0x7fc1ac13f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:02:11.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.836+0000 7fc1abfff640 1 --2- 172.21.15.103:0/4188115716 >> v2:172.21.15.62:3300/0 conn(0x7fc1ac06c320 0x7fc1ac13f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:11.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.836+0000 7fc1abfff640 1 -- 172.21.15.103:0/4188115716 >> v1:172.21.15.62:6789/0 conn(0x7fc1ac0b2280 legacy=0x7fc1ac145ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:11.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.836+0000 7fc1abfff640 10 monclient: _finish_hunting 0 2024-02-09T08:02:11.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.836+0000 7fc1abfff640 1 monclient: found mon.noname-c 2024-02-09T08:02:11.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.836+0000 7fc1abfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:02:11.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.836+0000 7fc1abfff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.103:3300/0 2024-02-09T08:02:11.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.836+0000 7fc1abfff640 1 -- 172.21.15.103:0/4188115716 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ac0aa5c0 con 0x7fc1ac0a9be0 2024-02-09T08:02:11.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.839+0000 7fc1abfff640 1 --2- 172.21.15.103:0/4188115716 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1ac0a9be0 0x7fc1ac13fd00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc19c009870 tx=0x7fc19c02b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e2b2f2ed1a1112f server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:02:11.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.843+0000 7fc1ab7fe640 1 -- 172.21.15.103:0/4188115716 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c0317e0 con 0x7fc1ac0a9be0 2024-02-09T08:02:11.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.843+0000 7fc1ab7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:11.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.843+0000 7fc1ab7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-09T08:02:11.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.843+0000 7fc1ab7fe640 10 monclient: dump: 2024-02-09T08:02:11.853 INFO:teuthology.orchestra.run.smithi103.stderr:epoch 1 2024-02-09T08:02:11.853 INFO:teuthology.orchestra.run.smithi103.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:11.853 INFO:teuthology.orchestra.run.smithi103.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:11.853 INFO:teuthology.orchestra.run.smithi103.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:11.853 INFO:teuthology.orchestra.run.smithi103.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:11.853 INFO:teuthology.orchestra.run.smithi103.stderr:election_strategy: 1 2024-02-09T08:02:11.853 INFO:teuthology.orchestra.run.smithi103.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:11.853 INFO:teuthology.orchestra.run.smithi103.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:11.853 INFO:teuthology.orchestra.run.smithi103.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:11.853 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:02:11.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.844+0000 7fc1ab7fe640 10 monclient: _finish_auth 0 2024-02-09T08:02:11.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.844+0000 7fc1ab7fe640 10 monclient: _check_auth_tickets 2024-02-09T08:02:11.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.844+0000 7fc1ab7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:02:11.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.844+0000 7fc1ab7fe640 1 -- 172.21.15.103:0/4188115716 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc19c031940 con 0x7fc1ac0a9be0 2024-02-09T08:02:11.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.844+0000 7fc1ab7fe640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:02:11.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.844+0000 7fc1ab7fe640 1 -- 172.21.15.103:0/4188115716 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c031cd0 con 0x7fc1ac0a9be0 2024-02-09T08:02:11.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.844+0000 7fc1ab7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:11.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.844+0000 7fc1ab7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:02:11.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.844+0000 7fc1ab7fe640 10 monclient: dump: 2024-02-09T08:02:11.855 INFO:teuthology.orchestra.run.smithi103.stderr:epoch 1 2024-02-09T08:02:11.855 INFO:teuthology.orchestra.run.smithi103.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:11.855 INFO:teuthology.orchestra.run.smithi103.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:11.855 INFO:teuthology.orchestra.run.smithi103.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:11.855 INFO:teuthology.orchestra.run.smithi103.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:11.855 INFO:teuthology.orchestra.run.smithi103.stderr:election_strategy: 1 2024-02-09T08:02:11.855 INFO:teuthology.orchestra.run.smithi103.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:11.855 INFO:teuthology.orchestra.run.smithi103.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:11.856 INFO:teuthology.orchestra.run.smithi103.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:11.856 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:02:11.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.844+0000 7fc1b31a6640 5 monclient: authenticate success, global_id 4129 2024-02-09T08:02:11.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.844+0000 7fc1b31a6640 10 monclient: get_monmap_and_config success 2024-02-09T08:02:11.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.844+0000 7fc1b31a6640 4 set_mon_vals no callback set 2024-02-09T08:02:11.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.844+0000 7fc1b31a6640 10 monclient: shutdown 2024-02-09T08:02:11.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.844+0000 7fc1b31a6640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:02:11.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.844+0000 7fc1b31a6640 1 -- 172.21.15.103:0/4188115716 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1ac0a9be0 msgr2=0x7fc1ac13fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:11.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.844+0000 7fc1b31a6640 1 --2- 172.21.15.103:0/4188115716 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1ac0a9be0 0x7fc1ac13fd00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc19c009870 tx=0x7fc19c02b880 comp rx=0 tx=0).stop 2024-02-09T08:02:11.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.844+0000 7fc1b31a6640 1 -- 172.21.15.103:0/4188115716 shutdown_connections 2024-02-09T08:02:11.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.844+0000 7fc1b31a6640 1 --2- 172.21.15.103:0/4188115716 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1ac0a9be0 0x7fc1ac13fd00 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:11.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.844+0000 7fc1b31a6640 1 --2- 172.21.15.103:0/4188115716 >> v2:172.21.15.62:3300/0 conn(0x7fc1ac06c320 0x7fc1ac13f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:11.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.844+0000 7fc1b31a6640 1 -- 172.21.15.103:0/4188115716 >> 172.21.15.103:0/4188115716 conn(0x7fc1ac0b4db0 msgr2=0x7fc1ac0b51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:02:11.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.844+0000 7fc1b31a6640 1 -- 172.21.15.103:0/4188115716 shutdown_connections 2024-02-09T08:02:11.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.844+0000 7fc1b31a6640 1 -- 172.21.15.103:0/4188115716 wait complete. 2024-02-09T08:02:11.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.845+0000 7fc1b31a6640 10 monclient: build_initial_monmap 2024-02-09T08:02:11.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.845+0000 7fc1b31a6640 10 monclient: monmap: 2024-02-09T08:02:11.857 INFO:teuthology.orchestra.run.smithi103.stderr:epoch 0 2024-02-09T08:02:11.858 INFO:teuthology.orchestra.run.smithi103.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:02:11.858 INFO:teuthology.orchestra.run.smithi103.stderr:last_changed 0.000000 2024-02-09T08:02:11.858 INFO:teuthology.orchestra.run.smithi103.stderr:created 0.000000 2024-02-09T08:02:11.858 INFO:teuthology.orchestra.run.smithi103.stderr:min_mon_release 0 (unknown) 2024-02-09T08:02:11.858 INFO:teuthology.orchestra.run.smithi103.stderr:election_strategy: 1 2024-02-09T08:02:11.858 INFO:teuthology.orchestra.run.smithi103.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:02:11.858 INFO:teuthology.orchestra.run.smithi103.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:02:11.858 INFO:teuthology.orchestra.run.smithi103.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:02:11.858 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:02:11.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.846+0000 7fc1b31a6640 1 librados: starting msgr at 2024-02-09T08:02:11.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.846+0000 7fc1b31a6640 1 librados: starting objecter 2024-02-09T08:02:11.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.846+0000 7fc1b31a6640 1 Processor -- start 2024-02-09T08:02:11.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.846+0000 7fc1b31a6640 1 -- start start 2024-02-09T08:02:11.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.846+0000 7fc1b31a6640 1 librados: setting wanted keys 2024-02-09T08:02:11.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.846+0000 7fc1b31a6640 1 librados: calling monclient init 2024-02-09T08:02:11.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.846+0000 7fc1b31a6640 10 monclient: init 2024-02-09T08:02:11.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.847+0000 7fc1b31a6640 10 monclient: _reopen_session rank -1 2024-02-09T08:02:11.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.847+0000 7fc1b31a6640 10 monclient: _add_conns ranks=[1,2,0] 2024-02-09T08:02:11.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.847+0000 7fc1b31a6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1ac06c320 0x7fc1ac138390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:11.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.847+0000 7fc1b31a6640 10 monclient(hunting): picked mon.noname-b con 0x7fc1ac06c320 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:02:11.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.847+0000 7fc1b31a6640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc1ac0a9be0 0x7fc1ac1d7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:11.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.847+0000 7fc1b31a6640 10 monclient(hunting): picked mon.noname-c con 0x7fc1ac0a9be0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:02:11.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.847+0000 7fc1b31a6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1ac0b2280 0x7fc1ac133ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:11.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.847+0000 7fc1b31a6640 10 monclient(hunting): picked mon.noname-a con 0x7fc1ac0b2280 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:02:11.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.847+0000 7fc1b31a6640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:11.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.847+0000 7fc1b31a6640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac139530 con 0x7fc1ac0b2280 2024-02-09T08:02:11.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.847+0000 7fc1b31a6640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:11.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.847+0000 7fc1b31a6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac1d7660 con 0x7fc1ac06c320 2024-02-09T08:02:11.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.847+0000 7fc1b31a6640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:11.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.847+0000 7fc1b31a6640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac139710 con 0x7fc1ac0a9be0 2024-02-09T08:02:11.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.847+0000 7fc1b31a6640 10 monclient(hunting): _renew_subs 2024-02-09T08:02:11.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.847+0000 7fc1b31a6640 10 monclient(hunting): authenticate will time out at 1455.044895s 2024-02-09T08:02:11.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.848+0000 7fc1b0f42640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1ac06c320 0x7fc1ac138390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:11.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.848+0000 7fc1abfff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc1ac0a9be0 0x7fc1ac1d7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:11.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.848+0000 7fc1b1743640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1ac0b2280 0x7fc1ac133ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:11.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.848+0000 7fc1b0f42640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1ac06c320 0x7fc1ac138390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:32826/0 (socket says 172.21.15.103:32826) 2024-02-09T08:02:11.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.848+0000 7fc1b0f42640 1 -- 172.21.15.103:0/3398612427 learned_addr learned my addr 172.21.15.103:0/3398612427 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-02-09T08:02:11.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.848+0000 7fc1b0f42640 10 monclient(hunting): get_auth_request con 0x7fc1ac06c320 auth_method 0 2024-02-09T08:02:11.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.848+0000 7fc1b0f42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:11.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.848+0000 7fc1b0f42640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:11.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.848+0000 7fc1b0f42640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:11.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.848+0000 7fc1abfff640 10 monclient(hunting): get_auth_request con 0x7fc1ac0a9be0 auth_method 0 2024-02-09T08:02:11.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.848+0000 7fc1abfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:11.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.848+0000 7fc1abfff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:11.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.848+0000 7fc1abfff640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:11.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.848+0000 7fc1b1743640 10 monclient(hunting): get_auth_request con 0x7fc1ac0b2280 auth_method 0 2024-02-09T08:02:11.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.848+0000 7fc1b1743640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:11.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.848+0000 7fc1b1743640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:11.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.848+0000 7fc1b1743640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:11.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.849+0000 7fc1b0f42640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:11.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.849+0000 7fc1b0f42640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:11.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.849+0000 7fc1b0f42640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:11.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.849+0000 7fc1abfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:11.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.849+0000 7fc1abfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:11.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.849+0000 7fc1abfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:11.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.849+0000 7fc1b1743640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:11.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.849+0000 7fc1b1743640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:11.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.849+0000 7fc1b1743640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:11.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.851+0000 7fc1b0f42640 10 monclient(hunting): handle_auth_done global_id 4132 payload 824 2024-02-09T08:02:11.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.851+0000 7fc1b0f42640 1 -- 172.21.15.103:0/3398612427 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc1ac0a9be0 msgr2=0x7fc1ac1d7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:11.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.851+0000 7fc1b0f42640 1 --2- 172.21.15.103:0/3398612427 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc1ac0a9be0 0x7fc1ac1d7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:11.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.851+0000 7fc1b0f42640 1 -- 172.21.15.103:0/3398612427 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1ac0b2280 msgr2=0x7fc1ac133ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:11.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.851+0000 7fc1b0f42640 1 --2- 172.21.15.103:0/3398612427 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1ac0b2280 0x7fc1ac133ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:11.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.851+0000 7fc1b0f42640 10 monclient: _finish_hunting 0 2024-02-09T08:02:11.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.851+0000 7fc1b0f42640 1 monclient: found mon.noname-b 2024-02-09T08:02:11.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.851+0000 7fc1b0f42640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:02:11.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.851+0000 7fc1b0f42640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.103:3300/0 2024-02-09T08:02:11.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.851+0000 7fc1b0f42640 1 -- 172.21.15.103:0/3398612427 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc19c0094d0 con 0x7fc1ac06c320 2024-02-09T08:02:11.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.853+0000 7fc1b0f42640 1 --2- 172.21.15.103:0/3398612427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1ac06c320 0x7fc1ac138390 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4009db0 tx=0x7fc1a400c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:02:11.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.853+0000 7fc1a97fa640 10 client.?.objecter ms_handle_connect 0x7fc1ac06c320 2024-02-09T08:02:11.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.853+0000 7fc1a97fa640 10 client.?.objecter resend_mon_ops 2024-02-09T08:02:11.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.857+0000 7fc1a97fa640 1 -- 172.21.15.103:0/3398612427 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a4014480 con 0x7fc1ac06c320 2024-02-09T08:02:11.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.857+0000 7fc1a97fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:11.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.857+0000 7fc1a97fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:02:11.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.857+0000 7fc1a97fa640 10 monclient: dump: 2024-02-09T08:02:11.867 INFO:teuthology.orchestra.run.smithi103.stderr:epoch 1 2024-02-09T08:02:11.867 INFO:teuthology.orchestra.run.smithi103.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:11.867 INFO:teuthology.orchestra.run.smithi103.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:11.867 INFO:teuthology.orchestra.run.smithi103.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:11.867 INFO:teuthology.orchestra.run.smithi103.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:11.867 INFO:teuthology.orchestra.run.smithi103.stderr:election_strategy: 1 2024-02-09T08:02:11.867 INFO:teuthology.orchestra.run.smithi103.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:11.867 INFO:teuthology.orchestra.run.smithi103.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:11.867 INFO:teuthology.orchestra.run.smithi103.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:11.867 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:02:11.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.857+0000 7fc1a97fa640 10 monclient: _finish_auth 0 2024-02-09T08:02:11.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.857+0000 7fc1a97fa640 10 monclient: _check_auth_tickets 2024-02-09T08:02:11.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.857+0000 7fc1a97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:02:11.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.857+0000 7fc1a97fa640 1 -- 172.21.15.103:0/3398612427 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a400f040 con 0x7fc1ac06c320 2024-02-09T08:02:11.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.857+0000 7fc1a97fa640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:02:11.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.857+0000 7fc1a97fa640 1 -- 172.21.15.103:0/3398612427 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a4014800 con 0x7fc1ac06c320 2024-02-09T08:02:11.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.857+0000 7fc1b31a6640 5 monclient: authenticate success, global_id 4132 2024-02-09T08:02:11.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.857+0000 7fc1a97fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:11.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.857+0000 7fc1a97fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:02:11.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.857+0000 7fc1a97fa640 10 monclient: dump: 2024-02-09T08:02:11.868 INFO:teuthology.orchestra.run.smithi103.stderr:epoch 1 2024-02-09T08:02:11.868 INFO:teuthology.orchestra.run.smithi103.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:11.869 INFO:teuthology.orchestra.run.smithi103.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:11.869 INFO:teuthology.orchestra.run.smithi103.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:11.869 INFO:teuthology.orchestra.run.smithi103.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:11.869 INFO:teuthology.orchestra.run.smithi103.stderr:election_strategy: 1 2024-02-09T08:02:11.869 INFO:teuthology.orchestra.run.smithi103.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:11.869 INFO:teuthology.orchestra.run.smithi103.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:11.869 INFO:teuthology.orchestra.run.smithi103.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:11.869 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:02:11.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.857+0000 7fc1b31a6640 10 monclient: _renew_subs 2024-02-09T08:02:11.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.857+0000 7fc1b31a6640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:02:11.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.857+0000 7fc1aaffd640 4 set_mon_vals no callback set 2024-02-09T08:02:11.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.857+0000 7fc1b31a6640 1 -- 172.21.15.103:0/3398612427 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1ac1434d0 con 0x7fc1ac06c320 2024-02-09T08:02:11.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.857+0000 7fc1b31a6640 10 client.4132.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:02:11.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.857+0000 7fc1b31a6640 10 monclient: _renew_subs 2024-02-09T08:02:11.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.857+0000 7fc1b31a6640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:02:11.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.857+0000 7fc1b31a6640 1 -- 172.21.15.103:0/3398612427 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1ac1405a0 con 0x7fc1ac06c320 2024-02-09T08:02:11.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.857+0000 7fc1b31a6640 1 librados: init done 2024-02-09T08:02:11.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.858+0000 7fc1b31a6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:02:11.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.858+0000 7fc1b31a6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:02:11.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.858+0000 7fc1b31a6640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:02:11.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.858+0000 7fc1b31a6640 1 -- 172.21.15.103:0/3398612427 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1ac04ef90 con 0x7fc1ac06c320 2024-02-09T08:02:11.882 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-02-09T08:02:11.880+0000 7fa0f91f1040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-09T08:02:11.911 INFO:tasks.ceph.mgr.y.smithi062.stderr:2024-02-09T08:02:11.909+0000 7f96d1c3f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-09T08:02:11.956 INFO:tasks.ceph.mgr.y.smithi062.stderr:2024-02-09T08:02:11.954+0000 7f96d1c3f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-09T08:02:11.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.958+0000 7fc1a97fa640 1 -- 172.21.15.103:0/3398612427 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fc1a4014cf0 con 0x7fc1ac06c320 2024-02-09T08:02:11.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.958+0000 7fc1a97fa640 1 -- 172.21.15.103:0/3398612427 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fc1a4013870 con 0x7fc1ac06c320 2024-02-09T08:02:11.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.958+0000 7fc1a97fa640 10 client.4132.objecter ms_dispatch 0x7fc1ac000b90 osd_map(5..5 src has 1..5) v4 2024-02-09T08:02:11.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.958+0000 7fc1a97fa640 3 client.4132.objecter handle_osd_map got epochs [5,5] > 0 2024-02-09T08:02:11.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.958+0000 7fc1a97fa640 3 client.4132.objecter handle_osd_map decoding full epoch 5 2024-02-09T08:02:11.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.958+0000 7fc1a97fa640 20 client.4132.objecter dump_active .. 0 homeless 2024-02-09T08:02:11.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.958+0000 7fc1a97fa640 1 -- 172.21.15.103:0/3398612427 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fc1a4018020 con 0x7fc1ac06c320 2024-02-09T08:02:11.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.959+0000 7fc1a97fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:02:11.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:11.959+0000 7fc1a97fa640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:02:12.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.031+0000 7fc1b31a6640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "3657c103-db3d-46c5-8afc-2b0b9da1e2e3", "id": 3}] 2024-02-09T08:02:12.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.031+0000 7fc1b31a6640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "3657c103-db3d-46c5-8afc-2b0b9da1e2e3", "id": 3}] 2024-02-09T08:02:12.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.031+0000 7fc1b31a6640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:02:12.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.031+0000 7fc1b31a6640 1 -- 172.21.15.103:0/3398612427 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3657c103-db3d-46c5-8afc-2b0b9da1e2e3", "id": 3} v 0) v1 -- 0x7fc1ac071270 con 0x7fc1ac06c320 2024-02-09T08:02:12.042 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-02-09T08:02:12.040+0000 7fa0f91f1040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-09T08:02:12.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.114+0000 7fc1a97fa640 1 -- 172.21.15.103:0/3398612427 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3657c103-db3d-46c5-8afc-2b0b9da1e2e3", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc1a4013670 con 0x7fc1ac06c320 2024-02-09T08:02:12.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.114+0000 7fc1a97fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "3657c103-db3d-46c5-8afc-2b0b9da1e2e3", "id": 3}] 2024-02-09T08:02:12.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.114+0000 7fc1a97fa640 10 monclient: _finish_command 2 = system:0 2024-02-09T08:02:12.116 INFO:teuthology.orchestra.run.smithi103.stdout:3 2024-02-09T08:02:12.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.114+0000 7fc1b31a6640 10 librados: watch_flush enter 2024-02-09T08:02:12.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.115+0000 7fc1b31a6640 10 librados: watch_flush exit 2024-02-09T08:02:12.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.115+0000 7fc1b31a6640 20 client.4132.objecter shutdown clearing up homeless session... 2024-02-09T08:02:12.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.115+0000 7fc1b31a6640 10 client.4132.objecter successfully canceled tick 2024-02-09T08:02:12.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.115+0000 7fc1b31a6640 10 monclient: shutdown 2024-02-09T08:02:12.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.115+0000 7fc1b31a6640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:02:12.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.115+0000 7fc1b31a6640 1 -- 172.21.15.103:0/3398612427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1ac06c320 msgr2=0x7fc1ac138390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:12.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.115+0000 7fc1b31a6640 1 --2- 172.21.15.103:0/3398612427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1ac06c320 0x7fc1ac138390 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4009db0 tx=0x7fc1a400c490 comp rx=0 tx=0).stop 2024-02-09T08:02:12.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.115+0000 7fc1b31a6640 1 -- 172.21.15.103:0/3398612427 shutdown_connections 2024-02-09T08:02:12.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.115+0000 7fc1b31a6640 1 --2- 172.21.15.103:0/3398612427 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1ac0b2280 0x7fc1ac133ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:12.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.115+0000 7fc1b31a6640 1 --2- 172.21.15.103:0/3398612427 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc1ac0a9be0 0x7fc1ac1d7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:12.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.115+0000 7fc1b31a6640 1 --2- 172.21.15.103:0/3398612427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1ac06c320 0x7fc1ac138390 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:12.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.115+0000 7fc1b31a6640 1 -- 172.21.15.103:0/3398612427 >> 172.21.15.103:0/3398612427 conn(0x7fc1ac0b4db0 msgr2=0x7fc1ac0b5190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:02:12.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.115+0000 7fc1b31a6640 1 -- 172.21.15.103:0/3398612427 shutdown_connections 2024-02-09T08:02:12.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.115+0000 7fc1b31a6640 1 -- 172.21.15.103:0/3398612427 wait complete. 2024-02-09T08:02:12.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.115+0000 7fc1b31a6640 1 librados: shutdown 2024-02-09T08:02:12.121 INFO:tasks.ceph.mgr.y.smithi062.stderr:2024-02-09T08:02:12.118+0000 7f96d1c3f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-09T08:02:12.127 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph osd new faf5e721-fa06-43f8-9b72-36ca8132ffea 4 2024-02-09T08:02:12.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.226+0000 7ff72442d640 10 monclient: get_monmap_and_config 2024-02-09T08:02:12.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.226+0000 7ff72442d640 10 monclient: build_initial_monmap 2024-02-09T08:02:12.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.227+0000 7ff72442d640 10 monclient: monmap: 2024-02-09T08:02:12.229 INFO:teuthology.orchestra.run.smithi103.stderr:epoch 0 2024-02-09T08:02:12.229 INFO:teuthology.orchestra.run.smithi103.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:12.229 INFO:teuthology.orchestra.run.smithi103.stderr:last_changed 2024-02-09T08:02:12.227493+0000 2024-02-09T08:02:12.229 INFO:teuthology.orchestra.run.smithi103.stderr:created 2024-02-09T08:02:12.227493+0000 2024-02-09T08:02:12.229 INFO:teuthology.orchestra.run.smithi103.stderr:min_mon_release 0 (unknown) 2024-02-09T08:02:12.229 INFO:teuthology.orchestra.run.smithi103.stderr:election_strategy: 1 2024-02-09T08:02:12.229 INFO:teuthology.orchestra.run.smithi103.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:02:12.229 INFO:teuthology.orchestra.run.smithi103.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:02:12.229 INFO:teuthology.orchestra.run.smithi103.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:02:12.229 INFO:teuthology.orchestra.run.smithi103.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:02:12.230 INFO:teuthology.orchestra.run.smithi103.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:02:12.230 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:02:12.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.227+0000 7ff72442d640 1 Processor -- start 2024-02-09T08:02:12.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.227+0000 7ff72442d640 1 -- start start 2024-02-09T08:02:12.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.227+0000 7ff72442d640 10 monclient: init 2024-02-09T08:02:12.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.228+0000 7ff72442d640 10 monclient: _reopen_session rank -1 2024-02-09T08:02:12.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.228+0000 7ff72442d640 10 monclient: _add_conns ranks=[3,0,1,4,2] 2024-02-09T08:02:12.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.228+0000 7ff72442d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff71c06c320 0x7ff71c13f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:12.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.228+0000 7ff72442d640 10 monclient(hunting): picked mon.noname-a con 0x7ff71c06c320 addr v2:172.21.15.62:3300/0 2024-02-09T08:02:12.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.228+0000 7ff72442d640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff71c0a9be0 addr v1:172.21.15.62:6789/0 2024-02-09T08:02:12.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.228+0000 7ff72442d640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ff71c0b2280 addr v1:172.21.15.103:6789/0 2024-02-09T08:02:12.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.228+0000 7ff72442d640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff71c0aa130 con 0x7ff71c0a9be0 2024-02-09T08:02:12.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.228+0000 7ff72442d640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff71c0aa5c0 con 0x7ff71c0b2280 2024-02-09T08:02:12.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.228+0000 7ff72442d640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:12.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.228+0000 7ff72442d640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff71c06c700 con 0x7ff71c06c320 2024-02-09T08:02:12.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.228+0000 7ff72442d640 10 monclient(hunting): _renew_subs 2024-02-09T08:02:12.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.228+0000 7ff72442d640 10 monclient(hunting): authenticate will time out at 1455.425592s 2024-02-09T08:02:12.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.229+0000 7ff7229ca640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff71c0b2280 0x7ff71c14cdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46818/0 (socket says 172.21.15.103:46818) 2024-02-09T08:02:12.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.229+0000 7ff7229ca640 1 -- 172.21.15.103:0/4158699664 learned_addr learned my addr 172.21.15.103:0/4158699664 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-02-09T08:02:12.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.229+0000 7ff7221c9640 1 --2- 172.21.15.103:0/4158699664 >> v2:172.21.15.62:3300/0 conn(0x7ff71c06c320 0x7ff71c13f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:12.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.229+0000 7ff7221c9640 10 monclient(hunting): get_auth_request con 0x7ff71c06c320 auth_method 0 2024-02-09T08:02:12.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.229+0000 7ff7221c9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:12.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.229+0000 7ff7221c9640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:12.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.229+0000 7ff7221c9640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:12.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.230+0000 7ff7221c9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:12.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.230+0000 7ff7221c9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:12.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.230+0000 7ff7221c9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:12.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.231+0000 7ff7211c7640 1 -- 172.21.15.103:0/4158699664 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3721275015 0 0) 0x7ff71c0aa5c0 con 0x7ff71c0b2280 2024-02-09T08:02:12.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.231+0000 7ff7211c7640 10 monclient(hunting): _negotiate 2024-02-09T08:02:12.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.231+0000 7ff7211c7640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:12.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.231+0000 7ff7211c7640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:12.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.231+0000 7ff7211c7640 10 monclient(hunting): my global_id is 4135 2024-02-09T08:02:12.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.231+0000 7ff7211c7640 1 -- 172.21.15.103:0/4158699664 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff708003520 con 0x7ff71c0b2280 2024-02-09T08:02:12.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.232+0000 7ff7221c9640 10 monclient(hunting): handle_auth_done global_id 4131 payload 274 2024-02-09T08:02:12.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.232+0000 7ff7221c9640 1 -- 172.21.15.103:0/4158699664 >> v1:172.21.15.103:6789/0 conn(0x7ff71c0b2280 legacy=0x7ff71c14cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:12.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.232+0000 7ff7221c9640 1 -- 172.21.15.103:0/4158699664 >> v1:172.21.15.62:6789/0 conn(0x7ff71c0a9be0 legacy=0x7ff71c145ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:12.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.232+0000 7ff7221c9640 10 monclient: _finish_hunting 0 2024-02-09T08:02:12.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.232+0000 7ff7221c9640 1 monclient: found mon.noname-a 2024-02-09T08:02:12.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.232+0000 7ff7221c9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:02:12.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.232+0000 7ff7221c9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-02-09T08:02:12.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.232+0000 7ff7221c9640 1 -- 172.21.15.103:0/4158699664 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff71c0ab5f0 con 0x7ff71c06c320 2024-02-09T08:02:12.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.235+0000 7ff7221c9640 1 --2- 172.21.15.103:0/4158699664 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff71c06c320 0x7ff71c13f7c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff70c0097d0 tx=0x7ff70c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=474bddfc6e87b038 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:02:12.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.238+0000 7ff7211c7640 1 -- 172.21.15.103:0/4158699664 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70c02e070 con 0x7ff71c06c320 2024-02-09T08:02:12.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.238+0000 7ff7211c7640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:12.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.238+0000 7ff7211c7640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-09T08:02:12.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.238+0000 7ff7211c7640 10 monclient: dump: 2024-02-09T08:02:12.240 INFO:teuthology.orchestra.run.smithi103.stderr:epoch 1 2024-02-09T08:02:12.240 INFO:teuthology.orchestra.run.smithi103.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:12.241 INFO:teuthology.orchestra.run.smithi103.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:12.241 INFO:teuthology.orchestra.run.smithi103.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:12.241 INFO:teuthology.orchestra.run.smithi103.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:12.241 INFO:teuthology.orchestra.run.smithi103.stderr:election_strategy: 1 2024-02-09T08:02:12.241 INFO:teuthology.orchestra.run.smithi103.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:12.241 INFO:teuthology.orchestra.run.smithi103.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:12.241 INFO:teuthology.orchestra.run.smithi103.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:12.241 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:02:12.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.238+0000 7ff7211c7640 10 monclient: _finish_auth 0 2024-02-09T08:02:12.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.238+0000 7ff7211c7640 10 monclient: _check_auth_tickets 2024-02-09T08:02:12.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.238+0000 7ff7211c7640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:02:12.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.238+0000 7ff7211c7640 1 -- 172.21.15.103:0/4158699664 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff70c0315a0 con 0x7ff71c06c320 2024-02-09T08:02:12.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.238+0000 7ff7211c7640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:02:12.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.238+0000 7ff7211c7640 1 -- 172.21.15.103:0/4158699664 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70c031930 con 0x7ff71c06c320 2024-02-09T08:02:12.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.238+0000 7ff72442d640 5 monclient: authenticate success, global_id 4131 2024-02-09T08:02:12.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.238+0000 7ff72442d640 10 monclient: get_monmap_and_config success 2024-02-09T08:02:12.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.238+0000 7ff72442d640 4 set_mon_vals no callback set 2024-02-09T08:02:12.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.238+0000 7ff7211c7640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:12.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.238+0000 7ff7211c7640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-09T08:02:12.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.238+0000 7ff7211c7640 10 monclient: dump: 2024-02-09T08:02:12.242 INFO:teuthology.orchestra.run.smithi103.stderr:epoch 1 2024-02-09T08:02:12.242 INFO:teuthology.orchestra.run.smithi103.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:12.242 INFO:teuthology.orchestra.run.smithi103.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:12.242 INFO:teuthology.orchestra.run.smithi103.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:12.242 INFO:teuthology.orchestra.run.smithi103.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:12.242 INFO:teuthology.orchestra.run.smithi103.stderr:election_strategy: 1 2024-02-09T08:02:12.242 INFO:teuthology.orchestra.run.smithi103.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:12.242 INFO:teuthology.orchestra.run.smithi103.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:12.242 INFO:teuthology.orchestra.run.smithi103.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:12.243 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:02:12.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.239+0000 7ff72442d640 10 monclient: shutdown 2024-02-09T08:02:12.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.239+0000 7ff72442d640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:02:12.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.239+0000 7ff72442d640 1 -- 172.21.15.103:0/4158699664 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff71c06c320 msgr2=0x7ff71c13f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:12.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.239+0000 7ff72442d640 1 --2- 172.21.15.103:0/4158699664 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff71c06c320 0x7ff71c13f7c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff70c0097d0 tx=0x7ff70c02b840 comp rx=0 tx=0).stop 2024-02-09T08:02:12.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.239+0000 7ff72442d640 1 -- 172.21.15.103:0/4158699664 shutdown_connections 2024-02-09T08:02:12.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.239+0000 7ff72442d640 1 --2- 172.21.15.103:0/4158699664 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff71c06c320 0x7ff71c13f7c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:12.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.239+0000 7ff72442d640 1 -- 172.21.15.103:0/4158699664 >> 172.21.15.103:0/4158699664 conn(0x7ff71c0b4db0 msgr2=0x7ff71c0b51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:02:12.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.239+0000 7ff72442d640 1 -- 172.21.15.103:0/4158699664 shutdown_connections 2024-02-09T08:02:12.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.239+0000 7ff72442d640 1 -- 172.21.15.103:0/4158699664 wait complete. 2024-02-09T08:02:12.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.240+0000 7ff72442d640 10 monclient: build_initial_monmap 2024-02-09T08:02:12.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.240+0000 7ff72442d640 10 monclient: monmap: 2024-02-09T08:02:12.247 INFO:teuthology.orchestra.run.smithi103.stderr:epoch 0 2024-02-09T08:02:12.247 INFO:teuthology.orchestra.run.smithi103.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:02:12.247 INFO:teuthology.orchestra.run.smithi103.stderr:last_changed 0.000000 2024-02-09T08:02:12.247 INFO:teuthology.orchestra.run.smithi103.stderr:created 0.000000 2024-02-09T08:02:12.247 INFO:teuthology.orchestra.run.smithi103.stderr:min_mon_release 0 (unknown) 2024-02-09T08:02:12.247 INFO:teuthology.orchestra.run.smithi103.stderr:election_strategy: 1 2024-02-09T08:02:12.247 INFO:teuthology.orchestra.run.smithi103.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:02:12.247 INFO:teuthology.orchestra.run.smithi103.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:02:12.247 INFO:teuthology.orchestra.run.smithi103.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:02:12.247 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:02:12.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.240+0000 7ff72442d640 1 librados: starting msgr at 2024-02-09T08:02:12.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.240+0000 7ff72442d640 1 librados: starting objecter 2024-02-09T08:02:12.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.240+0000 7ff72442d640 1 Processor -- start 2024-02-09T08:02:12.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.240+0000 7ff72442d640 1 -- start start 2024-02-09T08:02:12.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.240+0000 7ff72442d640 1 librados: setting wanted keys 2024-02-09T08:02:12.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.240+0000 7ff72442d640 1 librados: calling monclient init 2024-02-09T08:02:12.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.240+0000 7ff72442d640 10 monclient: init 2024-02-09T08:02:12.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.241+0000 7ff72442d640 10 monclient: _reopen_session rank -1 2024-02-09T08:02:12.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.241+0000 7ff72442d640 10 monclient: _add_conns ranks=[0,1,2] 2024-02-09T08:02:12.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.241+0000 7ff72442d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff71c06c320 0x7ff71c0ae360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:12.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.241+0000 7ff72442d640 10 monclient(hunting): picked mon.noname-a con 0x7ff71c06c320 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:02:12.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.241+0000 7ff72442d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff71c0a9be0 0x7ff71c1da9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:12.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.241+0000 7ff72442d640 10 monclient(hunting): picked mon.noname-b con 0x7ff71c0a9be0 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:02:12.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.241+0000 7ff72442d640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff71c0b2280 0x7ff71c1daf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:12.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.241+0000 7ff72442d640 10 monclient(hunting): picked mon.noname-c con 0x7ff71c0b2280 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:02:12.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.241+0000 7ff72442d640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:12.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.241+0000 7ff72442d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff71c0aeb30 con 0x7ff71c06c320 2024-02-09T08:02:12.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.241+0000 7ff72442d640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:12.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.241+0000 7ff72442d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff71c0af6d0 con 0x7ff71c0a9be0 2024-02-09T08:02:12.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.241+0000 7ff72442d640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:12.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.241+0000 7ff72442d640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff71c0af840 con 0x7ff71c0b2280 2024-02-09T08:02:12.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.241+0000 7ff72442d640 10 monclient(hunting): _renew_subs 2024-02-09T08:02:12.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.241+0000 7ff72442d640 10 monclient(hunting): authenticate will time out at 1455.438557s 2024-02-09T08:02:12.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.241+0000 7ff7219c8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff71c0a9be0 0x7ff71c1da9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:12.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.241+0000 7ff7221c9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff71c06c320 0x7ff71c0ae360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:12.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.241+0000 7ff7229ca640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff71c0b2280 0x7ff71c1daf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:12.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.242+0000 7ff7229ca640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff71c0b2280 0x7ff71c1daf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.103:59118/0 (socket says 172.21.15.103:59118) 2024-02-09T08:02:12.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.242+0000 7ff7229ca640 1 -- 172.21.15.103:0/4285227370 learned_addr learned my addr 172.21.15.103:0/4285227370 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-02-09T08:02:12.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.242+0000 7ff7229ca640 10 monclient(hunting): get_auth_request con 0x7ff71c0b2280 auth_method 0 2024-02-09T08:02:12.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.242+0000 7ff7229ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:12.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.242+0000 7ff7229ca640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:12.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.242+0000 7ff7229ca640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:12.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.242+0000 7ff7221c9640 10 monclient(hunting): get_auth_request con 0x7ff71c06c320 auth_method 0 2024-02-09T08:02:12.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.242+0000 7ff7221c9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:12.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.242+0000 7ff7221c9640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:12.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.242+0000 7ff7221c9640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:12.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.242+0000 7ff7219c8640 10 monclient(hunting): get_auth_request con 0x7ff71c0a9be0 auth_method 0 2024-02-09T08:02:12.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.242+0000 7ff7219c8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:12.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.242+0000 7ff7219c8640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:12.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.242+0000 7ff7219c8640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:12.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.242+0000 7ff7229ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:12.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.242+0000 7ff7229ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:12.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.242+0000 7ff7229ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:12.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.242+0000 7ff7219c8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:12.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.242+0000 7ff7219c8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:12.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.242+0000 7ff7219c8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:12.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.243+0000 7ff7221c9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:12.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.243+0000 7ff7221c9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:12.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.243+0000 7ff7221c9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:12.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.245+0000 7ff7229ca640 10 monclient(hunting): handle_auth_done global_id 4130 payload 824 2024-02-09T08:02:12.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.245+0000 7ff7229ca640 1 -- 172.21.15.103:0/4285227370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff71c0a9be0 msgr2=0x7ff71c1da9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:12.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.245+0000 7ff7229ca640 1 --2- 172.21.15.103:0/4285227370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff71c0a9be0 0x7ff71c1da9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:12.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.245+0000 7ff7229ca640 1 -- 172.21.15.103:0/4285227370 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff71c06c320 msgr2=0x7ff71c0ae360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:12.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.245+0000 7ff7229ca640 1 --2- 172.21.15.103:0/4285227370 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff71c06c320 0x7ff71c0ae360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:12.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.245+0000 7ff7229ca640 10 monclient: _finish_hunting 0 2024-02-09T08:02:12.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.245+0000 7ff7229ca640 1 monclient: found mon.noname-c 2024-02-09T08:02:12.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.245+0000 7ff7229ca640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:02:12.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.245+0000 7ff7229ca640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-02-09T08:02:12.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.245+0000 7ff7229ca640 1 -- 172.21.15.103:0/4285227370 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff70c009400 con 0x7ff71c0b2280 2024-02-09T08:02:12.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.248+0000 7ff7229ca640 1 --2- 172.21.15.103:0/4285227370 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff71c0b2280 0x7ff71c1daf20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff71400caa0 tx=0x7ff71400cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:02:12.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.248+0000 7ff712ffd640 10 client.?.objecter ms_handle_connect 0x7ff71c0b2280 2024-02-09T08:02:12.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.248+0000 7ff712ffd640 10 client.?.objecter resend_mon_ops 2024-02-09T08:02:12.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.251+0000 7ff712ffd640 1 -- 172.21.15.103:0/4285227370 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71400ac00 con 0x7ff71c0b2280 2024-02-09T08:02:12.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.251+0000 7ff712ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:12.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.251+0000 7ff712ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-09T08:02:12.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.251+0000 7ff712ffd640 10 monclient: dump: 2024-02-09T08:02:12.254 INFO:teuthology.orchestra.run.smithi103.stderr:epoch 1 2024-02-09T08:02:12.254 INFO:teuthology.orchestra.run.smithi103.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:12.255 INFO:teuthology.orchestra.run.smithi103.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:12.255 INFO:teuthology.orchestra.run.smithi103.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:12.255 INFO:teuthology.orchestra.run.smithi103.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:12.255 INFO:teuthology.orchestra.run.smithi103.stderr:election_strategy: 1 2024-02-09T08:02:12.255 INFO:teuthology.orchestra.run.smithi103.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:12.255 INFO:teuthology.orchestra.run.smithi103.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:12.255 INFO:teuthology.orchestra.run.smithi103.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:12.255 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:02:12.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.251+0000 7ff712ffd640 10 monclient: _finish_auth 0 2024-02-09T08:02:12.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.251+0000 7ff712ffd640 10 monclient: _check_auth_tickets 2024-02-09T08:02:12.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.251+0000 7ff712ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:02:12.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.251+0000 7ff712ffd640 1 -- 172.21.15.103:0/4285227370 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff71400ad60 con 0x7ff71c0b2280 2024-02-09T08:02:12.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.251+0000 7ff712ffd640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:02:12.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.251+0000 7ff712ffd640 1 -- 172.21.15.103:0/4285227370 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff714012600 con 0x7ff71c0b2280 2024-02-09T08:02:12.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.251+0000 7ff712ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:12.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.251+0000 7ff712ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-09T08:02:12.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.251+0000 7ff712ffd640 10 monclient: dump: 2024-02-09T08:02:12.256 INFO:teuthology.orchestra.run.smithi103.stderr:epoch 1 2024-02-09T08:02:12.256 INFO:teuthology.orchestra.run.smithi103.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:12.256 INFO:teuthology.orchestra.run.smithi103.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:12.256 INFO:teuthology.orchestra.run.smithi103.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:12.256 INFO:teuthology.orchestra.run.smithi103.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:12.256 INFO:teuthology.orchestra.run.smithi103.stderr:election_strategy: 1 2024-02-09T08:02:12.256 INFO:teuthology.orchestra.run.smithi103.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:12.256 INFO:teuthology.orchestra.run.smithi103.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:12.256 INFO:teuthology.orchestra.run.smithi103.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:12.256 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:02:12.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.251+0000 7ff72442d640 5 monclient: authenticate success, global_id 4130 2024-02-09T08:02:12.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.251+0000 7ff72442d640 10 monclient: _renew_subs 2024-02-09T08:02:12.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.251+0000 7ff7209c6640 4 set_mon_vals no callback set 2024-02-09T08:02:12.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.251+0000 7ff72442d640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:02:12.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.251+0000 7ff72442d640 1 -- 172.21.15.103:0/4285227370 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff71c0af240 con 0x7ff71c0b2280 2024-02-09T08:02:12.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.251+0000 7ff72442d640 10 client.4130.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:02:12.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.251+0000 7ff72442d640 10 monclient: _renew_subs 2024-02-09T08:02:12.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.251+0000 7ff72442d640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:02:12.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.251+0000 7ff72442d640 1 -- 172.21.15.103:0/4285227370 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff71c1db640 con 0x7ff71c0b2280 2024-02-09T08:02:12.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.251+0000 7ff72442d640 1 librados: init done 2024-02-09T08:02:12.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.252+0000 7ff72442d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:02:12.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.252+0000 7ff72442d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:02:12.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.252+0000 7ff72442d640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:02:12.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.252+0000 7ff72442d640 1 -- 172.21.15.103:0/4285227370 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff71c04ef90 con 0x7ff71c0b2280 2024-02-09T08:02:12.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.359+0000 7ff712ffd640 1 -- 172.21.15.103:0/4285227370 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7ff714012760 con 0x7ff71c0b2280 2024-02-09T08:02:12.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.363+0000 7ff712ffd640 1 -- 172.21.15.103:0/4285227370 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7ff714007580 con 0x7ff71c0b2280 2024-02-09T08:02:12.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.363+0000 7ff712ffd640 10 client.4130.objecter ms_dispatch 0x7ff71c000b90 osd_map(6..6 src has 1..6) v4 2024-02-09T08:02:12.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.363+0000 7ff712ffd640 3 client.4130.objecter handle_osd_map got epochs [6,6] > 0 2024-02-09T08:02:12.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.363+0000 7ff712ffd640 3 client.4130.objecter handle_osd_map decoding full epoch 6 2024-02-09T08:02:12.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.363+0000 7ff712ffd640 20 client.4130.objecter dump_active .. 0 homeless 2024-02-09T08:02:12.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.363+0000 7ff712ffd640 1 -- 172.21.15.103:0/4285227370 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7ff714021060 con 0x7ff71c0b2280 2024-02-09T08:02:12.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.363+0000 7ff712ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:02:12.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.363+0000 7ff712ffd640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:02:12.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.435+0000 7ff72442d640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "faf5e721-fa06-43f8-9b72-36ca8132ffea", "id": 4}] 2024-02-09T08:02:12.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.435+0000 7ff72442d640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "faf5e721-fa06-43f8-9b72-36ca8132ffea", "id": 4}] 2024-02-09T08:02:12.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.435+0000 7ff72442d640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:02:12.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.435+0000 7ff72442d640 1 -- 172.21.15.103:0/4285227370 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd new", "uuid": "faf5e721-fa06-43f8-9b72-36ca8132ffea", "id": 4} v 0) v1 -- 0x7ff71c0b0d70 con 0x7ff71c0b2280 2024-02-09T08:02:12.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.526+0000 7ff712ffd640 1 -- 172.21.15.103:0/4285227370 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "faf5e721-fa06-43f8-9b72-36ca8132ffea", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff714017070 con 0x7ff71c0b2280 2024-02-09T08:02:12.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.526+0000 7ff712ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "faf5e721-fa06-43f8-9b72-36ca8132ffea", "id": 4}] 2024-02-09T08:02:12.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.526+0000 7ff712ffd640 10 monclient: _finish_command 2 = system:0 2024-02-09T08:02:12.529 INFO:teuthology.orchestra.run.smithi103.stdout:4 2024-02-09T08:02:12.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.527+0000 7ff72442d640 10 librados: watch_flush enter 2024-02-09T08:02:12.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.527+0000 7ff72442d640 10 librados: watch_flush exit 2024-02-09T08:02:12.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.527+0000 7ff72442d640 20 client.4130.objecter shutdown clearing up homeless session... 2024-02-09T08:02:12.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.527+0000 7ff72442d640 10 client.4130.objecter successfully canceled tick 2024-02-09T08:02:12.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.527+0000 7ff72442d640 10 monclient: shutdown 2024-02-09T08:02:12.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.527+0000 7ff72442d640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:02:12.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.527+0000 7ff72442d640 1 -- 172.21.15.103:0/4285227370 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff71c0b2280 msgr2=0x7ff71c1daf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:12.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.527+0000 7ff72442d640 1 --2- 172.21.15.103:0/4285227370 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff71c0b2280 0x7ff71c1daf20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff71400caa0 tx=0x7ff71400cf60 comp rx=0 tx=0).stop 2024-02-09T08:02:12.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.527+0000 7ff72442d640 1 -- 172.21.15.103:0/4285227370 shutdown_connections 2024-02-09T08:02:12.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.527+0000 7ff72442d640 1 --2- 172.21.15.103:0/4285227370 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff71c0b2280 0x7ff71c1daf20 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:12.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.527+0000 7ff72442d640 1 --2- 172.21.15.103:0/4285227370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff71c0a9be0 0x7ff71c1da9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:12.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.527+0000 7ff72442d640 1 --2- 172.21.15.103:0/4285227370 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff71c06c320 0x7ff71c0ae360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:12.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.527+0000 7ff72442d640 1 -- 172.21.15.103:0/4285227370 >> 172.21.15.103:0/4285227370 conn(0x7ff71c0b4db0 msgr2=0x7ff71c069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:02:12.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.527+0000 7ff72442d640 1 -- 172.21.15.103:0/4285227370 shutdown_connections 2024-02-09T08:02:12.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.527+0000 7ff72442d640 1 -- 172.21.15.103:0/4285227370 wait complete. 2024-02-09T08:02:12.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.527+0000 7ff72442d640 1 librados: shutdown 2024-02-09T08:02:12.539 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph osd new 5c96dba1-53d2-4c0c-8928-5f09ea17a984 5 2024-02-09T08:02:12.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.641+0000 7f32aa1f0640 10 monclient: get_monmap_and_config 2024-02-09T08:02:12.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.641+0000 7f32aa1f0640 10 monclient: build_initial_monmap 2024-02-09T08:02:12.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.642+0000 7f32aa1f0640 10 monclient: monmap: 2024-02-09T08:02:12.644 INFO:teuthology.orchestra.run.smithi103.stderr:epoch 0 2024-02-09T08:02:12.644 INFO:teuthology.orchestra.run.smithi103.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:12.644 INFO:teuthology.orchestra.run.smithi103.stderr:last_changed 2024-02-09T08:02:12.642494+0000 2024-02-09T08:02:12.644 INFO:teuthology.orchestra.run.smithi103.stderr:created 2024-02-09T08:02:12.642494+0000 2024-02-09T08:02:12.644 INFO:teuthology.orchestra.run.smithi103.stderr:min_mon_release 0 (unknown) 2024-02-09T08:02:12.644 INFO:teuthology.orchestra.run.smithi103.stderr:election_strategy: 1 2024-02-09T08:02:12.645 INFO:teuthology.orchestra.run.smithi103.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:02:12.645 INFO:teuthology.orchestra.run.smithi103.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:02:12.645 INFO:teuthology.orchestra.run.smithi103.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:02:12.645 INFO:teuthology.orchestra.run.smithi103.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:02:12.645 INFO:teuthology.orchestra.run.smithi103.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:02:12.645 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:02:12.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.642+0000 7f32aa1f0640 1 Processor -- start 2024-02-09T08:02:12.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.642+0000 7f32aa1f0640 1 -- start start 2024-02-09T08:02:12.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.642+0000 7f32aa1f0640 10 monclient: init 2024-02-09T08:02:12.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.643+0000 7f32aa1f0640 10 monclient: _reopen_session rank -1 2024-02-09T08:02:12.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.643+0000 7f32aa1f0640 10 monclient: _add_conns ranks=[3,0,1,4,2] 2024-02-09T08:02:12.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.643+0000 7f32aa1f0640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f32a406c320 0x7f32a413f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:12.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.643+0000 7f32aa1f0640 10 monclient(hunting): picked mon.noname-a con 0x7f32a406c320 addr v2:172.21.15.62:3300/0 2024-02-09T08:02:12.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.643+0000 7f32aa1f0640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f32a40a9be0 addr v1:172.21.15.62:6789/0 2024-02-09T08:02:12.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.643+0000 7f32aa1f0640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f32a40b2280 addr v1:172.21.15.103:6789/0 2024-02-09T08:02:12.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.643+0000 7f32aa1f0640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32a40aa130 con 0x7f32a40a9be0 2024-02-09T08:02:12.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.643+0000 7f32aa1f0640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32a40aa5c0 con 0x7f32a40b2280 2024-02-09T08:02:12.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.643+0000 7f32aa1f0640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:12.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.643+0000 7f32aa1f0640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32a406c700 con 0x7f32a406c320 2024-02-09T08:02:12.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.643+0000 7f32aa1f0640 10 monclient(hunting): _renew_subs 2024-02-09T08:02:12.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.643+0000 7f32aa1f0640 10 monclient(hunting): authenticate will time out at 1455.840644s 2024-02-09T08:02:12.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.644+0000 7f32a3fff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f32a40b2280 0x7f32a414cdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46826/0 (socket says 172.21.15.103:46826) 2024-02-09T08:02:12.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.644+0000 7f32a3fff640 1 -- 172.21.15.103:0/3662875492 learned_addr learned my addr 172.21.15.103:0/3662875492 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-02-09T08:02:12.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.644+0000 7f32a37fe640 1 --2- 172.21.15.103:0/3662875492 >> v2:172.21.15.62:3300/0 conn(0x7f32a406c320 0x7f32a413f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:12.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.644+0000 7f32a37fe640 10 monclient(hunting): get_auth_request con 0x7f32a406c320 auth_method 0 2024-02-09T08:02:12.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.644+0000 7f32a37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:12.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.644+0000 7f32a37fe640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:12.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.644+0000 7f32a37fe640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:12.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.645+0000 7f32a37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:12.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.645+0000 7f32a37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:12.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.645+0000 7f32a37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:12.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.646+0000 7f32a27fc640 1 -- 172.21.15.103:0/3662875492 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 152030998 0 0) 0x7f32a40aa5c0 con 0x7f32a40b2280 2024-02-09T08:02:12.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.646+0000 7f32a27fc640 10 monclient(hunting): _negotiate 2024-02-09T08:02:12.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.646+0000 7f32a27fc640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:12.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.646+0000 7f32a27fc640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:12.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.646+0000 7f32a27fc640 10 monclient(hunting): my global_id is 4141 2024-02-09T08:02:12.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.646+0000 7f32a27fc640 1 -- 172.21.15.103:0/3662875492 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f328c003520 con 0x7f32a40b2280 2024-02-09T08:02:12.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.647+0000 7f32a37fe640 10 monclient(hunting): handle_auth_done global_id 4137 payload 274 2024-02-09T08:02:12.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.647+0000 7f32a37fe640 1 -- 172.21.15.103:0/3662875492 >> v1:172.21.15.103:6789/0 conn(0x7f32a40b2280 legacy=0x7f32a414cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:12.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.647+0000 7f32a37fe640 1 -- 172.21.15.103:0/3662875492 >> v1:172.21.15.62:6789/0 conn(0x7f32a40a9be0 legacy=0x7f32a4145ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:12.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.647+0000 7f32a37fe640 10 monclient: _finish_hunting 0 2024-02-09T08:02:12.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.647+0000 7f32a37fe640 1 monclient: found mon.noname-a 2024-02-09T08:02:12.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.647+0000 7f32a37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:02:12.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.647+0000 7f32a37fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-02-09T08:02:12.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.647+0000 7f32a37fe640 1 -- 172.21.15.103:0/3662875492 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a40ab5f0 con 0x7f32a406c320 2024-02-09T08:02:12.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.653+0000 7f32a37fe640 1 --2- 172.21.15.103:0/3662875492 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32a406c320 0x7f32a413f7c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f32940097d0 tx=0x7f329402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e489b3a606bf9c8b server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:02:12.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.655+0000 7f32a27fc640 1 -- 172.21.15.103:0/3662875492 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329402e070 con 0x7f32a406c320 2024-02-09T08:02:12.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.655+0000 7f32a27fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:12.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.655+0000 7f32a27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-09T08:02:12.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.655+0000 7f32a27fc640 10 monclient: dump: 2024-02-09T08:02:12.658 INFO:teuthology.orchestra.run.smithi103.stderr:epoch 1 2024-02-09T08:02:12.658 INFO:teuthology.orchestra.run.smithi103.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:12.658 INFO:teuthology.orchestra.run.smithi103.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:12.659 INFO:teuthology.orchestra.run.smithi103.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:12.659 INFO:teuthology.orchestra.run.smithi103.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:12.659 INFO:teuthology.orchestra.run.smithi103.stderr:election_strategy: 1 2024-02-09T08:02:12.659 INFO:teuthology.orchestra.run.smithi103.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:12.659 INFO:teuthology.orchestra.run.smithi103.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:12.659 INFO:teuthology.orchestra.run.smithi103.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:12.659 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:02:12.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.655+0000 7f32a27fc640 10 monclient: _finish_auth 0 2024-02-09T08:02:12.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.655+0000 7f32a27fc640 10 monclient: _check_auth_tickets 2024-02-09T08:02:12.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.655+0000 7f32a27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:02:12.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.655+0000 7f32aa1f0640 5 monclient: authenticate success, global_id 4137 2024-02-09T08:02:12.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.655+0000 7f32aa1f0640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-02-09T08:02:12.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.656+0000 7f32a27fc640 1 -- 172.21.15.103:0/3662875492 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32940315a0 con 0x7f32a406c320 2024-02-09T08:02:12.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.656+0000 7f32a27fc640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:02:12.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.656+0000 7f32a27fc640 1 -- 172.21.15.103:0/3662875492 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3294031910 con 0x7f32a406c320 2024-02-09T08:02:12.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.656+0000 7f32aa1f0640 10 monclient: get_monmap_and_config success 2024-02-09T08:02:12.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.656+0000 7f32aa1f0640 4 set_mon_vals no callback set 2024-02-09T08:02:12.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.656+0000 7f32a27fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:12.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.656+0000 7f32a27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-09T08:02:12.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.656+0000 7f32a27fc640 10 monclient: dump: 2024-02-09T08:02:12.665 INFO:teuthology.orchestra.run.smithi103.stderr:epoch 1 2024-02-09T08:02:12.665 INFO:teuthology.orchestra.run.smithi103.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:12.665 INFO:teuthology.orchestra.run.smithi103.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:12.665 INFO:teuthology.orchestra.run.smithi103.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:12.665 INFO:teuthology.orchestra.run.smithi103.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:12.665 INFO:teuthology.orchestra.run.smithi103.stderr:election_strategy: 1 2024-02-09T08:02:12.666 INFO:teuthology.orchestra.run.smithi103.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:12.666 INFO:teuthology.orchestra.run.smithi103.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:12.666 INFO:teuthology.orchestra.run.smithi103.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:12.666 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:02:12.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.657+0000 7f32aa1f0640 10 monclient: shutdown 2024-02-09T08:02:12.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.657+0000 7f32aa1f0640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:02:12.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.657+0000 7f32aa1f0640 1 -- 172.21.15.103:0/3662875492 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32a406c320 msgr2=0x7f32a413f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:12.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.657+0000 7f32aa1f0640 1 --2- 172.21.15.103:0/3662875492 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32a406c320 0x7f32a413f7c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f32940097d0 tx=0x7f329402b840 comp rx=0 tx=0).stop 2024-02-09T08:02:12.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.657+0000 7f32aa1f0640 1 -- 172.21.15.103:0/3662875492 shutdown_connections 2024-02-09T08:02:12.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.657+0000 7f32aa1f0640 1 --2- 172.21.15.103:0/3662875492 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32a406c320 0x7f32a413f7c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:12.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.657+0000 7f32aa1f0640 1 -- 172.21.15.103:0/3662875492 >> 172.21.15.103:0/3662875492 conn(0x7f32a40b4db0 msgr2=0x7f32a40b51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:02:12.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.657+0000 7f32aa1f0640 1 -- 172.21.15.103:0/3662875492 shutdown_connections 2024-02-09T08:02:12.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.657+0000 7f32aa1f0640 1 -- 172.21.15.103:0/3662875492 wait complete. 2024-02-09T08:02:12.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.658+0000 7f32aa1f0640 10 monclient: build_initial_monmap 2024-02-09T08:02:12.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.658+0000 7f32aa1f0640 10 monclient: monmap: 2024-02-09T08:02:12.667 INFO:teuthology.orchestra.run.smithi103.stderr:epoch 0 2024-02-09T08:02:12.667 INFO:teuthology.orchestra.run.smithi103.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:02:12.667 INFO:teuthology.orchestra.run.smithi103.stderr:last_changed 0.000000 2024-02-09T08:02:12.667 INFO:teuthology.orchestra.run.smithi103.stderr:created 0.000000 2024-02-09T08:02:12.667 INFO:teuthology.orchestra.run.smithi103.stderr:min_mon_release 0 (unknown) 2024-02-09T08:02:12.667 INFO:teuthology.orchestra.run.smithi103.stderr:election_strategy: 1 2024-02-09T08:02:12.667 INFO:teuthology.orchestra.run.smithi103.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:02:12.667 INFO:teuthology.orchestra.run.smithi103.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:02:12.667 INFO:teuthology.orchestra.run.smithi103.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:02:12.667 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:02:12.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.658+0000 7f32aa1f0640 1 librados: starting msgr at 2024-02-09T08:02:12.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.658+0000 7f32aa1f0640 1 librados: starting objecter 2024-02-09T08:02:12.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.658+0000 7f32aa1f0640 1 Processor -- start 2024-02-09T08:02:12.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.658+0000 7f32aa1f0640 1 -- start start 2024-02-09T08:02:12.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.658+0000 7f32aa1f0640 1 librados: setting wanted keys 2024-02-09T08:02:12.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.658+0000 7f32aa1f0640 1 librados: calling monclient init 2024-02-09T08:02:12.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.658+0000 7f32aa1f0640 10 monclient: init 2024-02-09T08:02:12.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.659+0000 7f32aa1f0640 10 monclient: _reopen_session rank -1 2024-02-09T08:02:12.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.659+0000 7f32aa1f0640 10 monclient: _add_conns ranks=[2,0,1] 2024-02-09T08:02:12.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.659+0000 7f32aa1f0640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f32a406c320 0x7f32a40b1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:12.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.659+0000 7f32aa1f0640 10 monclient(hunting): picked mon.noname-c con 0x7f32a406c320 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:02:12.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.659+0000 7f32aa1f0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32a40a9be0 0x7f32a41dad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:12.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.659+0000 7f32aa1f0640 10 monclient(hunting): picked mon.noname-a con 0x7f32a40a9be0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:02:12.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.659+0000 7f32aa1f0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32a40b2280 0x7f32a41db860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:12.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.659+0000 7f32aa1f0640 10 monclient(hunting): picked mon.noname-b con 0x7f32a40b2280 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:02:12.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.659+0000 7f32aa1f0640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:12.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.659+0000 7f32aa1f0640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a41d53f0 con 0x7f32a40a9be0 2024-02-09T08:02:12.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.659+0000 7f32aa1f0640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:12.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.659+0000 7f32aa1f0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a40b09a0 con 0x7f32a40b2280 2024-02-09T08:02:12.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.659+0000 7f32aa1f0640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:12.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.659+0000 7f32aa1f0640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32a41db340 con 0x7f32a406c320 2024-02-09T08:02:12.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.659+0000 7f32aa1f0640 10 monclient(hunting): _renew_subs 2024-02-09T08:02:12.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.659+0000 7f32aa1f0640 10 monclient(hunting): authenticate will time out at 1455.856650s 2024-02-09T08:02:12.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.659+0000 7f32a2ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32a40a9be0 0x7f32a41dad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:12.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.659+0000 7f32a3fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32a40b2280 0x7f32a41db860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:12.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.659+0000 7f32a37fe640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f32a406c320 0x7f32a40b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:12.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.660+0000 7f32a2ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32a40a9be0 0x7f32a41dad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.103:55394/0 (socket says 172.21.15.103:55394) 2024-02-09T08:02:12.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.660+0000 7f32a2ffd640 1 -- 172.21.15.103:0/2203607893 learned_addr learned my addr 172.21.15.103:0/2203607893 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-02-09T08:02:12.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.660+0000 7f32a2ffd640 10 monclient(hunting): get_auth_request con 0x7f32a40a9be0 auth_method 0 2024-02-09T08:02:12.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.660+0000 7f32a2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:12.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.660+0000 7f32a2ffd640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:12.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.660+0000 7f32a2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:12.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.660+0000 7f32a37fe640 10 monclient(hunting): get_auth_request con 0x7f32a406c320 auth_method 0 2024-02-09T08:02:12.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.660+0000 7f32a37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:12.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.660+0000 7f32a37fe640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:12.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.660+0000 7f32a37fe640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:12.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.660+0000 7f32a3fff640 10 monclient(hunting): get_auth_request con 0x7f32a40b2280 auth_method 0 2024-02-09T08:02:12.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.660+0000 7f32a3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:12.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.660+0000 7f32a3fff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:12.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.660+0000 7f32a3fff640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:12.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.660+0000 7f32a2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:12.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.660+0000 7f32a2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:12.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.660+0000 7f32a2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:12.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.660+0000 7f32a37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:12.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.660+0000 7f32a37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:12.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.660+0000 7f32a37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:12.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.660+0000 7f32a3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:12.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.660+0000 7f32a3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:12.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.660+0000 7f32a3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:12.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.663+0000 7f32a3fff640 10 monclient(hunting): handle_auth_done global_id 4144 payload 824 2024-02-09T08:02:12.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.663+0000 7f32a3fff640 1 -- 172.21.15.103:0/2203607893 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f32a406c320 msgr2=0x7f32a40b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:12.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.663+0000 7f32a3fff640 1 --2- 172.21.15.103:0/2203607893 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f32a406c320 0x7f32a40b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:12.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.663+0000 7f32a3fff640 1 -- 172.21.15.103:0/2203607893 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32a40a9be0 msgr2=0x7f32a41dad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:12.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.663+0000 7f32a3fff640 1 --2- 172.21.15.103:0/2203607893 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32a40a9be0 0x7f32a41dad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:12.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.663+0000 7f32a3fff640 10 monclient: _finish_hunting 0 2024-02-09T08:02:12.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.663+0000 7f32a3fff640 1 monclient: found mon.noname-b 2024-02-09T08:02:12.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.663+0000 7f32a3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:02:12.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.663+0000 7f32a3fff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.103:3300/0 2024-02-09T08:02:12.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.663+0000 7f32a3fff640 1 -- 172.21.15.103:0/2203607893 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3294009400 con 0x7f32a40b2280 2024-02-09T08:02:12.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.665+0000 7f32a3fff640 1 --2- 172.21.15.103:0/2203607893 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32a40b2280 0x7f32a41db860 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f329c00ca70 tx=0x7f329c00ce70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:02:12.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.665+0000 7f328bfff640 10 client.?.objecter ms_handle_connect 0x7f32a40b2280 2024-02-09T08:02:12.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.665+0000 7f328bfff640 10 client.?.objecter resend_mon_ops 2024-02-09T08:02:12.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.669+0000 7f328bfff640 1 -- 172.21.15.103:0/2203607893 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329c00ab10 con 0x7f32a40b2280 2024-02-09T08:02:12.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.669+0000 7f328bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:12.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.669+0000 7f328bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:02:12.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.669+0000 7f328bfff640 10 monclient: dump: 2024-02-09T08:02:12.675 INFO:teuthology.orchestra.run.smithi103.stderr:epoch 1 2024-02-09T08:02:12.675 INFO:teuthology.orchestra.run.smithi103.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:12.675 INFO:teuthology.orchestra.run.smithi103.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:12.675 INFO:teuthology.orchestra.run.smithi103.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:12.675 INFO:teuthology.orchestra.run.smithi103.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:12.675 INFO:teuthology.orchestra.run.smithi103.stderr:election_strategy: 1 2024-02-09T08:02:12.675 INFO:teuthology.orchestra.run.smithi103.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:12.675 INFO:teuthology.orchestra.run.smithi103.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:12.675 INFO:teuthology.orchestra.run.smithi103.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:12.675 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:02:12.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.669+0000 7f328bfff640 10 monclient: _finish_auth 0 2024-02-09T08:02:12.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.669+0000 7f328bfff640 10 monclient: _check_auth_tickets 2024-02-09T08:02:12.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.669+0000 7f328bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:02:12.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.669+0000 7f328bfff640 1 -- 172.21.15.103:0/2203607893 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f329c00ac70 con 0x7f32a40b2280 2024-02-09T08:02:12.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.669+0000 7f328bfff640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:02:12.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.669+0000 7f328bfff640 1 -- 172.21.15.103:0/2203607893 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329c012600 con 0x7f32a40b2280 2024-02-09T08:02:12.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.669+0000 7f328bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:12.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.669+0000 7f328bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:02:12.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.669+0000 7f328bfff640 10 monclient: dump: 2024-02-09T08:02:12.676 INFO:teuthology.orchestra.run.smithi103.stderr:epoch 1 2024-02-09T08:02:12.676 INFO:teuthology.orchestra.run.smithi103.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:12.676 INFO:teuthology.orchestra.run.smithi103.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:12.676 INFO:teuthology.orchestra.run.smithi103.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:12.676 INFO:teuthology.orchestra.run.smithi103.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:12.676 INFO:teuthology.orchestra.run.smithi103.stderr:election_strategy: 1 2024-02-09T08:02:12.676 INFO:teuthology.orchestra.run.smithi103.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:12.676 INFO:teuthology.orchestra.run.smithi103.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:12.676 INFO:teuthology.orchestra.run.smithi103.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:12.677 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:02:12.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.669+0000 7f32aa1f0640 5 monclient: authenticate success, global_id 4144 2024-02-09T08:02:12.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.669+0000 7f32aa1f0640 10 monclient: _renew_subs 2024-02-09T08:02:12.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.669+0000 7f32aa1f0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:02:12.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.669+0000 7f32aa1f0640 1 -- 172.21.15.103:0/2203607893 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32a40b1b70 con 0x7f32a40b2280 2024-02-09T08:02:12.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.669+0000 7f32a1ffb640 4 set_mon_vals no callback set 2024-02-09T08:02:12.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.669+0000 7f32aa1f0640 10 client.4144.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:02:12.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.669+0000 7f32aa1f0640 10 monclient: _renew_subs 2024-02-09T08:02:12.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.669+0000 7f32aa1f0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:02:12.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.669+0000 7f32aa1f0640 1 -- 172.21.15.103:0/2203607893 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32a40ae4b0 con 0x7f32a40b2280 2024-02-09T08:02:12.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.669+0000 7f32aa1f0640 1 librados: init done 2024-02-09T08:02:12.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.670+0000 7f32aa1f0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:02:12.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.670+0000 7f32aa1f0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:02:12.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.670+0000 7f32aa1f0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:02:12.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.670+0000 7f32aa1f0640 1 -- 172.21.15.103:0/2203607893 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32a404ef90 con 0x7f32a40b2280 2024-02-09T08:02:12.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.770+0000 7f328bfff640 1 -- 172.21.15.103:0/2203607893 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f329c012760 con 0x7f32a40b2280 2024-02-09T08:02:12.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.770+0000 7f328bfff640 1 -- 172.21.15.103:0/2203607893 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f329c0075f0 con 0x7f32a40b2280 2024-02-09T08:02:12.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.770+0000 7f328bfff640 10 client.4144.objecter ms_dispatch 0x7f32a4000b90 osd_map(7..7 src has 1..7) v4 2024-02-09T08:02:12.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.770+0000 7f328bfff640 3 client.4144.objecter handle_osd_map got epochs [7,7] > 0 2024-02-09T08:02:12.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.770+0000 7f328bfff640 3 client.4144.objecter handle_osd_map decoding full epoch 7 2024-02-09T08:02:12.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.770+0000 7f328bfff640 20 client.4144.objecter dump_active .. 0 homeless 2024-02-09T08:02:12.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.770+0000 7f328bfff640 1 -- 172.21.15.103:0/2203607893 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f329c021060 con 0x7f32a40b2280 2024-02-09T08:02:12.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.770+0000 7f328bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:02:12.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.770+0000 7f328bfff640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:02:12.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.843+0000 7f32aa1f0640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "5c96dba1-53d2-4c0c-8928-5f09ea17a984", "id": 5}] 2024-02-09T08:02:12.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.843+0000 7f32aa1f0640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "5c96dba1-53d2-4c0c-8928-5f09ea17a984", "id": 5}] 2024-02-09T08:02:12.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.843+0000 7f32aa1f0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:02:12.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.843+0000 7f32aa1f0640 1 -- 172.21.15.103:0/2203607893 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5c96dba1-53d2-4c0c-8928-5f09ea17a984", "id": 5} v 0) v1 -- 0x7f32a41db500 con 0x7f32a40b2280 2024-02-09T08:02:12.872 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-02-09T08:02:12.869+0000 7fa0f91f1040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-09T08:02:12.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.915+0000 7f328bfff640 1 -- 172.21.15.103:0/2203607893 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5c96dba1-53d2-4c0c-8928-5f09ea17a984", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f329c017070 con 0x7f32a40b2280 2024-02-09T08:02:12.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.916+0000 7f328bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "5c96dba1-53d2-4c0c-8928-5f09ea17a984", "id": 5}] 2024-02-09T08:02:12.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.916+0000 7f328bfff640 10 monclient: _finish_command 2 = system:0 2024-02-09T08:02:12.919 INFO:teuthology.orchestra.run.smithi103.stdout:5 2024-02-09T08:02:12.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.916+0000 7f32aa1f0640 10 librados: watch_flush enter 2024-02-09T08:02:12.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.916+0000 7f32aa1f0640 10 librados: watch_flush exit 2024-02-09T08:02:12.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.916+0000 7f32aa1f0640 20 client.4144.objecter shutdown clearing up homeless session... 2024-02-09T08:02:12.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.916+0000 7f32aa1f0640 10 client.4144.objecter successfully canceled tick 2024-02-09T08:02:12.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.916+0000 7f32aa1f0640 10 monclient: shutdown 2024-02-09T08:02:12.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.916+0000 7f32aa1f0640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:02:12.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.916+0000 7f32aa1f0640 1 -- 172.21.15.103:0/2203607893 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32a40b2280 msgr2=0x7f32a41db860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:12.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.916+0000 7f32aa1f0640 1 --2- 172.21.15.103:0/2203607893 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32a40b2280 0x7f32a41db860 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f329c00ca70 tx=0x7f329c00ce70 comp rx=0 tx=0).stop 2024-02-09T08:02:12.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.916+0000 7f32aa1f0640 1 -- 172.21.15.103:0/2203607893 shutdown_connections 2024-02-09T08:02:12.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.916+0000 7f32aa1f0640 1 --2- 172.21.15.103:0/2203607893 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32a40b2280 0x7f32a41db860 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:12.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.917+0000 7f32aa1f0640 1 --2- 172.21.15.103:0/2203607893 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32a40a9be0 0x7f32a41dad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:12.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.917+0000 7f32aa1f0640 1 --2- 172.21.15.103:0/2203607893 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f32a406c320 0x7f32a40b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:12.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.917+0000 7f32aa1f0640 1 -- 172.21.15.103:0/2203607893 >> 172.21.15.103:0/2203607893 conn(0x7f32a40b4db0 msgr2=0x7f32a40b3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:02:12.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.917+0000 7f32aa1f0640 1 -- 172.21.15.103:0/2203607893 shutdown_connections 2024-02-09T08:02:12.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.917+0000 7f32aa1f0640 1 -- 172.21.15.103:0/2203607893 wait complete. 2024-02-09T08:02:12.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:12.917+0000 7f32aa1f0640 1 librados: shutdown 2024-02-09T08:02:12.929 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph osd new 3473844d-d631-4ea4-96fb-638eccee5cb6 6 2024-02-09T08:02:12.983 INFO:tasks.ceph.mgr.y.smithi062.stderr:2024-02-09T08:02:12.980+0000 7f96d1c3f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-09T08:02:13.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.028+0000 7f2e476de640 10 monclient: get_monmap_and_config 2024-02-09T08:02:13.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.028+0000 7f2e476de640 10 monclient: build_initial_monmap 2024-02-09T08:02:13.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.028+0000 7f2e476de640 10 monclient: monmap: 2024-02-09T08:02:13.030 INFO:teuthology.orchestra.run.smithi103.stderr:epoch 0 2024-02-09T08:02:13.030 INFO:teuthology.orchestra.run.smithi103.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:13.030 INFO:teuthology.orchestra.run.smithi103.stderr:last_changed 2024-02-09T08:02:13.028817+0000 2024-02-09T08:02:13.030 INFO:teuthology.orchestra.run.smithi103.stderr:created 2024-02-09T08:02:13.028817+0000 2024-02-09T08:02:13.030 INFO:teuthology.orchestra.run.smithi103.stderr:min_mon_release 0 (unknown) 2024-02-09T08:02:13.030 INFO:teuthology.orchestra.run.smithi103.stderr:election_strategy: 1 2024-02-09T08:02:13.030 INFO:teuthology.orchestra.run.smithi103.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:02:13.030 INFO:teuthology.orchestra.run.smithi103.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:02:13.030 INFO:teuthology.orchestra.run.smithi103.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:02:13.030 INFO:teuthology.orchestra.run.smithi103.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:02:13.031 INFO:teuthology.orchestra.run.smithi103.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:02:13.031 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:02:13.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.028+0000 7f2e476de640 1 Processor -- start 2024-02-09T08:02:13.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.029+0000 7f2e476de640 1 -- start start 2024-02-09T08:02:13.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.029+0000 7f2e476de640 10 monclient: init 2024-02-09T08:02:13.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.029+0000 7f2e476de640 10 monclient: _reopen_session rank -1 2024-02-09T08:02:13.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.029+0000 7f2e476de640 10 monclient: _add_conns ranks=[3,4,0,1,2] 2024-02-09T08:02:13.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.029+0000 7f2e476de640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2e4006be10 0x7f2e400a9670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:13.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.029+0000 7f2e476de640 10 monclient(hunting): picked mon.noname-a con 0x7f2e4006be10 addr v2:172.21.15.62:3300/0 2024-02-09T08:02:13.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.029+0000 7f2e476de640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2e400b44c0 0x7f2e4013f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:13.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.029+0000 7f2e476de640 10 monclient(hunting): picked mon.noname-c con 0x7f2e400b44c0 addr v2:172.21.15.103:3300/0 2024-02-09T08:02:13.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.029+0000 7f2e476de640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f2e4013fd70 addr v1:172.21.15.62:6789/0 2024-02-09T08:02:13.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.029+0000 7f2e476de640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e401401a0 con 0x7f2e4013fd70 2024-02-09T08:02:13.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.029+0000 7f2e476de640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:13.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.029+0000 7f2e476de640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e4006c1f0 con 0x7f2e4006be10 2024-02-09T08:02:13.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.029+0000 7f2e476de640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:13.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.029+0000 7f2e476de640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e400a9e90 con 0x7f2e400b44c0 2024-02-09T08:02:13.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.029+0000 7f2e476de640 10 monclient(hunting): _renew_subs 2024-02-09T08:02:13.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.029+0000 7f2e476de640 10 monclient(hunting): authenticate will time out at 1456.226930s 2024-02-09T08:02:13.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.030+0000 7f2e44c79640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2e400b44c0 0x7f2e4013f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:13.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.030+0000 7f2e4547a640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2e4006be10 0x7f2e400a9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:13.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.030+0000 7f2e44c79640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2e400b44c0 0x7f2e4013f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:32852/0 (socket says 172.21.15.103:32852) 2024-02-09T08:02:13.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.030+0000 7f2e44c79640 1 -- 172.21.15.103:0/1500063996 learned_addr learned my addr 172.21.15.103:0/1500063996 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-02-09T08:02:13.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.030+0000 7f2e44c79640 10 monclient(hunting): get_auth_request con 0x7f2e400b44c0 auth_method 0 2024-02-09T08:02:13.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.030+0000 7f2e44c79640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:13.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.030+0000 7f2e44c79640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:13.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.030+0000 7f2e44c79640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:13.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.030+0000 7f2e4547a640 10 monclient(hunting): get_auth_request con 0x7f2e4006be10 auth_method 0 2024-02-09T08:02:13.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.030+0000 7f2e4547a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:13.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.030+0000 7f2e4547a640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:13.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.030+0000 7f2e4547a640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:13.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.031+0000 7f2e44c79640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:13.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.031+0000 7f2e44c79640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:13.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.031+0000 7f2e44c79640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:13.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.031+0000 7f2e4547a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:13.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.031+0000 7f2e4547a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:13.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.031+0000 7f2e4547a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:13.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.032+0000 7f2e44c79640 10 monclient(hunting): handle_auth_done global_id 4147 payload 274 2024-02-09T08:02:13.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.032+0000 7f2e44c79640 1 -- 172.21.15.103:0/1500063996 >> v2:172.21.15.62:3300/0 conn(0x7f2e4006be10 msgr2=0x7f2e400a9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:02:13.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.032+0000 7f2e44c79640 1 --2- 172.21.15.103:0/1500063996 >> v2:172.21.15.62:3300/0 conn(0x7f2e4006be10 0x7f2e400a9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:13.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.032+0000 7f2e44c79640 1 -- 172.21.15.103:0/1500063996 >> v1:172.21.15.62:6789/0 conn(0x7f2e4013fd70 legacy=0x7f2e40145a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:13.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.032+0000 7f2e44c79640 10 monclient: _finish_hunting 0 2024-02-09T08:02:13.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.032+0000 7f2e44c79640 1 monclient: found mon.noname-c 2024-02-09T08:02:13.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.032+0000 7f2e44c79640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:02:13.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.032+0000 7f2e44c79640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.103:3300/0 2024-02-09T08:02:13.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.032+0000 7f2e44c79640 1 -- 172.21.15.103:0/1500063996 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e400a9bb0 con 0x7f2e400b44c0 2024-02-09T08:02:13.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.034+0000 7f2e44c79640 1 --2- 172.21.15.103:0/1500063996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e400b44c0 0x7f2e4013f830 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2e400b48a0 tx=0x7f2e3c02b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3b5c99458b5b5e5 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:02:13.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.037+0000 7f2e37fff640 1 -- 172.21.15.103:0/1500063996 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c031870 con 0x7f2e400b44c0 2024-02-09T08:02:13.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.038+0000 7f2e37fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:13.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.038+0000 7f2e37fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-09T08:02:13.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.038+0000 7f2e37fff640 10 monclient: dump: 2024-02-09T08:02:13.040 INFO:teuthology.orchestra.run.smithi103.stderr:epoch 1 2024-02-09T08:02:13.040 INFO:teuthology.orchestra.run.smithi103.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:13.040 INFO:teuthology.orchestra.run.smithi103.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:13.040 INFO:teuthology.orchestra.run.smithi103.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:13.040 INFO:teuthology.orchestra.run.smithi103.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:13.040 INFO:teuthology.orchestra.run.smithi103.stderr:election_strategy: 1 2024-02-09T08:02:13.041 INFO:teuthology.orchestra.run.smithi103.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:13.041 INFO:teuthology.orchestra.run.smithi103.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:13.041 INFO:teuthology.orchestra.run.smithi103.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:13.041 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:02:13.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.038+0000 7f2e37fff640 10 monclient: _finish_auth 0 2024-02-09T08:02:13.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.038+0000 7f2e37fff640 10 monclient: _check_auth_tickets 2024-02-09T08:02:13.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.038+0000 7f2e37fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:02:13.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.038+0000 7f2e37fff640 1 -- 172.21.15.103:0/1500063996 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e3c0319d0 con 0x7f2e400b44c0 2024-02-09T08:02:13.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.038+0000 7f2e476de640 5 monclient: authenticate success, global_id 4147 2024-02-09T08:02:13.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.038+0000 7f2e476de640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-02-09T08:02:13.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.038+0000 7f2e37fff640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:02:13.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.038+0000 7f2e476de640 10 monclient: get_monmap_and_config success 2024-02-09T08:02:13.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.038+0000 7f2e37fff640 1 -- 172.21.15.103:0/1500063996 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c031d60 con 0x7f2e400b44c0 2024-02-09T08:02:13.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.038+0000 7f2e476de640 4 set_mon_vals no callback set 2024-02-09T08:02:13.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.038+0000 7f2e37fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:13.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.038+0000 7f2e37fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:02:13.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.038+0000 7f2e37fff640 10 monclient: dump: 2024-02-09T08:02:13.042 INFO:teuthology.orchestra.run.smithi103.stderr:epoch 1 2024-02-09T08:02:13.042 INFO:teuthology.orchestra.run.smithi103.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:13.042 INFO:teuthology.orchestra.run.smithi103.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:13.042 INFO:teuthology.orchestra.run.smithi103.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:13.042 INFO:teuthology.orchestra.run.smithi103.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:13.042 INFO:teuthology.orchestra.run.smithi103.stderr:election_strategy: 1 2024-02-09T08:02:13.042 INFO:teuthology.orchestra.run.smithi103.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:13.042 INFO:teuthology.orchestra.run.smithi103.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:13.042 INFO:teuthology.orchestra.run.smithi103.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:13.042 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:02:13.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.038+0000 7f2e476de640 10 monclient: shutdown 2024-02-09T08:02:13.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.038+0000 7f2e476de640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:02:13.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.038+0000 7f2e476de640 1 -- 172.21.15.103:0/1500063996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e400b44c0 msgr2=0x7f2e4013f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:13.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.038+0000 7f2e476de640 1 --2- 172.21.15.103:0/1500063996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e400b44c0 0x7f2e4013f830 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2e400b48a0 tx=0x7f2e3c02b910 comp rx=0 tx=0).stop 2024-02-09T08:02:13.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.038+0000 7f2e476de640 1 -- 172.21.15.103:0/1500063996 shutdown_connections 2024-02-09T08:02:13.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.038+0000 7f2e476de640 1 --2- 172.21.15.103:0/1500063996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e400b44c0 0x7f2e4013f830 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:13.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.038+0000 7f2e476de640 1 --2- 172.21.15.103:0/1500063996 >> v2:172.21.15.62:3300/0 conn(0x7f2e4006be10 0x7f2e400a9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:13.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.038+0000 7f2e476de640 1 -- 172.21.15.103:0/1500063996 >> 172.21.15.103:0/1500063996 conn(0x7f2e400b8070 msgr2=0x7f2e400b8480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:02:13.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.038+0000 7f2e476de640 1 -- 172.21.15.103:0/1500063996 shutdown_connections 2024-02-09T08:02:13.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.038+0000 7f2e476de640 1 -- 172.21.15.103:0/1500063996 wait complete. 2024-02-09T08:02:13.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.039+0000 7f2e476de640 10 monclient: build_initial_monmap 2024-02-09T08:02:13.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.039+0000 7f2e476de640 10 monclient: monmap: 2024-02-09T08:02:13.047 INFO:teuthology.orchestra.run.smithi103.stderr:epoch 0 2024-02-09T08:02:13.047 INFO:teuthology.orchestra.run.smithi103.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:02:13.047 INFO:teuthology.orchestra.run.smithi103.stderr:last_changed 0.000000 2024-02-09T08:02:13.047 INFO:teuthology.orchestra.run.smithi103.stderr:created 0.000000 2024-02-09T08:02:13.048 INFO:teuthology.orchestra.run.smithi103.stderr:min_mon_release 0 (unknown) 2024-02-09T08:02:13.048 INFO:teuthology.orchestra.run.smithi103.stderr:election_strategy: 1 2024-02-09T08:02:13.048 INFO:teuthology.orchestra.run.smithi103.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:02:13.048 INFO:teuthology.orchestra.run.smithi103.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:02:13.048 INFO:teuthology.orchestra.run.smithi103.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:02:13.048 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:02:13.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.039+0000 7f2e476de640 1 librados: starting msgr at 2024-02-09T08:02:13.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.039+0000 7f2e476de640 1 librados: starting objecter 2024-02-09T08:02:13.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.039+0000 7f2e476de640 1 Processor -- start 2024-02-09T08:02:13.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.039+0000 7f2e476de640 1 -- start start 2024-02-09T08:02:13.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.039+0000 7f2e476de640 1 librados: setting wanted keys 2024-02-09T08:02:13.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.039+0000 7f2e476de640 1 librados: calling monclient init 2024-02-09T08:02:13.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.039+0000 7f2e476de640 10 monclient: init 2024-02-09T08:02:13.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.040+0000 7f2e476de640 10 monclient: _reopen_session rank -1 2024-02-09T08:02:13.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.040+0000 7f2e476de640 10 monclient: _add_conns ranks=[2,0,1] 2024-02-09T08:02:13.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.040+0000 7f2e476de640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2e4006be10 0x7f2e4013b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:13.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.040+0000 7f2e476de640 10 monclient(hunting): picked mon.noname-c con 0x7f2e4006be10 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:02:13.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.040+0000 7f2e476de640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e400b44c0 0x7f2e401330f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:13.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.040+0000 7f2e476de640 10 monclient(hunting): picked mon.noname-a con 0x7f2e400b44c0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:02:13.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.040+0000 7f2e476de640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e4013fd70 0x7f2e40133630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:13.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.040+0000 7f2e476de640 10 monclient(hunting): picked mon.noname-b con 0x7f2e4013fd70 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:02:13.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.040+0000 7f2e476de640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:13.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.040+0000 7f2e476de640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e40133b70 con 0x7f2e400b44c0 2024-02-09T08:02:13.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.040+0000 7f2e476de640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:13.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.040+0000 7f2e476de640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4013c880 con 0x7f2e4013fd70 2024-02-09T08:02:13.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.040+0000 7f2e476de640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:13.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.040+0000 7f2e476de640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e40140660 con 0x7f2e4006be10 2024-02-09T08:02:13.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.040+0000 7f2e476de640 10 monclient(hunting): _renew_subs 2024-02-09T08:02:13.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.040+0000 7f2e476de640 10 monclient(hunting): authenticate will time out at 1456.237754s 2024-02-09T08:02:13.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.040+0000 7f2e45c7b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e4013fd70 0x7f2e40133630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:13.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.041+0000 7f2e44c79640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e400b44c0 0x7f2e401330f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:13.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.041+0000 7f2e4547a640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2e4006be10 0x7f2e4013b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:13.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.041+0000 7f2e45c7b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e4013fd70 0x7f2e40133630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:32858/0 (socket says 172.21.15.103:32858) 2024-02-09T08:02:13.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.041+0000 7f2e45c7b640 1 -- 172.21.15.103:0/1072750536 learned_addr learned my addr 172.21.15.103:0/1072750536 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-02-09T08:02:13.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.041+0000 7f2e45c7b640 10 monclient(hunting): get_auth_request con 0x7f2e4013fd70 auth_method 0 2024-02-09T08:02:13.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.041+0000 7f2e45c7b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:13.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.041+0000 7f2e45c7b640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:13.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.041+0000 7f2e45c7b640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:13.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.041+0000 7f2e4547a640 10 monclient(hunting): get_auth_request con 0x7f2e4006be10 auth_method 0 2024-02-09T08:02:13.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.041+0000 7f2e4547a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:13.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.041+0000 7f2e4547a640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:13.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.041+0000 7f2e4547a640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:13.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.041+0000 7f2e44c79640 10 monclient(hunting): get_auth_request con 0x7f2e400b44c0 auth_method 0 2024-02-09T08:02:13.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.041+0000 7f2e44c79640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:13.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.041+0000 7f2e44c79640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:13.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.041+0000 7f2e44c79640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:13.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.041+0000 7f2e45c7b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:13.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.041+0000 7f2e45c7b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:13.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.041+0000 7f2e45c7b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:13.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.041+0000 7f2e4547a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:13.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.041+0000 7f2e4547a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:13.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.041+0000 7f2e4547a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:13.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.041+0000 7f2e44c79640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:13.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.041+0000 7f2e44c79640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:13.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.041+0000 7f2e44c79640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:13.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.044+0000 7f2e45c7b640 10 monclient(hunting): handle_auth_done global_id 4150 payload 824 2024-02-09T08:02:13.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.044+0000 7f2e45c7b640 1 -- 172.21.15.103:0/1072750536 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2e4006be10 msgr2=0x7f2e4013b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:13.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.044+0000 7f2e45c7b640 1 --2- 172.21.15.103:0/1072750536 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2e4006be10 0x7f2e4013b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:13.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.044+0000 7f2e45c7b640 1 -- 172.21.15.103:0/1072750536 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e400b44c0 msgr2=0x7f2e401330f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:13.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.044+0000 7f2e45c7b640 1 --2- 172.21.15.103:0/1072750536 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e400b44c0 0x7f2e401330f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:13.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.044+0000 7f2e45c7b640 10 monclient: _finish_hunting 0 2024-02-09T08:02:13.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.044+0000 7f2e45c7b640 1 monclient: found mon.noname-b 2024-02-09T08:02:13.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.044+0000 7f2e45c7b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:02:13.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.044+0000 7f2e45c7b640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.103:3300/0 2024-02-09T08:02:13.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.044+0000 7f2e45c7b640 1 -- 172.21.15.103:0/1072750536 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e3c0094d0 con 0x7f2e4013fd70 2024-02-09T08:02:13.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.046+0000 7f2e45c7b640 1 --2- 172.21.15.103:0/1072750536 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e4013fd70 0x7f2e40133630 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2e3800c6b0 tx=0x7f2e3800cb70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:02:13.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.046+0000 7f2e35ffb640 10 client.?.objecter ms_handle_connect 0x7f2e4013fd70 2024-02-09T08:02:13.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.046+0000 7f2e35ffb640 10 client.?.objecter resend_mon_ops 2024-02-09T08:02:13.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.050+0000 7f2e35ffb640 1 -- 172.21.15.103:0/1072750536 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e38003b70 con 0x7f2e4013fd70 2024-02-09T08:02:13.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.050+0000 7f2e35ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:13.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.050+0000 7f2e35ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:02:13.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.050+0000 7f2e35ffb640 10 monclient: dump: 2024-02-09T08:02:13.055 INFO:teuthology.orchestra.run.smithi103.stderr:epoch 1 2024-02-09T08:02:13.055 INFO:teuthology.orchestra.run.smithi103.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:13.055 INFO:teuthology.orchestra.run.smithi103.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:13.055 INFO:teuthology.orchestra.run.smithi103.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:13.055 INFO:teuthology.orchestra.run.smithi103.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:13.055 INFO:teuthology.orchestra.run.smithi103.stderr:election_strategy: 1 2024-02-09T08:02:13.055 INFO:teuthology.orchestra.run.smithi103.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:13.055 INFO:teuthology.orchestra.run.smithi103.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:13.055 INFO:teuthology.orchestra.run.smithi103.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:13.055 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:02:13.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.050+0000 7f2e35ffb640 10 monclient: _finish_auth 0 2024-02-09T08:02:13.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.050+0000 7f2e35ffb640 10 monclient: _check_auth_tickets 2024-02-09T08:02:13.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.050+0000 7f2e35ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:02:13.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.050+0000 7f2e476de640 5 monclient: authenticate success, global_id 4150 2024-02-09T08:02:13.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.050+0000 7f2e35ffb640 1 -- 172.21.15.103:0/1072750536 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e38003cf0 con 0x7f2e4013fd70 2024-02-09T08:02:13.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.050+0000 7f2e35ffb640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:02:13.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.050+0000 7f2e35ffb640 1 -- 172.21.15.103:0/1072750536 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e38005310 con 0x7f2e4013fd70 2024-02-09T08:02:13.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.050+0000 7f2e35ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:13.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.050+0000 7f2e35ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:02:13.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.050+0000 7f2e35ffb640 10 monclient: dump: 2024-02-09T08:02:13.057 INFO:teuthology.orchestra.run.smithi103.stderr:epoch 1 2024-02-09T08:02:13.057 INFO:teuthology.orchestra.run.smithi103.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:13.057 INFO:teuthology.orchestra.run.smithi103.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:13.057 INFO:teuthology.orchestra.run.smithi103.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:13.057 INFO:teuthology.orchestra.run.smithi103.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:13.057 INFO:teuthology.orchestra.run.smithi103.stderr:election_strategy: 1 2024-02-09T08:02:13.057 INFO:teuthology.orchestra.run.smithi103.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:13.057 INFO:teuthology.orchestra.run.smithi103.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:13.058 INFO:teuthology.orchestra.run.smithi103.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:13.058 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:02:13.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.050+0000 7f2e377fe640 4 set_mon_vals no callback set 2024-02-09T08:02:13.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.050+0000 7f2e476de640 10 monclient: _renew_subs 2024-02-09T08:02:13.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.050+0000 7f2e476de640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:02:13.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.050+0000 7f2e476de640 1 -- 172.21.15.103:0/1072750536 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e40140350 con 0x7f2e4013fd70 2024-02-09T08:02:13.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.051+0000 7f2e476de640 10 client.4150.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:02:13.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.051+0000 7f2e476de640 10 monclient: _renew_subs 2024-02-09T08:02:13.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.051+0000 7f2e476de640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:02:13.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.051+0000 7f2e476de640 1 -- 172.21.15.103:0/1072750536 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e4013af10 con 0x7f2e4013fd70 2024-02-09T08:02:13.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.051+0000 7f2e476de640 1 librados: init done 2024-02-09T08:02:13.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.052+0000 7f2e476de640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:02:13.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.052+0000 7f2e476de640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:02:13.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.052+0000 7f2e476de640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:02:13.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.052+0000 7f2e476de640 1 -- 172.21.15.103:0/1072750536 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e40140b80 con 0x7f2e4013fd70 2024-02-09T08:02:13.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.054+0000 7f2e35ffb640 1 -- 172.21.15.103:0/1072750536 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f2e38005470 con 0x7f2e4013fd70 2024-02-09T08:02:13.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.054+0000 7f2e35ffb640 1 -- 172.21.15.103:0/1072750536 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f2e38025a20 con 0x7f2e4013fd70 2024-02-09T08:02:13.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.054+0000 7f2e35ffb640 10 client.4150.objecter ms_dispatch 0x7f2e40000b90 osd_map(8..8 src has 1..8) v4 2024-02-09T08:02:13.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.054+0000 7f2e35ffb640 3 client.4150.objecter handle_osd_map got epochs [8,8] > 0 2024-02-09T08:02:13.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.054+0000 7f2e35ffb640 3 client.4150.objecter handle_osd_map decoding full epoch 8 2024-02-09T08:02:13.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.054+0000 7f2e35ffb640 20 client.4150.objecter dump_active .. 0 homeless 2024-02-09T08:02:13.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.152+0000 7f2e35ffb640 1 -- 172.21.15.103:0/1072750536 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f2e40140b80 con 0x7f2e4013fd70 2024-02-09T08:02:13.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.153+0000 7f2e35ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:02:13.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.153+0000 7f2e35ffb640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:02:13.162 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-02-09T08:02:13.161+0000 7fa0f91f1040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-09T08:02:13.216 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-02-09T08:02:13.214+0000 7fa0f91f1040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-09T08:02:13.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.225+0000 7f2e476de640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "3473844d-d631-4ea4-96fb-638eccee5cb6", "id": 6}] 2024-02-09T08:02:13.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.225+0000 7f2e476de640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "3473844d-d631-4ea4-96fb-638eccee5cb6", "id": 6}] 2024-02-09T08:02:13.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.225+0000 7f2e476de640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:02:13.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.225+0000 7f2e476de640 1 -- 172.21.15.103:0/1072750536 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3473844d-d631-4ea4-96fb-638eccee5cb6", "id": 6} v 0) v1 -- 0x7f2e4004ef90 con 0x7f2e4013fd70 2024-02-09T08:02:13.272 INFO:tasks.ceph.mgr.y.smithi062.stderr:2024-02-09T08:02:13.270+0000 7f96d1c3f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-09T08:02:13.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.288+0000 7f2e35ffb640 1 -- 172.21.15.103:0/1072750536 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3473844d-d631-4ea4-96fb-638eccee5cb6", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2e38005720 con 0x7f2e4013fd70 2024-02-09T08:02:13.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.288+0000 7f2e35ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "3473844d-d631-4ea4-96fb-638eccee5cb6", "id": 6}] 2024-02-09T08:02:13.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.288+0000 7f2e35ffb640 10 monclient: _finish_command 2 = system:0 2024-02-09T08:02:13.291 INFO:teuthology.orchestra.run.smithi103.stdout:6 2024-02-09T08:02:13.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.289+0000 7f2e476de640 10 librados: watch_flush enter 2024-02-09T08:02:13.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.289+0000 7f2e476de640 10 librados: watch_flush exit 2024-02-09T08:02:13.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.289+0000 7f2e476de640 20 client.4150.objecter shutdown clearing up homeless session... 2024-02-09T08:02:13.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.289+0000 7f2e476de640 10 client.4150.objecter successfully canceled tick 2024-02-09T08:02:13.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.289+0000 7f2e476de640 10 monclient: shutdown 2024-02-09T08:02:13.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.289+0000 7f2e476de640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:02:13.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.289+0000 7f2e476de640 1 -- 172.21.15.103:0/1072750536 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e4013fd70 msgr2=0x7f2e40133630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:13.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.289+0000 7f2e476de640 1 --2- 172.21.15.103:0/1072750536 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e4013fd70 0x7f2e40133630 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2e3800c6b0 tx=0x7f2e3800cb70 comp rx=0 tx=0).stop 2024-02-09T08:02:13.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.289+0000 7f2e476de640 1 -- 172.21.15.103:0/1072750536 shutdown_connections 2024-02-09T08:02:13.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.289+0000 7f2e476de640 1 --2- 172.21.15.103:0/1072750536 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e4013fd70 0x7f2e40133630 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:13.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.289+0000 7f2e476de640 1 --2- 172.21.15.103:0/1072750536 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e400b44c0 0x7f2e401330f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:13.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.289+0000 7f2e476de640 1 --2- 172.21.15.103:0/1072750536 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2e4006be10 0x7f2e4013b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:13.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.289+0000 7f2e476de640 1 -- 172.21.15.103:0/1072750536 >> 172.21.15.103:0/1072750536 conn(0x7f2e400b8070 msgr2=0x7f2e400b5c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:02:13.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.290+0000 7f2e476de640 1 -- 172.21.15.103:0/1072750536 shutdown_connections 2024-02-09T08:02:13.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.290+0000 7f2e476de640 1 -- 172.21.15.103:0/1072750536 wait complete. 2024-02-09T08:02:13.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.290+0000 7f2e476de640 1 librados: shutdown 2024-02-09T08:02:13.302 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph osd new d31bdb4b-8938-4da9-8bf1-57cf730e839d 7 2024-02-09T08:02:13.327 INFO:tasks.ceph.mgr.y.smithi062.stderr:2024-02-09T08:02:13.324+0000 7f96d1c3f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-09T08:02:13.340 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-02-09T08:02:13.338+0000 7fa0f91f1040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-09T08:02:13.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.400+0000 7f3ba49cf640 10 monclient: get_monmap_and_config 2024-02-09T08:02:13.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.400+0000 7f3ba49cf640 10 monclient: build_initial_monmap 2024-02-09T08:02:13.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.400+0000 7f3ba49cf640 10 monclient: monmap: 2024-02-09T08:02:13.402 INFO:teuthology.orchestra.run.smithi103.stderr:epoch 0 2024-02-09T08:02:13.402 INFO:teuthology.orchestra.run.smithi103.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:13.402 INFO:teuthology.orchestra.run.smithi103.stderr:last_changed 2024-02-09T08:02:13.400933+0000 2024-02-09T08:02:13.403 INFO:teuthology.orchestra.run.smithi103.stderr:created 2024-02-09T08:02:13.400933+0000 2024-02-09T08:02:13.403 INFO:teuthology.orchestra.run.smithi103.stderr:min_mon_release 0 (unknown) 2024-02-09T08:02:13.403 INFO:teuthology.orchestra.run.smithi103.stderr:election_strategy: 1 2024-02-09T08:02:13.403 INFO:teuthology.orchestra.run.smithi103.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:02:13.403 INFO:teuthology.orchestra.run.smithi103.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:02:13.403 INFO:teuthology.orchestra.run.smithi103.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:02:13.403 INFO:teuthology.orchestra.run.smithi103.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:02:13.403 INFO:teuthology.orchestra.run.smithi103.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:02:13.403 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:02:13.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.400+0000 7f3ba49cf640 1 Processor -- start 2024-02-09T08:02:13.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.401+0000 7f3ba49cf640 1 -- start start 2024-02-09T08:02:13.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.401+0000 7f3ba49cf640 10 monclient: init 2024-02-09T08:02:13.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.401+0000 7f3ba49cf640 10 monclient: _reopen_session rank -1 2024-02-09T08:02:13.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.401+0000 7f3ba49cf640 10 monclient: _add_conns ranks=[2,0,1,4,3] 2024-02-09T08:02:13.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.401+0000 7f3ba49cf640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3ba0074680 0x7f3ba013f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:13.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.401+0000 7f3ba49cf640 10 monclient(hunting): picked mon.noname-b con 0x7f3ba0074680 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:02:13.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.401+0000 7f3ba49cf640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f3ba00af800 addr v1:172.21.15.62:6789/0 2024-02-09T08:02:13.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.401+0000 7f3ba49cf640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f3ba0146180 addr v1:172.21.15.103:6789/0 2024-02-09T08:02:13.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.401+0000 7f3ba49cf640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ba006f4c0 con 0x7f3ba00af800 2024-02-09T08:02:13.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.401+0000 7f3ba49cf640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ba006f7a0 con 0x7f3ba0146180 2024-02-09T08:02:13.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.401+0000 7f3ba49cf640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:13.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.401+0000 7f3ba49cf640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba0074a60 con 0x7f3ba0074680 2024-02-09T08:02:13.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.401+0000 7f3ba49cf640 10 monclient(hunting): _renew_subs 2024-02-09T08:02:13.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.401+0000 7f3ba49cf640 10 monclient(hunting): authenticate will time out at 1456.599005s 2024-02-09T08:02:13.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.402+0000 7f3b9ed9d640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f3ba0146180 0x7f3ba014ce00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46842/0 (socket says 172.21.15.103:46842) 2024-02-09T08:02:13.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.402+0000 7f3b9ed9d640 1 -- 172.21.15.103:0/2045314292 learned_addr learned my addr 172.21.15.103:0/2045314292 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-02-09T08:02:13.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.404+0000 7f3b9d59a640 1 -- 172.21.15.103:0/2045314292 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1222497971 0 0) 0x7f3ba006f4c0 con 0x7f3ba00af800 2024-02-09T08:02:13.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.404+0000 7f3b9d59a640 10 monclient(hunting): _negotiate 2024-02-09T08:02:13.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.404+0000 7f3b9d59a640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:13.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.404+0000 7f3b9d59a640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:13.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.404+0000 7f3b9d59a640 10 monclient(hunting): my global_id is 4152 2024-02-09T08:02:13.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.404+0000 7f3b9d59a640 1 -- 172.21.15.103:0/2045314292 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b88003520 con 0x7f3ba00af800 2024-02-09T08:02:13.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.404+0000 7f3b9d59a640 1 -- 172.21.15.103:0/2045314292 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 53012444 0 0) 0x7f3ba006f7a0 con 0x7f3ba0146180 2024-02-09T08:02:13.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.404+0000 7f3b9d59a640 10 monclient(hunting): _negotiate 2024-02-09T08:02:13.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.404+0000 7f3b9d59a640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:13.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.404+0000 7f3b9d59a640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:13.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.404+0000 7f3b9d59a640 10 monclient(hunting): my global_id is 4153 2024-02-09T08:02:13.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.404+0000 7f3b9d59a640 1 -- 172.21.15.103:0/2045314292 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ba006f4c0 con 0x7f3ba0146180 2024-02-09T08:02:13.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.407+0000 7f3b9d59a640 1 -- 172.21.15.103:0/2045314292 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 800243047 0 0) 0x7f3ba006f4c0 con 0x7f3ba0146180 2024-02-09T08:02:13.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.407+0000 7f3b9d59a640 1 -- 172.21.15.103:0/2045314292 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3ba0074680 msgr2=0x7f3ba013f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:02:13.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.407+0000 7f3b9d59a640 1 --2- 172.21.15.103:0/2045314292 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3ba0074680 0x7f3ba013f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:13.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.407+0000 7f3b9d59a640 1 -- 172.21.15.103:0/2045314292 >> v1:172.21.15.62:6789/0 conn(0x7f3ba00af800 legacy=0x7f3ba0145a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:13.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.407+0000 7f3b9d59a640 10 monclient: _finish_hunting 0 2024-02-09T08:02:13.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.407+0000 7f3b9d59a640 1 monclient: found mon.noname-c-legacy 2024-02-09T08:02:13.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.407+0000 7f3b9d59a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:02:13.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.407+0000 7f3b9d59a640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:172.21.15.103:6789/0 2024-02-09T08:02:13.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.407+0000 7f3b9d59a640 1 -- 172.21.15.103:0/2045314292 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba0140030 con 0x7f3ba0146180 2024-02-09T08:02:13.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.407+0000 7f3b9d59a640 10 monclient: _finish_auth 0 2024-02-09T08:02:13.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.407+0000 7f3b9d59a640 10 monclient: _check_auth_tickets 2024-02-09T08:02:13.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.407+0000 7f3b9d59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:02:13.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.407+0000 7f3b9d59a640 1 -- 172.21.15.103:0/2045314292 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1140318843 0 0) 0x7f3b90001670 con 0x7f3ba0146180 2024-02-09T08:02:13.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.407+0000 7f3b9d59a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:13.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.407+0000 7f3b9d59a640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2024-02-09T08:02:13.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.407+0000 7f3b9d59a640 10 monclient: dump: 2024-02-09T08:02:13.411 INFO:teuthology.orchestra.run.smithi103.stderr:epoch 1 2024-02-09T08:02:13.411 INFO:teuthology.orchestra.run.smithi103.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:13.411 INFO:teuthology.orchestra.run.smithi103.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:13.411 INFO:teuthology.orchestra.run.smithi103.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:13.411 INFO:teuthology.orchestra.run.smithi103.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:13.411 INFO:teuthology.orchestra.run.smithi103.stderr:election_strategy: 1 2024-02-09T08:02:13.411 INFO:teuthology.orchestra.run.smithi103.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:13.412 INFO:teuthology.orchestra.run.smithi103.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:13.412 INFO:teuthology.orchestra.run.smithi103.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:13.412 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:02:13.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.407+0000 7f3b9d59a640 1 monclient: mon.b has (v2) addrs [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] but i'm connected to v1:172.21.15.103:6789/0, reconnecting 2024-02-09T08:02:13.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.407+0000 7f3b9d59a640 10 monclient: _reopen_session rank -1 2024-02-09T08:02:13.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.407+0000 7f3b9d59a640 1 -- 172.21.15.103:0/2045314292 >> v1:172.21.15.103:6789/0 conn(0x7f3ba0146180 legacy=0x7f3ba014ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:13.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.407+0000 7f3b9d59a640 10 monclient: _add_conns ranks=[2,1,0] 2024-02-09T08:02:13.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.407+0000 7f3b9d59a640 1 --2- 172.21.15.103:0/2045314292 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3ba0074680 0x7f3b88004b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:13.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.407+0000 7f3b9d59a640 10 monclient(hunting): picked mon.c con 0x7f3ba0074680 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:02:13.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.407+0000 7f3b9d59a640 1 --2- 172.21.15.103:0/2045314292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b88005110 0x7f3b88003760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:13.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.407+0000 7f3b9d59a640 10 monclient(hunting): picked mon.b con 0x7f3b88005110 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:02:13.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.407+0000 7f3b9d59a640 1 --2- 172.21.15.103:0/2045314292 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b88003dc0 0x7f3b8800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:13.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.407+0000 7f3b9d59a640 10 monclient(hunting): picked mon.a con 0x7f3b88003dc0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:02:13.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.407+0000 7f3b9d59a640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:13.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.407+0000 7f3b9d59a640 1 -- 172.21.15.103:0/2045314292 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba0074a60 con 0x7f3b88003dc0 2024-02-09T08:02:13.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.407+0000 7f3b9d59a640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:13.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.407+0000 7f3b9d59a640 1 -- 172.21.15.103:0/2045314292 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b88004540 con 0x7f3b88005110 2024-02-09T08:02:13.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.407+0000 7f3b9d59a640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:13.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.407+0000 7f3b9d59a640 1 -- 172.21.15.103:0/2045314292 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8800bec0 con 0x7f3ba0074680 2024-02-09T08:02:13.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.407+0000 7f3b9d59a640 10 monclient(hunting): _renew_subs 2024-02-09T08:02:13.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.407+0000 7f3b9d59a640 10 monclient(hunting): _finish_auth 0 2024-02-09T08:02:13.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.410+0000 7f3b9ed9d640 1 --2- 172.21.15.103:0/2045314292 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b88003dc0 0x7f3b8800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:13.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.410+0000 7f3b9dd9b640 1 --2- 172.21.15.103:0/2045314292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b88005110 0x7f3b88003760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:13.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.411+0000 7f3b9dd9b640 10 monclient(hunting): get_auth_request con 0x7f3b88005110 auth_method 0 2024-02-09T08:02:13.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.411+0000 7f3b9dd9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:13.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.411+0000 7f3b9dd9b640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:13.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.411+0000 7f3b9dd9b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-02-09T08:02:13.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.411+0000 7f3b9dd9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:13.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.411+0000 7f3b9dd9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:13.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.411+0000 7f3b9dd9b640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-02-09T08:02:13.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.412+0000 7f3b9ed9d640 10 monclient(hunting): get_auth_request con 0x7f3b88003dc0 auth_method 0 2024-02-09T08:02:13.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.412+0000 7f3b9ed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:13.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.412+0000 7f3b9ed9d640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:13.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.412+0000 7f3b9ed9d640 10 monclient(hunting): _init_auth already have auth, reseting 2024-02-09T08:02:13.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.412+0000 7f3b9ed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:13.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.412+0000 7f3b9ed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:13.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.412+0000 7f3b9ed9d640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-02-09T08:02:13.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.417+0000 7f3b9e59c640 1 --2- 172.21.15.103:0/2045314292 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3ba0074680 0x7f3b88004b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:13.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.417+0000 7f3b9e59c640 10 monclient(hunting): get_auth_request con 0x7f3ba0074680 auth_method 0 2024-02-09T08:02:13.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.417+0000 7f3b9e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:13.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.417+0000 7f3b9e59c640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:13.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.417+0000 7f3b9e59c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-02-09T08:02:13.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.418+0000 7f3b9e59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:13.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.418+0000 7f3b9e59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:13.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.418+0000 7f3b9e59c640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-02-09T08:02:13.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.419+0000 7f3b9dd9b640 10 monclient(hunting): handle_auth_done global_id 4153 payload 293 2024-02-09T08:02:13.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.419+0000 7f3b9dd9b640 1 -- 172.21.15.103:0/2045314292 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3ba0074680 msgr2=0x7f3b88004b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:02:13.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.419+0000 7f3b9dd9b640 1 --2- 172.21.15.103:0/2045314292 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3ba0074680 0x7f3b88004b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:13.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.419+0000 7f3b9dd9b640 1 -- 172.21.15.103:0/2045314292 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b88003dc0 msgr2=0x7f3b8800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:02:13.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.419+0000 7f3b9dd9b640 1 --2- 172.21.15.103:0/2045314292 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b88003dc0 0x7f3b8800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:13.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.419+0000 7f3b9dd9b640 10 monclient: _finish_hunting 0 2024-02-09T08:02:13.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.419+0000 7f3b9dd9b640 1 monclient: found mon.b 2024-02-09T08:02:13.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.419+0000 7f3b9dd9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:02:13.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.419+0000 7f3b9dd9b640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:02:13.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.419+0000 7f3b9dd9b640 1 -- 172.21.15.103:0/2045314292 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba006f4c0 con 0x7f3b88005110 2024-02-09T08:02:13.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.419+0000 7f3b9dd9b640 10 monclient: _finish_auth 0 2024-02-09T08:02:13.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.419+0000 7f3b9dd9b640 10 monclient: _check_auth_tickets 2024-02-09T08:02:13.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.419+0000 7f3b9dd9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:02:13.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.419+0000 7f3ba49cf640 5 monclient: authenticate success, global_id 4153 2024-02-09T08:02:13.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.419+0000 7f3ba49cf640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-02-09T08:02:13.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.421+0000 7f3b9dd9b640 1 --2- 172.21.15.103:0/2045314292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b88005110 0x7f3b88003760 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3b94001900 tx=0x7f3b880057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6c9f09f0c84a9d4 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:02:13.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.424+0000 7f3b9d59a640 1 -- 172.21.15.103:0/2045314292 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b940052d0 con 0x7f3b88005110 2024-02-09T08:02:13.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.424+0000 7f3b9d59a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:13.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.424+0000 7f3b9d59a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:02:13.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.424+0000 7f3b9d59a640 10 monclient: dump: 2024-02-09T08:02:13.428 INFO:teuthology.orchestra.run.smithi103.stderr:epoch 1 2024-02-09T08:02:13.428 INFO:teuthology.orchestra.run.smithi103.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:13.428 INFO:teuthology.orchestra.run.smithi103.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:13.428 INFO:teuthology.orchestra.run.smithi103.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:13.428 INFO:teuthology.orchestra.run.smithi103.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:13.428 INFO:teuthology.orchestra.run.smithi103.stderr:election_strategy: 1 2024-02-09T08:02:13.429 INFO:teuthology.orchestra.run.smithi103.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:13.429 INFO:teuthology.orchestra.run.smithi103.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:13.429 INFO:teuthology.orchestra.run.smithi103.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:13.429 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:02:13.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.425+0000 7f3b9d59a640 1 -- 172.21.15.103:0/2045314292 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b94005450 con 0x7f3b88005110 2024-02-09T08:02:13.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.425+0000 7f3ba49cf640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-02-09T08:02:13.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.425+0000 7f3b9d59a640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:02:13.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.425+0000 7f3ba49cf640 10 monclient: get_monmap_and_config success 2024-02-09T08:02:13.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.425+0000 7f3b9d59a640 1 -- 172.21.15.103:0/2045314292 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b94003830 con 0x7f3b88005110 2024-02-09T08:02:13.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.425+0000 7f3ba49cf640 4 set_mon_vals no callback set 2024-02-09T08:02:13.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.425+0000 7f3b9d59a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:13.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.425+0000 7f3b9d59a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:02:13.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.425+0000 7f3b9d59a640 10 monclient: dump: 2024-02-09T08:02:13.429 INFO:teuthology.orchestra.run.smithi103.stderr:epoch 1 2024-02-09T08:02:13.430 INFO:teuthology.orchestra.run.smithi103.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:13.430 INFO:teuthology.orchestra.run.smithi103.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:13.430 INFO:teuthology.orchestra.run.smithi103.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:13.430 INFO:teuthology.orchestra.run.smithi103.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:13.430 INFO:teuthology.orchestra.run.smithi103.stderr:election_strategy: 1 2024-02-09T08:02:13.430 INFO:teuthology.orchestra.run.smithi103.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:13.430 INFO:teuthology.orchestra.run.smithi103.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:13.430 INFO:teuthology.orchestra.run.smithi103.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:13.430 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:02:13.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.425+0000 7f3ba49cf640 10 monclient: shutdown 2024-02-09T08:02:13.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.425+0000 7f3ba49cf640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:02:13.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.425+0000 7f3ba49cf640 1 -- 172.21.15.103:0/2045314292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b88005110 msgr2=0x7f3b88003760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:13.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.425+0000 7f3ba49cf640 1 --2- 172.21.15.103:0/2045314292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b88005110 0x7f3b88003760 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3b94001900 tx=0x7f3b880057f0 comp rx=0 tx=0).stop 2024-02-09T08:02:13.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.425+0000 7f3b9ed9d640 1 -- 172.21.15.103:0/2045314292 reap_dead start 2024-02-09T08:02:13.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.425+0000 7f3ba49cf640 1 -- 172.21.15.103:0/2045314292 shutdown_connections 2024-02-09T08:02:13.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.425+0000 7f3ba49cf640 1 -- 172.21.15.103:0/2045314292 >> 172.21.15.103:0/2045314292 conn(0x7f3ba006ac50 msgr2=0x7f3ba006b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:02:13.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.425+0000 7f3ba49cf640 1 -- 172.21.15.103:0/2045314292 shutdown_connections 2024-02-09T08:02:13.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.425+0000 7f3ba49cf640 1 -- 172.21.15.103:0/2045314292 wait complete. 2024-02-09T08:02:13.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.426+0000 7f3ba49cf640 10 monclient: build_initial_monmap 2024-02-09T08:02:13.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.426+0000 7f3ba49cf640 10 monclient: monmap: 2024-02-09T08:02:13.437 INFO:teuthology.orchestra.run.smithi103.stderr:epoch 0 2024-02-09T08:02:13.437 INFO:teuthology.orchestra.run.smithi103.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:02:13.437 INFO:teuthology.orchestra.run.smithi103.stderr:last_changed 0.000000 2024-02-09T08:02:13.437 INFO:teuthology.orchestra.run.smithi103.stderr:created 0.000000 2024-02-09T08:02:13.437 INFO:teuthology.orchestra.run.smithi103.stderr:min_mon_release 0 (unknown) 2024-02-09T08:02:13.437 INFO:teuthology.orchestra.run.smithi103.stderr:election_strategy: 1 2024-02-09T08:02:13.437 INFO:teuthology.orchestra.run.smithi103.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:02:13.437 INFO:teuthology.orchestra.run.smithi103.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:02:13.438 INFO:teuthology.orchestra.run.smithi103.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:02:13.438 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:02:13.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.427+0000 7f3ba49cf640 1 librados: starting msgr at 2024-02-09T08:02:13.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.427+0000 7f3ba49cf640 1 librados: starting objecter 2024-02-09T08:02:13.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.427+0000 7f3ba49cf640 1 Processor -- start 2024-02-09T08:02:13.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.427+0000 7f3ba49cf640 1 -- start start 2024-02-09T08:02:13.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.427+0000 7f3ba49cf640 1 librados: setting wanted keys 2024-02-09T08:02:13.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.427+0000 7f3ba49cf640 1 librados: calling monclient init 2024-02-09T08:02:13.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.427+0000 7f3ba49cf640 10 monclient: init 2024-02-09T08:02:13.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.427+0000 7f3ba49cf640 10 monclient: _reopen_session rank -1 2024-02-09T08:02:13.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.427+0000 7f3ba49cf640 10 monclient: _add_conns ranks=[0,1,2] 2024-02-09T08:02:13.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.427+0000 7f3ba49cf640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b88005110 0x7f3ba013a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:13.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.427+0000 7f3ba49cf640 10 monclient(hunting): picked mon.noname-a con 0x7f3b88005110 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:02:13.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.427+0000 7f3ba49cf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ba013b230 0x7f3ba013b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:13.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.427+0000 7f3ba49cf640 10 monclient(hunting): picked mon.noname-b con 0x7f3ba013b230 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:02:13.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.427+0000 7f3ba49cf640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3ba01d8020 0x7f3ba01d84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:13.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.427+0000 7f3ba49cf640 10 monclient(hunting): picked mon.noname-c con 0x7f3ba01d8020 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:02:13.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.427+0000 7f3ba49cf640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:13.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.427+0000 7f3ba49cf640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba01d7b90 con 0x7f3b88005110 2024-02-09T08:02:13.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.427+0000 7f3ba49cf640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:13.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.427+0000 7f3ba49cf640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba01cb4f0 con 0x7f3ba013b230 2024-02-09T08:02:13.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.427+0000 7f3ba49cf640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:13.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.427+0000 7f3ba49cf640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba0141bf0 con 0x7f3ba01d8020 2024-02-09T08:02:13.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.427+0000 7f3ba49cf640 10 monclient(hunting): _renew_subs 2024-02-09T08:02:13.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.427+0000 7f3ba49cf640 10 monclient(hunting): authenticate will time out at 1456.624964s 2024-02-09T08:02:13.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.428+0000 7f3b9dd9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ba013b230 0x7f3ba013b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:13.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.428+0000 7f3b9dd9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ba013b230 0x7f3ba013b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:32880/0 (socket says 172.21.15.103:32880) 2024-02-09T08:02:13.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.428+0000 7f3b9dd9b640 1 -- 172.21.15.103:0/428367522 learned_addr learned my addr 172.21.15.103:0/428367522 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-02-09T08:02:13.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.428+0000 7f3b9dd9b640 10 monclient(hunting): get_auth_request con 0x7f3ba013b230 auth_method 0 2024-02-09T08:02:13.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.428+0000 7f3b9dd9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:13.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.428+0000 7f3b9dd9b640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:13.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.428+0000 7f3b9dd9b640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:13.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.428+0000 7f3b9dd9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:13.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.428+0000 7f3b9dd9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:13.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.428+0000 7f3b9dd9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:13.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.429+0000 7f3b9ed9d640 1 --2- 172.21.15.103:0/428367522 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3ba01d8020 0x7f3ba01d84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:13.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.429+0000 7f3b9ed9d640 10 monclient(hunting): get_auth_request con 0x7f3ba01d8020 auth_method 0 2024-02-09T08:02:13.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.429+0000 7f3b9ed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:13.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.429+0000 7f3b9ed9d640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:13.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.429+0000 7f3b9ed9d640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:13.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.429+0000 7f3b9ed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:13.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.429+0000 7f3b9ed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:13.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.429+0000 7f3b9ed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:13.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.431+0000 7f3b9dd9b640 10 monclient(hunting): handle_auth_done global_id 4156 payload 824 2024-02-09T08:02:13.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.431+0000 7f3b9dd9b640 1 -- 172.21.15.103:0/428367522 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3ba01d8020 msgr2=0x7f3ba01d84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:13.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.431+0000 7f3b9dd9b640 1 --2- 172.21.15.103:0/428367522 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3ba01d8020 0x7f3ba01d84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:13.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.431+0000 7f3b9dd9b640 1 -- 172.21.15.103:0/428367522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b88005110 msgr2=0x7f3ba013a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:13.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.431+0000 7f3b9dd9b640 1 --2- 172.21.15.103:0/428367522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b88005110 0x7f3ba013a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:13.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.431+0000 7f3b9dd9b640 10 monclient: _finish_hunting 0 2024-02-09T08:02:13.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.431+0000 7f3b9dd9b640 1 monclient: found mon.noname-b 2024-02-09T08:02:13.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.431+0000 7f3b9dd9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:02:13.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.431+0000 7f3b9dd9b640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.103:3300/0 2024-02-09T08:02:13.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.431+0000 7f3b9dd9b640 1 -- 172.21.15.103:0/428367522 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba0141db0 con 0x7f3ba013b230 2024-02-09T08:02:13.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.433+0000 7f3b9dd9b640 1 --2- 172.21.15.103:0/428367522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ba013b230 0x7f3ba013b690 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3b94008fd0 tx=0x7f3b940012d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:02:13.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.433+0000 7f3b8effd640 10 client.?.objecter ms_handle_connect 0x7f3ba013b230 2024-02-09T08:02:13.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.433+0000 7f3b8effd640 10 client.?.objecter resend_mon_ops 2024-02-09T08:02:13.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.437+0000 7f3b8effd640 1 -- 172.21.15.103:0/428367522 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b94006be0 con 0x7f3ba013b230 2024-02-09T08:02:13.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.437+0000 7f3b8effd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:13.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.437+0000 7f3b8effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:02:13.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.437+0000 7f3b8effd640 10 monclient: dump: 2024-02-09T08:02:13.445 INFO:teuthology.orchestra.run.smithi103.stderr:epoch 1 2024-02-09T08:02:13.445 INFO:teuthology.orchestra.run.smithi103.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:13.445 INFO:teuthology.orchestra.run.smithi103.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:13.445 INFO:teuthology.orchestra.run.smithi103.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:13.445 INFO:teuthology.orchestra.run.smithi103.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:13.445 INFO:teuthology.orchestra.run.smithi103.stderr:election_strategy: 1 2024-02-09T08:02:13.445 INFO:teuthology.orchestra.run.smithi103.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:13.446 INFO:teuthology.orchestra.run.smithi103.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:13.446 INFO:teuthology.orchestra.run.smithi103.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:13.446 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:02:13.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.437+0000 7f3b8effd640 10 monclient: _finish_auth 0 2024-02-09T08:02:13.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.437+0000 7f3b8effd640 10 monclient: _check_auth_tickets 2024-02-09T08:02:13.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.437+0000 7f3b8effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:02:13.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.437+0000 7f3b8effd640 1 -- 172.21.15.103:0/428367522 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b94006d60 con 0x7f3ba013b230 2024-02-09T08:02:13.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.437+0000 7f3b8effd640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:02:13.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.437+0000 7f3b8effd640 1 -- 172.21.15.103:0/428367522 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b94003830 con 0x7f3ba013b230 2024-02-09T08:02:13.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.437+0000 7f3b8effd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:13.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.437+0000 7f3b8effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:02:13.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.437+0000 7f3b8effd640 10 monclient: dump: 2024-02-09T08:02:13.446 INFO:teuthology.orchestra.run.smithi103.stderr:epoch 1 2024-02-09T08:02:13.446 INFO:teuthology.orchestra.run.smithi103.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:13.447 INFO:teuthology.orchestra.run.smithi103.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:13.447 INFO:teuthology.orchestra.run.smithi103.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:13.447 INFO:teuthology.orchestra.run.smithi103.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:13.447 INFO:teuthology.orchestra.run.smithi103.stderr:election_strategy: 1 2024-02-09T08:02:13.447 INFO:teuthology.orchestra.run.smithi103.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:13.447 INFO:teuthology.orchestra.run.smithi103.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:13.447 INFO:teuthology.orchestra.run.smithi103.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:13.447 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:02:13.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.437+0000 7f3ba49cf640 5 monclient: authenticate success, global_id 4156 2024-02-09T08:02:13.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.437+0000 7f3ba49cf640 10 monclient: _renew_subs 2024-02-09T08:02:13.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.437+0000 7f3b9cd99640 4 set_mon_vals no callback set 2024-02-09T08:02:13.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.437+0000 7f3ba49cf640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:02:13.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.437+0000 7f3ba49cf640 1 -- 172.21.15.103:0/428367522 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ba01daf60 con 0x7f3ba013b230 2024-02-09T08:02:13.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.437+0000 7f3ba49cf640 10 client.4156.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:02:13.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.437+0000 7f3ba49cf640 10 monclient: _renew_subs 2024-02-09T08:02:13.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.437+0000 7f3ba49cf640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:02:13.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.437+0000 7f3ba49cf640 1 -- 172.21.15.103:0/428367522 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ba01db420 con 0x7f3ba013b230 2024-02-09T08:02:13.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.437+0000 7f3ba49cf640 1 librados: init done 2024-02-09T08:02:13.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.438+0000 7f3ba49cf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:02:13.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.438+0000 7f3ba49cf640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:02:13.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.438+0000 7f3ba49cf640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:02:13.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.438+0000 7f3ba49cf640 1 -- 172.21.15.103:0/428367522 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ba00682f0 con 0x7f3ba013b230 2024-02-09T08:02:13.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.440+0000 7f3b8effd640 1 -- 172.21.15.103:0/428367522 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f3b94030070 con 0x7f3ba013b230 2024-02-09T08:02:13.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.440+0000 7f3b8effd640 1 -- 172.21.15.103:0/428367522 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f3b94032ac0 con 0x7f3ba013b230 2024-02-09T08:02:13.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.440+0000 7f3b8effd640 10 client.4156.objecter ms_dispatch 0x7f3ba0000b90 osd_map(9..9 src has 1..9) v4 2024-02-09T08:02:13.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.440+0000 7f3b8effd640 3 client.4156.objecter handle_osd_map got epochs [9,9] > 0 2024-02-09T08:02:13.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.440+0000 7f3b8effd640 3 client.4156.objecter handle_osd_map decoding full epoch 9 2024-02-09T08:02:13.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.440+0000 7f3b8effd640 20 client.4156.objecter dump_active .. 0 homeless 2024-02-09T08:02:13.461 INFO:tasks.ceph.mgr.y.smithi062.stderr:2024-02-09T08:02:13.459+0000 7f96d1c3f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-09T08:02:13.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.535+0000 7f3b8effd640 1 -- 172.21.15.103:0/428367522 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f3b9404b060 con 0x7f3ba013b230 2024-02-09T08:02:13.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.535+0000 7f3b8effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:02:13.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.535+0000 7f3b8effd640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:02:13.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.606+0000 7f3ba49cf640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "d31bdb4b-8938-4da9-8bf1-57cf730e839d", "id": 7}] 2024-02-09T08:02:13.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.606+0000 7f3ba49cf640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "d31bdb4b-8938-4da9-8bf1-57cf730e839d", "id": 7}] 2024-02-09T08:02:13.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.606+0000 7f3ba49cf640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:02:13.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.606+0000 7f3ba49cf640 1 -- 172.21.15.103:0/428367522 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d31bdb4b-8938-4da9-8bf1-57cf730e839d", "id": 7} v 0) v1 -- 0x7f3ba004ef90 con 0x7f3ba013b230 2024-02-09T08:02:13.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:13.757+0000 7f3b8effd640 1 -- 172.21.15.103:0/428367522 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mgrmap(e 2) v1 ==== 44919+0+0 (secure 0 0 0) 0x7f3b94050480 con 0x7f3ba013b230 2024-02-09T08:02:14.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:14.050+0000 7f3b8effd640 1 -- 172.21.15.103:0/428367522 <== mon.1 v2:172.21.15.103:3300/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d31bdb4b-8938-4da9-8bf1-57cf730e839d", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3b94032460 con 0x7f3ba013b230 2024-02-09T08:02:14.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:14.050+0000 7f3b8effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "d31bdb4b-8938-4da9-8bf1-57cf730e839d", "id": 7}] 2024-02-09T08:02:14.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:14.050+0000 7f3b8effd640 10 monclient: _finish_command 2 = system:0 2024-02-09T08:02:14.053 INFO:teuthology.orchestra.run.smithi103.stdout:7 2024-02-09T08:02:14.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:14.051+0000 7f3ba49cf640 10 librados: watch_flush enter 2024-02-09T08:02:14.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:14.051+0000 7f3ba49cf640 10 librados: watch_flush exit 2024-02-09T08:02:14.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:14.051+0000 7f3ba49cf640 20 client.4156.objecter shutdown clearing up homeless session... 2024-02-09T08:02:14.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:14.051+0000 7f3ba49cf640 10 client.4156.objecter successfully canceled tick 2024-02-09T08:02:14.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:14.051+0000 7f3ba49cf640 10 monclient: shutdown 2024-02-09T08:02:14.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:14.051+0000 7f3ba49cf640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:02:14.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:14.051+0000 7f3ba49cf640 1 -- 172.21.15.103:0/428367522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ba013b230 msgr2=0x7f3ba013b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:14.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:14.051+0000 7f3ba49cf640 1 --2- 172.21.15.103:0/428367522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ba013b230 0x7f3ba013b690 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3b94008fd0 tx=0x7f3b940012d0 comp rx=0 tx=0).stop 2024-02-09T08:02:14.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:14.052+0000 7f3ba49cf640 1 -- 172.21.15.103:0/428367522 shutdown_connections 2024-02-09T08:02:14.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:14.052+0000 7f3ba49cf640 1 --2- 172.21.15.103:0/428367522 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3ba01d8020 0x7f3ba01d84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:14.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:14.052+0000 7f3ba49cf640 1 --2- 172.21.15.103:0/428367522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ba013b230 0x7f3ba013b690 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:14.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:14.052+0000 7f3ba49cf640 1 --2- 172.21.15.103:0/428367522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b88005110 0x7f3ba013a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:14.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:14.052+0000 7f3ba49cf640 1 -- 172.21.15.103:0/428367522 >> 172.21.15.103:0/428367522 conn(0x7f3ba006ac50 msgr2=0x7f3ba006b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:02:14.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:14.052+0000 7f3ba49cf640 1 -- 172.21.15.103:0/428367522 shutdown_connections 2024-02-09T08:02:14.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:14.052+0000 7f3ba49cf640 1 -- 172.21.15.103:0/428367522 wait complete. 2024-02-09T08:02:14.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-09T08:02:14.052+0000 7f3ba49cf640 1 librados: shutdown 2024-02-09T08:02:14.065 DEBUG:tasks.ceph_manager:running osd.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.0.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-02-09T08:02:14.065 INFO:tasks.ceph.osd.0:Restarting daemon 2024-02-09T08:02:14.065 DEBUG:teuthology.orchestra.run.smithi062:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 0 2024-02-09T08:02:14.067 INFO:tasks.ceph.osd.0:Started 2024-02-09T08:02:14.067 DEBUG:tasks.ceph_manager:running osd.1 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.1.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-02-09T08:02:14.067 INFO:tasks.ceph.osd.1:Restarting daemon 2024-02-09T08:02:14.068 DEBUG:teuthology.orchestra.run.smithi062:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.1.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 1 2024-02-09T08:02:14.070 INFO:tasks.ceph.osd.1:Started 2024-02-09T08:02:14.070 DEBUG:tasks.ceph_manager:running osd.2 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.2.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-02-09T08:02:14.070 INFO:tasks.ceph.osd.2:Restarting daemon 2024-02-09T08:02:14.070 DEBUG:teuthology.orchestra.run.smithi062:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.2.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 2 2024-02-09T08:02:14.072 INFO:tasks.ceph.osd.2:Started 2024-02-09T08:02:14.072 DEBUG:tasks.ceph_manager:running osd.3 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.3.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-02-09T08:02:14.072 INFO:tasks.ceph.osd.3:Restarting daemon 2024-02-09T08:02:14.073 DEBUG:teuthology.orchestra.run.smithi062:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.3.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 3 2024-02-09T08:02:14.075 INFO:tasks.ceph.osd.3:Started 2024-02-09T08:02:14.075 DEBUG:tasks.ceph_manager:running osd.4 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.4.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-02-09T08:02:14.075 INFO:tasks.ceph.osd.4:Restarting daemon 2024-02-09T08:02:14.075 DEBUG:teuthology.orchestra.run.smithi103:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.4.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 4 2024-02-09T08:02:14.107 INFO:tasks.ceph.osd.4:Started 2024-02-09T08:02:14.107 DEBUG:tasks.ceph_manager:running osd.5 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.5.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-02-09T08:02:14.107 INFO:tasks.ceph.osd.5:Restarting daemon 2024-02-09T08:02:14.107 DEBUG:teuthology.orchestra.run.smithi103:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.5.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 5 2024-02-09T08:02:14.109 INFO:tasks.ceph.osd.5:Started 2024-02-09T08:02:14.109 DEBUG:tasks.ceph_manager:running osd.6 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.6.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-02-09T08:02:14.110 INFO:tasks.ceph.osd.6:Restarting daemon 2024-02-09T08:02:14.110 DEBUG:teuthology.orchestra.run.smithi103:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.6.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 6 2024-02-09T08:02:14.112 INFO:tasks.ceph.osd.6:Started 2024-02-09T08:02:14.112 DEBUG:tasks.ceph_manager:running osd.7 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.7.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-02-09T08:02:14.112 INFO:tasks.ceph.osd.7:Restarting daemon 2024-02-09T08:02:14.112 DEBUG:teuthology.orchestra.run.smithi103:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.7.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 7 2024-02-09T08:02:14.114 INFO:tasks.ceph.osd.7:Started 2024-02-09T08:02:14.115 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-09T08:02:14.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.257+0000 7f9466f88640 10 monclient: get_monmap_and_config 2024-02-09T08:02:14.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.257+0000 7f9466f88640 10 monclient: build_initial_monmap 2024-02-09T08:02:14.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.257+0000 7f9466f88640 10 monclient: monmap: 2024-02-09T08:02:14.260 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:02:14.261 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:14.261 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:02:14.258848+0000 2024-02-09T08:02:14.261 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:02:14.258848+0000 2024-02-09T08:02:14.261 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:02:14.261 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:02:14.261 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:02:14.261 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:02:14.261 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:02:14.261 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:02:14.262 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:02:14.262 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:02:14.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.258+0000 7f9466f88640 1 Processor -- start 2024-02-09T08:02:14.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.258+0000 7f9466f88640 1 -- start start 2024-02-09T08:02:14.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.258+0000 7f9466f88640 10 monclient: init 2024-02-09T08:02:14.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.259+0000 7f9466f88640 10 monclient: _reopen_session rank -1 2024-02-09T08:02:14.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.259+0000 7f9466f88640 10 monclient: _add_conns ranks=[1,2,4,3,0] 2024-02-09T08:02:14.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.259+0000 7f9466f88640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f94600b5000 addr v1:172.21.15.103:6789/0 2024-02-09T08:02:14.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.259+0000 7f9466f88640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f94600a9e30 0x7f9460145de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:14.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.259+0000 7f9466f88640 10 monclient(hunting): picked mon.noname-b con 0x7f94600a9e30 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:02:14.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.259+0000 7f9466f88640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f946013fdf0 0x7f9460146320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:14.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.259+0000 7f9466f88640 10 monclient(hunting): picked mon.noname-c con 0x7f946013fdf0 addr v2:172.21.15.103:3300/0 2024-02-09T08:02:14.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.259+0000 7f9466f88640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94600aa4a0 con 0x7f94600b5000 2024-02-09T08:02:14.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.259+0000 7f9466f88640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:14.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.259+0000 7f9466f88640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94600b53e0 con 0x7f946013fdf0 2024-02-09T08:02:14.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.259+0000 7f9466f88640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:14.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.259+0000 7f9466f88640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9460146860 con 0x7f94600a9e30 2024-02-09T08:02:14.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.259+0000 7f9466f88640 10 monclient(hunting): _renew_subs 2024-02-09T08:02:14.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.259+0000 7f9466f88640 10 monclient(hunting): authenticate will time out at 1377.620219s 2024-02-09T08:02:14.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.281+0000 7f945ffff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f94600a9e30 0x7f9460145de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:14.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.281+0000 7f945ffff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f94600a9e30 0x7f9460145de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:35138/0 (socket says 172.21.15.62:35138) 2024-02-09T08:02:14.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.281+0000 7f945ffff640 1 -- 172.21.15.62:0/3572358439 learned_addr learned my addr 172.21.15.62:0/3572358439 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:02:14.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.281+0000 7f945ffff640 10 monclient(hunting): get_auth_request con 0x7f94600a9e30 auth_method 0 2024-02-09T08:02:14.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.281+0000 7f945ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:14.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.281+0000 7f945ffff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:14.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.281+0000 7f945ffff640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:14.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.282+0000 7f945ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:14.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.282+0000 7f945ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:14.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.282+0000 7f945ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:14.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.285+0000 7f945ffff640 10 monclient(hunting): handle_auth_done global_id 4154 payload 274 2024-02-09T08:02:14.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.285+0000 7f945ffff640 1 -- 172.21.15.62:0/3572358439 >> v2:172.21.15.103:3300/0 conn(0x7f946013fdf0 msgr2=0x7f9460146320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:02:14.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.285+0000 7f945ffff640 1 --2- 172.21.15.62:0/3572358439 >> v2:172.21.15.103:3300/0 conn(0x7f946013fdf0 0x7f9460146320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:14.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.285+0000 7f945ffff640 1 -- 172.21.15.62:0/3572358439 >> v1:172.21.15.103:6789/0 conn(0x7f94600b5000 legacy=0x7f946013f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:02:14.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.285+0000 7f945ffff640 10 monclient: _finish_hunting 0 2024-02-09T08:02:14.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.285+0000 7f945ffff640 1 monclient: found mon.noname-b 2024-02-09T08:02:14.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.285+0000 7f945ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:02:14.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.285+0000 7f945ffff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.62:3301/0 2024-02-09T08:02:14.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.285+0000 7f945ffff640 1 -- 172.21.15.62:0/3572358439 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94600b2900 con 0x7f94600a9e30 2024-02-09T08:02:14.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.287+0000 7f945ffff640 1 --2- 172.21.15.62:0/3572358439 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f94600a9e30 0x7f9460145de0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f944c009870 tx=0x7f944c02b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b81604427aa45c3 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:02:14.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.293+0000 7f945f7fe640 1 -- 172.21.15.62:0/3572358439 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944c0317c0 con 0x7f94600a9e30 2024-02-09T08:02:14.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.293+0000 7f945f7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:14.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.293+0000 7f945f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:02:14.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.293+0000 7f945f7fe640 10 monclient: dump: 2024-02-09T08:02:14.304 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:02:14.305 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:14.305 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:14.305 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:14.305 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:14.305 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:02:14.305 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:14.305 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:14.305 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:14.305 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:02:14.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.293+0000 7f945f7fe640 10 monclient: _finish_auth 0 2024-02-09T08:02:14.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.293+0000 7f945f7fe640 10 monclient: _check_auth_tickets 2024-02-09T08:02:14.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.293+0000 7f945f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:02:14.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.293+0000 7f945f7fe640 1 -- 172.21.15.62:0/3572358439 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f944c031920 con 0x7f94600a9e30 2024-02-09T08:02:14.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.293+0000 7f945f7fe640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:02:14.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.293+0000 7f945f7fe640 1 -- 172.21.15.62:0/3572358439 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944c031cb0 con 0x7f94600a9e30 2024-02-09T08:02:14.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.293+0000 7f945f7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:14.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.293+0000 7f945f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-09T08:02:14.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.293+0000 7f945f7fe640 10 monclient: dump: 2024-02-09T08:02:14.306 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:02:14.306 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:14.306 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:14.306 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:14.306 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:14.306 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:02:14.306 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:14.306 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:14.306 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:14.306 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:02:14.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.294+0000 7f9466f88640 5 monclient: authenticate success, global_id 4154 2024-02-09T08:02:14.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.294+0000 7f9466f88640 10 monclient: get_monmap_and_config success 2024-02-09T08:02:14.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.294+0000 7f9466f88640 4 set_mon_vals no callback set 2024-02-09T08:02:14.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.295+0000 7f9466f88640 10 monclient: shutdown 2024-02-09T08:02:14.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.295+0000 7f9466f88640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:02:14.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.295+0000 7f9466f88640 1 -- 172.21.15.62:0/3572358439 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f94600a9e30 msgr2=0x7f9460145de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:14.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.295+0000 7f9466f88640 1 --2- 172.21.15.62:0/3572358439 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f94600a9e30 0x7f9460145de0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f944c009870 tx=0x7f944c02b860 comp rx=0 tx=0).stop 2024-02-09T08:02:14.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.295+0000 7f9466f88640 1 -- 172.21.15.62:0/3572358439 shutdown_connections 2024-02-09T08:02:14.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.295+0000 7f9466f88640 1 --2- 172.21.15.62:0/3572358439 >> v2:172.21.15.103:3300/0 conn(0x7f946013fdf0 0x7f9460146320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:14.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.295+0000 7f9466f88640 1 --2- 172.21.15.62:0/3572358439 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f94600a9e30 0x7f9460145de0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:14.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.295+0000 7f9466f88640 1 -- 172.21.15.62:0/3572358439 >> 172.21.15.62:0/3572358439 conn(0x7f9460066bb0 msgr2=0x7f9460066fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:02:14.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.295+0000 7f9466f88640 1 -- 172.21.15.62:0/3572358439 shutdown_connections 2024-02-09T08:02:14.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.295+0000 7f9466f88640 1 -- 172.21.15.62:0/3572358439 wait complete. 2024-02-09T08:02:14.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.296+0000 7f9466f88640 10 monclient: build_initial_monmap 2024-02-09T08:02:14.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.296+0000 7f9466f88640 10 monclient: monmap: 2024-02-09T08:02:14.308 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:02:14.308 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:02:14.308 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:02:14.308 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:02:14.308 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:02:14.308 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:02:14.308 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:02:14.309 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:02:14.309 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:02:14.309 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:02:14.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.296+0000 7f9466f88640 1 librados: starting msgr at 2024-02-09T08:02:14.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.296+0000 7f9466f88640 1 librados: starting objecter 2024-02-09T08:02:14.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.296+0000 7f9466f88640 1 Processor -- start 2024-02-09T08:02:14.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.296+0000 7f9466f88640 1 -- start start 2024-02-09T08:02:14.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.296+0000 7f9466f88640 1 librados: setting wanted keys 2024-02-09T08:02:14.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.296+0000 7f9466f88640 1 librados: calling monclient init 2024-02-09T08:02:14.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.296+0000 7f9466f88640 10 monclient: init 2024-02-09T08:02:14.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.297+0000 7f9466f88640 10 monclient: _reopen_session rank -1 2024-02-09T08:02:14.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.297+0000 7f9466f88640 10 monclient: _add_conns ranks=[1,0,2] 2024-02-09T08:02:14.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.297+0000 7f9466f88640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94600a9e30 0x7f9460139d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:14.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.297+0000 7f9466f88640 10 monclient(hunting): picked mon.noname-b con 0x7f94600a9e30 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:02:14.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.297+0000 7f9466f88640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94600b5000 0x7f946013c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:14.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.297+0000 7f9466f88640 10 monclient(hunting): picked mon.noname-a con 0x7f94600b5000 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:02:14.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.297+0000 7f9466f88640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f946013fdf0 0x7f9460142b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:14.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.298+0000 7f9466f88640 10 monclient(hunting): picked mon.noname-c con 0x7f946013fdf0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:02:14.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.298+0000 7f9466f88640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:14.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.298+0000 7f9466f88640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f946013ccd0 con 0x7f94600b5000 2024-02-09T08:02:14.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.298+0000 7f9466f88640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:14.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.298+0000 7f9466f88640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f946013ba40 con 0x7f94600a9e30 2024-02-09T08:02:14.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.298+0000 7f9466f88640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:14.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.298+0000 7f9466f88640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f946013c270 con 0x7f946013fdf0 2024-02-09T08:02:14.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.298+0000 7f9466f88640 10 monclient(hunting): _renew_subs 2024-02-09T08:02:14.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.298+0000 7f9466f88640 10 monclient(hunting): authenticate will time out at 1377.658366s 2024-02-09T08:02:14.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.304+0000 7f9464d24640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94600a9e30 0x7f9460139d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:14.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.305+0000 7f9464d24640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94600a9e30 0x7f9460139d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.62:35606/0 (socket says 172.21.15.62:35606) 2024-02-09T08:02:14.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.305+0000 7f9464d24640 1 -- 172.21.15.62:0/2736580652 learned_addr learned my addr 172.21.15.62:0/2736580652 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:02:14.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.305+0000 7f9464d24640 10 monclient(hunting): get_auth_request con 0x7f94600a9e30 auth_method 0 2024-02-09T08:02:14.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.305+0000 7f9464d24640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:14.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.305+0000 7f9464d24640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:14.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.305+0000 7f9464d24640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:14.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.306+0000 7f9465525640 1 --2- 172.21.15.62:0/2736580652 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f946013fdf0 0x7f9460142b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:14.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.307+0000 7f9465525640 10 monclient(hunting): get_auth_request con 0x7f946013fdf0 auth_method 0 2024-02-09T08:02:14.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.307+0000 7f9465525640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:14.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.307+0000 7f9465525640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:14.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.307+0000 7f9465525640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:14.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.307+0000 7f9464d24640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:14.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.307+0000 7f9464d24640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:14.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.307+0000 7f9464d24640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:14.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.309+0000 7f9465525640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:14.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.309+0000 7f9465525640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:14.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.309+0000 7f9465525640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:14.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.312+0000 7f9465525640 10 monclient(hunting): handle_auth_done global_id 4157 payload 824 2024-02-09T08:02:14.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.312+0000 7f9465525640 1 -- 172.21.15.62:0/2736580652 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94600a9e30 msgr2=0x7f9460139d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:14.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.312+0000 7f9465525640 1 --2- 172.21.15.62:0/2736580652 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94600a9e30 0x7f9460139d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:14.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.312+0000 7f9465525640 1 -- 172.21.15.62:0/2736580652 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94600b5000 msgr2=0x7f946013c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:14.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.312+0000 7f9465525640 1 --2- 172.21.15.62:0/2736580652 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94600b5000 0x7f946013c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:14.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.312+0000 7f9465525640 10 monclient: _finish_hunting 0 2024-02-09T08:02:14.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.312+0000 7f9465525640 1 monclient: found mon.noname-c 2024-02-09T08:02:14.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.312+0000 7f9465525640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:02:14.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.312+0000 7f9465525640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-02-09T08:02:14.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.312+0000 7f9465525640 1 -- 172.21.15.62:0/2736580652 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f944c0094d0 con 0x7f946013fdf0 2024-02-09T08:02:14.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.337+0000 7f9465525640 1 --2- 172.21.15.62:0/2736580652 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f946013fdf0 0x7f9460142b90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f945800be20 tx=0x7f945800bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:02:14.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.337+0000 7f945d7fa640 10 client.?.objecter ms_handle_connect 0x7f946013fdf0 2024-02-09T08:02:14.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.337+0000 7f945d7fa640 10 client.?.objecter resend_mon_ops 2024-02-09T08:02:14.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.344+0000 7f945d7fa640 1 -- 172.21.15.62:0/2736580652 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945800ce70 con 0x7f946013fdf0 2024-02-09T08:02:14.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.344+0000 7f945d7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:14.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.344+0000 7f945d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-09T08:02:14.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.344+0000 7f945d7fa640 10 monclient: dump: 2024-02-09T08:02:14.347 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:02:14.347 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:14.347 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:14.347 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:14.347 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:14.347 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:02:14.347 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:14.347 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:14.347 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:14.347 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:02:14.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.344+0000 7f945d7fa640 10 monclient: _finish_auth 0 2024-02-09T08:02:14.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.344+0000 7f945d7fa640 10 monclient: _check_auth_tickets 2024-02-09T08:02:14.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.344+0000 7f945d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:02:14.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.344+0000 7f945d7fa640 1 -- 172.21.15.62:0/2736580652 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9458014440 con 0x7f946013fdf0 2024-02-09T08:02:14.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.344+0000 7f945d7fa640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:02:14.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.344+0000 7f945d7fa640 1 -- 172.21.15.62:0/2736580652 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9458014810 con 0x7f946013fdf0 2024-02-09T08:02:14.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.344+0000 7f945d7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:14.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.344+0000 7f945d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-09T08:02:14.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.344+0000 7f945d7fa640 10 monclient: dump: 2024-02-09T08:02:14.348 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:02:14.348 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:14.348 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:14.349 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:14.349 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:14.349 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:02:14.349 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:14.349 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:14.349 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:14.349 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:02:14.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.344+0000 7f9466f88640 5 monclient: authenticate success, global_id 4157 2024-02-09T08:02:14.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.344+0000 7f9466f88640 10 monclient: _renew_subs 2024-02-09T08:02:14.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.344+0000 7f9466f88640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:02:14.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.344+0000 7f9466f88640 1 -- 172.21.15.62:0/2736580652 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94600b4870 con 0x7f946013fdf0 2024-02-09T08:02:14.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.344+0000 7f945effd640 4 set_mon_vals no callback set 2024-02-09T08:02:14.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.344+0000 7f9466f88640 10 client.4157.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:02:14.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.344+0000 7f9466f88640 10 monclient: _renew_subs 2024-02-09T08:02:14.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.344+0000 7f9466f88640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:02:14.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.344+0000 7f9466f88640 1 -- 172.21.15.62:0/2736580652 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f946013ab20 con 0x7f946013fdf0 2024-02-09T08:02:14.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.344+0000 7f9466f88640 1 librados: init done 2024-02-09T08:02:14.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.346+0000 7f9466f88640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:02:14.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.346+0000 7f9466f88640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:02:14.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.346+0000 7f9466f88640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:02:14.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.346+0000 7f9466f88640 1 -- 172.21.15.62:0/2736580652 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f946004ef90 con 0x7f946013fdf0 2024-02-09T08:02:14.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.391+0000 7f945d7fa640 1 -- 172.21.15.62:0/2736580652 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 2) v1 ==== 44919+0+0 (secure 0 0 0) 0x7f945801d3b0 con 0x7f946013fdf0 2024-02-09T08:02:14.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.473+0000 7f945d7fa640 1 -- 172.21.15.62:0/2736580652 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f945801de10 con 0x7f946013fdf0 2024-02-09T08:02:14.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.473+0000 7f945d7fa640 10 client.4157.objecter ms_dispatch 0x7f9460000b90 osd_map(10..10 src has 1..10) v4 2024-02-09T08:02:14.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.473+0000 7f945d7fa640 3 client.4157.objecter handle_osd_map got epochs [10,10] > 0 2024-02-09T08:02:14.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.473+0000 7f945d7fa640 3 client.4157.objecter handle_osd_map decoding full epoch 10 2024-02-09T08:02:14.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.473+0000 7f945d7fa640 20 client.4157.objecter dump_active .. 0 homeless 2024-02-09T08:02:14.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.473+0000 7f945d7fa640 1 -- 172.21.15.62:0/2736580652 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f945801c360 con 0x7f946013fdf0 2024-02-09T08:02:14.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.473+0000 7f945d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:02:14.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.473+0000 7f945d7fa640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:02:14.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.575+0000 7f9466f88640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-02-09T08:02:14.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.575+0000 7f9466f88640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-02-09T08:02:14.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.575+0000 7f9466f88640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:02:14.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.575+0000 7f9466f88640 1 -- 172.21.15.62:0/2736580652 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f94600a9900 con 0x7f946013fdf0 2024-02-09T08:02:14.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.630+0000 7f945d7fa640 1 -- 172.21.15.62:0/2736580652 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f9458019070 con 0x7f946013fdf0 2024-02-09T08:02:14.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.630+0000 7f945d7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-02-09T08:02:14.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.630+0000 7f945d7fa640 10 monclient: _finish_command 2 = system:0 2024-02-09T08:02:14.633 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T08:02:14.634 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":10,"fsid":"981c5564-eb76-49a1-80ab-97c7647bc34a","created":"2024-02-09T08:02:07.866410+0000","modified":"2024-02-09T08:02:13.770858+0000","last_up_change":"0.000000","last_in_change":"2024-02-09T08:02:13.770858+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0e3b17d4-a50f-41d9-b455-0bc1606a5c86","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a0077e6c-220d-46f4-9be2-a707d1710890","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3739882a-5263-4113-840a-afd6acdcf15e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3657c103-db3d-46c5-8afc-2b0b9da1e2e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"faf5e721-fa06-43f8-9b72-36ca8132ffea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"5c96dba1-53d2-4c0c-8928-5f09ea17a984","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"3473844d-d631-4ea4-96fb-638eccee5cb6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d31bdb4b-8938-4da9-8bf1-57cf730e839d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-09T08:02:14.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.631+0000 7f9466f88640 10 librados: watch_flush enter 2024-02-09T08:02:14.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.631+0000 7f9466f88640 10 librados: watch_flush exit 2024-02-09T08:02:14.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.631+0000 7f9466f88640 20 client.4157.objecter shutdown clearing up homeless session... 2024-02-09T08:02:14.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.631+0000 7f9466f88640 10 client.4157.objecter successfully canceled tick 2024-02-09T08:02:14.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.631+0000 7f9466f88640 10 monclient: shutdown 2024-02-09T08:02:14.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.631+0000 7f9466f88640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:02:14.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.631+0000 7f9466f88640 1 -- 172.21.15.62:0/2736580652 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f946013fdf0 msgr2=0x7f9460142b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:14.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.631+0000 7f9466f88640 1 --2- 172.21.15.62:0/2736580652 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f946013fdf0 0x7f9460142b90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f945800be20 tx=0x7f945800bf10 comp rx=0 tx=0).stop 2024-02-09T08:02:14.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.632+0000 7f9466f88640 1 -- 172.21.15.62:0/2736580652 shutdown_connections 2024-02-09T08:02:14.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.632+0000 7f9466f88640 1 --2- 172.21.15.62:0/2736580652 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f946013fdf0 0x7f9460142b90 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:14.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.632+0000 7f9466f88640 1 --2- 172.21.15.62:0/2736580652 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94600b5000 0x7f946013c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:14.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.632+0000 7f9466f88640 1 --2- 172.21.15.62:0/2736580652 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94600a9e30 0x7f9460139d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:14.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.632+0000 7f9466f88640 1 -- 172.21.15.62:0/2736580652 >> 172.21.15.62:0/2736580652 conn(0x7f9460066bb0 msgr2=0x7f94600b6980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:02:14.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.632+0000 7f9466f88640 1 -- 172.21.15.62:0/2736580652 shutdown_connections 2024-02-09T08:02:14.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.632+0000 7f9466f88640 1 -- 172.21.15.62:0/2736580652 wait complete. 2024-02-09T08:02:14.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:02:14.632+0000 7f9466f88640 1 librados: shutdown 2024-02-09T08:02:14.646 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-02-09T08:02:14.646 INFO:tasks.ceph:Waiting for OSDs to come up 2024-02-09T08:02:15.301 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-02-09T08:02:15.299+0000 7fa09a455640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-02-09T08:02:15.397 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-02-09T08:02:15.395+0000 7fa09a455640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-02-09T08:02:15.452 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-09T08:02:15.599 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.596+0000 7f8f14295640 10 monclient: get_monmap_and_config 2024-02-09T08:02:15.599 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.596+0000 7f8f14295640 10 monclient: build_initial_monmap 2024-02-09T08:02:15.599 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.596+0000 7f8f14295640 10 monclient: monmap: 2024-02-09T08:02:15.599 INFO:teuthology.misc.health.smithi062.stderr:epoch 0 2024-02-09T08:02:15.600 INFO:teuthology.misc.health.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:15.600 INFO:teuthology.misc.health.smithi062.stderr:last_changed 2024-02-09T08:02:15.597621+0000 2024-02-09T08:02:15.600 INFO:teuthology.misc.health.smithi062.stderr:created 2024-02-09T08:02:15.597621+0000 2024-02-09T08:02:15.600 INFO:teuthology.misc.health.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:02:15.600 INFO:teuthology.misc.health.smithi062.stderr:election_strategy: 1 2024-02-09T08:02:15.600 INFO:teuthology.misc.health.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:02:15.600 INFO:teuthology.misc.health.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:02:15.600 INFO:teuthology.misc.health.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:02:15.600 INFO:teuthology.misc.health.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:02:15.600 INFO:teuthology.misc.health.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:02:15.600 INFO:teuthology.misc.health.smithi062.stderr: 2024-02-09T08:02:15.600 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.597+0000 7f8f14295640 1 Processor -- start 2024-02-09T08:02:15.600 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.597+0000 7f8f14295640 1 -- start start 2024-02-09T08:02:15.601 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.597+0000 7f8f14295640 10 monclient: init 2024-02-09T08:02:15.603 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.598+0000 7f8f14295640 10 monclient: _reopen_session rank -1 2024-02-09T08:02:15.603 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.598+0000 7f8f14295640 10 monclient: _add_conns ranks=[2,3,0,1,4] 2024-02-09T08:02:15.603 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.598+0000 7f8f14295640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8f0c0b5490 0x7f8f0c0a9850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:15.603 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.598+0000 7f8f14295640 10 monclient(hunting): picked mon.noname-b con 0x7f8f0c0b5490 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:02:15.603 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.598+0000 7f8f14295640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8f0c13f880 0x7f8f0c13fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:15.603 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.598+0000 7f8f14295640 10 monclient(hunting): picked mon.noname-a con 0x7f8f0c13f880 addr v2:172.21.15.62:3300/0 2024-02-09T08:02:15.603 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.598+0000 7f8f14295640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8f0c145b70 addr v1:172.21.15.62:6789/0 2024-02-09T08:02:15.603 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.598+0000 7f8f14295640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f0c1466f0 con 0x7f8f0c145b70 2024-02-09T08:02:15.603 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.598+0000 7f8f14295640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:15.603 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.598+0000 7f8f14295640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f0c0ab530 con 0x7f8f0c13f880 2024-02-09T08:02:15.603 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.598+0000 7f8f14295640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:15.603 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.598+0000 7f8f14295640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0c0b5870 con 0x7f8f0c0b5490 2024-02-09T08:02:15.603 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.598+0000 7f8f14295640 10 monclient(hunting): _renew_subs 2024-02-09T08:02:15.604 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.598+0000 7f8f14295640 10 monclient(hunting): authenticate will time out at 1378.958942s 2024-02-09T08:02:15.604 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.599+0000 7f8f12031640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8f0c0b5490 0x7f8f0c0a9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:15.604 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.600+0000 7f8f12031640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8f0c0b5490 0x7f8f0c0a9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:35154/0 (socket says 172.21.15.62:35154) 2024-02-09T08:02:15.604 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.600+0000 7f8f12031640 1 -- 172.21.15.62:0/2548326176 learned_addr learned my addr 172.21.15.62:0/2548326176 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:02:15.604 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.600+0000 7f8f12031640 10 monclient(hunting): get_auth_request con 0x7f8f0c0b5490 auth_method 0 2024-02-09T08:02:15.604 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.600+0000 7f8f12031640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:15.604 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.600+0000 7f8f12031640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:15.604 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.600+0000 7f8f12031640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:15.604 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.600+0000 7f8f12031640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:15.604 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.600+0000 7f8f12031640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:15.604 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.600+0000 7f8f12031640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:15.605 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.603+0000 7f8f12031640 10 monclient(hunting): handle_auth_done global_id 4160 payload 274 2024-02-09T08:02:15.606 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.603+0000 7f8f12031640 1 -- 172.21.15.62:0/2548326176 >> v2:172.21.15.62:3300/0 conn(0x7f8f0c13f880 msgr2=0x7f8f0c13fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:02:15.606 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.603+0000 7f8f12031640 1 --2- 172.21.15.62:0/2548326176 >> v2:172.21.15.62:3300/0 conn(0x7f8f0c13f880 0x7f8f0c13fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:15.606 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.603+0000 7f8f12031640 1 -- 172.21.15.62:0/2548326176 >> v1:172.21.15.62:6789/0 conn(0x7f8f0c145b70 legacy=0x7f8f0c145fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:02:15.606 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.603+0000 7f8f12031640 10 monclient: _finish_hunting 0 2024-02-09T08:02:15.606 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.603+0000 7f8f12031640 1 monclient: found mon.noname-b 2024-02-09T08:02:15.606 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.603+0000 7f8f12031640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:02:15.606 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.603+0000 7f8f12031640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.62:3301/0 2024-02-09T08:02:15.606 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.603+0000 7f8f12031640 1 -- 172.21.15.62:0/2548326176 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f0c140220 con 0x7f8f0c0b5490 2024-02-09T08:02:15.608 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.606+0000 7f8f12031640 1 --2- 172.21.15.62:0/2548326176 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8f0c0b5490 0x7f8f0c0a9850 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8f08009870 tx=0x7f8f0802b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a3d80cb4eb122f5 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:02:15.617 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.611+0000 7f8f1102f640 1 -- 172.21.15.62:0/2548326176 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f080317c0 con 0x7f8f0c0b5490 2024-02-09T08:02:15.617 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.611+0000 7f8f1102f640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:15.617 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.611+0000 7f8f1102f640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:02:15.617 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.611+0000 7f8f1102f640 10 monclient: dump: 2024-02-09T08:02:15.617 INFO:teuthology.misc.health.smithi062.stderr:epoch 1 2024-02-09T08:02:15.617 INFO:teuthology.misc.health.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:15.617 INFO:teuthology.misc.health.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:15.617 INFO:teuthology.misc.health.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:15.617 INFO:teuthology.misc.health.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:15.618 INFO:teuthology.misc.health.smithi062.stderr:election_strategy: 1 2024-02-09T08:02:15.618 INFO:teuthology.misc.health.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:15.618 INFO:teuthology.misc.health.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:15.618 INFO:teuthology.misc.health.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:15.618 INFO:teuthology.misc.health.smithi062.stderr: 2024-02-09T08:02:15.618 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.611+0000 7f8f1102f640 10 monclient: _finish_auth 0 2024-02-09T08:02:15.618 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.611+0000 7f8f1102f640 10 monclient: _check_auth_tickets 2024-02-09T08:02:15.618 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.611+0000 7f8f1102f640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:02:15.618 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.611+0000 7f8f1102f640 1 -- 172.21.15.62:0/2548326176 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f08031920 con 0x7f8f0c0b5490 2024-02-09T08:02:15.618 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.611+0000 7f8f1102f640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:02:15.618 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.611+0000 7f8f1102f640 1 -- 172.21.15.62:0/2548326176 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f08031cb0 con 0x7f8f0c0b5490 2024-02-09T08:02:15.618 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.611+0000 7f8f1102f640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:15.618 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.611+0000 7f8f1102f640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-09T08:02:15.618 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.611+0000 7f8f1102f640 10 monclient: dump: 2024-02-09T08:02:15.618 INFO:teuthology.misc.health.smithi062.stderr:epoch 1 2024-02-09T08:02:15.619 INFO:teuthology.misc.health.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:15.619 INFO:teuthology.misc.health.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:15.619 INFO:teuthology.misc.health.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:15.619 INFO:teuthology.misc.health.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:15.619 INFO:teuthology.misc.health.smithi062.stderr:election_strategy: 1 2024-02-09T08:02:15.619 INFO:teuthology.misc.health.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:15.619 INFO:teuthology.misc.health.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:15.619 INFO:teuthology.misc.health.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:15.619 INFO:teuthology.misc.health.smithi062.stderr: 2024-02-09T08:02:15.619 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.611+0000 7f8f14295640 5 monclient: authenticate success, global_id 4160 2024-02-09T08:02:15.619 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.611+0000 7f8f14295640 10 monclient: get_monmap_and_config success 2024-02-09T08:02:15.619 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.611+0000 7f8f14295640 4 set_mon_vals no callback set 2024-02-09T08:02:15.619 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.612+0000 7f8f14295640 10 monclient: shutdown 2024-02-09T08:02:15.619 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.612+0000 7f8f14295640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:02:15.619 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.612+0000 7f8f14295640 1 -- 172.21.15.62:0/2548326176 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8f0c0b5490 msgr2=0x7f8f0c0a9850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:15.620 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.612+0000 7f8f14295640 1 --2- 172.21.15.62:0/2548326176 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8f0c0b5490 0x7f8f0c0a9850 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8f08009870 tx=0x7f8f0802b860 comp rx=0 tx=0).stop 2024-02-09T08:02:15.620 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.612+0000 7f8f14295640 1 -- 172.21.15.62:0/2548326176 shutdown_connections 2024-02-09T08:02:15.620 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.612+0000 7f8f14295640 1 --2- 172.21.15.62:0/2548326176 >> v2:172.21.15.62:3300/0 conn(0x7f8f0c13f880 0x7f8f0c13fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:15.620 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.612+0000 7f8f14295640 1 --2- 172.21.15.62:0/2548326176 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8f0c0b5490 0x7f8f0c0a9850 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:15.620 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.612+0000 7f8f14295640 1 -- 172.21.15.62:0/2548326176 >> 172.21.15.62:0/2548326176 conn(0x7f8f0c0b8640 msgr2=0x7f8f0c0b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:02:15.620 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.614+0000 7f8f14295640 1 -- 172.21.15.62:0/2548326176 shutdown_connections 2024-02-09T08:02:15.620 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.614+0000 7f8f14295640 1 -- 172.21.15.62:0/2548326176 wait complete. 2024-02-09T08:02:15.620 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.615+0000 7f8f14295640 10 monclient: build_initial_monmap 2024-02-09T08:02:15.620 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.615+0000 7f8f14295640 10 monclient: monmap: 2024-02-09T08:02:15.620 INFO:teuthology.misc.health.smithi062.stderr:epoch 0 2024-02-09T08:02:15.620 INFO:teuthology.misc.health.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:02:15.620 INFO:teuthology.misc.health.smithi062.stderr:last_changed 0.000000 2024-02-09T08:02:15.620 INFO:teuthology.misc.health.smithi062.stderr:created 0.000000 2024-02-09T08:02:15.621 INFO:teuthology.misc.health.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:02:15.621 INFO:teuthology.misc.health.smithi062.stderr:election_strategy: 1 2024-02-09T08:02:15.621 INFO:teuthology.misc.health.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:02:15.621 INFO:teuthology.misc.health.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:02:15.621 INFO:teuthology.misc.health.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:02:15.621 INFO:teuthology.misc.health.smithi062.stderr: 2024-02-09T08:02:15.625 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.615+0000 7f8f14295640 1 librados: starting msgr at 2024-02-09T08:02:15.625 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.615+0000 7f8f14295640 1 librados: starting objecter 2024-02-09T08:02:15.625 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.615+0000 7f8f14295640 1 Processor -- start 2024-02-09T08:02:15.625 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.615+0000 7f8f14295640 1 -- start start 2024-02-09T08:02:15.625 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.615+0000 7f8f14295640 1 librados: setting wanted keys 2024-02-09T08:02:15.625 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.615+0000 7f8f14295640 1 librados: calling monclient init 2024-02-09T08:02:15.625 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.615+0000 7f8f14295640 10 monclient: init 2024-02-09T08:02:15.625 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.616+0000 7f8f14295640 10 monclient: _reopen_session rank -1 2024-02-09T08:02:15.625 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.616+0000 7f8f14295640 10 monclient: _add_conns ranks=[0,2,1] 2024-02-09T08:02:15.625 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.616+0000 7f8f14295640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f0c0b5490 0x7f8f0c13ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:15.626 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.616+0000 7f8f14295640 10 monclient(hunting): picked mon.noname-a con 0x7f8f0c0b5490 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:02:15.626 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.616+0000 7f8f14295640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8f0c13f880 0x7f8f0c142290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:15.626 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.616+0000 7f8f14295640 10 monclient(hunting): picked mon.noname-c con 0x7f8f0c13f880 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:02:15.626 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.616+0000 7f8f14295640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f0c145b70 0x7f8f0c1427d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:15.626 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.616+0000 7f8f14295640 10 monclient(hunting): picked mon.noname-b con 0x7f8f0c145b70 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:02:15.626 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.616+0000 7f8f14295640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:15.626 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.616+0000 7f8f14295640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0c1431a0 con 0x7f8f0c0b5490 2024-02-09T08:02:15.626 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.616+0000 7f8f14295640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:15.626 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.616+0000 7f8f14295640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0c06de40 con 0x7f8f0c145b70 2024-02-09T08:02:15.626 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.616+0000 7f8f14295640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:15.626 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.616+0000 7f8f14295640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0c0b1c40 con 0x7f8f0c13f880 2024-02-09T08:02:15.626 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.616+0000 7f8f14295640 10 monclient(hunting): _renew_subs 2024-02-09T08:02:15.626 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.616+0000 7f8f14295640 10 monclient(hunting): authenticate will time out at 1378.977207s 2024-02-09T08:02:15.627 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.617+0000 7f8f11830640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8f0c13f880 0x7f8f0c142290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:15.627 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.617+0000 7f8f12832640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f0c145b70 0x7f8f0c1427d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:15.627 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.618+0000 7f8f12832640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f0c145b70 0x7f8f0c1427d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.62:35608/0 (socket says 172.21.15.62:35608) 2024-02-09T08:02:15.627 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.618+0000 7f8f12832640 1 -- 172.21.15.62:0/759985879 learned_addr learned my addr 172.21.15.62:0/759985879 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:02:15.627 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.618+0000 7f8f12832640 10 monclient(hunting): get_auth_request con 0x7f8f0c145b70 auth_method 0 2024-02-09T08:02:15.627 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.618+0000 7f8f12832640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:15.627 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.618+0000 7f8f12832640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:15.627 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.618+0000 7f8f12832640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:15.627 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.618+0000 7f8f11830640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8f0c13f880 0x7f8f0c142290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:35168/0 (socket says 172.21.15.62:35168) 2024-02-09T08:02:15.627 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.618+0000 7f8f11830640 10 monclient(hunting): get_auth_request con 0x7f8f0c13f880 auth_method 0 2024-02-09T08:02:15.627 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.618+0000 7f8f11830640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:15.627 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.618+0000 7f8f11830640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:15.627 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.618+0000 7f8f11830640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:15.627 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.619+0000 7f8f12832640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:15.627 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.619+0000 7f8f12832640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:15.628 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.619+0000 7f8f12832640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:15.628 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.619+0000 7f8f11830640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:15.628 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.619+0000 7f8f11830640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:15.628 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.619+0000 7f8f11830640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:15.629 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.623+0000 7f8f12832640 10 monclient(hunting): handle_auth_done global_id 4174 payload 824 2024-02-09T08:02:15.629 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.623+0000 7f8f12832640 1 -- 172.21.15.62:0/759985879 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8f0c13f880 msgr2=0x7f8f0c142290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:15.629 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.623+0000 7f8f12832640 1 --2- 172.21.15.62:0/759985879 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8f0c13f880 0x7f8f0c142290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:15.630 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.623+0000 7f8f12832640 1 -- 172.21.15.62:0/759985879 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f0c0b5490 msgr2=0x7f8f0c13ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:15.630 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.623+0000 7f8f12832640 1 --2- 172.21.15.62:0/759985879 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f0c0b5490 0x7f8f0c13ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:15.630 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.623+0000 7f8f12832640 10 monclient: _finish_hunting 0 2024-02-09T08:02:15.630 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.623+0000 7f8f12832640 1 monclient: found mon.noname-b 2024-02-09T08:02:15.630 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.623+0000 7f8f12832640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:02:15.630 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.623+0000 7f8f12832640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.103:3300/0 2024-02-09T08:02:15.630 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.623+0000 7f8f12832640 1 -- 172.21.15.62:0/759985879 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f080094d0 con 0x7f8f0c145b70 2024-02-09T08:02:15.630 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.627+0000 7f8f12832640 1 --2- 172.21.15.62:0/759985879 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f0c145b70 0x7f8f0c1427d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8f0400b990 tx=0x7f8f0400bd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:02:15.630 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.627+0000 7f8f02ffd640 10 client.?.objecter ms_handle_connect 0x7f8f0c145b70 2024-02-09T08:02:15.630 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.627+0000 7f8f02ffd640 10 client.?.objecter resend_mon_ops 2024-02-09T08:02:15.648 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.645+0000 7f8f02ffd640 1 -- 172.21.15.62:0/759985879 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f0400caa0 con 0x7f8f0c145b70 2024-02-09T08:02:15.649 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.645+0000 7f8f02ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:15.649 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.645+0000 7f8f02ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:02:15.649 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.645+0000 7f8f02ffd640 10 monclient: dump: 2024-02-09T08:02:15.649 INFO:teuthology.misc.health.smithi062.stderr:epoch 1 2024-02-09T08:02:15.649 INFO:teuthology.misc.health.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:15.649 INFO:teuthology.misc.health.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:15.649 INFO:teuthology.misc.health.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:15.649 INFO:teuthology.misc.health.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:15.649 INFO:teuthology.misc.health.smithi062.stderr:election_strategy: 1 2024-02-09T08:02:15.649 INFO:teuthology.misc.health.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:15.649 INFO:teuthology.misc.health.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:15.649 INFO:teuthology.misc.health.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:15.649 INFO:teuthology.misc.health.smithi062.stderr: 2024-02-09T08:02:15.650 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.645+0000 7f8f02ffd640 10 monclient: _finish_auth 0 2024-02-09T08:02:15.650 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.645+0000 7f8f02ffd640 10 monclient: _check_auth_tickets 2024-02-09T08:02:15.650 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.645+0000 7f8f02ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:02:15.650 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.645+0000 7f8f14295640 5 monclient: authenticate success, global_id 4174 2024-02-09T08:02:15.650 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.645+0000 7f8f14295640 10 monclient: _renew_subs 2024-02-09T08:02:15.650 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.645+0000 7f8f14295640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:02:15.650 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.645+0000 7f8f14295640 1 -- 172.21.15.62:0/759985879 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f0c142d30 con 0x7f8f0c145b70 2024-02-09T08:02:15.650 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.645+0000 7f8f14295640 10 client.4174.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:02:15.650 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.645+0000 7f8f14295640 10 monclient: _renew_subs 2024-02-09T08:02:15.650 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.645+0000 7f8f14295640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:02:15.650 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.645+0000 7f8f14295640 1 -- 172.21.15.62:0/759985879 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f0c06cfc0 con 0x7f8f0c145b70 2024-02-09T08:02:15.650 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.645+0000 7f8f14295640 1 librados: init done 2024-02-09T08:02:15.650 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.646+0000 7f8f14295640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:02:15.650 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.646+0000 7f8f14295640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:02:15.650 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.646+0000 7f8f14295640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:02:15.651 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.646+0000 7f8f14295640 1 -- 172.21.15.62:0/759985879 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f0c068120 con 0x7f8f0c145b70 2024-02-09T08:02:15.754 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.751+0000 7f8f02ffd640 1 -- 172.21.15.62:0/759985879 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f040098d0 con 0x7f8f0c145b70 2024-02-09T08:02:15.754 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.751+0000 7f8f02ffd640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:02:15.754 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.751+0000 7f8f02ffd640 1 -- 172.21.15.62:0/759985879 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f0400ce40 con 0x7f8f0c145b70 2024-02-09T08:02:15.754 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.751+0000 7f8f02ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:15.754 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.751+0000 7f8f02ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:02:15.755 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.751+0000 7f8f02ffd640 10 monclient: dump: 2024-02-09T08:02:15.755 INFO:teuthology.misc.health.smithi062.stderr:epoch 1 2024-02-09T08:02:15.755 INFO:teuthology.misc.health.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:15.755 INFO:teuthology.misc.health.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:15.755 INFO:teuthology.misc.health.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:15.755 INFO:teuthology.misc.health.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:15.755 INFO:teuthology.misc.health.smithi062.stderr:election_strategy: 1 2024-02-09T08:02:15.755 INFO:teuthology.misc.health.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:15.755 INFO:teuthology.misc.health.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:15.755 INFO:teuthology.misc.health.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:15.755 INFO:teuthology.misc.health.smithi062.stderr: 2024-02-09T08:02:15.755 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:15.751+0000 7f8f1082e640 4 set_mon_vals no callback set 2024-02-09T08:02:16.212 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:16.210+0000 7f8f02ffd640 1 -- 172.21.15.62:0/759985879 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 3) v1 ==== 89626+0+0 (secure 0 0 0) 0x7f8f04014440 con 0x7f8f0c145b70 2024-02-09T08:02:16.213 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:16.211+0000 7f8f02ffd640 1 --2- 172.21.15.62:0/759985879 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f8ef006d020 0x7f8ef006f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:16.213 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:16.211+0000 7f8f12031640 1 --2- 172.21.15.62:0/759985879 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f8ef006d020 0x7f8ef006f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:16.213 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:16.211+0000 7f8f12031640 10 monclient: get_auth_request con 0x7f8ef006d020 auth_method 0 2024-02-09T08:02:16.213 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:16.212+0000 7f8f02ffd640 10 client.4174.objecter ms_handle_connect 0x7f8ef006d020 2024-02-09T08:02:16.213 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:16.212+0000 7f8f12031640 1 --2- 172.21.15.62:0/759985879 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f8ef006d020 0x7f8ef006f4e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8f08009870 tx=0x7f8f08030000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:02:16.216 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:16.214+0000 7f8f02ffd640 1 -- 172.21.15.62:0/759985879 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f8f04058f80 con 0x7f8f0c145b70 2024-02-09T08:02:16.217 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:16.214+0000 7f8f02ffd640 10 client.4174.objecter ms_dispatch 0x7f8f0c000b90 osd_map(10..10 src has 1..10) v4 2024-02-09T08:02:16.217 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:16.214+0000 7f8f02ffd640 3 client.4174.objecter handle_osd_map got epochs [10,10] > 0 2024-02-09T08:02:16.217 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:16.214+0000 7f8f02ffd640 3 client.4174.objecter handle_osd_map decoding full epoch 10 2024-02-09T08:02:16.217 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:16.214+0000 7f8f02ffd640 20 client.4174.objecter dump_active .. 0 homeless 2024-02-09T08:02:16.254 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:16.251+0000 7f8f02ffd640 1 -- 172.21.15.62:0/759985879 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8f04055220 con 0x7f8f0c145b70 2024-02-09T08:02:16.254 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:16.251+0000 7f8f02ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:02:16.254 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:16.251+0000 7f8f02ffd640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:02:16.617 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:16.614+0000 7f8f14295640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-02-09T08:02:16.617 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:16.614+0000 7f8f14295640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-02-09T08:02:16.617 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:16.614+0000 7f8f14295640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:02:16.617 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:16.614+0000 7f8f14295640 1 -- 172.21.15.62:0/759985879 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f0c06c120 con 0x7f8f0c145b70 2024-02-09T08:02:16.747 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:16.744+0000 7f8f02ffd640 1 -- 172.21.15.62:0/759985879 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mgrmap(e 4) v1 ==== 89732+0+0 (secure 0 0 0) 0x7f8f040555f0 con 0x7f8f0c145b70 2024-02-09T08:02:17.035 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:17.033+0000 7f8f02ffd640 1 -- 172.21.15.62:0/759985879 <== mon.1 v2:172.21.15.103:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f8f0403eac0 con 0x7f8f0c145b70 2024-02-09T08:02:17.036 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:17.033+0000 7f8f02ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-02-09T08:02:17.036 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:17.033+0000 7f8f02ffd640 10 monclient: _finish_command 2 = system:0 2024-02-09T08:02:17.036 INFO:teuthology.misc.health.smithi062.stdout: 2024-02-09T08:02:17.036 INFO:teuthology.misc.health.smithi062.stdout:{"epoch":10,"fsid":"981c5564-eb76-49a1-80ab-97c7647bc34a","created":"2024-02-09T08:02:07.866410+0000","modified":"2024-02-09T08:02:13.770858+0000","last_up_change":"0.000000","last_in_change":"2024-02-09T08:02:13.770858+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0e3b17d4-a50f-41d9-b455-0bc1606a5c86","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a0077e6c-220d-46f4-9be2-a707d1710890","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3739882a-5263-4113-840a-afd6acdcf15e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3657c103-db3d-46c5-8afc-2b0b9da1e2e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"faf5e721-fa06-43f8-9b72-36ca8132ffea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"5c96dba1-53d2-4c0c-8928-5f09ea17a984","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"3473844d-d631-4ea4-96fb-638eccee5cb6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d31bdb4b-8938-4da9-8bf1-57cf730e839d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-09T08:02:17.039 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:17.036+0000 7f8f14295640 10 librados: watch_flush enter 2024-02-09T08:02:17.039 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:17.036+0000 7f8f14295640 10 librados: watch_flush exit 2024-02-09T08:02:17.039 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:17.036+0000 7f8f14295640 20 client.4174.objecter shutdown clearing up homeless session... 2024-02-09T08:02:17.039 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:17.036+0000 7f8f14295640 10 client.4174.objecter successfully canceled tick 2024-02-09T08:02:17.039 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:17.036+0000 7f8f14295640 1 -- 172.21.15.62:0/759985879 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f8ef006d020 msgr2=0x7f8ef006f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:17.039 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:17.036+0000 7f8f14295640 1 --2- 172.21.15.62:0/759985879 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f8ef006d020 0x7f8ef006f4e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8f08009870 tx=0x7f8f08030000 comp rx=0 tx=0).stop 2024-02-09T08:02:17.040 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:17.036+0000 7f8f14295640 10 monclient: shutdown 2024-02-09T08:02:17.040 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:17.036+0000 7f8f14295640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:02:17.040 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:17.036+0000 7f8f14295640 1 -- 172.21.15.62:0/759985879 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f0c145b70 msgr2=0x7f8f0c1427d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:17.040 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:17.036+0000 7f8f14295640 1 --2- 172.21.15.62:0/759985879 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f0c145b70 0x7f8f0c1427d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8f0400b990 tx=0x7f8f0400bd90 comp rx=0 tx=0).stop 2024-02-09T08:02:17.040 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:17.036+0000 7f8f14295640 1 -- 172.21.15.62:0/759985879 shutdown_connections 2024-02-09T08:02:17.040 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:17.036+0000 7f8f14295640 1 --2- 172.21.15.62:0/759985879 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f8ef006d020 0x7f8ef006f4e0 secure :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8f08009870 tx=0x7f8f08030000 comp rx=0 tx=0).stop 2024-02-09T08:02:17.040 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:17.036+0000 7f8f14295640 1 --2- 172.21.15.62:0/759985879 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f0c145b70 0x7f8f0c1427d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:17.040 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:17.036+0000 7f8f14295640 1 --2- 172.21.15.62:0/759985879 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8f0c13f880 0x7f8f0c142290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:17.040 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:17.036+0000 7f8f14295640 1 --2- 172.21.15.62:0/759985879 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f0c0b5490 0x7f8f0c13ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:17.040 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:17.036+0000 7f8f14295640 1 -- 172.21.15.62:0/759985879 >> 172.21.15.62:0/759985879 conn(0x7f8f0c0b8640 msgr2=0x7f8f0c145fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:02:17.040 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:17.037+0000 7f8f14295640 1 -- 172.21.15.62:0/759985879 shutdown_connections 2024-02-09T08:02:17.040 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:17.037+0000 7f8f14295640 1 -- 172.21.15.62:0/759985879 wait complete. 2024-02-09T08:02:17.040 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:17.037+0000 7f8f14295640 1 librados: shutdown 2024-02-09T08:02:17.052 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-02-09T08:02:21.531 INFO:tasks.ceph.osd.5.smithi103.stderr:==00:00:00:07.357 35348== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:21.557 INFO:tasks.ceph.osd.4.smithi103.stderr:==00:00:00:07.384 35347== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:21.574 INFO:tasks.ceph.osd.7.smithi103.stderr:==00:00:00:07.395 35350== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:21.592 INFO:tasks.ceph.osd.5.smithi103.stderr:==00:00:00:07.419 35348== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:21.618 INFO:tasks.ceph.osd.4.smithi103.stderr:==00:00:00:07.445 35347== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:21.636 INFO:tasks.ceph.osd.7.smithi103.stderr:==00:00:00:07.457 35350== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:21.982 INFO:tasks.ceph.osd.1.smithi062.stderr:==00:00:00:07.829 35351== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:21.993 INFO:tasks.ceph.osd.0.smithi062.stderr:==00:00:00:07.853 35346== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:22.034 INFO:tasks.ceph.osd.6.smithi103.stderr:==00:00:00:07.859 35349== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:22.050 INFO:tasks.ceph.osd.1.smithi062.stderr:==00:00:00:07.897 35351== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:22.068 INFO:tasks.ceph.osd.0.smithi062.stderr:==00:00:00:07.928 35346== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:22.092 INFO:tasks.ceph.osd.6.smithi103.stderr:==00:00:00:07.918 35349== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:22.130 INFO:tasks.ceph.osd.2.smithi062.stderr:==00:00:00:07.974 35352== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:22.152 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-02-09T08:02:22.142+0000 5dc3480 -1 Falling back to public interface 2024-02-09T08:02:22.189 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:02:22.182+0000 5dc3480 -1 Falling back to public interface 2024-02-09T08:02:22.195 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:02:22.188+0000 5dc3480 -1 Falling back to public interface 2024-02-09T08:02:22.196 INFO:tasks.ceph.osd.2.smithi062.stderr:==00:00:00:08.041 35352== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:22.303 INFO:tasks.ceph.osd.3.smithi062.stderr:==00:00:00:08.159 35349== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:22.364 INFO:tasks.ceph.osd.3.smithi062.stderr:==00:00:00:08.221 35349== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:22.596 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:02:22.588+0000 5dc3480 -1 Falling back to public interface 2024-02-09T08:02:22.610 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:02:22.602+0000 5dc3480 -1 Falling back to public interface 2024-02-09T08:02:22.612 INFO:tasks.ceph.osd.5.smithi103.stderr:==00:00:00:08.439 35348== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:22.659 INFO:tasks.ceph.osd.4.smithi103.stderr:==00:00:00:08.486 35347== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:22.661 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-02-09T08:02:22.653+0000 5dc3480 -1 Falling back to public interface 2024-02-09T08:02:22.669 INFO:tasks.ceph.osd.7.smithi103.stderr:==00:00:00:08.490 35350== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:22.750 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:02:22.742+0000 5dc3480 -1 Falling back to public interface 2024-02-09T08:02:22.945 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:02:22.937+0000 5dc3480 -1 Falling back to public interface 2024-02-09T08:02:22.978 INFO:tasks.ceph.osd.5.smithi103.stderr:==00:00:00:08.805 35348== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:23.026 INFO:tasks.ceph.osd.4.smithi103.stderr:==00:00:00:08.853 35347== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:23.040 INFO:tasks.ceph.osd.7.smithi103.stderr:==00:00:00:08.861 35350== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:23.091 INFO:tasks.ceph.osd.1.smithi062.stderr:==00:00:00:08.938 35351== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:23.117 INFO:tasks.ceph.osd.0.smithi062.stderr:==00:00:00:08.977 35346== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:23.135 INFO:tasks.ceph.osd.6.smithi103.stderr:==00:00:00:08.961 35349== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:23.228 INFO:tasks.ceph.osd.2.smithi062.stderr:==00:00:00:09.072 35352== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:23.268 INFO:tasks.ceph.osd.5.smithi103.stderr:==00:00:00:09.095 35348== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:23.366 INFO:tasks.ceph.osd.7.smithi103.stderr:==00:00:00:09.186 35350== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:23.381 INFO:tasks.ceph.osd.4.smithi103.stderr:==00:00:00:09.208 35347== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:23.458 INFO:tasks.ceph.osd.1.smithi062.stderr:==00:00:00:09.305 35351== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:23.473 INFO:tasks.ceph.osd.3.smithi062.stderr:==00:00:00:09.330 35349== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:23.489 INFO:tasks.ceph.osd.0.smithi062.stderr:==00:00:00:09.349 35346== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:23.501 INFO:tasks.ceph.osd.6.smithi103.stderr:==00:00:00:09.327 35349== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:23.536 INFO:tasks.ceph.osd.5.smithi103.stderr:==00:00:00:09.363 35348== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:23.600 INFO:tasks.ceph.osd.2.smithi062.stderr:==00:00:00:09.445 35352== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:23.634 INFO:tasks.ceph.osd.7.smithi103.stderr:==00:00:00:09.455 35350== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:23.668 INFO:tasks.ceph.osd.2.smithi062.stderr:==00:00:00:09.513 35352== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:23.672 INFO:tasks.ceph.osd.4.smithi103.stderr:==00:00:00:09.499 35347== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:23.780 INFO:tasks.ceph.osd.1.smithi062.stderr:==00:00:00:09.627 35351== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:23.800 INFO:tasks.ceph.osd.5.smithi103.stderr:==00:00:00:09.627 35348== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:23.805 INFO:tasks.ceph.osd.0.smithi062.stderr:==00:00:00:09.665 35346== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:23.823 INFO:tasks.ceph.osd.6.smithi103.stderr:==00:00:00:09.649 35349== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:23.843 INFO:tasks.ceph.osd.3.smithi062.stderr:==00:00:00:09.699 35349== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:23.858 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-09T08:02:23.898 INFO:tasks.ceph.osd.7.smithi103.stderr:==00:00:00:09.719 35350== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:23.941 INFO:tasks.ceph.osd.2.smithi062.stderr:==00:00:00:09.786 35352== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:23.948 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.946+0000 7f282291e640 10 monclient: get_monmap_and_config 2024-02-09T08:02:23.948 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.946+0000 7f282291e640 10 monclient: build_initial_monmap 2024-02-09T08:02:23.948 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.946+0000 7f282291e640 10 monclient: monmap: 2024-02-09T08:02:23.948 INFO:teuthology.misc.health.smithi062.stderr:epoch 0 2024-02-09T08:02:23.948 INFO:teuthology.misc.health.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:23.948 INFO:teuthology.misc.health.smithi062.stderr:last_changed 2024-02-09T08:02:23.947138+0000 2024-02-09T08:02:23.948 INFO:teuthology.misc.health.smithi062.stderr:created 2024-02-09T08:02:23.947138+0000 2024-02-09T08:02:23.948 INFO:teuthology.misc.health.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:02:23.949 INFO:teuthology.misc.health.smithi062.stderr:election_strategy: 1 2024-02-09T08:02:23.949 INFO:teuthology.misc.health.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:02:23.949 INFO:teuthology.misc.health.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:02:23.949 INFO:teuthology.misc.health.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:02:23.949 INFO:teuthology.misc.health.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:02:23.949 INFO:teuthology.misc.health.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:02:23.949 INFO:teuthology.misc.health.smithi062.stderr: 2024-02-09T08:02:23.950 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.946+0000 7f282291e640 1 Processor -- start 2024-02-09T08:02:23.950 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.946+0000 7f282291e640 1 -- start start 2024-02-09T08:02:23.950 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.946+0000 7f282291e640 10 monclient: init 2024-02-09T08:02:23.951 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.947+0000 7f282291e640 10 monclient: _reopen_session rank -1 2024-02-09T08:02:23.951 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.947+0000 7f282291e640 10 monclient: _add_conns ranks=[2,1,0,3,4] 2024-02-09T08:02:23.951 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.947+0000 7f282291e640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f281c0b5490 0x7f281c0a9850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:23.951 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.947+0000 7f282291e640 10 monclient(hunting): picked mon.noname-b con 0x7f281c0b5490 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:02:23.951 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.947+0000 7f282291e640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f281c13f880 addr v1:172.21.15.103:6789/0 2024-02-09T08:02:23.951 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.947+0000 7f282291e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f281c145b70 addr v1:172.21.15.62:6789/0 2024-02-09T08:02:23.951 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.947+0000 7f282291e640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f281c1466f0 con 0x7f281c145b70 2024-02-09T08:02:23.951 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.947+0000 7f282291e640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f281c0ab730 con 0x7f281c13f880 2024-02-09T08:02:23.951 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.947+0000 7f282291e640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:23.951 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.947+0000 7f282291e640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f281c0ab530 con 0x7f281c0b5490 2024-02-09T08:02:23.951 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.947+0000 7f282291e640 10 monclient(hunting): _renew_subs 2024-02-09T08:02:23.951 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.947+0000 7f282291e640 10 monclient(hunting): authenticate will time out at 1387.307665s 2024-02-09T08:02:23.951 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.948+0000 7f2820ebb640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f281c145b70 0x7f281c145fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:48890/0 (socket says 172.21.15.62:48890) 2024-02-09T08:02:23.952 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.948+0000 7f2820ebb640 1 -- 172.21.15.62:0/3313076514 learned_addr learned my addr 172.21.15.62:0/3313076514 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-09T08:02:23.952 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.948+0000 7f281bfff640 1 --2- 172.21.15.62:0/3313076514 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f281c0b5490 0x7f281c0a9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:23.952 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.948+0000 7f281bfff640 10 monclient(hunting): get_auth_request con 0x7f281c0b5490 auth_method 0 2024-02-09T08:02:23.952 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.948+0000 7f281bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:23.952 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.948+0000 7f281bfff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:23.952 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.948+0000 7f281bfff640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:23.953 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.949+0000 7f281bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:23.953 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.949+0000 7f281bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:23.953 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.949+0000 7f281bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:23.953 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.950+0000 7f281affd640 1 -- 172.21.15.62:0/3313076514 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 500528517 0 0) 0x7f281c0ab730 con 0x7f281c13f880 2024-02-09T08:02:23.953 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.950+0000 7f281affd640 10 monclient(hunting): _negotiate 2024-02-09T08:02:23.954 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.950+0000 7f281affd640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:23.954 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.950+0000 7f281affd640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:23.954 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.950+0000 7f281affd640 10 monclient(hunting): my global_id is 4201 2024-02-09T08:02:23.954 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.950+0000 7f281affd640 1 -- 172.21.15.62:0/3313076514 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2804003520 con 0x7f281c13f880 2024-02-09T08:02:23.954 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.950+0000 7f281affd640 1 -- 172.21.15.62:0/3313076514 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1377057057 0 0) 0x7f281c1466f0 con 0x7f281c145b70 2024-02-09T08:02:23.954 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.951+0000 7f281affd640 10 monclient(hunting): _negotiate 2024-02-09T08:02:23.954 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.951+0000 7f281affd640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:23.954 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.951+0000 7f281affd640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:23.954 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.951+0000 7f281affd640 10 monclient(hunting): my global_id is 4176 2024-02-09T08:02:23.954 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.951+0000 7f281affd640 1 -- 172.21.15.62:0/3313076514 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f281c0ab730 con 0x7f281c145b70 2024-02-09T08:02:23.954 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.951+0000 7f281bfff640 10 monclient(hunting): handle_auth_done global_id 4187 payload 274 2024-02-09T08:02:23.954 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.951+0000 7f281bfff640 1 -- 172.21.15.62:0/3313076514 >> v1:172.21.15.103:6789/0 conn(0x7f281c13f880 legacy=0x7f281c13fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:23.954 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.951+0000 7f281bfff640 1 -- 172.21.15.62:0/3313076514 >> v1:172.21.15.62:6789/0 conn(0x7f281c145b70 legacy=0x7f281c145fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:23.955 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.951+0000 7f281bfff640 10 monclient: _finish_hunting 0 2024-02-09T08:02:23.955 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.951+0000 7f281bfff640 1 monclient: found mon.noname-b 2024-02-09T08:02:23.955 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.951+0000 7f281bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:02:23.955 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.951+0000 7f281bfff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.62:3301/0 2024-02-09T08:02:23.955 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.951+0000 7f281bfff640 1 -- 172.21.15.62:0/3313076514 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f281c0aa160 con 0x7f281c0b5490 2024-02-09T08:02:23.955 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.953+0000 7f281bfff640 1 --2- 172.21.15.62:0/3313076514 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f281c0b5490 0x7f281c0a9850 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f280c0097d0 tx=0x7f280c02b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8635c2324dec0da9 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:02:23.959 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.956+0000 7f281affd640 1 -- 172.21.15.62:0/3313076514 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f280c031800 con 0x7f281c0b5490 2024-02-09T08:02:23.959 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.956+0000 7f281affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:23.959 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.956+0000 7f281affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:02:23.959 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.956+0000 7f281affd640 10 monclient: dump: 2024-02-09T08:02:23.959 INFO:teuthology.misc.health.smithi062.stderr:epoch 1 2024-02-09T08:02:23.959 INFO:teuthology.misc.health.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:23.959 INFO:teuthology.misc.health.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:23.959 INFO:teuthology.misc.health.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:23.959 INFO:teuthology.misc.health.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:23.959 INFO:teuthology.misc.health.smithi062.stderr:election_strategy: 1 2024-02-09T08:02:23.959 INFO:teuthology.misc.health.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:23.959 INFO:teuthology.misc.health.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:23.960 INFO:teuthology.misc.health.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:23.960 INFO:teuthology.misc.health.smithi062.stderr: 2024-02-09T08:02:23.960 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.956+0000 7f281affd640 10 monclient: _finish_auth 0 2024-02-09T08:02:23.960 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.956+0000 7f281affd640 10 monclient: _check_auth_tickets 2024-02-09T08:02:23.960 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.956+0000 7f281affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:02:23.960 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.956+0000 7f281affd640 1 -- 172.21.15.62:0/3313076514 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f280c031960 con 0x7f281c0b5490 2024-02-09T08:02:23.960 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.956+0000 7f282291e640 5 monclient: authenticate success, global_id 4187 2024-02-09T08:02:23.960 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.956+0000 7f281affd640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:02:23.960 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.956+0000 7f282291e640 10 monclient: get_monmap_and_config success 2024-02-09T08:02:23.960 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.956+0000 7f282291e640 4 set_mon_vals no callback set 2024-02-09T08:02:23.961 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.956+0000 7f281affd640 1 -- 172.21.15.62:0/3313076514 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f280c031cf0 con 0x7f281c0b5490 2024-02-09T08:02:23.961 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.956+0000 7f281affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:23.961 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.956+0000 7f281affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-09T08:02:23.961 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.956+0000 7f281affd640 10 monclient: dump: 2024-02-09T08:02:23.961 INFO:teuthology.misc.health.smithi062.stderr:epoch 1 2024-02-09T08:02:23.961 INFO:teuthology.misc.health.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:23.961 INFO:teuthology.misc.health.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:23.961 INFO:teuthology.misc.health.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:23.961 INFO:teuthology.misc.health.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:23.961 INFO:teuthology.misc.health.smithi062.stderr:election_strategy: 1 2024-02-09T08:02:23.961 INFO:teuthology.misc.health.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:23.961 INFO:teuthology.misc.health.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:23.961 INFO:teuthology.misc.health.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:23.961 INFO:teuthology.misc.health.smithi062.stderr: 2024-02-09T08:02:23.965 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.957+0000 7f282291e640 10 monclient: shutdown 2024-02-09T08:02:23.965 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.957+0000 7f282291e640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:02:23.965 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.957+0000 7f282291e640 1 -- 172.21.15.62:0/3313076514 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f281c0b5490 msgr2=0x7f281c0a9850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:23.965 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.957+0000 7f282291e640 1 --2- 172.21.15.62:0/3313076514 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f281c0b5490 0x7f281c0a9850 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f280c0097d0 tx=0x7f280c02b8a0 comp rx=0 tx=0).stop 2024-02-09T08:02:23.965 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.957+0000 7f282291e640 1 -- 172.21.15.62:0/3313076514 shutdown_connections 2024-02-09T08:02:23.965 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.957+0000 7f282291e640 1 --2- 172.21.15.62:0/3313076514 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f281c0b5490 0x7f281c0a9850 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:23.965 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.957+0000 7f282291e640 1 -- 172.21.15.62:0/3313076514 >> 172.21.15.62:0/3313076514 conn(0x7f281c0b8640 msgr2=0x7f281c0b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:02:23.965 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.957+0000 7f282291e640 1 -- 172.21.15.62:0/3313076514 shutdown_connections 2024-02-09T08:02:23.966 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.957+0000 7f282291e640 1 -- 172.21.15.62:0/3313076514 wait complete. 2024-02-09T08:02:23.966 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.958+0000 7f282291e640 10 monclient: build_initial_monmap 2024-02-09T08:02:23.966 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.958+0000 7f282291e640 10 monclient: monmap: 2024-02-09T08:02:23.966 INFO:teuthology.misc.health.smithi062.stderr:epoch 0 2024-02-09T08:02:23.966 INFO:teuthology.misc.health.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:02:23.966 INFO:teuthology.misc.health.smithi062.stderr:last_changed 0.000000 2024-02-09T08:02:23.966 INFO:teuthology.misc.health.smithi062.stderr:created 0.000000 2024-02-09T08:02:23.966 INFO:teuthology.misc.health.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:02:23.966 INFO:teuthology.misc.health.smithi062.stderr:election_strategy: 1 2024-02-09T08:02:23.966 INFO:teuthology.misc.health.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:02:23.966 INFO:teuthology.misc.health.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:02:23.966 INFO:teuthology.misc.health.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:02:23.966 INFO:teuthology.misc.health.smithi062.stderr: 2024-02-09T08:02:23.966 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.958+0000 7f282291e640 1 librados: starting msgr at 2024-02-09T08:02:23.967 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.958+0000 7f282291e640 1 librados: starting objecter 2024-02-09T08:02:23.967 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.958+0000 7f282291e640 1 Processor -- start 2024-02-09T08:02:23.967 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.958+0000 7f282291e640 1 -- start start 2024-02-09T08:02:23.967 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.958+0000 7f282291e640 1 librados: setting wanted keys 2024-02-09T08:02:23.967 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.958+0000 7f282291e640 1 librados: calling monclient init 2024-02-09T08:02:23.967 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.958+0000 7f282291e640 10 monclient: init 2024-02-09T08:02:23.967 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.959+0000 7f282291e640 10 monclient: _reopen_session rank -1 2024-02-09T08:02:23.967 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.959+0000 7f282291e640 10 monclient: _add_conns ranks=[2,0,1] 2024-02-09T08:02:23.967 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.959+0000 7f282291e640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f281c0b5490 0x7f281c13afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:23.967 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.959+0000 7f282291e640 10 monclient(hunting): picked mon.noname-c con 0x7f281c0b5490 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:02:23.967 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.959+0000 7f282291e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f281c13f880 0x7f281c0b65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:23.967 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.959+0000 7f282291e640 10 monclient(hunting): picked mon.noname-a con 0x7f281c13f880 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:02:23.967 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.959+0000 7f282291e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f281c145b70 0x7f281c0b6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:23.967 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.959+0000 7f282291e640 10 monclient(hunting): picked mon.noname-b con 0x7f281c145b70 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:02:23.968 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.959+0000 7f282291e640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:23.968 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.959+0000 7f282291e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281c140f70 con 0x7f281c13f880 2024-02-09T08:02:23.968 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.959+0000 7f282291e640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:23.968 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.959+0000 7f282291e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281c141250 con 0x7f281c145b70 2024-02-09T08:02:23.968 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.959+0000 7f282291e640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:23.968 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.959+0000 7f282291e640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f281c141530 con 0x7f281c0b5490 2024-02-09T08:02:23.968 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.959+0000 7f282291e640 10 monclient(hunting): _renew_subs 2024-02-09T08:02:23.968 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.959+0000 7f282291e640 10 monclient(hunting): authenticate will time out at 1387.319823s 2024-02-09T08:02:23.968 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.960+0000 7f2820ebb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f281c145b70 0x7f281c0b6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:23.968 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.960+0000 7f2820ebb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f281c145b70 0x7f281c0b6b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.62:47974/0 (socket says 172.21.15.62:47974) 2024-02-09T08:02:23.968 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.960+0000 7f2820ebb640 1 -- 172.21.15.62:0/3234344388 learned_addr learned my addr 172.21.15.62:0/3234344388 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:02:23.968 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.960+0000 7f2820ebb640 10 monclient(hunting): get_auth_request con 0x7f281c145b70 auth_method 0 2024-02-09T08:02:23.968 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.960+0000 7f2820ebb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:23.968 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.960+0000 7f2820ebb640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:23.969 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.960+0000 7f2820ebb640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:23.969 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.961+0000 7f2820ebb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:23.969 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.961+0000 7f2820ebb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:23.969 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.961+0000 7f2820ebb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:23.969 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.961+0000 7f281b7fe640 1 --2- 172.21.15.62:0/3234344388 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f281c13f880 0x7f281c0b65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:23.969 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.961+0000 7f281bfff640 1 --2- 172.21.15.62:0/3234344388 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f281c0b5490 0x7f281c13afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:23.969 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.961+0000 7f281b7fe640 10 monclient(hunting): get_auth_request con 0x7f281c13f880 auth_method 0 2024-02-09T08:02:23.969 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.961+0000 7f281b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:23.969 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.961+0000 7f281b7fe640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:23.969 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.961+0000 7f281b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:23.969 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.962+0000 7f281b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:23.969 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.962+0000 7f281b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:23.969 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.962+0000 7f281b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:23.969 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.962+0000 7f281bfff640 10 monclient(hunting): get_auth_request con 0x7f281c0b5490 auth_method 0 2024-02-09T08:02:23.969 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.962+0000 7f281bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:23.970 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.962+0000 7f281bfff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:23.970 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.962+0000 7f281bfff640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:23.970 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.963+0000 7f281bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:23.970 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.963+0000 7f281bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:23.970 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.963+0000 7f281bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:23.970 INFO:tasks.ceph.osd.4.smithi103.stderr:==00:00:00:09.794 35347== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:23.973 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.963+0000 7f2820ebb640 10 monclient(hunting): handle_auth_done global_id 4204 payload 824 2024-02-09T08:02:23.973 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.963+0000 7f2820ebb640 1 -- 172.21.15.62:0/3234344388 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f281c0b5490 msgr2=0x7f281c13afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:23.974 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.963+0000 7f2820ebb640 1 --2- 172.21.15.62:0/3234344388 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f281c0b5490 0x7f281c13afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:23.974 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.963+0000 7f2820ebb640 1 -- 172.21.15.62:0/3234344388 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f281c13f880 msgr2=0x7f281c0b65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:23.974 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.963+0000 7f2820ebb640 1 --2- 172.21.15.62:0/3234344388 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f281c13f880 0x7f281c0b65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:23.974 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.963+0000 7f2820ebb640 10 monclient: _finish_hunting 0 2024-02-09T08:02:23.974 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.963+0000 7f2820ebb640 1 monclient: found mon.noname-b 2024-02-09T08:02:23.974 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.963+0000 7f2820ebb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:02:23.974 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.963+0000 7f2820ebb640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.103:3300/0 2024-02-09T08:02:23.974 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.963+0000 7f2820ebb640 1 -- 172.21.15.62:0/3234344388 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f280c009400 con 0x7f281c145b70 2024-02-09T08:02:23.974 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.966+0000 7f2820ebb640 1 --2- 172.21.15.62:0/3234344388 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f281c145b70 0x7f281c0b6b30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f281400caa0 tx=0x7f281400cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:02:23.974 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.966+0000 7f2818ff9640 10 client.?.objecter ms_handle_connect 0x7f281c145b70 2024-02-09T08:02:23.974 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.966+0000 7f2818ff9640 10 client.?.objecter resend_mon_ops 2024-02-09T08:02:23.974 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.969+0000 7f2818ff9640 1 -- 172.21.15.62:0/3234344388 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281400ac00 con 0x7f281c145b70 2024-02-09T08:02:23.974 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.969+0000 7f2818ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:23.975 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.969+0000 7f2818ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:02:23.975 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.969+0000 7f2818ff9640 10 monclient: dump: 2024-02-09T08:02:23.975 INFO:teuthology.misc.health.smithi062.stderr:epoch 1 2024-02-09T08:02:23.975 INFO:teuthology.misc.health.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:23.975 INFO:teuthology.misc.health.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:23.975 INFO:teuthology.misc.health.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:23.975 INFO:teuthology.misc.health.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:23.975 INFO:teuthology.misc.health.smithi062.stderr:election_strategy: 1 2024-02-09T08:02:23.975 INFO:teuthology.misc.health.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:23.975 INFO:teuthology.misc.health.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:23.975 INFO:teuthology.misc.health.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:23.975 INFO:teuthology.misc.health.smithi062.stderr: 2024-02-09T08:02:23.975 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.969+0000 7f2818ff9640 10 monclient: _finish_auth 0 2024-02-09T08:02:23.975 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.969+0000 7f2818ff9640 10 monclient: _check_auth_tickets 2024-02-09T08:02:23.975 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.969+0000 7f2818ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:02:23.976 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.969+0000 7f282291e640 5 monclient: authenticate success, global_id 4204 2024-02-09T08:02:23.976 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.969+0000 7f2818ff9640 1 -- 172.21.15.62:0/3234344388 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f281400ad60 con 0x7f281c145b70 2024-02-09T08:02:23.976 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.969+0000 7f2818ff9640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:02:23.976 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.969+0000 7f2818ff9640 1 -- 172.21.15.62:0/3234344388 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2814012620 con 0x7f281c145b70 2024-02-09T08:02:23.976 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.969+0000 7f282291e640 10 monclient: _renew_subs 2024-02-09T08:02:23.976 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.969+0000 7f282291e640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:02:23.976 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.969+0000 7f282291e640 1 -- 172.21.15.62:0/3234344388 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f281c13bfb0 con 0x7f281c145b70 2024-02-09T08:02:23.976 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.969+0000 7f2818ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:23.976 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.969+0000 7f2818ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:02:23.976 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.969+0000 7f281a7fc640 4 set_mon_vals no callback set 2024-02-09T08:02:23.976 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.969+0000 7f2818ff9640 10 monclient: dump: 2024-02-09T08:02:23.976 INFO:teuthology.misc.health.smithi062.stderr:epoch 1 2024-02-09T08:02:23.976 INFO:teuthology.misc.health.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:23.976 INFO:teuthology.misc.health.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:23.977 INFO:teuthology.misc.health.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:23.977 INFO:teuthology.misc.health.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:23.977 INFO:teuthology.misc.health.smithi062.stderr:election_strategy: 1 2024-02-09T08:02:23.977 INFO:teuthology.misc.health.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:23.977 INFO:teuthology.misc.health.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:23.977 INFO:teuthology.misc.health.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:23.977 INFO:teuthology.misc.health.smithi062.stderr: 2024-02-09T08:02:23.977 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.969+0000 7f282291e640 10 client.4204.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:02:23.977 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.969+0000 7f282291e640 10 monclient: _renew_subs 2024-02-09T08:02:23.977 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.969+0000 7f282291e640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:02:23.977 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.969+0000 7f282291e640 1 -- 172.21.15.62:0/3234344388 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f281c1403f0 con 0x7f281c145b70 2024-02-09T08:02:23.977 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.969+0000 7f282291e640 1 librados: init done 2024-02-09T08:02:23.977 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.970+0000 7f282291e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:02:23.977 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.970+0000 7f282291e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:02:23.977 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.970+0000 7f282291e640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:02:23.978 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.970+0000 7f282291e640 1 -- 172.21.15.62:0/3234344388 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f281c06c120 con 0x7f281c145b70 2024-02-09T08:02:23.990 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.988+0000 7f2818ff9640 1 -- 172.21.15.62:0/3234344388 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 89732+0+0 (secure 0 0 0) 0x7f2814007070 con 0x7f281c145b70 2024-02-09T08:02:23.990 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.988+0000 7f2818ff9640 1 --2- 172.21.15.62:0/3234344388 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f280806d110 0x7f280806f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:23.991 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.988+0000 7f281bfff640 1 --2- 172.21.15.62:0/3234344388 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f280806d110 0x7f280806f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:23.991 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.988+0000 7f281bfff640 10 monclient: get_auth_request con 0x7f280806d110 auth_method 0 2024-02-09T08:02:23.991 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.989+0000 7f281bfff640 1 --2- 172.21.15.62:0/3234344388 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f280806d110 0x7f280806f5d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f280c036000 tx=0x7f280c03c040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:02:23.991 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.989+0000 7f2818ff9640 10 client.4204.objecter ms_handle_connect 0x7f280806d110 2024-02-09T08:02:23.993 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.990+0000 7f2818ff9640 1 -- 172.21.15.62:0/3234344388 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f2814058d50 con 0x7f281c145b70 2024-02-09T08:02:23.993 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.990+0000 7f2818ff9640 10 client.4204.objecter ms_dispatch 0x7f281c000b90 osd_map(10..10 src has 1..10) v4 2024-02-09T08:02:23.993 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.990+0000 7f2818ff9640 3 client.4204.objecter handle_osd_map got epochs [10,10] > 0 2024-02-09T08:02:23.993 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.990+0000 7f2818ff9640 3 client.4204.objecter handle_osd_map decoding full epoch 10 2024-02-09T08:02:23.993 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:23.991+0000 7f2818ff9640 20 client.4204.objecter dump_active .. 0 homeless 2024-02-09T08:02:24.049 INFO:tasks.ceph.osd.1.smithi062.stderr:==00:00:00:09.896 35351== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:24.064 INFO:tasks.ceph.osd.5.smithi103.stderr:==00:00:00:09.891 35348== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:24.075 INFO:tasks.ceph.osd.0.smithi062.stderr:==00:00:00:09.935 35346== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:24.088 INFO:tasks.ceph.osd.6.smithi103.stderr:==00:00:00:09.914 35349== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:24.164 INFO:tasks.ceph.osd.7.smithi103.stderr:==00:00:00:09.985 35350== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:24.200 INFO:tasks.ceph.osd.3.smithi062.stderr:==00:00:00:10.057 35349== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:24.206 INFO:tasks.ceph.osd.2.smithi062.stderr:==00:00:00:10.051 35352== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:24.231 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:24.229+0000 7f2818ff9640 1 -- 172.21.15.62:0/3234344388 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2814054ff0 con 0x7f281c145b70 2024-02-09T08:02:24.231 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:24.229+0000 7f2818ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:02:24.231 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:24.229+0000 7f2818ff9640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:02:24.257 INFO:tasks.ceph.osd.4.smithi103.stderr:==00:00:00:10.084 35347== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:24.320 INFO:tasks.ceph.osd.1.smithi062.stderr:==00:00:00:10.168 35351== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:24.332 INFO:tasks.ceph.osd.5.smithi103.stderr:==00:00:00:10.159 35348== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:24.343 INFO:tasks.ceph.osd.0.smithi062.stderr:==00:00:00:10.203 35346== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:24.357 INFO:tasks.ceph.osd.6.smithi103.stderr:==00:00:00:10.183 35349== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:24.411 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:24.408+0000 7f282291e640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-02-09T08:02:24.411 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:24.408+0000 7f282291e640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-02-09T08:02:24.411 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:24.408+0000 7f282291e640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:02:24.411 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:24.408+0000 7f282291e640 1 -- 172.21.15.62:0/3234344388 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f281c068920 con 0x7f281c145b70 2024-02-09T08:02:24.426 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:24.424+0000 7f2818ff9640 1 -- 172.21.15.62:0/3234344388 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f28140586b0 con 0x7f281c145b70 2024-02-09T08:02:24.426 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:24.424+0000 7f2818ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-02-09T08:02:24.426 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:24.424+0000 7f2818ff9640 10 monclient: _finish_command 2 = system:0 2024-02-09T08:02:24.427 INFO:teuthology.misc.health.smithi062.stdout: 2024-02-09T08:02:24.427 INFO:teuthology.misc.health.smithi062.stdout:{"epoch":10,"fsid":"981c5564-eb76-49a1-80ab-97c7647bc34a","created":"2024-02-09T08:02:07.866410+0000","modified":"2024-02-09T08:02:13.770858+0000","last_up_change":"0.000000","last_in_change":"2024-02-09T08:02:13.770858+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0e3b17d4-a50f-41d9-b455-0bc1606a5c86","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a0077e6c-220d-46f4-9be2-a707d1710890","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3739882a-5263-4113-840a-afd6acdcf15e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3657c103-db3d-46c5-8afc-2b0b9da1e2e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"faf5e721-fa06-43f8-9b72-36ca8132ffea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"5c96dba1-53d2-4c0c-8928-5f09ea17a984","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"3473844d-d631-4ea4-96fb-638eccee5cb6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d31bdb4b-8938-4da9-8bf1-57cf730e839d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-09T08:02:24.428 INFO:tasks.ceph.osd.7.smithi103.stderr:==00:00:00:10.249 35350== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:24.431 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:24.426+0000 7f282291e640 10 librados: watch_flush enter 2024-02-09T08:02:24.432 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:24.426+0000 7f282291e640 10 librados: watch_flush exit 2024-02-09T08:02:24.432 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:24.426+0000 7f282291e640 20 client.4204.objecter shutdown clearing up homeless session... 2024-02-09T08:02:24.432 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:24.426+0000 7f282291e640 10 client.4204.objecter successfully canceled tick 2024-02-09T08:02:24.432 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:24.426+0000 7f282291e640 1 -- 172.21.15.62:0/3234344388 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f280806d110 msgr2=0x7f280806f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:24.432 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:24.426+0000 7f282291e640 1 --2- 172.21.15.62:0/3234344388 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f280806d110 0x7f280806f5d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f280c036000 tx=0x7f280c03c040 comp rx=0 tx=0).stop 2024-02-09T08:02:24.432 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:24.426+0000 7f282291e640 10 monclient: shutdown 2024-02-09T08:02:24.433 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:24.426+0000 7f282291e640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:02:24.433 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:24.426+0000 7f282291e640 1 -- 172.21.15.62:0/3234344388 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f281c145b70 msgr2=0x7f281c0b6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:24.433 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:24.426+0000 7f282291e640 1 --2- 172.21.15.62:0/3234344388 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f281c145b70 0x7f281c0b6b30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f281400caa0 tx=0x7f281400cf60 comp rx=0 tx=0).stop 2024-02-09T08:02:24.433 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:24.426+0000 7f282291e640 1 -- 172.21.15.62:0/3234344388 shutdown_connections 2024-02-09T08:02:24.433 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:24.426+0000 7f282291e640 1 --2- 172.21.15.62:0/3234344388 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f280806d110 0x7f280806f5d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:24.433 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:24.426+0000 7f282291e640 1 --2- 172.21.15.62:0/3234344388 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f281c145b70 0x7f281c0b6b30 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:24.433 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:24.426+0000 7f282291e640 1 --2- 172.21.15.62:0/3234344388 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f281c13f880 0x7f281c0b65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:24.433 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:24.426+0000 7f282291e640 1 --2- 172.21.15.62:0/3234344388 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f281c0b5490 0x7f281c13afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:24.434 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:24.426+0000 7f282291e640 1 -- 172.21.15.62:0/3234344388 >> 172.21.15.62:0/3234344388 conn(0x7f281c0b8640 msgr2=0x7f281c145fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:02:24.434 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:24.426+0000 7f282291e640 1 -- 172.21.15.62:0/3234344388 shutdown_connections 2024-02-09T08:02:24.434 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:24.426+0000 7f282291e640 1 -- 172.21.15.62:0/3234344388 wait complete. 2024-02-09T08:02:24.434 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:24.426+0000 7f282291e640 1 librados: shutdown 2024-02-09T08:02:24.438 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-02-09T08:02:24.473 INFO:tasks.ceph.osd.2.smithi062.stderr:==00:00:00:10.317 35352== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:24.502 INFO:tasks.ceph.osd.3.smithi062.stderr:==00:00:00:10.359 35349== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:24.544 INFO:tasks.ceph.osd.4.smithi103.stderr:==00:00:00:10.372 35347== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:24.585 INFO:tasks.ceph.osd.1.smithi062.stderr:==00:00:00:10.432 35351== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:24.600 INFO:tasks.ceph.osd.5.smithi103.stderr:==00:00:00:10.427 35348== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:24.609 INFO:tasks.ceph.osd.0.smithi062.stderr:==00:00:00:10.469 35346== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:24.625 INFO:tasks.ceph.osd.6.smithi103.stderr:==00:00:00:10.451 35349== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:24.693 INFO:tasks.ceph.osd.7.smithi103.stderr:==00:00:00:10.514 35350== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:24.741 INFO:tasks.ceph.osd.2.smithi062.stderr:==00:00:00:10.585 35352== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:24.791 INFO:tasks.ceph.osd.3.smithi062.stderr:==00:00:00:10.647 35349== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:24.832 INFO:tasks.ceph.osd.4.smithi103.stderr:==00:00:00:10.660 35347== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:24.849 INFO:tasks.ceph.osd.1.smithi062.stderr:==00:00:00:10.697 35351== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:24.867 INFO:tasks.ceph.osd.5.smithi103.stderr:==00:00:00:10.694 35348== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:24.877 INFO:tasks.ceph.osd.0.smithi062.stderr:==00:00:00:10.737 35346== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:24.908 INFO:tasks.ceph.osd.6.smithi103.stderr:==00:00:00:10.734 35349== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:24.961 INFO:tasks.ceph.osd.7.smithi103.stderr:==00:00:00:10.782 35350== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:25.009 INFO:tasks.ceph.osd.2.smithi062.stderr:==00:00:00:10.854 35352== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:25.084 INFO:tasks.ceph.osd.3.smithi062.stderr:==00:00:00:10.940 35349== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:25.120 INFO:tasks.ceph.osd.4.smithi103.stderr:==00:00:00:10.947 35347== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:25.127 INFO:tasks.ceph.osd.1.smithi062.stderr:==00:00:00:10.975 35351== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:25.152 INFO:tasks.ceph.osd.0.smithi062.stderr:==00:00:00:11.011 35346== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:25.174 INFO:tasks.ceph.osd.6.smithi103.stderr:==00:00:00:11.000 35349== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:25.278 INFO:tasks.ceph.osd.2.smithi062.stderr:==00:00:00:11.123 35352== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:25.358 INFO:tasks.ceph.osd.5.smithi103.stderr:==00:00:00:11.185 35348== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:25.373 INFO:tasks.ceph.osd.3.smithi062.stderr:==00:00:00:11.229 35349== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:25.395 INFO:tasks.ceph.osd.1.smithi062.stderr:==00:00:00:11.243 35351== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:25.419 INFO:tasks.ceph.osd.0.smithi062.stderr:==00:00:00:11.279 35346== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:25.428 INFO:tasks.ceph.osd.5.smithi103.stderr:==00:00:00:11.255 35348== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:25.447 INFO:tasks.ceph.osd.6.smithi103.stderr:==00:00:00:11.273 35349== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:25.479 INFO:tasks.ceph.osd.7.smithi103.stderr:==00:00:00:11.300 35350== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:25.535 INFO:tasks.ceph.osd.7.smithi103.stderr:==00:00:00:11.356 35350== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:25.638 INFO:tasks.ceph.osd.4.smithi103.stderr:==00:00:00:11.466 35347== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:25.670 INFO:tasks.ceph.osd.3.smithi062.stderr:==00:00:00:11.526 35349== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:25.693 INFO:tasks.ceph.osd.4.smithi103.stderr:==00:00:00:11.520 35347== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:25.789 INFO:tasks.ceph.osd.2.smithi062.stderr:==00:00:00:11.633 35352== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:25.845 INFO:tasks.ceph.osd.2.smithi062.stderr:==00:00:00:11.690 35352== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:25.912 INFO:tasks.ceph.osd.1.smithi062.stderr:==00:00:00:11.759 35351== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:25.931 INFO:tasks.ceph.osd.0.smithi062.stderr:==00:00:00:11.791 35346== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:25.957 INFO:tasks.ceph.osd.6.smithi103.stderr:==00:00:00:11.783 35349== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:25.963 INFO:tasks.ceph.osd.3.smithi062.stderr:==00:00:00:11.819 35349== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:25.971 INFO:tasks.ceph.osd.1.smithi062.stderr:==00:00:00:11.818 35351== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:26.006 INFO:tasks.ceph.osd.0.smithi062.stderr:==00:00:00:11.866 35346== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:26.011 INFO:tasks.ceph.osd.6.smithi103.stderr:==00:00:00:11.837 35349== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:26.466 INFO:tasks.ceph.osd.3.smithi062.stderr:==00:00:00:12.323 35349== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:26.522 INFO:tasks.ceph.osd.3.smithi062.stderr:==00:00:00:12.379 35349== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:30.971 INFO:tasks.ceph.osd.5.smithi103.stderr:==00:00:00:16.798 35348== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:31.044 INFO:tasks.ceph.osd.7.smithi103.stderr:==00:00:00:16.865 35350== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:31.244 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-09T08:02:31.246 INFO:tasks.ceph.osd.4.smithi103.stderr:==00:00:00:17.073 35347== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:31.334 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.332+0000 7fefb981c640 10 monclient: get_monmap_and_config 2024-02-09T08:02:31.335 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.332+0000 7fefb981c640 10 monclient: build_initial_monmap 2024-02-09T08:02:31.335 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.332+0000 7fefb981c640 10 monclient: monmap: 2024-02-09T08:02:31.335 INFO:teuthology.misc.health.smithi062.stderr:epoch 0 2024-02-09T08:02:31.335 INFO:teuthology.misc.health.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:31.335 INFO:teuthology.misc.health.smithi062.stderr:last_changed 2024-02-09T08:02:31.333665+0000 2024-02-09T08:02:31.335 INFO:teuthology.misc.health.smithi062.stderr:created 2024-02-09T08:02:31.333665+0000 2024-02-09T08:02:31.335 INFO:teuthology.misc.health.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:02:31.335 INFO:teuthology.misc.health.smithi062.stderr:election_strategy: 1 2024-02-09T08:02:31.335 INFO:teuthology.misc.health.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:02:31.335 INFO:teuthology.misc.health.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:02:31.335 INFO:teuthology.misc.health.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:02:31.335 INFO:teuthology.misc.health.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:02:31.335 INFO:teuthology.misc.health.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:02:31.336 INFO:teuthology.misc.health.smithi062.stderr: 2024-02-09T08:02:31.337 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.333+0000 7fefb981c640 1 Processor -- start 2024-02-09T08:02:31.337 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.333+0000 7fefb981c640 1 -- start start 2024-02-09T08:02:31.337 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.333+0000 7fefb981c640 10 monclient: init 2024-02-09T08:02:31.337 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.333+0000 7fefb981c640 10 monclient: _reopen_session rank -1 2024-02-09T08:02:31.337 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.333+0000 7fefb981c640 10 monclient: _add_conns ranks=[1,4,3,2,0] 2024-02-09T08:02:31.337 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.333+0000 7fefb981c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fefb40b5270 addr v1:172.21.15.103:6789/0 2024-02-09T08:02:31.337 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.333+0000 7fefb981c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fefb413fc80 0x7fefb40a9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:31.337 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.333+0000 7fefb981c640 10 monclient(hunting): picked mon.noname-c con 0x7fefb413fc80 addr v2:172.21.15.103:3300/0 2024-02-09T08:02:31.337 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.334+0000 7fefb981c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fefb4145e00 0x7fefb4146220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:31.337 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.334+0000 7fefb981c640 10 monclient(hunting): picked mon.noname-a con 0x7fefb4145e00 addr v2:172.21.15.62:3300/0 2024-02-09T08:02:31.338 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.334+0000 7fefb981c640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefb40ab0f0 con 0x7fefb40b5270 2024-02-09T08:02:31.338 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.334+0000 7fefb981c640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:31.338 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.334+0000 7fefb981c640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefb40b5650 con 0x7fefb4145e00 2024-02-09T08:02:31.338 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.334+0000 7fefb981c640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:31.338 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.334+0000 7fefb981c640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefb40ab340 con 0x7fefb413fc80 2024-02-09T08:02:31.338 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.334+0000 7fefb981c640 10 monclient(hunting): _renew_subs 2024-02-09T08:02:31.338 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.334+0000 7fefb981c640 10 monclient(hunting): authenticate will time out at 1394.694342s 2024-02-09T08:02:31.338 INFO:tasks.ceph.osd.2.smithi062.stderr:==00:00:00:17.181 35352== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:31.339 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.334+0000 7fefb37fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fefb4145e00 0x7fefb4146220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:31.339 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.334+0000 7fefb27fc640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fefb413fc80 0x7fefb40a9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:31.339 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.335+0000 7fefb37fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fefb4145e00 0x7fefb4146220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44620/0 (socket says 172.21.15.62:44620) 2024-02-09T08:02:31.339 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.335+0000 7fefb37fe640 1 -- 172.21.15.62:0/770095815 learned_addr learned my addr 172.21.15.62:0/770095815 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:02:31.339 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.335+0000 7fefb37fe640 10 monclient(hunting): get_auth_request con 0x7fefb4145e00 auth_method 0 2024-02-09T08:02:31.340 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.335+0000 7fefb37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:31.340 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.335+0000 7fefb37fe640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:31.340 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.335+0000 7fefb37fe640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:31.340 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.335+0000 7fefb27fc640 10 monclient(hunting): get_auth_request con 0x7fefb413fc80 auth_method 0 2024-02-09T08:02:31.340 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.335+0000 7fefb27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:31.340 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.335+0000 7fefb27fc640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:31.340 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.335+0000 7fefb27fc640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:31.340 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.335+0000 7fefb37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:31.340 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.335+0000 7fefb37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:31.340 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.335+0000 7fefb37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:31.341 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.336+0000 7fefb27fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:31.341 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.336+0000 7fefb27fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:31.341 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.336+0000 7fefb27fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:31.341 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.338+0000 7fefb37fe640 10 monclient(hunting): handle_auth_done global_id 4182 payload 274 2024-02-09T08:02:31.342 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.338+0000 7fefb37fe640 1 -- 172.21.15.62:0/770095815 >> v2:172.21.15.103:3300/0 conn(0x7fefb413fc80 msgr2=0x7fefb40a9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:02:31.342 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.338+0000 7fefb37fe640 1 --2- 172.21.15.62:0/770095815 >> v2:172.21.15.103:3300/0 conn(0x7fefb413fc80 0x7fefb40a9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:31.342 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.338+0000 7fefb37fe640 1 -- 172.21.15.62:0/770095815 >> v1:172.21.15.103:6789/0 conn(0x7fefb40b5270 legacy=0x7fefb413f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:31.342 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.338+0000 7fefb37fe640 10 monclient: _finish_hunting 0 2024-02-09T08:02:31.342 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.338+0000 7fefb37fe640 1 monclient: found mon.noname-a 2024-02-09T08:02:31.342 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.338+0000 7fefb37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:02:31.342 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.338+0000 7fefb37fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-02-09T08:02:31.342 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.338+0000 7fefb37fe640 1 -- 172.21.15.62:0/770095815 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb40ab620 con 0x7fefb4145e00 2024-02-09T08:02:31.342 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.340+0000 7fefb37fe640 1 --2- 172.21.15.62:0/770095815 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fefb4145e00 0x7fefb4146220 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fefb40b91c0 tx=0x7fefac02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f88844f392b059f4 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:02:31.346 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.343+0000 7fefb1ffb640 1 -- 172.21.15.62:0/770095815 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefac02ca80 con 0x7fefb4145e00 2024-02-09T08:02:31.346 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.343+0000 7fefb1ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:31.346 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.343+0000 7fefb1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-09T08:02:31.346 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.343+0000 7fefb1ffb640 10 monclient: dump: 2024-02-09T08:02:31.346 INFO:teuthology.misc.health.smithi062.stderr:epoch 1 2024-02-09T08:02:31.346 INFO:teuthology.misc.health.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:31.346 INFO:teuthology.misc.health.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:31.346 INFO:teuthology.misc.health.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:31.346 INFO:teuthology.misc.health.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:31.346 INFO:teuthology.misc.health.smithi062.stderr:election_strategy: 1 2024-02-09T08:02:31.346 INFO:teuthology.misc.health.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:31.346 INFO:teuthology.misc.health.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:31.347 INFO:teuthology.misc.health.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:31.347 INFO:teuthology.misc.health.smithi062.stderr: 2024-02-09T08:02:31.347 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.343+0000 7fefb1ffb640 10 monclient: _finish_auth 0 2024-02-09T08:02:31.347 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.343+0000 7fefb1ffb640 10 monclient: _check_auth_tickets 2024-02-09T08:02:31.347 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.343+0000 7fefb1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:02:31.347 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.344+0000 7fefb981c640 5 monclient: authenticate success, global_id 4182 2024-02-09T08:02:31.347 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.344+0000 7fefb981c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-02-09T08:02:31.348 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.346+0000 7fefb1ffb640 1 -- 172.21.15.62:0/770095815 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefac02cbe0 con 0x7fefb4145e00 2024-02-09T08:02:31.348 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.346+0000 7fefb1ffb640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:02:31.348 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.346+0000 7fefb1ffb640 1 -- 172.21.15.62:0/770095815 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefac0343f0 con 0x7fefb4145e00 2024-02-09T08:02:31.348 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.346+0000 7fefb1ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:31.348 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.346+0000 7fefb1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-09T08:02:31.348 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.346+0000 7fefb1ffb640 10 monclient: dump: 2024-02-09T08:02:31.349 INFO:teuthology.misc.health.smithi062.stderr:epoch 1 2024-02-09T08:02:31.349 INFO:teuthology.misc.health.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:31.349 INFO:teuthology.misc.health.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:31.349 INFO:teuthology.misc.health.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:31.349 INFO:teuthology.misc.health.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:31.349 INFO:teuthology.misc.health.smithi062.stderr:election_strategy: 1 2024-02-09T08:02:31.349 INFO:teuthology.misc.health.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:31.349 INFO:teuthology.misc.health.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:31.349 INFO:teuthology.misc.health.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:31.349 INFO:teuthology.misc.health.smithi062.stderr: 2024-02-09T08:02:31.349 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.346+0000 7fefb981c640 10 monclient: get_monmap_and_config success 2024-02-09T08:02:31.349 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.346+0000 7fefb981c640 4 set_mon_vals no callback set 2024-02-09T08:02:31.350 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.347+0000 7fefb981c640 10 monclient: shutdown 2024-02-09T08:02:31.350 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.347+0000 7fefb981c640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:02:31.350 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.347+0000 7fefb981c640 1 -- 172.21.15.62:0/770095815 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fefb4145e00 msgr2=0x7fefb4146220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:31.351 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.347+0000 7fefb981c640 1 --2- 172.21.15.62:0/770095815 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fefb4145e00 0x7fefb4146220 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fefb40b91c0 tx=0x7fefac02bee0 comp rx=0 tx=0).stop 2024-02-09T08:02:31.351 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.347+0000 7fefb981c640 1 -- 172.21.15.62:0/770095815 shutdown_connections 2024-02-09T08:02:31.351 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.347+0000 7fefb981c640 1 --2- 172.21.15.62:0/770095815 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fefb4145e00 0x7fefb4146220 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:31.351 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.347+0000 7fefb981c640 1 --2- 172.21.15.62:0/770095815 >> v2:172.21.15.103:3300/0 conn(0x7fefb413fc80 0x7fefb40a9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:31.351 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.347+0000 7fefb981c640 1 -- 172.21.15.62:0/770095815 >> 172.21.15.62:0/770095815 conn(0x7fefb4066c90 msgr2=0x7fefb40670a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:02:31.351 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.347+0000 7fefb981c640 1 -- 172.21.15.62:0/770095815 shutdown_connections 2024-02-09T08:02:31.351 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.347+0000 7fefb981c640 1 -- 172.21.15.62:0/770095815 wait complete. 2024-02-09T08:02:31.351 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.348+0000 7fefb981c640 10 monclient: build_initial_monmap 2024-02-09T08:02:31.351 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.348+0000 7fefb981c640 10 monclient: monmap: 2024-02-09T08:02:31.351 INFO:teuthology.misc.health.smithi062.stderr:epoch 0 2024-02-09T08:02:31.351 INFO:teuthology.misc.health.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:02:31.351 INFO:teuthology.misc.health.smithi062.stderr:last_changed 0.000000 2024-02-09T08:02:31.351 INFO:teuthology.misc.health.smithi062.stderr:created 0.000000 2024-02-09T08:02:31.351 INFO:teuthology.misc.health.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:02:31.352 INFO:teuthology.misc.health.smithi062.stderr:election_strategy: 1 2024-02-09T08:02:31.352 INFO:teuthology.misc.health.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:02:31.352 INFO:teuthology.misc.health.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:02:31.352 INFO:teuthology.misc.health.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:02:31.352 INFO:teuthology.misc.health.smithi062.stderr: 2024-02-09T08:02:31.357 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.349+0000 7fefb981c640 1 librados: starting msgr at 2024-02-09T08:02:31.357 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.349+0000 7fefb981c640 1 librados: starting objecter 2024-02-09T08:02:31.357 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.349+0000 7fefb981c640 1 Processor -- start 2024-02-09T08:02:31.357 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.349+0000 7fefb981c640 1 -- start start 2024-02-09T08:02:31.357 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.349+0000 7fefb981c640 1 librados: setting wanted keys 2024-02-09T08:02:31.358 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.349+0000 7fefb981c640 1 librados: calling monclient init 2024-02-09T08:02:31.358 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.349+0000 7fefb981c640 10 monclient: init 2024-02-09T08:02:31.358 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.350+0000 7fefb981c640 10 monclient: _reopen_session rank -1 2024-02-09T08:02:31.358 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.350+0000 7fefb981c640 10 monclient: _add_conns ranks=[1,2,0] 2024-02-09T08:02:31.358 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.350+0000 7fefb981c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefb40b5270 0x7fefb4144650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:31.358 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.350+0000 7fefb981c640 10 monclient(hunting): picked mon.noname-b con 0x7fefb40b5270 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:02:31.358 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.350+0000 7fefb981c640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fefb413fc80 0x7fefb4136700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:31.358 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.350+0000 7fefb981c640 10 monclient(hunting): picked mon.noname-c con 0x7fefb413fc80 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:02:31.358 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.350+0000 7fefb981c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fefb4145e00 0x7fefb4136c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:31.358 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.350+0000 7fefb981c640 10 monclient(hunting): picked mon.noname-a con 0x7fefb4145e00 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:02:31.358 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.350+0000 7fefb981c640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:31.358 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.350+0000 7fefb981c640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb4135960 con 0x7fefb4145e00 2024-02-09T08:02:31.358 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.350+0000 7fefb981c640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:31.358 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.350+0000 7fefb981c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb4145020 con 0x7fefb40b5270 2024-02-09T08:02:31.358 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.350+0000 7fefb981c640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:31.359 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.350+0000 7fefb981c640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefb4135bd0 con 0x7fefb413fc80 2024-02-09T08:02:31.359 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.350+0000 7fefb981c640 10 monclient(hunting): _renew_subs 2024-02-09T08:02:31.359 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.350+0000 7fefb981c640 10 monclient(hunting): authenticate will time out at 1394.710949s 2024-02-09T08:02:31.359 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.351+0000 7fefb2ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefb40b5270 0x7fefb4144650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:31.359 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.351+0000 7fefb37fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fefb4145e00 0x7fefb4136c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:31.359 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.351+0000 7fefb27fc640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fefb413fc80 0x7fefb4136700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:31.359 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.351+0000 7fefb37fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fefb4145e00 0x7fefb4136c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44628/0 (socket says 172.21.15.62:44628) 2024-02-09T08:02:31.359 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.351+0000 7fefb37fe640 1 -- 172.21.15.62:0/2936588785 learned_addr learned my addr 172.21.15.62:0/2936588785 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:02:31.359 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.351+0000 7fefb37fe640 10 monclient(hunting): get_auth_request con 0x7fefb4145e00 auth_method 0 2024-02-09T08:02:31.359 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.351+0000 7fefb37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:31.359 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.351+0000 7fefb37fe640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:31.359 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.351+0000 7fefb37fe640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:31.359 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.351+0000 7fefb2ffd640 10 monclient(hunting): get_auth_request con 0x7fefb40b5270 auth_method 0 2024-02-09T08:02:31.359 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.351+0000 7fefb2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:31.360 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.351+0000 7fefb2ffd640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:31.360 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.351+0000 7fefb2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:31.360 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.351+0000 7fefb27fc640 10 monclient(hunting): get_auth_request con 0x7fefb413fc80 auth_method 0 2024-02-09T08:02:31.360 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.351+0000 7fefb27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:31.360 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.351+0000 7fefb27fc640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:31.360 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.351+0000 7fefb27fc640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:31.360 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.352+0000 7fefb2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:31.360 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.352+0000 7fefb2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:31.360 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.352+0000 7fefb2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:31.360 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.352+0000 7fefb37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:31.360 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.352+0000 7fefb37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:31.360 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.352+0000 7fefb37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:31.360 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.352+0000 7fefb27fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:31.360 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.352+0000 7fefb27fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:31.360 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.352+0000 7fefb27fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:31.362 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.356+0000 7fefb2ffd640 10 monclient(hunting): handle_auth_done global_id 4210 payload 824 2024-02-09T08:02:31.362 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.356+0000 7fefb2ffd640 1 -- 172.21.15.62:0/2936588785 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fefb413fc80 msgr2=0x7fefb4136700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:31.362 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.356+0000 7fefb2ffd640 1 --2- 172.21.15.62:0/2936588785 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fefb413fc80 0x7fefb4136700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:31.362 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.356+0000 7fefb2ffd640 1 -- 172.21.15.62:0/2936588785 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fefb4145e00 msgr2=0x7fefb4136c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:31.362 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.356+0000 7fefb2ffd640 1 --2- 172.21.15.62:0/2936588785 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fefb4145e00 0x7fefb4136c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:31.362 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.356+0000 7fefb2ffd640 10 monclient: _finish_hunting 0 2024-02-09T08:02:31.362 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.356+0000 7fefb2ffd640 1 monclient: found mon.noname-b 2024-02-09T08:02:31.363 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.356+0000 7fefb2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:02:31.363 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.356+0000 7fefb2ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.103:3300/0 2024-02-09T08:02:31.363 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.356+0000 7fefb2ffd640 1 -- 172.21.15.62:0/2936588785 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefac009b30 con 0x7fefb40b5270 2024-02-09T08:02:31.363 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.359+0000 7fefb2ffd640 1 --2- 172.21.15.62:0/2936588785 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefb40b5270 0x7fefb4144650 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fefa400c340 tx=0x7fefa400c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:02:31.363 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.359+0000 7fef9bfff640 10 client.?.objecter ms_handle_connect 0x7fefb40b5270 2024-02-09T08:02:31.363 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.359+0000 7fef9bfff640 10 client.?.objecter resend_mon_ops 2024-02-09T08:02:31.368 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.364+0000 7fef9bfff640 1 -- 172.21.15.62:0/2936588785 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa40052d0 con 0x7fefb40b5270 2024-02-09T08:02:31.369 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.364+0000 7fef9bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:31.369 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.364+0000 7fef9bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:02:31.369 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.364+0000 7fef9bfff640 10 monclient: dump: 2024-02-09T08:02:31.369 INFO:teuthology.misc.health.smithi062.stderr:epoch 1 2024-02-09T08:02:31.369 INFO:teuthology.misc.health.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:31.369 INFO:teuthology.misc.health.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:31.369 INFO:teuthology.misc.health.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:31.369 INFO:teuthology.misc.health.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:31.369 INFO:teuthology.misc.health.smithi062.stderr:election_strategy: 1 2024-02-09T08:02:31.369 INFO:teuthology.misc.health.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:31.369 INFO:teuthology.misc.health.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:31.369 INFO:teuthology.misc.health.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:31.369 INFO:teuthology.misc.health.smithi062.stderr: 2024-02-09T08:02:31.370 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.364+0000 7fef9bfff640 10 monclient: _finish_auth 0 2024-02-09T08:02:31.370 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.364+0000 7fef9bfff640 10 monclient: _check_auth_tickets 2024-02-09T08:02:31.370 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.364+0000 7fef9bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:02:31.370 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.364+0000 7fef9bfff640 1 -- 172.21.15.62:0/2936588785 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefa4005450 con 0x7fefb40b5270 2024-02-09T08:02:31.370 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.364+0000 7fefb981c640 5 monclient: authenticate success, global_id 4210 2024-02-09T08:02:31.370 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.364+0000 7fefb981c640 10 monclient: _renew_subs 2024-02-09T08:02:31.370 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.364+0000 7fefb981c640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:02:31.370 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.364+0000 7fefb981c640 1 -- 172.21.15.62:0/2936588785 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefb4144b90 con 0x7fefb40b5270 2024-02-09T08:02:31.370 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.364+0000 7fef9bfff640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:02:31.370 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.364+0000 7fef9bfff640 1 -- 172.21.15.62:0/2936588785 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa4007260 con 0x7fefb40b5270 2024-02-09T08:02:31.370 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.364+0000 7fef9bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:31.370 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.364+0000 7fef9bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:02:31.370 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.364+0000 7fef9bfff640 10 monclient: dump: 2024-02-09T08:02:31.370 INFO:teuthology.misc.health.smithi062.stderr:epoch 1 2024-02-09T08:02:31.371 INFO:teuthology.misc.health.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:31.371 INFO:teuthology.misc.health.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:31.371 INFO:teuthology.misc.health.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:31.371 INFO:teuthology.misc.health.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:31.371 INFO:teuthology.misc.health.smithi062.stderr:election_strategy: 1 2024-02-09T08:02:31.371 INFO:teuthology.misc.health.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:31.371 INFO:teuthology.misc.health.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:31.371 INFO:teuthology.misc.health.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:31.371 INFO:teuthology.misc.health.smithi062.stderr: 2024-02-09T08:02:31.371 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.364+0000 7fefb981c640 10 client.4210.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:02:31.371 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.364+0000 7fefb981c640 10 monclient: _renew_subs 2024-02-09T08:02:31.371 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.364+0000 7fefb981c640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:02:31.371 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.364+0000 7fefb17fa640 4 set_mon_vals no callback set 2024-02-09T08:02:31.371 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.364+0000 7fefb981c640 1 -- 172.21.15.62:0/2936588785 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefb4137360 con 0x7fefb40b5270 2024-02-09T08:02:31.371 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.364+0000 7fefb981c640 1 librados: init done 2024-02-09T08:02:31.371 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.365+0000 7fefb981c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:02:31.372 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.365+0000 7fefb981c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:02:31.372 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.365+0000 7fefb981c640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:02:31.372 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.365+0000 7fefb981c640 1 -- 172.21.15.62:0/2936588785 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefb4144e00 con 0x7fefb40b5270 2024-02-09T08:02:31.396 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.393+0000 7fef9bfff640 1 -- 172.21.15.62:0/2936588785 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 89732+0+0 (secure 0 0 0) 0x7fefa40073c0 con 0x7fefb40b5270 2024-02-09T08:02:31.397 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.394+0000 7fef9bfff640 1 --2- 172.21.15.62:0/2936588785 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fefa006d110 0x7fefa006f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:31.397 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.394+0000 7fefb27fc640 1 --2- 172.21.15.62:0/2936588785 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fefa006d110 0x7fefa006f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:31.397 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.394+0000 7fefb27fc640 10 monclient: get_auth_request con 0x7fefa006d110 auth_method 0 2024-02-09T08:02:31.397 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.395+0000 7fefb27fc640 1 --2- 172.21.15.62:0/2936588785 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fefa006d110 0x7fefa006f5d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fefb4137860 tx=0x7fefa8009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:02:31.397 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.395+0000 7fef9bfff640 10 client.4210.objecter ms_handle_connect 0x7fefa006d110 2024-02-09T08:02:31.400 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.398+0000 7fef9bfff640 1 -- 172.21.15.62:0/2936588785 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fefa4058270 con 0x7fefb40b5270 2024-02-09T08:02:31.400 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.398+0000 7fef9bfff640 10 client.4210.objecter ms_dispatch 0x7fefb4000b90 osd_map(10..10 src has 1..10) v4 2024-02-09T08:02:31.400 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.398+0000 7fef9bfff640 3 client.4210.objecter handle_osd_map got epochs [10,10] > 0 2024-02-09T08:02:31.401 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.398+0000 7fef9bfff640 3 client.4210.objecter handle_osd_map decoding full epoch 10 2024-02-09T08:02:31.401 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.398+0000 7fef9bfff640 20 client.4210.objecter dump_active .. 0 homeless 2024-02-09T08:02:31.510 INFO:tasks.ceph.osd.0.smithi062.stderr:==00:00:00:17.370 35346== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:31.564 INFO:tasks.ceph.osd.1.smithi062.stderr:==00:00:00:17.412 35351== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:31.593 INFO:tasks.ceph.osd.6.smithi103.stderr:==00:00:00:17.418 35349== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:31.712 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.710+0000 7fef9bfff640 1 -- 172.21.15.62:0/2936588785 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fefa4054510 con 0x7fefb40b5270 2024-02-09T08:02:31.713 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.710+0000 7fef9bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:02:31.713 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.710+0000 7fef9bfff640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:02:31.796 INFO:tasks.ceph.osd.3.smithi062.stderr:==00:00:00:17.653 35349== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:31.925 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.922+0000 7fefb981c640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-02-09T08:02:31.925 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.922+0000 7fefb981c640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-02-09T08:02:31.925 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.922+0000 7fefb981c640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:02:31.925 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.922+0000 7fefb981c640 1 -- 172.21.15.62:0/2936588785 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fefb406a4b0 con 0x7fefb40b5270 2024-02-09T08:02:31.941 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.939+0000 7fef9bfff640 1 -- 172.21.15.62:0/2936588785 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7fefa4020020 con 0x7fefb40b5270 2024-02-09T08:02:31.942 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.939+0000 7fef9bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-02-09T08:02:31.942 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.939+0000 7fef9bfff640 10 monclient: _finish_command 2 = system:0 2024-02-09T08:02:31.942 INFO:teuthology.misc.health.smithi062.stdout: 2024-02-09T08:02:31.942 INFO:teuthology.misc.health.smithi062.stdout:{"epoch":10,"fsid":"981c5564-eb76-49a1-80ab-97c7647bc34a","created":"2024-02-09T08:02:07.866410+0000","modified":"2024-02-09T08:02:13.770858+0000","last_up_change":"0.000000","last_in_change":"2024-02-09T08:02:13.770858+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0e3b17d4-a50f-41d9-b455-0bc1606a5c86","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a0077e6c-220d-46f4-9be2-a707d1710890","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3739882a-5263-4113-840a-afd6acdcf15e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3657c103-db3d-46c5-8afc-2b0b9da1e2e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"faf5e721-fa06-43f8-9b72-36ca8132ffea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"5c96dba1-53d2-4c0c-8928-5f09ea17a984","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"3473844d-d631-4ea4-96fb-638eccee5cb6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d31bdb4b-8938-4da9-8bf1-57cf730e839d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-09T08:02:31.944 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.941+0000 7fefb981c640 10 librados: watch_flush enter 2024-02-09T08:02:31.944 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.941+0000 7fefb981c640 10 librados: watch_flush exit 2024-02-09T08:02:31.944 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.941+0000 7fefb981c640 20 client.4210.objecter shutdown clearing up homeless session... 2024-02-09T08:02:31.944 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.941+0000 7fefb981c640 10 client.4210.objecter successfully canceled tick 2024-02-09T08:02:31.944 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.941+0000 7fefb981c640 1 -- 172.21.15.62:0/2936588785 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fefa006d110 msgr2=0x7fefa006f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:31.944 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.941+0000 7fefb981c640 1 --2- 172.21.15.62:0/2936588785 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fefa006d110 0x7fefa006f5d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fefb4137860 tx=0x7fefa8009190 comp rx=0 tx=0).stop 2024-02-09T08:02:31.944 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.941+0000 7fefb981c640 10 monclient: shutdown 2024-02-09T08:02:31.945 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.941+0000 7fefb981c640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:02:31.945 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.941+0000 7fefb981c640 1 -- 172.21.15.62:0/2936588785 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefb40b5270 msgr2=0x7fefb4144650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:31.945 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.941+0000 7fefb981c640 1 --2- 172.21.15.62:0/2936588785 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefb40b5270 0x7fefb4144650 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fefa400c340 tx=0x7fefa400c800 comp rx=0 tx=0).stop 2024-02-09T08:02:31.945 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.941+0000 7fefb981c640 1 -- 172.21.15.62:0/2936588785 shutdown_connections 2024-02-09T08:02:31.945 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.941+0000 7fefb981c640 1 --2- 172.21.15.62:0/2936588785 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fefa006d110 0x7fefa006f5d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:31.945 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.941+0000 7fefb981c640 1 --2- 172.21.15.62:0/2936588785 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fefb4145e00 0x7fefb4136c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:31.945 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.941+0000 7fefb981c640 1 --2- 172.21.15.62:0/2936588785 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fefb413fc80 0x7fefb4136700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:31.945 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.941+0000 7fefb981c640 1 --2- 172.21.15.62:0/2936588785 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefb40b5270 0x7fefb4144650 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:31.945 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.941+0000 7fefb981c640 1 -- 172.21.15.62:0/2936588785 >> 172.21.15.62:0/2936588785 conn(0x7fefb4066c90 msgr2=0x7fefb413f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:02:31.945 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.942+0000 7fefb981c640 1 -- 172.21.15.62:0/2936588785 shutdown_connections 2024-02-09T08:02:31.945 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.942+0000 7fefb981c640 1 -- 172.21.15.62:0/2936588785 wait complete. 2024-02-09T08:02:31.945 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:31.942+0000 7fefb981c640 1 librados: shutdown 2024-02-09T08:02:31.954 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-02-09T08:02:36.819 INFO:tasks.ceph.osd.5.smithi103.stderr:==00:00:00:22.646 35348== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:36.823 INFO:tasks.ceph.osd.5.smithi103.stderr:==00:00:00:22.650 35348== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:37.446 INFO:tasks.ceph.osd.4.smithi103.stderr:==00:00:00:23.273 35347== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:37.450 INFO:tasks.ceph.osd.4.smithi103.stderr:==00:00:00:23.277 35347== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:37.463 INFO:tasks.ceph.osd.0.smithi062.stderr:==00:00:00:23.323 35346== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:37.466 INFO:tasks.ceph.osd.0.smithi062.stderr:==00:00:00:23.327 35346== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:37.491 INFO:tasks.ceph.osd.6.smithi103.stderr:==00:00:00:23.317 35349== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:37.497 INFO:tasks.ceph.osd.6.smithi103.stderr:==00:00:00:23.323 35349== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:37.501 INFO:tasks.ceph.osd.3.smithi062.stderr:==00:00:00:23.358 35349== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:37.508 INFO:tasks.ceph.osd.3.smithi062.stderr:==00:00:00:23.364 35349== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:37.563 INFO:tasks.ceph.osd.1.smithi062.stderr:==00:00:00:23.410 35351== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:37.566 INFO:tasks.ceph.osd.1.smithi062.stderr:==00:00:00:23.414 35351== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:37.631 INFO:tasks.ceph.osd.7.smithi103.stderr:==00:00:00:23.452 35350== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:37.636 INFO:tasks.ceph.osd.7.smithi103.stderr:==00:00:00:23.457 35350== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:37.690 INFO:tasks.ceph.osd.2.smithi062.stderr:==00:00:00:23.535 35352== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:37.697 INFO:tasks.ceph.osd.2.smithi062.stderr:==00:00:00:23.542 35352== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:38.762 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-09T08:02:38.878 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.875+0000 7fcf23e2d640 10 monclient: get_monmap_and_config 2024-02-09T08:02:38.878 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.875+0000 7fcf23e2d640 10 monclient: build_initial_monmap 2024-02-09T08:02:38.878 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.875+0000 7fcf23e2d640 10 monclient: monmap: 2024-02-09T08:02:38.878 INFO:teuthology.misc.health.smithi062.stderr:epoch 0 2024-02-09T08:02:38.878 INFO:teuthology.misc.health.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:38.879 INFO:teuthology.misc.health.smithi062.stderr:last_changed 2024-02-09T08:02:38.876761+0000 2024-02-09T08:02:38.879 INFO:teuthology.misc.health.smithi062.stderr:created 2024-02-09T08:02:38.876761+0000 2024-02-09T08:02:38.879 INFO:teuthology.misc.health.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:02:38.879 INFO:teuthology.misc.health.smithi062.stderr:election_strategy: 1 2024-02-09T08:02:38.879 INFO:teuthology.misc.health.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:02:38.879 INFO:teuthology.misc.health.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:02:38.879 INFO:teuthology.misc.health.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:02:38.879 INFO:teuthology.misc.health.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:02:38.879 INFO:teuthology.misc.health.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:02:38.879 INFO:teuthology.misc.health.smithi062.stderr: 2024-02-09T08:02:38.881 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.876+0000 7fcf23e2d640 1 Processor -- start 2024-02-09T08:02:38.882 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.876+0000 7fcf23e2d640 1 -- start start 2024-02-09T08:02:38.882 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.876+0000 7fcf23e2d640 10 monclient: init 2024-02-09T08:02:38.882 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.877+0000 7fcf23e2d640 10 monclient: _reopen_session rank -1 2024-02-09T08:02:38.882 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.877+0000 7fcf23e2d640 10 monclient: _add_conns ranks=[3,4,1,2,0] 2024-02-09T08:02:38.882 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.877+0000 7fcf23e2d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fcf1c0b5490 0x7fcf1c0a9850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:38.882 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.877+0000 7fcf23e2d640 10 monclient(hunting): picked mon.noname-a con 0x7fcf1c0b5490 addr v2:172.21.15.62:3300/0 2024-02-09T08:02:38.882 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.877+0000 7fcf23e2d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fcf1c13f880 0x7fcf1c13fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:38.882 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.877+0000 7fcf23e2d640 10 monclient(hunting): picked mon.noname-c con 0x7fcf1c13f880 addr v2:172.21.15.103:3300/0 2024-02-09T08:02:38.882 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.878+0000 7fcf21bc9640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fcf1c0b5490 0x7fcf1c0a9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:38.882 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.878+0000 7fcf23e2d640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fcf1c145b70 addr v1:172.21.15.103:6789/0 2024-02-09T08:02:38.882 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.878+0000 7fcf23e2d640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf1c140250 con 0x7fcf1c145b70 2024-02-09T08:02:38.882 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.878+0000 7fcf23e2d640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:38.883 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.878+0000 7fcf23e2d640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf1c0ab530 con 0x7fcf1c0b5490 2024-02-09T08:02:38.883 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.878+0000 7fcf23e2d640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:38.883 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.878+0000 7fcf23e2d640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf1c0b5870 con 0x7fcf1c13f880 2024-02-09T08:02:38.883 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.878+0000 7fcf23e2d640 10 monclient(hunting): _renew_subs 2024-02-09T08:02:38.883 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.878+0000 7fcf23e2d640 10 monclient(hunting): authenticate will time out at 1402.238746s 2024-02-09T08:02:38.883 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.878+0000 7fcf213c8640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fcf1c13f880 0x7fcf1c13fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:38.883 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.878+0000 7fcf21bc9640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fcf1c0b5490 0x7fcf1c0a9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44642/0 (socket says 172.21.15.62:44642) 2024-02-09T08:02:38.883 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.878+0000 7fcf21bc9640 1 -- 172.21.15.62:0/2767138060 learned_addr learned my addr 172.21.15.62:0/2767138060 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:02:38.883 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.878+0000 7fcf21bc9640 10 monclient(hunting): get_auth_request con 0x7fcf1c0b5490 auth_method 0 2024-02-09T08:02:38.883 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.878+0000 7fcf21bc9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:38.883 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.878+0000 7fcf21bc9640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:38.883 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.878+0000 7fcf21bc9640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:38.883 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.879+0000 7fcf213c8640 10 monclient(hunting): get_auth_request con 0x7fcf1c13f880 auth_method 0 2024-02-09T08:02:38.883 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.879+0000 7fcf213c8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:38.884 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.879+0000 7fcf213c8640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:38.884 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.879+0000 7fcf213c8640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:38.884 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.879+0000 7fcf21bc9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:38.884 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.879+0000 7fcf21bc9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:38.884 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.879+0000 7fcf21bc9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:38.885 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.879+0000 7fcf213c8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:38.885 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.879+0000 7fcf213c8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:38.885 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.879+0000 7fcf213c8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:38.885 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.881+0000 7fcf21bc9640 10 monclient(hunting): handle_auth_done global_id 4188 payload 274 2024-02-09T08:02:38.885 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.882+0000 7fcf21bc9640 1 -- 172.21.15.62:0/2767138060 >> v2:172.21.15.103:3300/0 conn(0x7fcf1c13f880 msgr2=0x7fcf1c13fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:02:38.885 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.882+0000 7fcf21bc9640 1 --2- 172.21.15.62:0/2767138060 >> v2:172.21.15.103:3300/0 conn(0x7fcf1c13f880 0x7fcf1c13fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:38.885 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.882+0000 7fcf21bc9640 1 -- 172.21.15.62:0/2767138060 >> v1:172.21.15.103:6789/0 conn(0x7fcf1c145b70 legacy=0x7fcf1c145f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:02:38.885 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.882+0000 7fcf21bc9640 10 monclient: _finish_hunting 0 2024-02-09T08:02:38.885 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.882+0000 7fcf21bc9640 1 monclient: found mon.noname-a 2024-02-09T08:02:38.885 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.882+0000 7fcf21bc9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:02:38.885 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.882+0000 7fcf21bc9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-02-09T08:02:38.885 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.882+0000 7fcf21bc9640 1 -- 172.21.15.62:0/2767138060 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf1c146680 con 0x7fcf1c0b5490 2024-02-09T08:02:38.887 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.884+0000 7fcf21bc9640 1 --2- 172.21.15.62:0/2767138060 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf1c0b5490 0x7fcf1c0a9850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c072280 tx=0x7fcf1802b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ae29f31bcfb04df server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:02:38.900 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.890+0000 7fcf20bc7640 1 -- 172.21.15.62:0/2767138060 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf180317d0 con 0x7fcf1c0b5490 2024-02-09T08:02:38.900 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.890+0000 7fcf20bc7640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:38.900 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.890+0000 7fcf20bc7640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-09T08:02:38.901 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.890+0000 7fcf20bc7640 10 monclient: dump: 2024-02-09T08:02:38.901 INFO:teuthology.misc.health.smithi062.stderr:epoch 1 2024-02-09T08:02:38.901 INFO:teuthology.misc.health.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:38.901 INFO:teuthology.misc.health.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:38.901 INFO:teuthology.misc.health.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:38.901 INFO:teuthology.misc.health.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:38.901 INFO:teuthology.misc.health.smithi062.stderr:election_strategy: 1 2024-02-09T08:02:38.901 INFO:teuthology.misc.health.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:38.901 INFO:teuthology.misc.health.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:38.901 INFO:teuthology.misc.health.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:38.901 INFO:teuthology.misc.health.smithi062.stderr: 2024-02-09T08:02:38.901 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.890+0000 7fcf20bc7640 10 monclient: _finish_auth 0 2024-02-09T08:02:38.901 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.890+0000 7fcf20bc7640 10 monclient: _check_auth_tickets 2024-02-09T08:02:38.901 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.890+0000 7fcf20bc7640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:02:38.902 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.890+0000 7fcf23e2d640 5 monclient: authenticate success, global_id 4188 2024-02-09T08:02:38.902 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.890+0000 7fcf23e2d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-02-09T08:02:38.902 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.890+0000 7fcf20bc7640 1 -- 172.21.15.62:0/2767138060 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf18031930 con 0x7fcf1c0b5490 2024-02-09T08:02:38.902 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.890+0000 7fcf20bc7640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:02:38.902 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.890+0000 7fcf20bc7640 1 -- 172.21.15.62:0/2767138060 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf18031cc0 con 0x7fcf1c0b5490 2024-02-09T08:02:38.902 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.890+0000 7fcf23e2d640 10 monclient: get_monmap_and_config success 2024-02-09T08:02:38.902 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.890+0000 7fcf23e2d640 4 set_mon_vals no callback set 2024-02-09T08:02:38.902 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.890+0000 7fcf20bc7640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:38.902 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.890+0000 7fcf20bc7640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-09T08:02:38.902 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.890+0000 7fcf20bc7640 10 monclient: dump: 2024-02-09T08:02:38.903 INFO:teuthology.misc.health.smithi062.stderr:epoch 1 2024-02-09T08:02:38.903 INFO:teuthology.misc.health.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:38.903 INFO:teuthology.misc.health.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:38.903 INFO:teuthology.misc.health.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:38.903 INFO:teuthology.misc.health.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:38.903 INFO:teuthology.misc.health.smithi062.stderr:election_strategy: 1 2024-02-09T08:02:38.903 INFO:teuthology.misc.health.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:38.903 INFO:teuthology.misc.health.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:38.903 INFO:teuthology.misc.health.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:38.903 INFO:teuthology.misc.health.smithi062.stderr: 2024-02-09T08:02:38.903 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.891+0000 7fcf23e2d640 10 monclient: shutdown 2024-02-09T08:02:38.903 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.891+0000 7fcf23e2d640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:02:38.903 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.891+0000 7fcf23e2d640 1 -- 172.21.15.62:0/2767138060 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf1c0b5490 msgr2=0x7fcf1c0a9850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:38.903 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.891+0000 7fcf23e2d640 1 --2- 172.21.15.62:0/2767138060 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf1c0b5490 0x7fcf1c0a9850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c072280 tx=0x7fcf1802b870 comp rx=0 tx=0).stop 2024-02-09T08:02:38.904 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.891+0000 7fcf23e2d640 1 -- 172.21.15.62:0/2767138060 shutdown_connections 2024-02-09T08:02:38.904 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.891+0000 7fcf23e2d640 1 --2- 172.21.15.62:0/2767138060 >> v2:172.21.15.103:3300/0 conn(0x7fcf1c13f880 0x7fcf1c13fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:38.904 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.891+0000 7fcf23e2d640 1 --2- 172.21.15.62:0/2767138060 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf1c0b5490 0x7fcf1c0a9850 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:38.904 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.891+0000 7fcf23e2d640 1 -- 172.21.15.62:0/2767138060 >> 172.21.15.62:0/2767138060 conn(0x7fcf1c0b8640 msgr2=0x7fcf1c0b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:02:38.904 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.891+0000 7fcf23e2d640 1 -- 172.21.15.62:0/2767138060 shutdown_connections 2024-02-09T08:02:38.904 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.891+0000 7fcf23e2d640 1 -- 172.21.15.62:0/2767138060 wait complete. 2024-02-09T08:02:38.904 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.892+0000 7fcf23e2d640 10 monclient: build_initial_monmap 2024-02-09T08:02:38.904 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.892+0000 7fcf23e2d640 10 monclient: monmap: 2024-02-09T08:02:38.904 INFO:teuthology.misc.health.smithi062.stderr:epoch 0 2024-02-09T08:02:38.904 INFO:teuthology.misc.health.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:02:38.904 INFO:teuthology.misc.health.smithi062.stderr:last_changed 0.000000 2024-02-09T08:02:38.904 INFO:teuthology.misc.health.smithi062.stderr:created 0.000000 2024-02-09T08:02:38.904 INFO:teuthology.misc.health.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:02:38.905 INFO:teuthology.misc.health.smithi062.stderr:election_strategy: 1 2024-02-09T08:02:38.905 INFO:teuthology.misc.health.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:02:38.905 INFO:teuthology.misc.health.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:02:38.905 INFO:teuthology.misc.health.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:02:38.905 INFO:teuthology.misc.health.smithi062.stderr: 2024-02-09T08:02:38.905 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.892+0000 7fcf23e2d640 1 librados: starting msgr at 2024-02-09T08:02:38.905 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.892+0000 7fcf23e2d640 1 librados: starting objecter 2024-02-09T08:02:38.905 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.893+0000 7fcf23e2d640 1 Processor -- start 2024-02-09T08:02:38.905 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.893+0000 7fcf23e2d640 1 -- start start 2024-02-09T08:02:38.905 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.893+0000 7fcf23e2d640 1 librados: setting wanted keys 2024-02-09T08:02:38.905 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.893+0000 7fcf23e2d640 1 librados: calling monclient init 2024-02-09T08:02:38.905 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.893+0000 7fcf23e2d640 10 monclient: init 2024-02-09T08:02:38.905 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.894+0000 7fcf23e2d640 10 monclient: _reopen_session rank -1 2024-02-09T08:02:38.905 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.894+0000 7fcf23e2d640 10 monclient: _add_conns ranks=[1,2,0] 2024-02-09T08:02:38.905 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.894+0000 7fcf23e2d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf1c0b5490 0x7fcf1c1db150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:38.906 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.894+0000 7fcf23e2d640 10 monclient(hunting): picked mon.noname-b con 0x7fcf1c0b5490 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:02:38.906 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.894+0000 7fcf23e2d640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf1c13f880 0x7fcf1c0b5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:38.906 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.894+0000 7fcf23e2d640 10 monclient(hunting): picked mon.noname-c con 0x7fcf1c13f880 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:02:38.906 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.894+0000 7fcf23e2d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf1c145b70 0x7fcf1c0b6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:38.906 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.894+0000 7fcf23e2d640 10 monclient(hunting): picked mon.noname-a con 0x7fcf1c145b70 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:02:38.906 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.894+0000 7fcf23e2d640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:38.906 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.894+0000 7fcf23e2d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c1320d0 con 0x7fcf1c145b70 2024-02-09T08:02:38.906 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.894+0000 7fcf23e2d640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:38.906 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.894+0000 7fcf23e2d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c0b6680 con 0x7fcf1c0b5490 2024-02-09T08:02:38.906 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.894+0000 7fcf23e2d640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:38.906 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.894+0000 7fcf23e2d640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c139890 con 0x7fcf1c13f880 2024-02-09T08:02:38.906 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.894+0000 7fcf23e2d640 10 monclient(hunting): _renew_subs 2024-02-09T08:02:38.906 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.895+0000 7fcf23e2d640 10 monclient(hunting): authenticate will time out at 1402.255269s 2024-02-09T08:02:38.906 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.895+0000 7fcf21bc9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf1c0b5490 0x7fcf1c1db150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:38.907 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.895+0000 7fcf213c8640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf1c13f880 0x7fcf1c0b5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:38.907 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.895+0000 7fcf223ca640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf1c145b70 0x7fcf1c0b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:38.907 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.895+0000 7fcf223ca640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf1c145b70 0x7fcf1c0b6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44658/0 (socket says 172.21.15.62:44658) 2024-02-09T08:02:38.907 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.895+0000 7fcf223ca640 1 -- 172.21.15.62:0/3225802753 learned_addr learned my addr 172.21.15.62:0/3225802753 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:02:38.907 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.895+0000 7fcf223ca640 10 monclient(hunting): get_auth_request con 0x7fcf1c145b70 auth_method 0 2024-02-09T08:02:38.907 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.895+0000 7fcf223ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:38.907 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.895+0000 7fcf223ca640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:38.907 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.895+0000 7fcf223ca640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:38.907 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.895+0000 7fcf213c8640 10 monclient(hunting): get_auth_request con 0x7fcf1c13f880 auth_method 0 2024-02-09T08:02:38.907 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.895+0000 7fcf213c8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:38.907 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.895+0000 7fcf213c8640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:38.907 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.895+0000 7fcf213c8640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:38.907 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.895+0000 7fcf21bc9640 10 monclient(hunting): get_auth_request con 0x7fcf1c0b5490 auth_method 0 2024-02-09T08:02:38.907 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.895+0000 7fcf21bc9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:38.908 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.895+0000 7fcf21bc9640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:38.908 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.895+0000 7fcf21bc9640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:38.908 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.896+0000 7fcf213c8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:38.908 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.896+0000 7fcf213c8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:38.908 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.896+0000 7fcf213c8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:38.908 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.896+0000 7fcf21bc9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:38.908 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.896+0000 7fcf21bc9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:38.908 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.896+0000 7fcf21bc9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:38.908 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.896+0000 7fcf223ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:38.908 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.896+0000 7fcf223ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:38.908 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.896+0000 7fcf223ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:38.909 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.900+0000 7fcf213c8640 10 monclient(hunting): handle_auth_done global_id 4196 payload 824 2024-02-09T08:02:38.909 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.900+0000 7fcf213c8640 1 -- 172.21.15.62:0/3225802753 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf1c0b5490 msgr2=0x7fcf1c1db150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:38.909 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.900+0000 7fcf213c8640 1 --2- 172.21.15.62:0/3225802753 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf1c0b5490 0x7fcf1c1db150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:38.909 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.900+0000 7fcf213c8640 1 -- 172.21.15.62:0/3225802753 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf1c145b70 msgr2=0x7fcf1c0b6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:38.909 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.900+0000 7fcf213c8640 1 --2- 172.21.15.62:0/3225802753 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf1c145b70 0x7fcf1c0b6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:38.909 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.900+0000 7fcf213c8640 10 monclient: _finish_hunting 0 2024-02-09T08:02:38.909 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.900+0000 7fcf213c8640 1 monclient: found mon.noname-c 2024-02-09T08:02:38.909 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.900+0000 7fcf213c8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:02:38.910 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.900+0000 7fcf213c8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-02-09T08:02:38.910 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.900+0000 7fcf213c8640 1 -- 172.21.15.62:0/3225802753 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf180094d0 con 0x7fcf1c13f880 2024-02-09T08:02:38.910 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.904+0000 7fcf213c8640 1 --2- 172.21.15.62:0/3225802753 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf1c13f880 0x7fcf1c0b5c00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c00e880 tx=0x7fcf0c00ed40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:02:38.910 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.904+0000 7fcf127fc640 10 client.?.objecter ms_handle_connect 0x7fcf1c13f880 2024-02-09T08:02:38.910 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.904+0000 7fcf127fc640 10 client.?.objecter resend_mon_ops 2024-02-09T08:02:38.914 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.909+0000 7fcf127fc640 1 -- 172.21.15.62:0/3225802753 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0c00c940 con 0x7fcf1c13f880 2024-02-09T08:02:38.915 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.909+0000 7fcf127fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:38.915 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.909+0000 7fcf127fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-09T08:02:38.915 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.909+0000 7fcf127fc640 10 monclient: dump: 2024-02-09T08:02:38.915 INFO:teuthology.misc.health.smithi062.stderr:epoch 1 2024-02-09T08:02:38.915 INFO:teuthology.misc.health.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:38.915 INFO:teuthology.misc.health.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:38.915 INFO:teuthology.misc.health.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:38.915 INFO:teuthology.misc.health.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:38.915 INFO:teuthology.misc.health.smithi062.stderr:election_strategy: 1 2024-02-09T08:02:38.915 INFO:teuthology.misc.health.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:38.915 INFO:teuthology.misc.health.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:38.915 INFO:teuthology.misc.health.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:38.916 INFO:teuthology.misc.health.smithi062.stderr: 2024-02-09T08:02:38.916 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.909+0000 7fcf127fc640 10 monclient: _finish_auth 0 2024-02-09T08:02:38.916 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.909+0000 7fcf127fc640 10 monclient: _check_auth_tickets 2024-02-09T08:02:38.916 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.909+0000 7fcf127fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:02:38.916 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.909+0000 7fcf127fc640 1 -- 172.21.15.62:0/3225802753 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf0c00caa0 con 0x7fcf1c13f880 2024-02-09T08:02:38.916 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.909+0000 7fcf23e2d640 5 monclient: authenticate success, global_id 4196 2024-02-09T08:02:38.916 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.909+0000 7fcf23e2d640 10 monclient: _renew_subs 2024-02-09T08:02:38.916 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.909+0000 7fcf23e2d640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:02:38.916 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.909+0000 7fcf23e2d640 1 -- 172.21.15.62:0/3225802753 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf1c139b00 con 0x7fcf1c13f880 2024-02-09T08:02:38.916 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.909+0000 7fcf127fc640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:02:38.916 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.909+0000 7fcf23e2d640 10 client.4196.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:02:38.916 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.910+0000 7fcf13fff640 4 set_mon_vals no callback set 2024-02-09T08:02:38.917 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.910+0000 7fcf127fc640 1 -- 172.21.15.62:0/3225802753 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0c00ce50 con 0x7fcf1c13f880 2024-02-09T08:02:38.917 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.910+0000 7fcf23e2d640 10 monclient: _renew_subs 2024-02-09T08:02:38.917 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.910+0000 7fcf23e2d640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:02:38.917 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.910+0000 7fcf23e2d640 1 -- 172.21.15.62:0/3225802753 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf1c139fe0 con 0x7fcf1c13f880 2024-02-09T08:02:38.917 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.910+0000 7fcf23e2d640 1 librados: init done 2024-02-09T08:02:38.917 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.910+0000 7fcf127fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:38.917 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.910+0000 7fcf127fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-09T08:02:38.917 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.910+0000 7fcf127fc640 10 monclient: dump: 2024-02-09T08:02:38.917 INFO:teuthology.misc.health.smithi062.stderr:epoch 1 2024-02-09T08:02:38.917 INFO:teuthology.misc.health.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:38.917 INFO:teuthology.misc.health.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:38.917 INFO:teuthology.misc.health.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:38.917 INFO:teuthology.misc.health.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:38.918 INFO:teuthology.misc.health.smithi062.stderr:election_strategy: 1 2024-02-09T08:02:38.918 INFO:teuthology.misc.health.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:38.918 INFO:teuthology.misc.health.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:38.918 INFO:teuthology.misc.health.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:38.918 INFO:teuthology.misc.health.smithi062.stderr: 2024-02-09T08:02:38.918 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.911+0000 7fcf23e2d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:02:38.918 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.911+0000 7fcf23e2d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:02:38.918 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.911+0000 7fcf23e2d640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:02:38.918 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.911+0000 7fcf23e2d640 1 -- 172.21.15.62:0/3225802753 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf1c1dba20 con 0x7fcf1c13f880 2024-02-09T08:02:38.936 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.934+0000 7fcf127fc640 1 -- 172.21.15.62:0/3225802753 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 4) v1 ==== 89732+0+0 (secure 0 0 0) 0x7fcf0c013470 con 0x7fcf1c13f880 2024-02-09T08:02:38.936 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.934+0000 7fcf127fc640 1 --2- 172.21.15.62:0/3225802753 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fcf0006d160 0x7fcf0006f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:38.938 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.935+0000 7fcf21bc9640 1 --2- 172.21.15.62:0/3225802753 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fcf0006d160 0x7fcf0006f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:38.938 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.935+0000 7fcf21bc9640 10 monclient: get_auth_request con 0x7fcf0006d160 auth_method 0 2024-02-09T08:02:38.938 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.935+0000 7fcf21bc9640 1 --2- 172.21.15.62:0/3225802753 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fcf0006d160 0x7fcf0006f620 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcf18036000 tx=0x7fcf1803d040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:02:38.938 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.935+0000 7fcf127fc640 10 client.4196.objecter ms_handle_connect 0x7fcf0006d160 2024-02-09T08:02:38.945 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.943+0000 7fcf127fc640 1 -- 172.21.15.62:0/3225802753 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fcf0c058d50 con 0x7fcf1c13f880 2024-02-09T08:02:38.945 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.943+0000 7fcf127fc640 10 client.4196.objecter ms_dispatch 0x7fcf1c000b90 osd_map(10..10 src has 1..10) v4 2024-02-09T08:02:38.945 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.943+0000 7fcf127fc640 3 client.4196.objecter handle_osd_map got epochs [10,10] > 0 2024-02-09T08:02:38.945 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.943+0000 7fcf127fc640 3 client.4196.objecter handle_osd_map decoding full epoch 10 2024-02-09T08:02:38.945 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:38.943+0000 7fcf127fc640 20 client.4196.objecter dump_active .. 0 homeless 2024-02-09T08:02:39.227 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:39.225+0000 7fcf127fc640 1 -- 172.21.15.62:0/3225802753 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcf0c054ff0 con 0x7fcf1c13f880 2024-02-09T08:02:39.228 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:39.225+0000 7fcf127fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:02:39.228 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:39.225+0000 7fcf127fc640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:02:39.568 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:39.566+0000 7fcf23e2d640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-02-09T08:02:39.569 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:39.566+0000 7fcf23e2d640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-02-09T08:02:39.569 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:39.566+0000 7fcf23e2d640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:02:39.569 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:39.566+0000 7fcf23e2d640 1 -- 172.21.15.62:0/3225802753 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf1c1dba20 con 0x7fcf1c13f880 2024-02-09T08:02:39.584 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:39.582+0000 7fcf127fc640 1 -- 172.21.15.62:0/3225802753 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7fcf1c1dba20 con 0x7fcf1c13f880 2024-02-09T08:02:39.584 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:39.582+0000 7fcf127fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-02-09T08:02:39.585 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:39.582+0000 7fcf127fc640 10 monclient: _finish_command 2 = system:0 2024-02-09T08:02:39.585 INFO:teuthology.misc.health.smithi062.stdout: 2024-02-09T08:02:39.585 INFO:teuthology.misc.health.smithi062.stdout:{"epoch":10,"fsid":"981c5564-eb76-49a1-80ab-97c7647bc34a","created":"2024-02-09T08:02:07.866410+0000","modified":"2024-02-09T08:02:13.770858+0000","last_up_change":"0.000000","last_in_change":"2024-02-09T08:02:13.770858+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0e3b17d4-a50f-41d9-b455-0bc1606a5c86","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a0077e6c-220d-46f4-9be2-a707d1710890","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3739882a-5263-4113-840a-afd6acdcf15e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3657c103-db3d-46c5-8afc-2b0b9da1e2e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"faf5e721-fa06-43f8-9b72-36ca8132ffea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"5c96dba1-53d2-4c0c-8928-5f09ea17a984","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"3473844d-d631-4ea4-96fb-638eccee5cb6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d31bdb4b-8938-4da9-8bf1-57cf730e839d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-09T08:02:39.589 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:39.584+0000 7fcf23e2d640 10 librados: watch_flush enter 2024-02-09T08:02:39.589 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:39.584+0000 7fcf23e2d640 10 librados: watch_flush exit 2024-02-09T08:02:39.589 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:39.585+0000 7fcf23e2d640 20 client.4196.objecter shutdown clearing up homeless session... 2024-02-09T08:02:39.589 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:39.585+0000 7fcf23e2d640 10 client.4196.objecter successfully canceled tick 2024-02-09T08:02:39.589 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:39.585+0000 7fcf23e2d640 1 -- 172.21.15.62:0/3225802753 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fcf0006d160 msgr2=0x7fcf0006f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:39.589 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:39.585+0000 7fcf23e2d640 1 --2- 172.21.15.62:0/3225802753 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fcf0006d160 0x7fcf0006f620 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcf18036000 tx=0x7fcf1803d040 comp rx=0 tx=0).stop 2024-02-09T08:02:39.589 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:39.585+0000 7fcf23e2d640 10 monclient: shutdown 2024-02-09T08:02:39.589 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:39.585+0000 7fcf23e2d640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:02:39.589 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:39.585+0000 7fcf23e2d640 1 -- 172.21.15.62:0/3225802753 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf1c13f880 msgr2=0x7fcf1c0b5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:39.590 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:39.585+0000 7fcf23e2d640 1 --2- 172.21.15.62:0/3225802753 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf1c13f880 0x7fcf1c0b5c00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c00e880 tx=0x7fcf0c00ed40 comp rx=0 tx=0).stop 2024-02-09T08:02:39.590 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:39.585+0000 7fcf23e2d640 1 -- 172.21.15.62:0/3225802753 shutdown_connections 2024-02-09T08:02:39.590 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:39.585+0000 7fcf23e2d640 1 --2- 172.21.15.62:0/3225802753 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fcf0006d160 0x7fcf0006f620 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:39.590 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:39.585+0000 7fcf23e2d640 1 --2- 172.21.15.62:0/3225802753 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf1c145b70 0x7fcf1c0b6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:39.590 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:39.585+0000 7fcf23e2d640 1 --2- 172.21.15.62:0/3225802753 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf1c13f880 0x7fcf1c0b5c00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:39.590 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:39.585+0000 7fcf23e2d640 1 --2- 172.21.15.62:0/3225802753 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf1c0b5490 0x7fcf1c1db150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:39.590 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:39.585+0000 7fcf23e2d640 1 -- 172.21.15.62:0/3225802753 >> 172.21.15.62:0/3225802753 conn(0x7fcf1c0b8640 msgr2=0x7fcf1c0a9490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:02:39.590 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:39.585+0000 7fcf23e2d640 1 -- 172.21.15.62:0/3225802753 shutdown_connections 2024-02-09T08:02:39.590 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:39.585+0000 7fcf23e2d640 1 -- 172.21.15.62:0/3225802753 wait complete. 2024-02-09T08:02:39.590 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:39.585+0000 7fcf23e2d640 1 librados: shutdown 2024-02-09T08:02:39.601 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-02-09T08:02:40.998 INFO:tasks.ceph.osd.5.smithi103.stderr:==00:00:00:26.825 35348== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:41.682 INFO:tasks.ceph.osd.3.smithi062.stderr:==00:00:00:27.538 35349== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:41.796 INFO:tasks.ceph.osd.1.smithi062.stderr:==00:00:00:27.643 35351== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:41.888 INFO:tasks.ceph.osd.4.smithi103.stderr:==00:00:00:27.715 35347== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:41.934 INFO:tasks.ceph.osd.6.smithi103.stderr:==00:00:00:27.759 35349== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:42.090 INFO:tasks.ceph.osd.0.smithi062.stderr:==00:00:00:27.950 35346== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:42.114 INFO:tasks.ceph.osd.7.smithi103.stderr:==00:00:00:27.935 35350== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:42.353 INFO:tasks.ceph.osd.2.smithi062.stderr:==00:00:00:28.198 35352== Warning: unimplemented fcntl command: 1038 2024-02-09T08:02:46.408 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-09T08:02:46.498 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.496+0000 7f9faec05640 10 monclient: get_monmap_and_config 2024-02-09T08:02:46.498 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.496+0000 7f9faec05640 10 monclient: build_initial_monmap 2024-02-09T08:02:46.498 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.496+0000 7f9faec05640 10 monclient: monmap: 2024-02-09T08:02:46.498 INFO:teuthology.misc.health.smithi062.stderr:epoch 0 2024-02-09T08:02:46.498 INFO:teuthology.misc.health.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:46.499 INFO:teuthology.misc.health.smithi062.stderr:last_changed 2024-02-09T08:02:46.497087+0000 2024-02-09T08:02:46.499 INFO:teuthology.misc.health.smithi062.stderr:created 2024-02-09T08:02:46.497087+0000 2024-02-09T08:02:46.499 INFO:teuthology.misc.health.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:02:46.499 INFO:teuthology.misc.health.smithi062.stderr:election_strategy: 1 2024-02-09T08:02:46.499 INFO:teuthology.misc.health.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:02:46.499 INFO:teuthology.misc.health.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:02:46.499 INFO:teuthology.misc.health.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:02:46.499 INFO:teuthology.misc.health.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:02:46.499 INFO:teuthology.misc.health.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:02:46.499 INFO:teuthology.misc.health.smithi062.stderr: 2024-02-09T08:02:46.501 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.496+0000 7f9faec05640 1 Processor -- start 2024-02-09T08:02:46.501 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.496+0000 7f9faec05640 1 -- start start 2024-02-09T08:02:46.501 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.496+0000 7f9faec05640 10 monclient: init 2024-02-09T08:02:46.501 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.497+0000 7f9faec05640 10 monclient: _reopen_session rank -1 2024-02-09T08:02:46.501 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.497+0000 7f9faec05640 10 monclient: _add_conns ranks=[3,0,1,2,4] 2024-02-09T08:02:46.501 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.497+0000 7f9faec05640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9fa80b5490 0x7f9fa80a9850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:46.501 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.497+0000 7f9faec05640 10 monclient(hunting): picked mon.noname-a con 0x7f9fa80b5490 addr v2:172.21.15.62:3300/0 2024-02-09T08:02:46.501 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.497+0000 7f9faec05640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f9fa813f880 addr v1:172.21.15.62:6789/0 2024-02-09T08:02:46.501 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.497+0000 7f9faec05640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f9fa8146280 addr v1:172.21.15.103:6789/0 2024-02-09T08:02:46.501 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.497+0000 7f9faec05640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fa8146680 con 0x7f9fa813f880 2024-02-09T08:02:46.501 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.497+0000 7f9faec05640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fa80ab730 con 0x7f9fa8146280 2024-02-09T08:02:46.501 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.497+0000 7f9faec05640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:46.502 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.497+0000 7f9faec05640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fa80ab530 con 0x7f9fa80b5490 2024-02-09T08:02:46.502 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.497+0000 7f9faec05640 10 monclient(hunting): _renew_subs 2024-02-09T08:02:46.502 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.497+0000 7f9faec05640 10 monclient(hunting): authenticate will time out at 1409.857834s 2024-02-09T08:02:46.502 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.498+0000 7f9fa7fff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f9fa813f880 0x7f9fa8145b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:60726/0 (socket says 172.21.15.62:60726) 2024-02-09T08:02:46.502 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.498+0000 7f9fa7fff640 1 -- 172.21.15.62:0/993966895 learned_addr learned my addr 172.21.15.62:0/993966895 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-09T08:02:46.502 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.498+0000 7f9fac9a1640 1 --2- 172.21.15.62:0/993966895 >> v2:172.21.15.62:3300/0 conn(0x7f9fa80b5490 0x7f9fa80a9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:46.502 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.498+0000 7f9fac9a1640 10 monclient(hunting): get_auth_request con 0x7f9fa80b5490 auth_method 0 2024-02-09T08:02:46.502 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.498+0000 7f9fac9a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:46.502 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.498+0000 7f9fac9a1640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:46.502 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.498+0000 7f9fac9a1640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:46.503 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.499+0000 7f9fac9a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:46.503 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.499+0000 7f9fac9a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:46.504 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.499+0000 7f9fac9a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:46.504 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.501+0000 7f9fac9a1640 10 monclient(hunting): handle_auth_done global_id 4194 payload 274 2024-02-09T08:02:46.504 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.501+0000 7f9fac9a1640 1 -- 172.21.15.62:0/993966895 >> v1:172.21.15.103:6789/0 conn(0x7f9fa8146280 legacy=0x7f9fa814cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:46.504 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.501+0000 7f9fac9a1640 1 -- 172.21.15.62:0/993966895 >> v1:172.21.15.62:6789/0 conn(0x7f9fa813f880 legacy=0x7f9fa8145b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:46.504 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.501+0000 7f9fac9a1640 10 monclient: _finish_hunting 0 2024-02-09T08:02:46.504 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.501+0000 7f9fac9a1640 1 monclient: found mon.noname-a 2024-02-09T08:02:46.504 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.501+0000 7f9fac9a1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:02:46.504 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.501+0000 7f9fac9a1640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-02-09T08:02:46.504 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.501+0000 7f9fac9a1640 1 -- 172.21.15.62:0/993966895 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa80aa160 con 0x7f9fa80b5490 2024-02-09T08:02:46.508 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.506+0000 7f9fac9a1640 1 --2- 172.21.15.62:0/993966895 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9fa80b5490 0x7f9fa80a9850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c0097a0 tx=0x7f9f9c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a143d57653feb62 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:02:46.513 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.510+0000 7f9fa77fe640 1 -- 172.21.15.62:0/993966895 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c031830 con 0x7f9fa80b5490 2024-02-09T08:02:46.513 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.510+0000 7f9fa77fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:46.514 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.510+0000 7f9fa77fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-09T08:02:46.514 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.510+0000 7f9fa77fe640 10 monclient: dump: 2024-02-09T08:02:46.514 INFO:teuthology.misc.health.smithi062.stderr:epoch 1 2024-02-09T08:02:46.514 INFO:teuthology.misc.health.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:46.514 INFO:teuthology.misc.health.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:46.514 INFO:teuthology.misc.health.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:46.514 INFO:teuthology.misc.health.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:46.514 INFO:teuthology.misc.health.smithi062.stderr:election_strategy: 1 2024-02-09T08:02:46.514 INFO:teuthology.misc.health.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:46.514 INFO:teuthology.misc.health.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:46.514 INFO:teuthology.misc.health.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:46.514 INFO:teuthology.misc.health.smithi062.stderr: 2024-02-09T08:02:46.514 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.510+0000 7f9fa77fe640 10 monclient: _finish_auth 0 2024-02-09T08:02:46.514 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.510+0000 7f9fa77fe640 10 monclient: _check_auth_tickets 2024-02-09T08:02:46.515 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.510+0000 7f9fa77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:02:46.515 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.510+0000 7f9fa77fe640 1 -- 172.21.15.62:0/993966895 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f9c031990 con 0x7f9fa80b5490 2024-02-09T08:02:46.515 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.510+0000 7f9fa77fe640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:02:46.515 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.510+0000 7f9fa77fe640 1 -- 172.21.15.62:0/993966895 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c031d20 con 0x7f9fa80b5490 2024-02-09T08:02:46.515 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.510+0000 7f9fa77fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:46.515 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.510+0000 7f9fa77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-09T08:02:46.515 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.510+0000 7f9fa77fe640 10 monclient: dump: 2024-02-09T08:02:46.515 INFO:teuthology.misc.health.smithi062.stderr:epoch 1 2024-02-09T08:02:46.515 INFO:teuthology.misc.health.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:46.515 INFO:teuthology.misc.health.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:46.515 INFO:teuthology.misc.health.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:46.515 INFO:teuthology.misc.health.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:46.515 INFO:teuthology.misc.health.smithi062.stderr:election_strategy: 1 2024-02-09T08:02:46.515 INFO:teuthology.misc.health.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:46.516 INFO:teuthology.misc.health.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:46.516 INFO:teuthology.misc.health.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:46.516 INFO:teuthology.misc.health.smithi062.stderr: 2024-02-09T08:02:46.516 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.510+0000 7f9faec05640 5 monclient: authenticate success, global_id 4194 2024-02-09T08:02:46.516 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.510+0000 7f9faec05640 10 monclient: get_monmap_and_config success 2024-02-09T08:02:46.516 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.510+0000 7f9faec05640 4 set_mon_vals no callback set 2024-02-09T08:02:46.516 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.511+0000 7f9faec05640 10 monclient: shutdown 2024-02-09T08:02:46.516 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.511+0000 7f9faec05640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:02:46.516 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.511+0000 7f9faec05640 1 -- 172.21.15.62:0/993966895 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9fa80b5490 msgr2=0x7f9fa80a9850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:46.516 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.511+0000 7f9faec05640 1 --2- 172.21.15.62:0/993966895 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9fa80b5490 0x7f9fa80a9850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c0097a0 tx=0x7f9f9c02b8d0 comp rx=0 tx=0).stop 2024-02-09T08:02:46.521 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.512+0000 7f9faec05640 1 -- 172.21.15.62:0/993966895 shutdown_connections 2024-02-09T08:02:46.521 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.512+0000 7f9faec05640 1 --2- 172.21.15.62:0/993966895 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9fa80b5490 0x7f9fa80a9850 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:46.521 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.512+0000 7f9faec05640 1 -- 172.21.15.62:0/993966895 >> 172.21.15.62:0/993966895 conn(0x7f9fa80b8640 msgr2=0x7f9fa80b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:02:46.521 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.512+0000 7f9faec05640 1 -- 172.21.15.62:0/993966895 shutdown_connections 2024-02-09T08:02:46.521 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.512+0000 7f9faec05640 1 -- 172.21.15.62:0/993966895 wait complete. 2024-02-09T08:02:46.521 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.513+0000 7f9faec05640 10 monclient: build_initial_monmap 2024-02-09T08:02:46.521 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.513+0000 7f9faec05640 10 monclient: monmap: 2024-02-09T08:02:46.521 INFO:teuthology.misc.health.smithi062.stderr:epoch 0 2024-02-09T08:02:46.521 INFO:teuthology.misc.health.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:02:46.521 INFO:teuthology.misc.health.smithi062.stderr:last_changed 0.000000 2024-02-09T08:02:46.521 INFO:teuthology.misc.health.smithi062.stderr:created 0.000000 2024-02-09T08:02:46.521 INFO:teuthology.misc.health.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:02:46.522 INFO:teuthology.misc.health.smithi062.stderr:election_strategy: 1 2024-02-09T08:02:46.522 INFO:teuthology.misc.health.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:02:46.522 INFO:teuthology.misc.health.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:02:46.522 INFO:teuthology.misc.health.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:02:46.522 INFO:teuthology.misc.health.smithi062.stderr: 2024-02-09T08:02:46.522 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.513+0000 7f9faec05640 1 librados: starting msgr at 2024-02-09T08:02:46.522 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.513+0000 7f9faec05640 1 librados: starting objecter 2024-02-09T08:02:46.522 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.513+0000 7f9faec05640 1 Processor -- start 2024-02-09T08:02:46.522 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.514+0000 7f9faec05640 1 -- start start 2024-02-09T08:02:46.522 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.514+0000 7f9faec05640 1 librados: setting wanted keys 2024-02-09T08:02:46.522 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.514+0000 7f9faec05640 1 librados: calling monclient init 2024-02-09T08:02:46.522 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.514+0000 7f9faec05640 10 monclient: init 2024-02-09T08:02:46.522 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.515+0000 7f9faec05640 10 monclient: _reopen_session rank -1 2024-02-09T08:02:46.522 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.515+0000 7f9faec05640 10 monclient: _add_conns ranks=[2,1,0] 2024-02-09T08:02:46.523 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.515+0000 7f9faec05640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9fa80b5490 0x7f9fa8141060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:46.523 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.515+0000 7f9faec05640 10 monclient(hunting): picked mon.noname-c con 0x7f9fa80b5490 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:02:46.523 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.515+0000 7f9faec05640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fa813f880 0x7f9fa8143db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:46.523 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.515+0000 7f9faec05640 10 monclient(hunting): picked mon.noname-b con 0x7f9fa813f880 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:02:46.523 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.515+0000 7f9faec05640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9fa8146280 0x7f9fa81442f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:46.523 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.515+0000 7f9faec05640 10 monclient(hunting): picked mon.noname-a con 0x7f9fa8146280 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:02:46.523 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.515+0000 7f9faec05640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:46.523 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.515+0000 7f9faec05640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa8143170 con 0x7f9fa8146280 2024-02-09T08:02:46.523 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.515+0000 7f9faec05640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:46.523 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.515+0000 7f9faec05640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa8141d20 con 0x7f9fa813f880 2024-02-09T08:02:46.523 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.515+0000 7f9faec05640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:46.523 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.515+0000 7f9faec05640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa81403f0 con 0x7f9fa80b5490 2024-02-09T08:02:46.523 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.515+0000 7f9faec05640 10 monclient(hunting): _renew_subs 2024-02-09T08:02:46.523 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.515+0000 7f9faec05640 10 monclient(hunting): authenticate will time out at 1409.875506s 2024-02-09T08:02:46.523 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.515+0000 7f9fa7fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fa813f880 0x7f9fa8143db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:46.524 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.515+0000 7f9fad1a2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9fa8146280 0x7f9fa81442f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:46.524 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.515+0000 7f9fac9a1640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9fa80b5490 0x7f9fa8141060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:46.524 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.516+0000 7f9fad1a2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9fa8146280 0x7f9fa81442f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:36430/0 (socket says 172.21.15.62:36430) 2024-02-09T08:02:46.524 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.516+0000 7f9fad1a2640 1 -- 172.21.15.62:0/2463644488 learned_addr learned my addr 172.21.15.62:0/2463644488 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:02:46.524 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.516+0000 7f9fad1a2640 10 monclient(hunting): get_auth_request con 0x7f9fa8146280 auth_method 0 2024-02-09T08:02:46.524 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.516+0000 7f9fad1a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:46.524 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.516+0000 7f9fad1a2640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:46.524 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.516+0000 7f9fad1a2640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:46.524 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.516+0000 7f9fac9a1640 10 monclient(hunting): get_auth_request con 0x7f9fa80b5490 auth_method 0 2024-02-09T08:02:46.524 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.516+0000 7f9fac9a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:46.524 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.516+0000 7f9fac9a1640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:46.524 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.516+0000 7f9fac9a1640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:46.524 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.516+0000 7f9fa7fff640 10 monclient(hunting): get_auth_request con 0x7f9fa813f880 auth_method 0 2024-02-09T08:02:46.524 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.516+0000 7f9fa7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:46.525 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.516+0000 7f9fa7fff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:46.525 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.516+0000 7f9fa7fff640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:46.525 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.516+0000 7f9fad1a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:46.525 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.516+0000 7f9fad1a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:46.525 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.516+0000 7f9fad1a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:46.525 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.517+0000 7f9fa7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:46.525 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.517+0000 7f9fa7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:46.525 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.517+0000 7f9fa7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:46.525 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.517+0000 7f9fac9a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:46.525 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.517+0000 7f9fac9a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:46.525 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.517+0000 7f9fac9a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:46.527 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.519+0000 7f9fad1a2640 10 monclient(hunting): handle_auth_done global_id 4200 payload 824 2024-02-09T08:02:46.527 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.519+0000 7f9fad1a2640 1 -- 172.21.15.62:0/2463644488 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9fa80b5490 msgr2=0x7f9fa8141060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:46.527 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.519+0000 7f9fad1a2640 1 --2- 172.21.15.62:0/2463644488 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9fa80b5490 0x7f9fa8141060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:46.527 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.519+0000 7f9fad1a2640 1 -- 172.21.15.62:0/2463644488 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fa813f880 msgr2=0x7f9fa8143db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:46.527 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.519+0000 7f9fad1a2640 1 --2- 172.21.15.62:0/2463644488 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fa813f880 0x7f9fa8143db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:46.527 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.519+0000 7f9fad1a2640 10 monclient: _finish_hunting 0 2024-02-09T08:02:46.527 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.519+0000 7f9fad1a2640 1 monclient: found mon.noname-a 2024-02-09T08:02:46.527 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.519+0000 7f9fad1a2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:02:46.527 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.519+0000 7f9fad1a2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-02-09T08:02:46.527 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.519+0000 7f9fad1a2640 1 -- 172.21.15.62:0/2463644488 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f9c009400 con 0x7f9fa8146280 2024-02-09T08:02:46.527 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.522+0000 7f9fad1a2640 1 --2- 172.21.15.62:0/2463644488 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9fa8146280 0x7f9fa81442f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9fa000c6b0 tx=0x7f9fa000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:02:46.528 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.523+0000 7f9fa57fa640 10 client.?.objecter ms_handle_connect 0x7f9fa8146280 2024-02-09T08:02:46.528 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.523+0000 7f9fa57fa640 10 client.?.objecter resend_mon_ops 2024-02-09T08:02:46.532 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.527+0000 7f9fa57fa640 1 -- 172.21.15.62:0/2463644488 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa0003b70 con 0x7f9fa8146280 2024-02-09T08:02:46.532 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.527+0000 7f9fa57fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:46.532 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.527+0000 7f9fa57fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-09T08:02:46.532 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.527+0000 7f9fa57fa640 10 monclient: dump: 2024-02-09T08:02:46.532 INFO:teuthology.misc.health.smithi062.stderr:epoch 1 2024-02-09T08:02:46.532 INFO:teuthology.misc.health.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:46.532 INFO:teuthology.misc.health.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:46.532 INFO:teuthology.misc.health.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:46.532 INFO:teuthology.misc.health.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:46.532 INFO:teuthology.misc.health.smithi062.stderr:election_strategy: 1 2024-02-09T08:02:46.532 INFO:teuthology.misc.health.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:46.532 INFO:teuthology.misc.health.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:46.533 INFO:teuthology.misc.health.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:46.533 INFO:teuthology.misc.health.smithi062.stderr: 2024-02-09T08:02:46.533 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.527+0000 7f9fa57fa640 10 monclient: _finish_auth 0 2024-02-09T08:02:46.533 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.527+0000 7f9fa57fa640 10 monclient: _check_auth_tickets 2024-02-09T08:02:46.533 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.527+0000 7f9fa57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:02:46.533 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.527+0000 7f9fa57fa640 1 -- 172.21.15.62:0/2463644488 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa0003cf0 con 0x7f9fa8146280 2024-02-09T08:02:46.533 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.527+0000 7f9faec05640 5 monclient: authenticate success, global_id 4200 2024-02-09T08:02:46.533 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.527+0000 7f9faec05640 10 monclient: _renew_subs 2024-02-09T08:02:46.533 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.527+0000 7f9faec05640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:02:46.533 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.527+0000 7f9faec05640 1 -- 172.21.15.62:0/2463644488 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fa81415a0 con 0x7f9fa8146280 2024-02-09T08:02:46.533 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.527+0000 7f9fa57fa640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:02:46.533 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.527+0000 7f9fa57fa640 1 -- 172.21.15.62:0/2463644488 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa0003ea0 con 0x7f9fa8146280 2024-02-09T08:02:46.533 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.527+0000 7f9fa57fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:46.533 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.527+0000 7f9fa57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-09T08:02:46.534 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.527+0000 7f9fa57fa640 10 monclient: dump: 2024-02-09T08:02:46.534 INFO:teuthology.misc.health.smithi062.stderr:epoch 1 2024-02-09T08:02:46.534 INFO:teuthology.misc.health.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:46.534 INFO:teuthology.misc.health.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:46.534 INFO:teuthology.misc.health.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:46.534 INFO:teuthology.misc.health.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:46.534 INFO:teuthology.misc.health.smithi062.stderr:election_strategy: 1 2024-02-09T08:02:46.534 INFO:teuthology.misc.health.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:46.534 INFO:teuthology.misc.health.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:46.534 INFO:teuthology.misc.health.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:46.534 INFO:teuthology.misc.health.smithi062.stderr: 2024-02-09T08:02:46.534 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.527+0000 7f9fa6ffd640 4 set_mon_vals no callback set 2024-02-09T08:02:46.534 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.528+0000 7f9faec05640 10 client.4200.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:02:46.534 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.528+0000 7f9faec05640 10 monclient: _renew_subs 2024-02-09T08:02:46.534 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.528+0000 7f9faec05640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:02:46.535 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.528+0000 7f9faec05640 1 -- 172.21.15.62:0/2463644488 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fa8142420 con 0x7f9fa8146280 2024-02-09T08:02:46.535 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.528+0000 7f9faec05640 1 librados: init done 2024-02-09T08:02:46.535 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.529+0000 7f9faec05640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:02:46.535 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.529+0000 7f9faec05640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:02:46.535 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.529+0000 7f9faec05640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:02:46.535 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.529+0000 7f9faec05640 1 -- 172.21.15.62:0/2463644488 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fa806c120 con 0x7f9fa8146280 2024-02-09T08:02:46.553 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.551+0000 7f9fa57fa640 1 -- 172.21.15.62:0/2463644488 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 89732+0+0 (secure 0 0 0) 0x7f9fa0005310 con 0x7f9fa8146280 2024-02-09T08:02:46.554 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.552+0000 7f9fa57fa640 1 --2- 172.21.15.62:0/2463644488 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f9f8c06d160 0x7f9f8c06f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:46.554 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.552+0000 7f9fac9a1640 1 --2- 172.21.15.62:0/2463644488 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f9f8c06d160 0x7f9f8c06f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:46.554 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.552+0000 7f9fac9a1640 10 monclient: get_auth_request con 0x7f9f8c06d160 auth_method 0 2024-02-09T08:02:46.555 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.553+0000 7f9fac9a1640 1 --2- 172.21.15.62:0/2463644488 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f9f8c06d160 0x7f9f8c06f620 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c036000 tx=0x7f9f9c03c040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:02:46.555 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.553+0000 7f9fa57fa640 10 client.4200.objecter ms_handle_connect 0x7f9f8c06d160 2024-02-09T08:02:46.816 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.813+0000 7f9fa57fa640 1 -- 172.21.15.62:0/2463644488 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f9fa0059100 con 0x7f9fa8146280 2024-02-09T08:02:46.816 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.813+0000 7f9fa57fa640 10 client.4200.objecter ms_dispatch 0x7f9fa8000b90 osd_map(10..10 src has 1..10) v4 2024-02-09T08:02:46.816 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.813+0000 7f9fa57fa640 3 client.4200.objecter handle_osd_map got epochs [10,10] > 0 2024-02-09T08:02:46.816 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.813+0000 7f9fa57fa640 3 client.4200.objecter handle_osd_map decoding full epoch 10 2024-02-09T08:02:46.816 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.813+0000 7f9fa57fa640 20 client.4200.objecter dump_active .. 0 homeless 2024-02-09T08:02:46.816 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.813+0000 7f9fa57fa640 1 -- 172.21.15.62:0/2463644488 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9fa00553a0 con 0x7f9fa8146280 2024-02-09T08:02:46.816 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.814+0000 7f9fa57fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:02:46.816 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:46.814+0000 7f9fa57fa640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:02:47.077 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:47.075+0000 7f9faec05640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-02-09T08:02:47.077 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:47.075+0000 7f9faec05640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-02-09T08:02:47.077 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:47.075+0000 7f9faec05640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:02:47.077 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:47.075+0000 7f9faec05640 1 -- 172.21.15.62:0/2463644488 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9fa81469f0 con 0x7f9fa8146280 2024-02-09T08:02:47.140 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:47.137+0000 7f9fa57fa640 1 -- 172.21.15.62:0/2463644488 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f9fa0058a60 con 0x7f9fa8146280 2024-02-09T08:02:47.140 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:47.137+0000 7f9fa57fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-02-09T08:02:47.140 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:47.137+0000 7f9fa57fa640 10 monclient: _finish_command 2 = system:0 2024-02-09T08:02:47.140 INFO:teuthology.misc.health.smithi062.stdout: 2024-02-09T08:02:47.141 INFO:teuthology.misc.health.smithi062.stdout:{"epoch":10,"fsid":"981c5564-eb76-49a1-80ab-97c7647bc34a","created":"2024-02-09T08:02:07.866410+0000","modified":"2024-02-09T08:02:13.770858+0000","last_up_change":"0.000000","last_in_change":"2024-02-09T08:02:13.770858+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0e3b17d4-a50f-41d9-b455-0bc1606a5c86","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a0077e6c-220d-46f4-9be2-a707d1710890","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3739882a-5263-4113-840a-afd6acdcf15e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3657c103-db3d-46c5-8afc-2b0b9da1e2e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"faf5e721-fa06-43f8-9b72-36ca8132ffea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"5c96dba1-53d2-4c0c-8928-5f09ea17a984","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"3473844d-d631-4ea4-96fb-638eccee5cb6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d31bdb4b-8938-4da9-8bf1-57cf730e839d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-09T08:02:47.143 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:47.140+0000 7f9faec05640 10 librados: watch_flush enter 2024-02-09T08:02:47.143 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:47.140+0000 7f9faec05640 10 librados: watch_flush exit 2024-02-09T08:02:47.143 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:47.140+0000 7f9faec05640 20 client.4200.objecter shutdown clearing up homeless session... 2024-02-09T08:02:47.143 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:47.140+0000 7f9faec05640 10 client.4200.objecter successfully canceled tick 2024-02-09T08:02:47.143 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:47.140+0000 7f9faec05640 1 -- 172.21.15.62:0/2463644488 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f9f8c06d160 msgr2=0x7f9f8c06f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:47.144 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:47.140+0000 7f9faec05640 1 --2- 172.21.15.62:0/2463644488 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f9f8c06d160 0x7f9f8c06f620 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c036000 tx=0x7f9f9c03c040 comp rx=0 tx=0).stop 2024-02-09T08:02:47.144 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:47.140+0000 7f9faec05640 10 monclient: shutdown 2024-02-09T08:02:47.144 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:47.140+0000 7f9faec05640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:02:47.144 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:47.140+0000 7f9faec05640 1 -- 172.21.15.62:0/2463644488 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9fa8146280 msgr2=0x7f9fa81442f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:47.144 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:47.141+0000 7f9faec05640 1 --2- 172.21.15.62:0/2463644488 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9fa8146280 0x7f9fa81442f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9fa000c6b0 tx=0x7f9fa000cb70 comp rx=0 tx=0).stop 2024-02-09T08:02:47.144 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:47.141+0000 7f9faec05640 1 -- 172.21.15.62:0/2463644488 shutdown_connections 2024-02-09T08:02:47.144 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:47.141+0000 7f9faec05640 1 --2- 172.21.15.62:0/2463644488 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f9f8c06d160 0x7f9f8c06f620 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:47.144 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:47.141+0000 7f9faec05640 1 --2- 172.21.15.62:0/2463644488 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9fa8146280 0x7f9fa81442f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:47.144 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:47.141+0000 7f9faec05640 1 --2- 172.21.15.62:0/2463644488 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fa813f880 0x7f9fa8143db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:47.144 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:47.141+0000 7f9faec05640 1 --2- 172.21.15.62:0/2463644488 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9fa80b5490 0x7f9fa8141060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:47.144 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:47.141+0000 7f9faec05640 1 -- 172.21.15.62:0/2463644488 >> 172.21.15.62:0/2463644488 conn(0x7f9fa80b8640 msgr2=0x7f9fa80b7790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:02:47.144 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:47.141+0000 7f9faec05640 1 -- 172.21.15.62:0/2463644488 shutdown_connections 2024-02-09T08:02:47.144 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:47.141+0000 7f9faec05640 1 -- 172.21.15.62:0/2463644488 wait complete. 2024-02-09T08:02:47.144 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:47.141+0000 7f9faec05640 1 librados: shutdown 2024-02-09T08:02:47.154 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-02-09T08:02:48.962 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-02-09T08:02:48.956+0000 5dc3480 -1 osd.5 0 log_to_monitors true 2024-02-09T08:02:49.994 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:02:49.988+0000 5dc3480 -1 osd.4 0 log_to_monitors true 2024-02-09T08:02:50.218 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:02:50.213+0000 5dc3480 -1 osd.7 0 log_to_monitors true 2024-02-09T08:02:50.220 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-02-09T08:02:50.215+0000 5dc3480 -1 osd.6 0 log_to_monitors true 2024-02-09T08:02:50.683 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:02:50.679+0000 5dc3480 -1 osd.1 0 log_to_monitors true 2024-02-09T08:02:50.840 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:02:50.809+0000 5dc3480 -1 osd.0 0 log_to_monitors true 2024-02-09T08:02:51.153 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:02:51.148+0000 5dc3480 -1 osd.3 0 log_to_monitors true 2024-02-09T08:02:51.740 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:02:51.735+0000 5dc3480 -1 osd.2 0 log_to_monitors true 2024-02-09T08:02:52.586 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-02-09T08:02:52.580+0000 c68d640 -1 osd.5 0 waiting for initial osdmap 2024-02-09T08:02:52.986 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-02-09T08:02:52.970+0000 1044c640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-09T08:02:53.738 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:02:53.730+0000 c68d640 -1 osd.7 0 waiting for initial osdmap 2024-02-09T08:02:53.779 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-02-09T08:02:53.772+0000 ae77640 -1 osd.6 0 waiting for initial osdmap 2024-02-09T08:02:53.961 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-09T08:02:54.050 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.048+0000 7f6bfe363640 10 monclient: get_monmap_and_config 2024-02-09T08:02:54.051 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.048+0000 7f6bfe363640 10 monclient: build_initial_monmap 2024-02-09T08:02:54.051 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.048+0000 7f6bfe363640 10 monclient: monmap: 2024-02-09T08:02:54.051 INFO:teuthology.misc.health.smithi062.stderr:epoch 0 2024-02-09T08:02:54.051 INFO:teuthology.misc.health.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:54.051 INFO:teuthology.misc.health.smithi062.stderr:last_changed 2024-02-09T08:02:54.049751+0000 2024-02-09T08:02:54.051 INFO:teuthology.misc.health.smithi062.stderr:created 2024-02-09T08:02:54.049751+0000 2024-02-09T08:02:54.051 INFO:teuthology.misc.health.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:02:54.051 INFO:teuthology.misc.health.smithi062.stderr:election_strategy: 1 2024-02-09T08:02:54.051 INFO:teuthology.misc.health.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:02:54.051 INFO:teuthology.misc.health.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:02:54.052 INFO:teuthology.misc.health.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:02:54.052 INFO:teuthology.misc.health.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:02:54.052 INFO:teuthology.misc.health.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:02:54.052 INFO:teuthology.misc.health.smithi062.stderr: 2024-02-09T08:02:54.054 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.049+0000 7f6bfe363640 1 Processor -- start 2024-02-09T08:02:54.054 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.049+0000 7f6bfe363640 1 -- start start 2024-02-09T08:02:54.054 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.049+0000 7f6bfe363640 10 monclient: init 2024-02-09T08:02:54.054 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.050+0000 7f6bfe363640 10 monclient: _reopen_session rank -1 2024-02-09T08:02:54.054 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.050+0000 7f6bfe363640 10 monclient: _add_conns ranks=[1,3,2,4,0] 2024-02-09T08:02:54.054 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.050+0000 7f6bfe363640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f6bf80b5270 addr v1:172.21.15.103:6789/0 2024-02-09T08:02:54.054 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.050+0000 7f6bfe363640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6bf813fc80 0x7f6bf80a9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:54.054 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.050+0000 7f6bfe363640 10 monclient(hunting): picked mon.noname-a con 0x7f6bf813fc80 addr v2:172.21.15.62:3300/0 2024-02-09T08:02:54.054 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.050+0000 7f6bfe363640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6bf8145e00 0x7f6bf8146270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:54.055 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.050+0000 7f6bfe363640 10 monclient(hunting): picked mon.noname-b con 0x7f6bf8145e00 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:02:54.055 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.050+0000 7f6bfe363640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bf80ab0f0 con 0x7f6bf80b5270 2024-02-09T08:02:54.055 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.050+0000 7f6bfe363640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:54.055 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.050+0000 7f6bfe363640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bf80b5650 con 0x7f6bf813fc80 2024-02-09T08:02:54.055 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.050+0000 7f6bfe363640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:54.055 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.050+0000 7f6bfe363640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf80ab340 con 0x7f6bf8145e00 2024-02-09T08:02:54.055 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.050+0000 7f6bfe363640 10 monclient(hunting): _renew_subs 2024-02-09T08:02:54.055 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.050+0000 7f6bfe363640 10 monclient(hunting): authenticate will time out at 1417.410340s 2024-02-09T08:02:54.055 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.050+0000 7f6bf77fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6bf813fc80 0x7f6bf80a9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:54.055 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.050+0000 7f6bfc900640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6bf8145e00 0x7f6bf8146270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:54.055 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.050+0000 7f6bf77fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6bf813fc80 0x7f6bf80a9e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56404/0 (socket says 172.21.15.62:56404) 2024-02-09T08:02:54.055 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.050+0000 7f6bf77fe640 1 -- 172.21.15.62:0/2926041574 learned_addr learned my addr 172.21.15.62:0/2926041574 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:02:54.055 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.050+0000 7f6bf77fe640 10 monclient(hunting): get_auth_request con 0x7f6bf813fc80 auth_method 0 2024-02-09T08:02:54.055 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.050+0000 7f6bfc900640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6bf8145e00 0x7f6bf8146270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:43174/0 (socket says 172.21.15.62:43174) 2024-02-09T08:02:54.056 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.050+0000 7f6bf77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:54.056 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.050+0000 7f6bf77fe640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:54.056 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.050+0000 7f6bf77fe640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:54.056 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.050+0000 7f6bfc900640 10 monclient(hunting): get_auth_request con 0x7f6bf8145e00 auth_method 0 2024-02-09T08:02:54.056 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.050+0000 7f6bfc900640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:54.056 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.050+0000 7f6bfc900640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:54.056 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.050+0000 7f6bfc900640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:54.056 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.051+0000 7f6bfc900640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:54.056 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.051+0000 7f6bfc900640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:54.056 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.051+0000 7f6bfc900640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:54.056 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.051+0000 7f6bf77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:54.056 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.051+0000 7f6bf77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:54.056 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.051+0000 7f6bf77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:54.057 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.053+0000 7f6bfc900640 10 monclient(hunting): handle_auth_done global_id 4226 payload 274 2024-02-09T08:02:54.057 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.053+0000 7f6bfc900640 1 -- 172.21.15.62:0/2926041574 >> v2:172.21.15.62:3300/0 conn(0x7f6bf813fc80 msgr2=0x7f6bf80a9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:02:54.057 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.053+0000 7f6bfc900640 1 --2- 172.21.15.62:0/2926041574 >> v2:172.21.15.62:3300/0 conn(0x7f6bf813fc80 0x7f6bf80a9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:54.057 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.053+0000 7f6bfc900640 1 -- 172.21.15.62:0/2926041574 >> v1:172.21.15.103:6789/0 conn(0x7f6bf80b5270 legacy=0x7f6bf813f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:54.058 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.053+0000 7f6bfc900640 10 monclient: _finish_hunting 0 2024-02-09T08:02:54.058 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.053+0000 7f6bfc900640 1 monclient: found mon.noname-b 2024-02-09T08:02:54.058 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.053+0000 7f6bfc900640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:02:54.058 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.053+0000 7f6bfc900640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.62:3301/0 2024-02-09T08:02:54.058 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.053+0000 7f6bfc900640 1 -- 172.21.15.62:0/2926041574 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf80ab620 con 0x7f6bf8145e00 2024-02-09T08:02:54.058 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.055+0000 7f6bfc900640 1 --2- 172.21.15.62:0/2926041574 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6bf8145e00 0x7f6bf8146270 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6bf0009d90 tx=0x7f6bf002be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bef681c857adee87 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:02:54.060 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.058+0000 7f6bf6ffd640 1 -- 172.21.15.62:0/2926041574 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf002cbc0 con 0x7f6bf8145e00 2024-02-09T08:02:54.061 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.058+0000 7f6bf6ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:54.061 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.058+0000 7f6bf6ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:02:54.061 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.058+0000 7f6bf6ffd640 10 monclient: dump: 2024-02-09T08:02:54.061 INFO:teuthology.misc.health.smithi062.stderr:epoch 1 2024-02-09T08:02:54.061 INFO:teuthology.misc.health.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:54.061 INFO:teuthology.misc.health.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:54.061 INFO:teuthology.misc.health.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:54.061 INFO:teuthology.misc.health.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:54.061 INFO:teuthology.misc.health.smithi062.stderr:election_strategy: 1 2024-02-09T08:02:54.061 INFO:teuthology.misc.health.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:54.061 INFO:teuthology.misc.health.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:54.061 INFO:teuthology.misc.health.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:54.062 INFO:teuthology.misc.health.smithi062.stderr: 2024-02-09T08:02:54.062 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.058+0000 7f6bf6ffd640 10 monclient: _finish_auth 0 2024-02-09T08:02:54.062 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.058+0000 7f6bf6ffd640 10 monclient: _check_auth_tickets 2024-02-09T08:02:54.062 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.058+0000 7f6bf6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:02:54.062 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.058+0000 7f6bf6ffd640 1 -- 172.21.15.62:0/2926041574 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf002cd20 con 0x7f6bf8145e00 2024-02-09T08:02:54.062 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.058+0000 7f6bfe363640 5 monclient: authenticate success, global_id 4226 2024-02-09T08:02:54.062 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.058+0000 7f6bfe363640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-02-09T08:02:54.062 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.058+0000 7f6bf6ffd640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:02:54.062 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.058+0000 7f6bfe363640 10 monclient: get_monmap_and_config success 2024-02-09T08:02:54.062 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.058+0000 7f6bfe363640 4 set_mon_vals no callback set 2024-02-09T08:02:54.062 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.058+0000 7f6bf6ffd640 1 -- 172.21.15.62:0/2926041574 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf0034660 con 0x7f6bf8145e00 2024-02-09T08:02:54.062 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.058+0000 7f6bf6ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:54.062 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.058+0000 7f6bf6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-09T08:02:54.062 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.058+0000 7f6bf6ffd640 10 monclient: dump: 2024-02-09T08:02:54.063 INFO:teuthology.misc.health.smithi062.stderr:epoch 1 2024-02-09T08:02:54.063 INFO:teuthology.misc.health.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:54.063 INFO:teuthology.misc.health.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:54.063 INFO:teuthology.misc.health.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:54.063 INFO:teuthology.misc.health.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:54.063 INFO:teuthology.misc.health.smithi062.stderr:election_strategy: 1 2024-02-09T08:02:54.063 INFO:teuthology.misc.health.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:54.063 INFO:teuthology.misc.health.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:54.063 INFO:teuthology.misc.health.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:54.063 INFO:teuthology.misc.health.smithi062.stderr: 2024-02-09T08:02:54.066 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.059+0000 7f6bfe363640 10 monclient: shutdown 2024-02-09T08:02:54.067 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.059+0000 7f6bfe363640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:02:54.067 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.059+0000 7f6bfe363640 1 -- 172.21.15.62:0/2926041574 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6bf8145e00 msgr2=0x7f6bf8146270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:54.067 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.059+0000 7f6bfe363640 1 --2- 172.21.15.62:0/2926041574 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6bf8145e00 0x7f6bf8146270 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6bf0009d90 tx=0x7f6bf002be10 comp rx=0 tx=0).stop 2024-02-09T08:02:54.067 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.059+0000 7f6bfe363640 1 -- 172.21.15.62:0/2926041574 shutdown_connections 2024-02-09T08:02:54.067 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.059+0000 7f6bfe363640 1 --2- 172.21.15.62:0/2926041574 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6bf8145e00 0x7f6bf8146270 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:54.067 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.059+0000 7f6bfe363640 1 --2- 172.21.15.62:0/2926041574 >> v2:172.21.15.62:3300/0 conn(0x7f6bf813fc80 0x7f6bf80a9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:54.067 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.059+0000 7f6bfe363640 1 -- 172.21.15.62:0/2926041574 >> 172.21.15.62:0/2926041574 conn(0x7f6bf8066c90 msgr2=0x7f6bf80670a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:02:54.067 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.059+0000 7f6bfe363640 1 -- 172.21.15.62:0/2926041574 shutdown_connections 2024-02-09T08:02:54.067 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.059+0000 7f6bfe363640 1 -- 172.21.15.62:0/2926041574 wait complete. 2024-02-09T08:02:54.067 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.060+0000 7f6bfe363640 10 monclient: build_initial_monmap 2024-02-09T08:02:54.067 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.060+0000 7f6bfe363640 10 monclient: monmap: 2024-02-09T08:02:54.067 INFO:teuthology.misc.health.smithi062.stderr:epoch 0 2024-02-09T08:02:54.068 INFO:teuthology.misc.health.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:02:54.068 INFO:teuthology.misc.health.smithi062.stderr:last_changed 0.000000 2024-02-09T08:02:54.068 INFO:teuthology.misc.health.smithi062.stderr:created 0.000000 2024-02-09T08:02:54.068 INFO:teuthology.misc.health.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:02:54.068 INFO:teuthology.misc.health.smithi062.stderr:election_strategy: 1 2024-02-09T08:02:54.068 INFO:teuthology.misc.health.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:02:54.068 INFO:teuthology.misc.health.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:02:54.068 INFO:teuthology.misc.health.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:02:54.068 INFO:teuthology.misc.health.smithi062.stderr: 2024-02-09T08:02:54.068 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.060+0000 7f6bfe363640 1 librados: starting msgr at 2024-02-09T08:02:54.068 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.060+0000 7f6bfe363640 1 librados: starting objecter 2024-02-09T08:02:54.068 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.060+0000 7f6bfe363640 1 Processor -- start 2024-02-09T08:02:54.068 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.060+0000 7f6bfe363640 1 -- start start 2024-02-09T08:02:54.069 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.060+0000 7f6bfe363640 1 librados: setting wanted keys 2024-02-09T08:02:54.069 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.060+0000 7f6bfe363640 1 librados: calling monclient init 2024-02-09T08:02:54.069 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.060+0000 7f6bfe363640 10 monclient: init 2024-02-09T08:02:54.069 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.061+0000 7f6bfe363640 10 monclient: _reopen_session rank -1 2024-02-09T08:02:54.069 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.061+0000 7f6bfe363640 10 monclient: _add_conns ranks=[1,0,2] 2024-02-09T08:02:54.069 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.061+0000 7f6bfe363640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bf80b5270 0x7f6bf813bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:54.069 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.061+0000 7f6bfe363640 10 monclient(hunting): picked mon.noname-b con 0x7f6bf80b5270 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:02:54.069 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.061+0000 7f6bfe363640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6bf813fc80 0x7f6bf813c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:54.069 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.061+0000 7f6bfe363640 10 monclient(hunting): picked mon.noname-a con 0x7f6bf813fc80 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:02:54.069 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.061+0000 7f6bfe363640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6bf8145e00 0x7f6bf813cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:54.069 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.061+0000 7f6bfe363640 10 monclient(hunting): picked mon.noname-c con 0x7f6bf8145e00 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:02:54.069 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.061+0000 7f6bfe363640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:54.069 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.061+0000 7f6bfe363640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf813db20 con 0x7f6bf813fc80 2024-02-09T08:02:54.069 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.061+0000 7f6bfe363640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:54.070 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.061+0000 7f6bfe363640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf813dd90 con 0x7f6bf80b5270 2024-02-09T08:02:54.070 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.061+0000 7f6bfe363640 10 monclient(hunting): start opening mon connection 2024-02-09T08:02:54.070 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.061+0000 7f6bfe363640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf813e070 con 0x7f6bf8145e00 2024-02-09T08:02:54.070 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.061+0000 7f6bfe363640 10 monclient(hunting): _renew_subs 2024-02-09T08:02:54.070 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.061+0000 7f6bfe363640 10 monclient(hunting): authenticate will time out at 1417.421654s 2024-02-09T08:02:54.070 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.061+0000 7f6bfc900640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6bf8145e00 0x7f6bf813cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:54.070 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.061+0000 7f6bf77fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6bf813fc80 0x7f6bf813c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:54.070 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.062+0000 7f6bf7fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bf80b5270 0x7f6bf813bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:54.070 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.062+0000 7f6bfc900640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6bf8145e00 0x7f6bf813cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:43186/0 (socket says 172.21.15.62:43186) 2024-02-09T08:02:54.070 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.062+0000 7f6bfc900640 1 -- 172.21.15.62:0/1502932869 learned_addr learned my addr 172.21.15.62:0/1502932869 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:02:54.070 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.062+0000 7f6bfc900640 10 monclient(hunting): get_auth_request con 0x7f6bf8145e00 auth_method 0 2024-02-09T08:02:54.070 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.062+0000 7f6bfc900640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:54.070 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.062+0000 7f6bfc900640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:54.070 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.062+0000 7f6bfc900640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:54.071 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.062+0000 7f6bf77fe640 10 monclient(hunting): get_auth_request con 0x7f6bf813fc80 auth_method 0 2024-02-09T08:02:54.071 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.062+0000 7f6bf77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:54.071 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.062+0000 7f6bf77fe640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:54.071 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.062+0000 7f6bf77fe640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:54.071 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.062+0000 7f6bf7fff640 10 monclient(hunting): get_auth_request con 0x7f6bf80b5270 auth_method 0 2024-02-09T08:02:54.071 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.062+0000 7f6bf7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:02:54.071 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.062+0000 7f6bf7fff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:02:54.071 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.062+0000 7f6bf7fff640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:02:54.071 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.062+0000 7f6bfc900640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:54.071 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.062+0000 7f6bfc900640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:54.071 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.062+0000 7f6bfc900640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:54.071 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.062+0000 7f6bf77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:54.071 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.062+0000 7f6bf77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:54.071 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.062+0000 7f6bf77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:54.071 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.062+0000 7f6bf7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:02:54.072 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.062+0000 7f6bf7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:02:54.072 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.062+0000 7f6bf7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:02:54.073 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.065+0000 7f6bf77fe640 10 monclient(hunting): handle_auth_done global_id 4227 payload 824 2024-02-09T08:02:54.073 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.065+0000 7f6bf77fe640 1 -- 172.21.15.62:0/1502932869 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6bf8145e00 msgr2=0x7f6bf813cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:54.073 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.065+0000 7f6bf77fe640 1 --2- 172.21.15.62:0/1502932869 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6bf8145e00 0x7f6bf813cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:54.073 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.065+0000 7f6bf77fe640 1 -- 172.21.15.62:0/1502932869 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bf80b5270 msgr2=0x7f6bf813bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:54.073 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.065+0000 7f6bf77fe640 1 --2- 172.21.15.62:0/1502932869 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bf80b5270 0x7f6bf813bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:54.073 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.065+0000 7f6bf77fe640 10 monclient: _finish_hunting 0 2024-02-09T08:02:54.073 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.065+0000 7f6bf77fe640 1 monclient: found mon.noname-a 2024-02-09T08:02:54.073 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.065+0000 7f6bf77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:02:54.073 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.065+0000 7f6bf77fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-02-09T08:02:54.073 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.065+0000 7f6bf77fe640 1 -- 172.21.15.62:0/1502932869 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf0009a70 con 0x7f6bf813fc80 2024-02-09T08:02:54.073 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.065+0000 7f6bfc900640 1 --2- 172.21.15.62:0/1502932869 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6bf8145e00 0x7f6bf813cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-09T08:02:54.073 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.067+0000 7f6bf77fe640 1 --2- 172.21.15.62:0/1502932869 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6bf813fc80 0x7f6bf813c660 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6bec00e850 tx=0x7f6bec00ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:02:54.073 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.067+0000 7f6bf4ff9640 10 client.?.objecter ms_handle_connect 0x7f6bf813fc80 2024-02-09T08:02:54.074 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.067+0000 7f6bf4ff9640 10 client.?.objecter resend_mon_ops 2024-02-09T08:02:54.075 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.071+0000 7f6bf4ff9640 1 -- 172.21.15.62:0/1502932869 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bec00c940 con 0x7f6bf813fc80 2024-02-09T08:02:54.075 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.071+0000 7f6bf4ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:54.075 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.071+0000 7f6bf4ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-09T08:02:54.075 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.071+0000 7f6bf4ff9640 10 monclient: dump: 2024-02-09T08:02:54.075 INFO:teuthology.misc.health.smithi062.stderr:epoch 1 2024-02-09T08:02:54.075 INFO:teuthology.misc.health.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:54.075 INFO:teuthology.misc.health.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:54.075 INFO:teuthology.misc.health.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:54.075 INFO:teuthology.misc.health.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:54.075 INFO:teuthology.misc.health.smithi062.stderr:election_strategy: 1 2024-02-09T08:02:54.075 INFO:teuthology.misc.health.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:54.075 INFO:teuthology.misc.health.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:54.076 INFO:teuthology.misc.health.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:54.076 INFO:teuthology.misc.health.smithi062.stderr: 2024-02-09T08:02:54.076 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.071+0000 7f6bf4ff9640 10 monclient: _finish_auth 0 2024-02-09T08:02:54.076 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.071+0000 7f6bf4ff9640 10 monclient: _check_auth_tickets 2024-02-09T08:02:54.076 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.071+0000 7f6bf4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:02:54.076 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.071+0000 7f6bf4ff9640 1 -- 172.21.15.62:0/1502932869 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bec00caa0 con 0x7f6bf813fc80 2024-02-09T08:02:54.076 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.071+0000 7f6bf4ff9640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:02:54.076 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.071+0000 7f6bf4ff9640 1 -- 172.21.15.62:0/1502932869 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bec00ce10 con 0x7f6bf813fc80 2024-02-09T08:02:54.076 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.071+0000 7f6bf4ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:02:54.076 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.071+0000 7f6bf4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-09T08:02:54.076 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.071+0000 7f6bf4ff9640 10 monclient: dump: 2024-02-09T08:02:54.076 INFO:teuthology.misc.health.smithi062.stderr:epoch 1 2024-02-09T08:02:54.076 INFO:teuthology.misc.health.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:02:54.076 INFO:teuthology.misc.health.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:54.077 INFO:teuthology.misc.health.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:02:54.077 INFO:teuthology.misc.health.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:02:54.077 INFO:teuthology.misc.health.smithi062.stderr:election_strategy: 1 2024-02-09T08:02:54.077 INFO:teuthology.misc.health.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:02:54.077 INFO:teuthology.misc.health.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:02:54.077 INFO:teuthology.misc.health.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:02:54.077 INFO:teuthology.misc.health.smithi062.stderr: 2024-02-09T08:02:54.077 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.071+0000 7f6bfe363640 5 monclient: authenticate success, global_id 4227 2024-02-09T08:02:54.077 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.071+0000 7f6bfe363640 10 monclient: _renew_subs 2024-02-09T08:02:54.077 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.071+0000 7f6bfe363640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:02:54.077 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.071+0000 7f6bf67fc640 4 set_mon_vals no callback set 2024-02-09T08:02:54.077 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.071+0000 7f6bfe363640 1 -- 172.21.15.62:0/1502932869 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bf8142990 con 0x7f6bf813fc80 2024-02-09T08:02:54.077 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.071+0000 7f6bfe363640 10 client.4227.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:02:54.077 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.071+0000 7f6bfe363640 10 monclient: _renew_subs 2024-02-09T08:02:54.077 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.071+0000 7f6bfe363640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:02:54.078 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.071+0000 7f6bfe363640 1 -- 172.21.15.62:0/1502932869 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bf813d0e0 con 0x7f6bf813fc80 2024-02-09T08:02:54.078 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.071+0000 7f6bfe363640 1 librados: init done 2024-02-09T08:02:54.078 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.072+0000 7f6bfe363640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:02:54.078 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.072+0000 7f6bfe363640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:02:54.078 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.072+0000 7f6bfe363640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:02:54.078 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.072+0000 7f6bfe363640 1 -- 172.21.15.62:0/1502932869 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bf813d330 con 0x7f6bf813fc80 2024-02-09T08:02:54.092 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.090+0000 7f6bf4ff9640 1 -- 172.21.15.62:0/1502932869 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 89732+0+0 (secure 0 0 0) 0x7f6bec013470 con 0x7f6bf813fc80 2024-02-09T08:02:54.093 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.090+0000 7f6bf4ff9640 1 --2- 172.21.15.62:0/1502932869 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f6be406d160 0x7f6be406f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:02:54.093 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.091+0000 7f6bf7fff640 1 --2- 172.21.15.62:0/1502932869 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f6be406d160 0x7f6be406f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:02:54.093 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.091+0000 7f6bf7fff640 10 monclient: get_auth_request con 0x7f6be406d160 auth_method 0 2024-02-09T08:02:54.093 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.091+0000 7f6bf7fff640 1 --2- 172.21.15.62:0/1502932869 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f6be406d160 0x7f6be406f620 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6be8001780 tx=0x7f6be8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:02:54.093 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.091+0000 7f6bf4ff9640 10 client.4227.objecter ms_handle_connect 0x7f6be406d160 2024-02-09T08:02:54.096 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.094+0000 7f6bf4ff9640 1 -- 172.21.15.62:0/1502932869 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2337+0+0 (secure 0 0 0) 0x7f6bec0592d0 con 0x7f6bf813fc80 2024-02-09T08:02:54.096 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.094+0000 7f6bf4ff9640 10 client.4227.objecter ms_dispatch 0x7f6bf8000b90 osd_map(13..13 src has 1..13) v4 2024-02-09T08:02:54.096 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.094+0000 7f6bf4ff9640 3 client.4227.objecter handle_osd_map got epochs [13,13] > 0 2024-02-09T08:02:54.096 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.094+0000 7f6bf4ff9640 3 client.4227.objecter handle_osd_map decoding full epoch 13 2024-02-09T08:02:54.096 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.094+0000 7f6bf4ff9640 20 client.4227.objecter dump_active .. 0 homeless 2024-02-09T08:02:54.194 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:02:54.177+0000 1044c640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-09T08:02:54.225 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-02-09T08:02:54.209+0000 1044c640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-09T08:02:54.358 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.356+0000 7f6bf4ff9640 1 -- 172.21.15.62:0/1502932869 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6bec055570 con 0x7f6bf813fc80 2024-02-09T08:02:54.358 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.356+0000 7f6bf4ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:02:54.358 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.356+0000 7f6bf4ff9640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:02:54.556 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.553+0000 7f6bfe363640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-02-09T08:02:54.556 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.553+0000 7f6bfe363640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-02-09T08:02:54.556 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.553+0000 7f6bfe363640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:02:54.556 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.553+0000 7f6bfe363640 1 -- 172.21.15.62:0/1502932869 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6bf806a4b0 con 0x7f6bf813fc80 2024-02-09T08:02:54.665 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.662+0000 7f6bf4ff9640 1 -- 172.21.15.62:0/1502932869 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+7578 (secure 0 0 0) 0x7f6bec017090 con 0x7f6bf813fc80 2024-02-09T08:02:54.665 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.663+0000 7f6bf4ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-02-09T08:02:54.665 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.663+0000 7f6bf4ff9640 10 monclient: _finish_command 2 = system:0 2024-02-09T08:02:54.665 INFO:teuthology.misc.health.smithi062.stdout: 2024-02-09T08:02:54.665 INFO:teuthology.misc.health.smithi062.stdout:{"epoch":14,"fsid":"981c5564-eb76-49a1-80ab-97c7647bc34a","created":"2024-02-09T08:02:07.866410+0000","modified":"2024-02-09T08:02:54.364324+0000","last_up_change":"2024-02-09T08:02:53.207419+0000","last_in_change":"2024-02-09T08:02:13.770858+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0e3b17d4-a50f-41d9-b455-0bc1606a5c86","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a0077e6c-220d-46f4-9be2-a707d1710890","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3739882a-5263-4113-840a-afd6acdcf15e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3657c103-db3d-46c5-8afc-2b0b9da1e2e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"faf5e721-fa06-43f8-9b72-36ca8132ffea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"5c96dba1-53d2-4c0c-8928-5f09ea17a984","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":262591034},{"type":"v1","addr":"172.21.15.103:6803","nonce":262591034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":262591034},{"type":"v1","addr":"172.21.15.103:6805","nonce":262591034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":262591034},{"type":"v1","addr":"172.21.15.103:6809","nonce":262591034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":262591034},{"type":"v1","addr":"172.21.15.103:6807","nonce":262591034}]},"public_addr":"172.21.15.103:6803/262591034","cluster_addr":"172.21.15.103:6805/262591034","heartbeat_back_addr":"172.21.15.103:6809/262591034","heartbeat_front_addr":"172.21.15.103:6807/262591034","state":["exists","up"]},{"osd":6,"uuid":"3473844d-d631-4ea4-96fb-638eccee5cb6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d31bdb4b-8938-4da9-8bf1-57cf730e839d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T08:02:50.950607+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-09T08:02:54.667 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.665+0000 7f6bfe363640 10 librados: watch_flush enter 2024-02-09T08:02:54.667 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.665+0000 7f6bfe363640 10 librados: watch_flush exit 2024-02-09T08:02:54.667 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.665+0000 7f6bfe363640 20 client.4227.objecter shutdown clearing up homeless session... 2024-02-09T08:02:54.667 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.665+0000 7f6bfe363640 10 client.4227.objecter successfully canceled tick 2024-02-09T08:02:54.668 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.665+0000 7f6bfe363640 1 -- 172.21.15.62:0/1502932869 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f6be406d160 msgr2=0x7f6be406f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:54.668 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.665+0000 7f6bfe363640 1 --2- 172.21.15.62:0/1502932869 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f6be406d160 0x7f6be406f620 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6be8001780 tx=0x7f6be8009040 comp rx=0 tx=0).stop 2024-02-09T08:02:54.668 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.665+0000 7f6bfe363640 10 monclient: shutdown 2024-02-09T08:02:54.669 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.665+0000 7f6bfe363640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:02:54.669 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.665+0000 7f6bfe363640 1 -- 172.21.15.62:0/1502932869 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6bf813fc80 msgr2=0x7f6bf813c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:02:54.669 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.665+0000 7f6bfe363640 1 --2- 172.21.15.62:0/1502932869 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6bf813fc80 0x7f6bf813c660 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6bec00e850 tx=0x7f6bec00ed10 comp rx=0 tx=0).stop 2024-02-09T08:02:54.669 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.666+0000 7f6bfe363640 1 -- 172.21.15.62:0/1502932869 shutdown_connections 2024-02-09T08:02:54.669 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.666+0000 7f6bfe363640 1 --2- 172.21.15.62:0/1502932869 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f6be406d160 0x7f6be406f620 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:54.669 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.666+0000 7f6bfe363640 1 --2- 172.21.15.62:0/1502932869 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6bf8145e00 0x7f6bf813cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:54.669 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.666+0000 7f6bfe363640 1 --2- 172.21.15.62:0/1502932869 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6bf813fc80 0x7f6bf813c660 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:54.669 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.666+0000 7f6bfe363640 1 --2- 172.21.15.62:0/1502932869 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bf80b5270 0x7f6bf813bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:02:54.669 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.666+0000 7f6bfe363640 1 -- 172.21.15.62:0/1502932869 >> 172.21.15.62:0/1502932869 conn(0x7f6bf8066c90 msgr2=0x7f6bf813ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:02:54.669 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.666+0000 7f6bfe363640 1 -- 172.21.15.62:0/1502932869 shutdown_connections 2024-02-09T08:02:54.669 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.666+0000 7f6bfe363640 1 -- 172.21.15.62:0/1502932869 wait complete. 2024-02-09T08:02:54.669 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:02:54.666+0000 7f6bfe363640 1 librados: shutdown 2024-02-09T08:02:54.681 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-02-09T08:02:54.874 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:02:54.868+0000 ae77640 -1 osd.0 0 waiting for initial osdmap 2024-02-09T08:02:54.890 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:02:54.885+0000 c68d640 -1 osd.2 0 waiting for initial osdmap 2024-02-09T08:02:54.912 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:02:54.896+0000 ae77640 -1 osd.1 0 waiting for initial osdmap 2024-02-09T08:02:55.352 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:02:55.336+0000 1044c640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-09T08:02:55.354 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:02:55.335+0000 1044c640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-09T08:02:55.393 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:02:55.375+0000 1044c640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-09T08:03:00.443 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:03:00.429+0000 5dc3480 -1 bdev(0x1946c6c0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2024-02-09T08:03:00.648 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:03:00.443+0000 5dc3480 -1 bdev(0x1946c6c0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 2 2024-02-09T08:03:00.649 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:03:00.496+0000 5dc3480 -1 bdev(0x1946c6c0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2024-02-09T08:03:00.757 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:03:00.647+0000 5dc3480 -1 bdev(0x1946c6c0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2024-02-09T08:03:00.759 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:03:00.756+0000 5dc3480 -1 bdev(0x1946c6c0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2024-02-09T08:03:00.924 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:03:00.911+0000 5dc3480 -1 bdev(0x1946c6c0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 2 2024-02-09T08:03:01.002 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:03:00.922+0000 5dc3480 -1 bdev(0x1946c6c0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2024-02-09T08:03:01.023 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:03:00.949+0000 5dc3480 -1 bdev(0x1946c6c0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2024-02-09T08:03:01.027 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:03:00.999+0000 5dc3480 -1 bdev(0x1946c6c0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2024-02-09T08:03:01.329 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:03:01.058+0000 5dc3480 -1 bdev(0x1946c6c0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 2 2024-02-09T08:03:01.487 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-09T08:03:01.611 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.609+0000 7fd6b8e62640 10 monclient: get_monmap_and_config 2024-02-09T08:03:01.612 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.609+0000 7fd6b8e62640 10 monclient: build_initial_monmap 2024-02-09T08:03:01.612 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.609+0000 7fd6b8e62640 10 monclient: monmap: 2024-02-09T08:03:01.612 INFO:teuthology.misc.health.smithi062.stderr:epoch 0 2024-02-09T08:03:01.612 INFO:teuthology.misc.health.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:01.612 INFO:teuthology.misc.health.smithi062.stderr:last_changed 2024-02-09T08:03:01.610636+0000 2024-02-09T08:03:01.612 INFO:teuthology.misc.health.smithi062.stderr:created 2024-02-09T08:03:01.610636+0000 2024-02-09T08:03:01.612 INFO:teuthology.misc.health.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:01.612 INFO:teuthology.misc.health.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:01.612 INFO:teuthology.misc.health.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:03:01.612 INFO:teuthology.misc.health.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:03:01.612 INFO:teuthology.misc.health.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:03:01.612 INFO:teuthology.misc.health.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:03:01.612 INFO:teuthology.misc.health.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:03:01.612 INFO:teuthology.misc.health.smithi062.stderr: 2024-02-09T08:03:01.614 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.610+0000 7fd6b8e62640 1 Processor -- start 2024-02-09T08:03:01.614 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.610+0000 7fd6b8e62640 1 -- start start 2024-02-09T08:03:01.614 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.610+0000 7fd6b8e62640 10 monclient: init 2024-02-09T08:03:01.614 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.610+0000 7fd6b8e62640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:01.614 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.610+0000 7fd6b8e62640 10 monclient: _add_conns ranks=[1,0,2,4,3] 2024-02-09T08:03:01.614 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.610+0000 7fd6b8e62640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fd6b40b5490 addr v1:172.21.15.103:6789/0 2024-02-09T08:03:01.614 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.611+0000 7fd6b8e62640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd6b413f880 addr v1:172.21.15.62:6789/0 2024-02-09T08:03:01.615 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.611+0000 7fd6b8e62640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd6b4146280 0x7fd6b413fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:01.615 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.611+0000 7fd6b8e62640 10 monclient(hunting): picked mon.noname-b con 0x7fd6b4146280 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:01.615 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.611+0000 7fd6b8e62640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6b4140250 con 0x7fd6b413f880 2024-02-09T08:03:01.615 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.611+0000 7fd6b8e62640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6b41466d0 con 0x7fd6b40b5490 2024-02-09T08:03:01.615 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.611+0000 7fd6b8e62640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:01.615 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.611+0000 7fd6b8e62640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b40ab530 con 0x7fd6b4146280 2024-02-09T08:03:01.615 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.611+0000 7fd6b8e62640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:01.615 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.611+0000 7fd6b8e62640 10 monclient(hunting): authenticate will time out at 1424.971319s 2024-02-09T08:03:01.615 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.611+0000 7fd6abfff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fd6b413f880 0x7fd6b4145b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:41134/0 (socket says 172.21.15.62:41134) 2024-02-09T08:03:01.615 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.611+0000 7fd6b259c640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fd6b40b5490 0x7fd6b40a9850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.62:53976/0 (socket says 172.21.15.62:53976) 2024-02-09T08:03:01.615 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.611+0000 7fd6abfff640 1 -- 172.21.15.62:0/3365672877 learned_addr learned my addr 172.21.15.62:0/3365672877 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-09T08:03:01.616 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.614+0000 7fd6b1d9b640 1 -- 172.21.15.62:0/3365672877 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1371839108 0 0) 0x7fd6b41466d0 con 0x7fd6b40b5490 2024-02-09T08:03:01.617 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.614+0000 7fd6b1d9b640 10 monclient(hunting): _negotiate 2024-02-09T08:03:01.617 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.614+0000 7fd6b1d9b640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:01.617 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.614+0000 7fd6b1d9b640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:01.617 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.614+0000 7fd6b1d9b640 10 monclient(hunting): my global_id is 4255 2024-02-09T08:03:01.617 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.614+0000 7fd6b1d9b640 1 -- 172.21.15.62:0/3365672877 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6a0003520 con 0x7fd6b40b5490 2024-02-09T08:03:01.617 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.614+0000 7fd6b1d9b640 1 -- 172.21.15.62:0/3365672877 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2884846298 0 0) 0x7fd69c001110 con 0x7fd6b413f880 2024-02-09T08:03:01.617 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.614+0000 7fd6b1d9b640 10 monclient(hunting): _negotiate 2024-02-09T08:03:01.617 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.614+0000 7fd6b1d9b640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:01.617 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.614+0000 7fd6b1d9b640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:01.617 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.614+0000 7fd6b1d9b640 10 monclient(hunting): my global_id is 4236 2024-02-09T08:03:01.617 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.614+0000 7fd6b1d9b640 1 -- 172.21.15.62:0/3365672877 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6b41466d0 con 0x7fd6b413f880 2024-02-09T08:03:01.621 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.617+0000 7fd6b1d9b640 1 -- 172.21.15.62:0/3365672877 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1359195797 0 0) 0x7fd6a0003520 con 0x7fd6b40b5490 2024-02-09T08:03:01.621 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.617+0000 7fd6b1d9b640 1 -- 172.21.15.62:0/3365672877 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd6b4146280 msgr2=0x7fd6b413fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:01.621 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.617+0000 7fd6b1d9b640 1 --2- 172.21.15.62:0/3365672877 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd6b4146280 0x7fd6b413fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:01.621 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.617+0000 7fd6b1d9b640 1 -- 172.21.15.62:0/3365672877 >> v1:172.21.15.62:6789/0 conn(0x7fd6b413f880 legacy=0x7fd6b4145b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:01.621 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.617+0000 7fd6b1d9b640 10 monclient: _finish_hunting 0 2024-02-09T08:03:01.621 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.617+0000 7fd6b1d9b640 1 monclient: found mon.noname-c-legacy 2024-02-09T08:03:01.621 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.617+0000 7fd6b1d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:01.621 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.617+0000 7fd6b1d9b640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:172.21.15.103:6789/0 2024-02-09T08:03:01.621 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.617+0000 7fd6b1d9b640 1 -- 172.21.15.62:0/3365672877 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b40ab730 con 0x7fd6b40b5490 2024-02-09T08:03:01.621 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.617+0000 7fd6b1d9b640 10 monclient: _finish_auth 0 2024-02-09T08:03:01.621 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.617+0000 7fd6b1d9b640 10 monclient: _check_auth_tickets 2024-02-09T08:03:01.621 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.617+0000 7fd6b1d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:01.622 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.617+0000 7fd6b8e62640 5 monclient: authenticate success, global_id 4255 2024-02-09T08:03:01.622 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.617+0000 7fd6b8e62640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-02-09T08:03:01.622 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.617+0000 7fd6b1d9b640 1 -- 172.21.15.62:0/3365672877 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1140318843 0 0) 0x7fd6a4001670 con 0x7fd6b40b5490 2024-02-09T08:03:01.622 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.617+0000 7fd6b1d9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:01.622 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.617+0000 7fd6b1d9b640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2024-02-09T08:03:01.622 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.617+0000 7fd6b1d9b640 10 monclient: dump: 2024-02-09T08:03:01.622 INFO:teuthology.misc.health.smithi062.stderr:epoch 1 2024-02-09T08:03:01.622 INFO:teuthology.misc.health.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:01.623 INFO:teuthology.misc.health.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:01.623 INFO:teuthology.misc.health.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:01.623 INFO:teuthology.misc.health.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:01.623 INFO:teuthology.misc.health.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:01.623 INFO:teuthology.misc.health.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:01.623 INFO:teuthology.misc.health.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:01.623 INFO:teuthology.misc.health.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:01.623 INFO:teuthology.misc.health.smithi062.stderr: 2024-02-09T08:03:01.623 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.617+0000 7fd6b1d9b640 1 monclient: mon.b has (v2) addrs [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] but i'm connected to v1:172.21.15.103:6789/0, reconnecting 2024-02-09T08:03:01.624 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.617+0000 7fd6b1d9b640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:01.624 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.617+0000 7fd6b1d9b640 1 -- 172.21.15.62:0/3365672877 >> v1:172.21.15.103:6789/0 conn(0x7fd6b40b5490 legacy=0x7fd6b40a9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:01.624 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.617+0000 7fd6b1d9b640 10 monclient: _add_conns ranks=[1,0,2] 2024-02-09T08:03:01.624 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.617+0000 7fd6b1d9b640 1 --2- 172.21.15.62:0/3365672877 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd6a0003b00 0x7fd6a0003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:01.624 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.617+0000 7fd6b1d9b640 10 monclient(hunting): picked mon.b con 0x7fd6a0003b00 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:03:01.624 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.617+0000 7fd6b1d9b640 1 --2- 172.21.15.62:0/3365672877 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6a00047c0 0x7fd6a0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:01.624 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.617+0000 7fd6b1d9b640 10 monclient(hunting): picked mon.a con 0x7fd6a00047c0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:03:01.624 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.617+0000 7fd6b1d9b640 1 --2- 172.21.15.62:0/3365672877 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd6b4146280 0x7fd6a000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:01.624 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.617+0000 7fd6b1d9b640 10 monclient(hunting): picked mon.c con 0x7fd6b4146280 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:01.624 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.617+0000 7fd6b1d9b640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:01.624 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.617+0000 7fd6b1d9b640 1 -- 172.21.15.62:0/3365672877 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b40ab530 con 0x7fd6a00047c0 2024-02-09T08:03:01.624 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.617+0000 7fd6b1d9b640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:01.624 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.617+0000 7fd6b1d9b640 1 -- 172.21.15.62:0/3365672877 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a0005500 con 0x7fd6a0003b00 2024-02-09T08:03:01.624 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.617+0000 7fd6b1d9b640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:01.625 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.617+0000 7fd6b1d9b640 1 -- 172.21.15.62:0/3365672877 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a000bec0 con 0x7fd6b4146280 2024-02-09T08:03:01.625 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.617+0000 7fd6b1d9b640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:01.625 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.617+0000 7fd6b1d9b640 10 monclient(hunting): _finish_auth 0 2024-02-09T08:03:01.625 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.617+0000 7fd6b8e62640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2024-02-09T08:03:01.626 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.620+0000 7fd6b259c640 1 --2- 172.21.15.62:0/3365672877 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd6a0003b00 0x7fd6a0003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:01.626 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.620+0000 7fd6b259c640 10 monclient(hunting): get_auth_request con 0x7fd6a0003b00 auth_method 0 2024-02-09T08:03:01.627 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.620+0000 7fd6b259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:01.627 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.620+0000 7fd6b259c640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:01.627 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.620+0000 7fd6b259c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-02-09T08:03:01.627 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.621+0000 7fd6b259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:01.627 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.621+0000 7fd6b259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:01.627 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.621+0000 7fd6b259c640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-02-09T08:03:01.627 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.621+0000 7fd6b2d9d640 1 --2- 172.21.15.62:0/3365672877 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd6b4146280 0x7fd6a000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:01.627 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.622+0000 7fd6b2d9d640 10 monclient(hunting): get_auth_request con 0x7fd6b4146280 auth_method 0 2024-02-09T08:03:01.627 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.622+0000 7fd6b2d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:01.627 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.622+0000 7fd6b2d9d640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:01.627 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.622+0000 7fd6b2d9d640 10 monclient(hunting): _init_auth already have auth, reseting 2024-02-09T08:03:01.627 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.622+0000 7fd6abfff640 1 --2- 172.21.15.62:0/3365672877 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6a00047c0 0x7fd6a0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:01.627 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.623+0000 7fd6b259c640 10 monclient(hunting): handle_auth_done global_id 4255 payload 293 2024-02-09T08:03:01.627 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.623+0000 7fd6b259c640 1 -- 172.21.15.62:0/3365672877 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd6b4146280 msgr2=0x7fd6a000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:01.627 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.623+0000 7fd6b259c640 1 --2- 172.21.15.62:0/3365672877 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd6b4146280 0x7fd6a000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:01.628 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.623+0000 7fd6b259c640 1 -- 172.21.15.62:0/3365672877 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6a00047c0 msgr2=0x7fd6a0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:01.628 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.623+0000 7fd6b259c640 1 --2- 172.21.15.62:0/3365672877 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6a00047c0 0x7fd6a0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:01.628 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.623+0000 7fd6b259c640 10 monclient: _finish_hunting 0 2024-02-09T08:03:01.628 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.623+0000 7fd6b259c640 1 monclient: found mon.b 2024-02-09T08:03:01.628 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.623+0000 7fd6b259c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:01.628 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.623+0000 7fd6b259c640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:01.628 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.623+0000 7fd6b259c640 1 -- 172.21.15.62:0/3365672877 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a0003520 con 0x7fd6a0003b00 2024-02-09T08:03:01.628 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.623+0000 7fd6b259c640 10 monclient: _finish_auth 0 2024-02-09T08:03:01.628 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.623+0000 7fd6b259c640 10 monclient: _check_auth_tickets 2024-02-09T08:03:01.628 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.623+0000 7fd6b259c640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:01.628 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.623+0000 7fd6abfff640 10 monclient: get_auth_request con 0x7fd6a00047c0 auth_method 0 2024-02-09T08:03:01.628 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.623+0000 7fd6abfff640 1 --2- 172.21.15.62:0/3365672877 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6a00047c0 0x7fd6a0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-09T08:03:01.629 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.625+0000 7fd6b259c640 1 --2- 172.21.15.62:0/3365672877 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd6a0003b00 0x7fd6a0003f00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4007f90 tx=0x7fd6a00057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8aa99b245f6cdfd4 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:01.631 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.628+0000 7fd6b1d9b640 1 -- 172.21.15.62:0/3365672877 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a4007270 con 0x7fd6a0003b00 2024-02-09T08:03:01.631 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.628+0000 7fd6b1d9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:01.631 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.628+0000 7fd6b1d9b640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:03:01.631 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.628+0000 7fd6b1d9b640 10 monclient: dump: 2024-02-09T08:03:01.631 INFO:teuthology.misc.health.smithi062.stderr:epoch 1 2024-02-09T08:03:01.631 INFO:teuthology.misc.health.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:01.631 INFO:teuthology.misc.health.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:01.631 INFO:teuthology.misc.health.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:01.631 INFO:teuthology.misc.health.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:01.631 INFO:teuthology.misc.health.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:01.631 INFO:teuthology.misc.health.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:01.632 INFO:teuthology.misc.health.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:01.632 INFO:teuthology.misc.health.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:01.632 INFO:teuthology.misc.health.smithi062.stderr: 2024-02-09T08:03:01.632 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.628+0000 7fd6b1d9b640 1 -- 172.21.15.62:0/3365672877 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6a40073d0 con 0x7fd6a0003b00 2024-02-09T08:03:01.632 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.628+0000 7fd6b1d9b640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:01.632 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.628+0000 7fd6b1d9b640 1 -- 172.21.15.62:0/3365672877 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a4005810 con 0x7fd6a0003b00 2024-02-09T08:03:01.632 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.628+0000 7fd6b8e62640 10 monclient: get_monmap_and_config success 2024-02-09T08:03:01.632 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.628+0000 7fd6b8e62640 4 set_mon_vals no callback set 2024-02-09T08:03:01.632 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.628+0000 7fd6b1d9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:01.632 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.628+0000 7fd6b1d9b640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:03:01.632 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.628+0000 7fd6b1d9b640 10 monclient: dump: 2024-02-09T08:03:01.632 INFO:teuthology.misc.health.smithi062.stderr:epoch 1 2024-02-09T08:03:01.632 INFO:teuthology.misc.health.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:01.632 INFO:teuthology.misc.health.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:01.633 INFO:teuthology.misc.health.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:01.633 INFO:teuthology.misc.health.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:01.633 INFO:teuthology.misc.health.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:01.633 INFO:teuthology.misc.health.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:01.633 INFO:teuthology.misc.health.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:01.633 INFO:teuthology.misc.health.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:01.633 INFO:teuthology.misc.health.smithi062.stderr: 2024-02-09T08:03:01.637 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.629+0000 7fd6b8e62640 10 monclient: shutdown 2024-02-09T08:03:01.637 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.629+0000 7fd6b8e62640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:01.637 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.629+0000 7fd6b8e62640 1 -- 172.21.15.62:0/3365672877 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd6a0003b00 msgr2=0x7fd6a0003f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:01.637 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.629+0000 7fd6b8e62640 1 --2- 172.21.15.62:0/3365672877 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd6a0003b00 0x7fd6a0003f00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4007f90 tx=0x7fd6a00057f0 comp rx=0 tx=0).stop 2024-02-09T08:03:01.637 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.629+0000 7fd6b2d9d640 1 -- 172.21.15.62:0/3365672877 reap_dead start 2024-02-09T08:03:01.637 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.629+0000 7fd6b8e62640 1 -- 172.21.15.62:0/3365672877 shutdown_connections 2024-02-09T08:03:01.637 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.629+0000 7fd6b8e62640 1 -- 172.21.15.62:0/3365672877 >> 172.21.15.62:0/3365672877 conn(0x7fd6b40b8640 msgr2=0x7fd6b40b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:01.637 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.629+0000 7fd6b8e62640 1 -- 172.21.15.62:0/3365672877 shutdown_connections 2024-02-09T08:03:01.637 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.630+0000 7fd6b8e62640 1 -- 172.21.15.62:0/3365672877 wait complete. 2024-02-09T08:03:01.637 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.631+0000 7fd6b8e62640 10 monclient: build_initial_monmap 2024-02-09T08:03:01.637 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.631+0000 7fd6b8e62640 10 monclient: monmap: 2024-02-09T08:03:01.638 INFO:teuthology.misc.health.smithi062.stderr:epoch 0 2024-02-09T08:03:01.638 INFO:teuthology.misc.health.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:03:01.638 INFO:teuthology.misc.health.smithi062.stderr:last_changed 0.000000 2024-02-09T08:03:01.638 INFO:teuthology.misc.health.smithi062.stderr:created 0.000000 2024-02-09T08:03:01.638 INFO:teuthology.misc.health.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:01.638 INFO:teuthology.misc.health.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:01.638 INFO:teuthology.misc.health.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:03:01.638 INFO:teuthology.misc.health.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:03:01.638 INFO:teuthology.misc.health.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:03:01.638 INFO:teuthology.misc.health.smithi062.stderr: 2024-02-09T08:03:01.638 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.631+0000 7fd6b8e62640 1 librados: starting msgr at 2024-02-09T08:03:01.638 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.631+0000 7fd6b8e62640 1 librados: starting objecter 2024-02-09T08:03:01.638 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.631+0000 7fd6b8e62640 1 Processor -- start 2024-02-09T08:03:01.638 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.631+0000 7fd6b8e62640 1 -- start start 2024-02-09T08:03:01.638 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.631+0000 7fd6b8e62640 1 librados: setting wanted keys 2024-02-09T08:03:01.639 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.631+0000 7fd6b8e62640 1 librados: calling monclient init 2024-02-09T08:03:01.639 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.631+0000 7fd6b8e62640 10 monclient: init 2024-02-09T08:03:01.639 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.632+0000 7fd6b8e62640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:01.639 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.632+0000 7fd6b8e62640 10 monclient: _add_conns ranks=[0,2,1] 2024-02-09T08:03:01.639 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.632+0000 7fd6b8e62640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6a0003b00 0x7fd6b40ace80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:01.639 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.632+0000 7fd6b8e62640 10 monclient(hunting): picked mon.noname-a con 0x7fd6a0003b00 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:03:01.639 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.632+0000 7fd6b8e62640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd6b41d8130 0x7fd6b41d8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:01.639 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.632+0000 7fd6b8e62640 10 monclient(hunting): picked mon.noname-c con 0x7fd6b41d8130 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:01.639 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.632+0000 7fd6b8e62640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd6b40b1250 0x7fd6b40b16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:01.639 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.632+0000 7fd6b8e62640 10 monclient(hunting): picked mon.noname-b con 0x7fd6b40b1250 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:03:01.639 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.632+0000 7fd6b8e62640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:01.639 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.632+0000 7fd6b8e62640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b41d58c0 con 0x7fd6a0003b00 2024-02-09T08:03:01.639 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.632+0000 7fd6b8e62640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:01.639 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.632+0000 7fd6b8e62640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b41d7ca0 con 0x7fd6b40b1250 2024-02-09T08:03:01.640 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.632+0000 7fd6b8e62640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:01.640 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.632+0000 7fd6b8e62640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b40ae800 con 0x7fd6b41d8130 2024-02-09T08:03:01.640 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.632+0000 7fd6b8e62640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:01.640 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.632+0000 7fd6b8e62640 10 monclient(hunting): authenticate will time out at 1424.992996s 2024-02-09T08:03:01.640 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.633+0000 7fd6b2d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd6b40b1250 0x7fd6b40b16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:01.640 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.633+0000 7fd6abfff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd6b41d8130 0x7fd6b41d8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:01.640 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.633+0000 7fd6b259c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6a0003b00 0x7fd6b40ace80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:01.640 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.633+0000 7fd6b2d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd6b40b1250 0x7fd6b40b16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.62:38496/0 (socket says 172.21.15.62:38496) 2024-02-09T08:03:01.640 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.633+0000 7fd6b2d9d640 1 -- 172.21.15.62:0/2828259366 learned_addr learned my addr 172.21.15.62:0/2828259366 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:01.640 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.633+0000 7fd6b2d9d640 10 monclient(hunting): get_auth_request con 0x7fd6b40b1250 auth_method 0 2024-02-09T08:03:01.640 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.633+0000 7fd6b2d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:01.640 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.633+0000 7fd6b2d9d640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:01.640 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.633+0000 7fd6b2d9d640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:01.640 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.633+0000 7fd6abfff640 10 monclient(hunting): get_auth_request con 0x7fd6b41d8130 auth_method 0 2024-02-09T08:03:01.641 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.633+0000 7fd6abfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:01.641 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.633+0000 7fd6abfff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:01.641 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.633+0000 7fd6abfff640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:01.641 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.633+0000 7fd6b259c640 10 monclient(hunting): get_auth_request con 0x7fd6a0003b00 auth_method 0 2024-02-09T08:03:01.641 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.633+0000 7fd6b259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:01.641 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.633+0000 7fd6b259c640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:01.641 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.633+0000 7fd6b259c640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:01.641 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.633+0000 7fd6b2d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:01.641 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.634+0000 7fd6b2d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:01.641 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.634+0000 7fd6b2d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:01.641 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.634+0000 7fd6abfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:01.641 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.634+0000 7fd6abfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:01.641 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.634+0000 7fd6abfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:01.641 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.634+0000 7fd6b259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:01.641 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.634+0000 7fd6b259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:01.642 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.634+0000 7fd6b259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:01.642 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.636+0000 7fd6b2d9d640 10 monclient(hunting): handle_auth_done global_id 4258 payload 824 2024-02-09T08:03:01.643 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.636+0000 7fd6b2d9d640 1 -- 172.21.15.62:0/2828259366 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd6b41d8130 msgr2=0x7fd6b41d8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:01.643 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.636+0000 7fd6b2d9d640 1 --2- 172.21.15.62:0/2828259366 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd6b41d8130 0x7fd6b41d8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:01.643 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.636+0000 7fd6b2d9d640 1 -- 172.21.15.62:0/2828259366 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6a0003b00 msgr2=0x7fd6b40ace80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:01.643 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.636+0000 7fd6b2d9d640 1 --2- 172.21.15.62:0/2828259366 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6a0003b00 0x7fd6b40ace80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:01.643 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.636+0000 7fd6b2d9d640 10 monclient: _finish_hunting 0 2024-02-09T08:03:01.643 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.636+0000 7fd6b2d9d640 1 monclient: found mon.noname-b 2024-02-09T08:03:01.643 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.636+0000 7fd6b2d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:01.643 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.636+0000 7fd6b2d9d640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.103:3300/0 2024-02-09T08:03:01.643 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.636+0000 7fd6b2d9d640 1 -- 172.21.15.62:0/2828259366 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b4141850 con 0x7fd6b40b1250 2024-02-09T08:03:01.643 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.638+0000 7fd6b2d9d640 1 --2- 172.21.15.62:0/2828259366 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd6b40b1250 0x7fd6b40b16b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4074cb0 tx=0x7fd6ac00df30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:01.643 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.638+0000 7fd6aaffd640 10 client.?.objecter ms_handle_connect 0x7fd6b40b1250 2024-02-09T08:03:01.643 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.638+0000 7fd6aaffd640 10 client.?.objecter resend_mon_ops 2024-02-09T08:03:01.664 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.661+0000 7fd6aaffd640 1 -- 172.21.15.62:0/2828259366 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac00bea0 con 0x7fd6b40b1250 2024-02-09T08:03:01.664 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.661+0000 7fd6aaffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:01.664 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.661+0000 7fd6aaffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:03:01.664 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.661+0000 7fd6aaffd640 10 monclient: dump: 2024-02-09T08:03:01.665 INFO:teuthology.misc.health.smithi062.stderr:epoch 1 2024-02-09T08:03:01.665 INFO:teuthology.misc.health.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:01.665 INFO:teuthology.misc.health.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:01.665 INFO:teuthology.misc.health.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:01.665 INFO:teuthology.misc.health.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:01.665 INFO:teuthology.misc.health.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:01.665 INFO:teuthology.misc.health.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:01.665 INFO:teuthology.misc.health.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:01.665 INFO:teuthology.misc.health.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:01.665 INFO:teuthology.misc.health.smithi062.stderr: 2024-02-09T08:03:01.665 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.661+0000 7fd6aaffd640 10 monclient: _finish_auth 0 2024-02-09T08:03:01.665 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.661+0000 7fd6aaffd640 10 monclient: _check_auth_tickets 2024-02-09T08:03:01.665 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.661+0000 7fd6aaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:01.665 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.661+0000 7fd6aaffd640 1 -- 172.21.15.62:0/2828259366 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6ac012070 con 0x7fd6b40b1250 2024-02-09T08:03:01.666 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.661+0000 7fd6aaffd640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:01.666 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.661+0000 7fd6aaffd640 1 -- 172.21.15.62:0/2828259366 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac003bb0 con 0x7fd6b40b1250 2024-02-09T08:03:01.666 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.661+0000 7fd6b8e62640 5 monclient: authenticate success, global_id 4258 2024-02-09T08:03:01.666 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.661+0000 7fd6b8e62640 10 monclient: _renew_subs 2024-02-09T08:03:01.666 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.661+0000 7fd6b8e62640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:01.666 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.661+0000 7fd6b8e62640 1 -- 172.21.15.62:0/2828259366 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6b40ac410 con 0x7fd6b40b1250 2024-02-09T08:03:01.666 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.661+0000 7fd6b159a640 4 set_mon_vals no callback set 2024-02-09T08:03:01.666 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.661+0000 7fd6aaffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:01.666 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.661+0000 7fd6aaffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:03:01.666 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.661+0000 7fd6aaffd640 10 monclient: dump: 2024-02-09T08:03:01.666 INFO:teuthology.misc.health.smithi062.stderr:epoch 1 2024-02-09T08:03:01.666 INFO:teuthology.misc.health.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:01.666 INFO:teuthology.misc.health.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:01.666 INFO:teuthology.misc.health.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:01.666 INFO:teuthology.misc.health.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:01.667 INFO:teuthology.misc.health.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:01.667 INFO:teuthology.misc.health.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:01.667 INFO:teuthology.misc.health.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:01.667 INFO:teuthology.misc.health.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:01.667 INFO:teuthology.misc.health.smithi062.stderr: 2024-02-09T08:03:01.667 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.661+0000 7fd6b8e62640 10 client.4258.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:03:01.667 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.661+0000 7fd6b8e62640 10 monclient: _renew_subs 2024-02-09T08:03:01.667 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.661+0000 7fd6b8e62640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:01.667 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.661+0000 7fd6b8e62640 1 -- 172.21.15.62:0/2828259366 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6b40b1bf0 con 0x7fd6b40b1250 2024-02-09T08:03:01.667 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.661+0000 7fd6b8e62640 1 librados: init done 2024-02-09T08:03:01.668 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.663+0000 7fd6b8e62640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:01.668 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.663+0000 7fd6b8e62640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:01.668 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.663+0000 7fd6b8e62640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:01.668 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.663+0000 7fd6b8e62640 1 -- 172.21.15.62:0/2828259366 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6b406c120 con 0x7fd6b40b1250 2024-02-09T08:03:01.683 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.680+0000 7fd6aaffd640 1 -- 172.21.15.62:0/2828259366 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 89732+0+0 (secure 0 0 0) 0x7fd6ac021440 con 0x7fd6b40b1250 2024-02-09T08:03:01.683 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.680+0000 7fd6aaffd640 1 --2- 172.21.15.62:0/2828259366 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fd69406d190 0x7fd69406f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:01.683 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.681+0000 7fd6b259c640 1 --2- 172.21.15.62:0/2828259366 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fd69406d190 0x7fd69406f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:01.683 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.681+0000 7fd6b259c640 10 monclient: get_auth_request con 0x7fd69406d190 auth_method 0 2024-02-09T08:03:01.683 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.681+0000 7fd6aaffd640 10 client.4258.objecter ms_handle_connect 0x7fd69406d190 2024-02-09T08:03:01.684 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.681+0000 7fd6b259c640 1 --2- 172.21.15.62:0/2828259366 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fd69406d190 0x7fd69406f650 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4034000 tx=0x7fd6a4007000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:01.929 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.927+0000 7fd6aaffd640 1 -- 172.21.15.62:0/2828259366 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4297+0+0 (secure 0 0 0) 0x7fd6ac058b50 con 0x7fd6b40b1250 2024-02-09T08:03:01.929 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.927+0000 7fd6aaffd640 10 client.4258.objecter ms_dispatch 0x7fd6b4000b90 osd_map(19..19 src has 1..19) v4 2024-02-09T08:03:01.929 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.927+0000 7fd6aaffd640 3 client.4258.objecter handle_osd_map got epochs [19,19] > 0 2024-02-09T08:03:01.929 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.927+0000 7fd6aaffd640 3 client.4258.objecter handle_osd_map decoding full epoch 19 2024-02-09T08:03:01.929 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.927+0000 7fd6aaffd640 20 client.4258.objecter dump_active .. 0 homeless 2024-02-09T08:03:01.948 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.943+0000 7fd6aaffd640 1 -- 172.21.15.62:0/2828259366 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd6ac054df0 con 0x7fd6b40b1250 2024-02-09T08:03:01.948 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.943+0000 7fd6aaffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:01.948 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:01.943+0000 7fd6aaffd640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:03:02.136 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:02.134+0000 7fd6b8e62640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-02-09T08:03:02.136 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:02.134+0000 7fd6b8e62640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-02-09T08:03:02.136 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:02.134+0000 7fd6b8e62640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:02.136 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:02.134+0000 7fd6b8e62640 1 -- 172.21.15.62:0/2828259366 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6b4068920 con 0x7fd6b40b1250 2024-02-09T08:03:02.227 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:02.225+0000 7fd6aaffd640 1 -- 172.21.15.62:0/2828259366 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+11878 (secure 0 0 0) 0x7fd6ac0584b0 con 0x7fd6b40b1250 2024-02-09T08:03:02.227 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:02.225+0000 7fd6aaffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-02-09T08:03:02.227 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:02.225+0000 7fd6aaffd640 10 monclient: _finish_command 2 = system:0 2024-02-09T08:03:02.227 INFO:teuthology.misc.health.smithi062.stdout: 2024-02-09T08:03:02.228 INFO:teuthology.misc.health.smithi062.stdout:{"epoch":19,"fsid":"981c5564-eb76-49a1-80ab-97c7647bc34a","created":"2024-02-09T08:02:07.866410+0000","modified":"2024-02-09T08:03:00.117724+0000","last_up_change":"2024-02-09T08:02:56.594120+0000","last_in_change":"2024-02-09T08:02:13.770858+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-09T08:02:56.035293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0e3b17d4-a50f-41d9-b455-0bc1606a5c86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":3842068700},{"type":"v1","addr":"172.21.15.62:6809","nonce":3842068700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3842068700},{"type":"v1","addr":"172.21.15.62:6811","nonce":3842068700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3842068700},{"type":"v1","addr":"172.21.15.62:6815","nonce":3842068700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3842068700},{"type":"v1","addr":"172.21.15.62:6813","nonce":3842068700}]},"public_addr":"172.21.15.62:6809/3842068700","cluster_addr":"172.21.15.62:6811/3842068700","heartbeat_back_addr":"172.21.15.62:6815/3842068700","heartbeat_front_addr":"172.21.15.62:6813/3842068700","state":["exists","up"]},{"osd":1,"uuid":"a0077e6c-220d-46f4-9be2-a707d1710890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":3837949327},{"type":"v1","addr":"172.21.15.62:6801","nonce":3837949327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":3837949327},{"type":"v1","addr":"172.21.15.62:6803","nonce":3837949327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":3837949327},{"type":"v1","addr":"172.21.15.62:6807","nonce":3837949327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":3837949327},{"type":"v1","addr":"172.21.15.62:6805","nonce":3837949327}]},"public_addr":"172.21.15.62:6801/3837949327","cluster_addr":"172.21.15.62:6803/3837949327","heartbeat_back_addr":"172.21.15.62:6807/3837949327","heartbeat_front_addr":"172.21.15.62:6805/3837949327","state":["exists","up"]},{"osd":2,"uuid":"3739882a-5263-4113-840a-afd6acdcf15e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":2695503114},{"type":"v1","addr":"172.21.15.62:6817","nonce":2695503114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2695503114},{"type":"v1","addr":"172.21.15.62:6819","nonce":2695503114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2695503114},{"type":"v1","addr":"172.21.15.62:6823","nonce":2695503114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":2695503114},{"type":"v1","addr":"172.21.15.62:6821","nonce":2695503114}]},"public_addr":"172.21.15.62:6817/2695503114","cluster_addr":"172.21.15.62:6819/2695503114","heartbeat_back_addr":"172.21.15.62:6823/2695503114","heartbeat_front_addr":"172.21.15.62:6821/2695503114","state":["exists","up"]},{"osd":3,"uuid":"3657c103-db3d-46c5-8afc-2b0b9da1e2e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"faf5e721-fa06-43f8-9b72-36ca8132ffea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"5c96dba1-53d2-4c0c-8928-5f09ea17a984","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":262591034},{"type":"v1","addr":"172.21.15.103:6803","nonce":262591034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":262591034},{"type":"v1","addr":"172.21.15.103:6805","nonce":262591034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":262591034},{"type":"v1","addr":"172.21.15.103:6809","nonce":262591034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":262591034},{"type":"v1","addr":"172.21.15.103:6807","nonce":262591034}]},"public_addr":"172.21.15.103:6803/262591034","cluster_addr":"172.21.15.103:6805/262591034","heartbeat_back_addr":"172.21.15.103:6809/262591034","heartbeat_front_addr":"172.21.15.103:6807/262591034","state":["exists","up"]},{"osd":6,"uuid":"3473844d-d631-4ea4-96fb-638eccee5cb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3983655111},{"type":"v1","addr":"172.21.15.103:6827","nonce":3983655111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3983655111},{"type":"v1","addr":"172.21.15.103:6829","nonce":3983655111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3983655111},{"type":"v1","addr":"172.21.15.103:6833","nonce":3983655111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3983655111},{"type":"v1","addr":"172.21.15.103:6831","nonce":3983655111}]},"public_addr":"172.21.15.103:6827/3983655111","cluster_addr":"172.21.15.103:6829/3983655111","heartbeat_back_addr":"172.21.15.103:6833/3983655111","heartbeat_front_addr":"172.21.15.103:6831/3983655111","state":["exists","up"]},{"osd":7,"uuid":"d31bdb4b-8938-4da9-8bf1-57cf730e839d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":1369132028},{"type":"v1","addr":"172.21.15.103:6813","nonce":1369132028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":1369132028},{"type":"v1","addr":"172.21.15.103:6819","nonce":1369132028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1369132028},{"type":"v1","addr":"172.21.15.103:6825","nonce":1369132028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6821","nonce":1369132028},{"type":"v1","addr":"172.21.15.103:6823","nonce":1369132028}]},"public_addr":"172.21.15.103:6813/1369132028","cluster_addr":"172.21.15.103:6819/1369132028","heartbeat_back_addr":"172.21.15.103:6825/1369132028","heartbeat_front_addr":"172.21.15.103:6823/1369132028","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T08:02:53.044658+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T08:02:52.943983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T08:02:53.834176+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T08:02:50.950607+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T08:02:52.166722+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T08:02:52.154749+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-09T08:03:02.230 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:02.227+0000 7fd6b8e62640 10 librados: watch_flush enter 2024-02-09T08:03:02.230 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:02.227+0000 7fd6b8e62640 10 librados: watch_flush exit 2024-02-09T08:03:02.230 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:02.227+0000 7fd6b8e62640 20 client.4258.objecter shutdown clearing up homeless session... 2024-02-09T08:03:02.230 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:02.227+0000 7fd6b8e62640 10 client.4258.objecter successfully canceled tick 2024-02-09T08:03:02.230 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:02.227+0000 7fd6b8e62640 1 -- 172.21.15.62:0/2828259366 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fd69406d190 msgr2=0x7fd69406f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:02.230 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:02.227+0000 7fd6b8e62640 1 --2- 172.21.15.62:0/2828259366 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fd69406d190 0x7fd69406f650 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4034000 tx=0x7fd6a4007000 comp rx=0 tx=0).stop 2024-02-09T08:03:02.230 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:02.227+0000 7fd6b8e62640 10 monclient: shutdown 2024-02-09T08:03:02.230 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:02.227+0000 7fd6b8e62640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:02.230 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:02.227+0000 7fd6b8e62640 1 -- 172.21.15.62:0/2828259366 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd6b40b1250 msgr2=0x7fd6b40b16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:02.230 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:02.227+0000 7fd6b8e62640 1 --2- 172.21.15.62:0/2828259366 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd6b40b1250 0x7fd6b40b16b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4074cb0 tx=0x7fd6ac00df30 comp rx=0 tx=0).stop 2024-02-09T08:03:02.230 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:02.227+0000 7fd6b8e62640 1 -- 172.21.15.62:0/2828259366 shutdown_connections 2024-02-09T08:03:02.230 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:02.227+0000 7fd6b8e62640 1 --2- 172.21.15.62:0/2828259366 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fd69406d190 0x7fd69406f650 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:02.231 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:02.227+0000 7fd6b8e62640 1 --2- 172.21.15.62:0/2828259366 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd6b40b1250 0x7fd6b40b16b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:02.231 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:02.227+0000 7fd6b8e62640 1 --2- 172.21.15.62:0/2828259366 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd6b41d8130 0x7fd6b41d8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:02.231 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:02.227+0000 7fd6b8e62640 1 --2- 172.21.15.62:0/2828259366 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6a0003b00 0x7fd6b40ace80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:02.231 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:02.227+0000 7fd6b8e62640 1 -- 172.21.15.62:0/2828259366 >> 172.21.15.62:0/2828259366 conn(0x7fd6b40b8640 msgr2=0x7fd6b413ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:02.231 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:02.227+0000 7fd6b8e62640 1 -- 172.21.15.62:0/2828259366 shutdown_connections 2024-02-09T08:03:02.231 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:02.227+0000 7fd6b8e62640 1 -- 172.21.15.62:0/2828259366 wait complete. 2024-02-09T08:03:02.231 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:02.227+0000 7fd6b8e62640 1 librados: shutdown 2024-02-09T08:03:02.243 DEBUG:teuthology.misc:6 of 8 OSDs are up 2024-02-09T08:03:02.257 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:03:02.252+0000 c68d640 -1 osd.4 0 waiting for initial osdmap 2024-02-09T08:03:02.674 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:03:02.659+0000 14454640 -1 osd.4 19 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-09T08:03:02.806 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:03:02.790+0000 5dc3480 -1 bdev(0x166acca0 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2024-02-09T08:03:02.944 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:03:02.831+0000 5dc3480 -1 bdev(0x166acca0 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2024-02-09T08:03:02.963 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:03:02.942+0000 5dc3480 -1 bdev(0x166acca0 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2024-02-09T08:03:03.340 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:03:02.961+0000 5dc3480 -1 bdev(0x166acca0 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2024-02-09T08:03:03.650 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:03:03.343+0000 5dc3480 -1 bdev(0x166acca0 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 2 2024-02-09T08:03:03.703 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:03:03.683+0000 5dc3480 -1 bdev(0x166acca0 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 3 2024-02-09T08:03:03.835 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:03:03.702+0000 5dc3480 -1 bdev(0x166acca0 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2024-02-09T08:03:03.836 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:03:03.765+0000 5dc3480 -1 bdev(0x166acca0 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2024-02-09T08:03:03.836 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:03:03.798+0000 5dc3480 -1 bdev(0x166acca0 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2024-02-09T08:03:03.836 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:03:03.814+0000 5dc3480 -1 bdev(0x166acca0 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2024-02-09T08:03:04.784 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:03:04.778+0000 ae77640 -1 osd.3 0 waiting for initial osdmap 2024-02-09T08:03:05.110 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:01:14.517 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:03:05.166 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:01:14.573 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:03:05.196 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:01:14.593 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:03:05.203 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:01:14.609 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:03:05.251 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:03:05.235+0000 14454640 -1 osd.3 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-09T08:03:05.259 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:01:14.656 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:03:05.260 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:01:14.667 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:03:05.427 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:01:14.834 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:03:05.499 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:01:14.896 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:03:05.501 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:01:14.908 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:03:09.050 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-09T08:03:09.146 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.144+0000 7f8c6bb7b640 10 monclient: get_monmap_and_config 2024-02-09T08:03:09.146 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.144+0000 7f8c6bb7b640 10 monclient: build_initial_monmap 2024-02-09T08:03:09.146 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.144+0000 7f8c6bb7b640 10 monclient: monmap: 2024-02-09T08:03:09.146 INFO:teuthology.misc.health.smithi062.stderr:epoch 0 2024-02-09T08:03:09.147 INFO:teuthology.misc.health.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:09.147 INFO:teuthology.misc.health.smithi062.stderr:last_changed 2024-02-09T08:03:09.145455+0000 2024-02-09T08:03:09.147 INFO:teuthology.misc.health.smithi062.stderr:created 2024-02-09T08:03:09.145455+0000 2024-02-09T08:03:09.147 INFO:teuthology.misc.health.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:09.147 INFO:teuthology.misc.health.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:09.147 INFO:teuthology.misc.health.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:03:09.147 INFO:teuthology.misc.health.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:03:09.147 INFO:teuthology.misc.health.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:03:09.147 INFO:teuthology.misc.health.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:03:09.147 INFO:teuthology.misc.health.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:03:09.147 INFO:teuthology.misc.health.smithi062.stderr: 2024-02-09T08:03:09.150 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.144+0000 7f8c6bb7b640 1 Processor -- start 2024-02-09T08:03:09.150 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.145+0000 7f8c6bb7b640 1 -- start start 2024-02-09T08:03:09.150 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.145+0000 7f8c6bb7b640 10 monclient: init 2024-02-09T08:03:09.150 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.145+0000 7f8c6bb7b640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:09.150 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.145+0000 7f8c6bb7b640 10 monclient: _add_conns ranks=[4,1,2,3,0] 2024-02-09T08:03:09.150 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.145+0000 7f8c6bb7b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8c6406b7f0 0x7f8c64071510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:09.150 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.145+0000 7f8c6bb7b640 10 monclient(hunting): picked mon.noname-c con 0x7f8c6406b7f0 addr v2:172.21.15.103:3300/0 2024-02-09T08:03:09.150 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.145+0000 7f8c6bb7b640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f8c641431a0 addr v1:172.21.15.103:6789/0 2024-02-09T08:03:09.150 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.145+0000 7f8c6bb7b640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8c641465b0 0x7f8c6414d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:09.150 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.145+0000 7f8c6bb7b640 10 monclient(hunting): picked mon.noname-b con 0x7f8c641465b0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:09.150 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.145+0000 7f8c6bb7b640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c6406bef0 con 0x7f8c641431a0 2024-02-09T08:03:09.151 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.145+0000 7f8c6bb7b640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:09.151 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.145+0000 7f8c6bb7b640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c64070930 con 0x7f8c6406b7f0 2024-02-09T08:03:09.151 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.145+0000 7f8c6bb7b640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:09.151 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.145+0000 7f8c6bb7b640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c64071a50 con 0x7f8c641465b0 2024-02-09T08:03:09.151 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.145+0000 7f8c6bb7b640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:09.151 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.145+0000 7f8c6bb7b640 10 monclient(hunting): authenticate will time out at 1432.506012s 2024-02-09T08:03:09.151 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.146+0000 7f8c6a118640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8c641465b0 0x7f8c6414d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:09.151 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.146+0000 7f8c69917640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8c6406b7f0 0x7f8c64071510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:09.151 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.146+0000 7f8c6a118640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8c641465b0 0x7f8c6414d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:33484/0 (socket says 172.21.15.62:33484) 2024-02-09T08:03:09.151 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.146+0000 7f8c6a118640 1 -- 172.21.15.62:0/2367378285 learned_addr learned my addr 172.21.15.62:0/2367378285 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:09.151 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.146+0000 7f8c6a118640 10 monclient(hunting): get_auth_request con 0x7f8c641465b0 auth_method 0 2024-02-09T08:03:09.151 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.146+0000 7f8c6a118640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:09.151 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.146+0000 7f8c6a118640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:09.151 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.146+0000 7f8c6a118640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:09.152 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.147+0000 7f8c69917640 10 monclient(hunting): get_auth_request con 0x7f8c6406b7f0 auth_method 0 2024-02-09T08:03:09.152 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.147+0000 7f8c69917640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:09.152 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.147+0000 7f8c69917640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:09.152 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.147+0000 7f8c69917640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:09.152 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.147+0000 7f8c6a118640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:09.152 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.147+0000 7f8c6a118640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:09.152 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.147+0000 7f8c6a118640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:09.152 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.147+0000 7f8c69917640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:09.152 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.147+0000 7f8c69917640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:09.152 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.147+0000 7f8c69917640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:09.153 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.149+0000 7f8c69917640 10 monclient(hunting): handle_auth_done global_id 4264 payload 274 2024-02-09T08:03:09.153 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.149+0000 7f8c69917640 1 -- 172.21.15.62:0/2367378285 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8c641465b0 msgr2=0x7f8c6414d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:09.153 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.149+0000 7f8c69917640 1 --2- 172.21.15.62:0/2367378285 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8c641465b0 0x7f8c6414d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:09.153 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.149+0000 7f8c69917640 1 -- 172.21.15.62:0/2367378285 >> v1:172.21.15.103:6789/0 conn(0x7f8c641431a0 legacy=0x7f8c64145ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:09.153 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.149+0000 7f8c69917640 10 monclient: _finish_hunting 0 2024-02-09T08:03:09.153 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.149+0000 7f8c69917640 1 monclient: found mon.noname-c 2024-02-09T08:03:09.153 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.149+0000 7f8c69917640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:09.153 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.149+0000 7f8c69917640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.103:3300/0 2024-02-09T08:03:09.153 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.149+0000 7f8c69917640 1 -- 172.21.15.62:0/2367378285 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c64070b30 con 0x7f8c6406b7f0 2024-02-09T08:03:09.155 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.153+0000 7f8c69917640 1 --2- 172.21.15.62:0/2367378285 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c6406b7f0 0x7f8c64071510 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8c600097a0 tx=0x7f8c6002b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8323d8d4c053bcfc server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:09.159 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.157+0000 7f8c68915640 1 -- 172.21.15.62:0/2367378285 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c60031780 con 0x7f8c6406b7f0 2024-02-09T08:03:09.159 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.157+0000 7f8c68915640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:09.159 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.157+0000 7f8c68915640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-09T08:03:09.159 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.157+0000 7f8c68915640 10 monclient: dump: 2024-02-09T08:03:09.160 INFO:teuthology.misc.health.smithi062.stderr:epoch 1 2024-02-09T08:03:09.160 INFO:teuthology.misc.health.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:09.160 INFO:teuthology.misc.health.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:09.160 INFO:teuthology.misc.health.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:09.160 INFO:teuthology.misc.health.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:09.160 INFO:teuthology.misc.health.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:09.160 INFO:teuthology.misc.health.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:09.160 INFO:teuthology.misc.health.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:09.160 INFO:teuthology.misc.health.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:09.160 INFO:teuthology.misc.health.smithi062.stderr: 2024-02-09T08:03:09.160 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.157+0000 7f8c68915640 10 monclient: _finish_auth 0 2024-02-09T08:03:09.160 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.157+0000 7f8c68915640 10 monclient: _check_auth_tickets 2024-02-09T08:03:09.160 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.157+0000 7f8c68915640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:09.160 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.157+0000 7f8c68915640 1 -- 172.21.15.62:0/2367378285 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c600318e0 con 0x7f8c6406b7f0 2024-02-09T08:03:09.161 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.157+0000 7f8c68915640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:09.161 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.157+0000 7f8c68915640 1 -- 172.21.15.62:0/2367378285 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c60031c70 con 0x7f8c6406b7f0 2024-02-09T08:03:09.161 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.157+0000 7f8c6bb7b640 5 monclient: authenticate success, global_id 4264 2024-02-09T08:03:09.161 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.157+0000 7f8c6bb7b640 10 monclient: get_monmap_and_config success 2024-02-09T08:03:09.161 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.157+0000 7f8c6bb7b640 4 set_mon_vals no callback set 2024-02-09T08:03:09.161 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.157+0000 7f8c68915640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:09.161 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.157+0000 7f8c68915640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:03:09.161 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.157+0000 7f8c68915640 10 monclient: dump: 2024-02-09T08:03:09.161 INFO:teuthology.misc.health.smithi062.stderr:epoch 1 2024-02-09T08:03:09.161 INFO:teuthology.misc.health.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:09.161 INFO:teuthology.misc.health.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:09.161 INFO:teuthology.misc.health.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:09.161 INFO:teuthology.misc.health.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:09.161 INFO:teuthology.misc.health.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:09.161 INFO:teuthology.misc.health.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:09.162 INFO:teuthology.misc.health.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:09.162 INFO:teuthology.misc.health.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:09.162 INFO:teuthology.misc.health.smithi062.stderr: 2024-02-09T08:03:09.165 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.158+0000 7f8c6bb7b640 10 monclient: shutdown 2024-02-09T08:03:09.165 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.158+0000 7f8c6bb7b640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:09.165 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.158+0000 7f8c6bb7b640 1 -- 172.21.15.62:0/2367378285 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c6406b7f0 msgr2=0x7f8c64071510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:09.165 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.158+0000 7f8c6bb7b640 1 --2- 172.21.15.62:0/2367378285 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c6406b7f0 0x7f8c64071510 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8c600097a0 tx=0x7f8c6002b820 comp rx=0 tx=0).stop 2024-02-09T08:03:09.165 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.158+0000 7f8c6bb7b640 1 -- 172.21.15.62:0/2367378285 shutdown_connections 2024-02-09T08:03:09.165 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.158+0000 7f8c6bb7b640 1 --2- 172.21.15.62:0/2367378285 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8c641465b0 0x7f8c6414d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:09.166 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.158+0000 7f8c6bb7b640 1 --2- 172.21.15.62:0/2367378285 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c6406b7f0 0x7f8c64071510 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:09.166 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.158+0000 7f8c6bb7b640 1 -- 172.21.15.62:0/2367378285 >> 172.21.15.62:0/2367378285 conn(0x7f8c640b6410 msgr2=0x7f8c640b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:09.166 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.158+0000 7f8c6bb7b640 1 -- 172.21.15.62:0/2367378285 shutdown_connections 2024-02-09T08:03:09.166 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.158+0000 7f8c6bb7b640 1 -- 172.21.15.62:0/2367378285 wait complete. 2024-02-09T08:03:09.166 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.159+0000 7f8c6bb7b640 10 monclient: build_initial_monmap 2024-02-09T08:03:09.166 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.159+0000 7f8c6bb7b640 10 monclient: monmap: 2024-02-09T08:03:09.166 INFO:teuthology.misc.health.smithi062.stderr:epoch 0 2024-02-09T08:03:09.166 INFO:teuthology.misc.health.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:03:09.166 INFO:teuthology.misc.health.smithi062.stderr:last_changed 0.000000 2024-02-09T08:03:09.166 INFO:teuthology.misc.health.smithi062.stderr:created 0.000000 2024-02-09T08:03:09.166 INFO:teuthology.misc.health.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:09.166 INFO:teuthology.misc.health.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:09.166 INFO:teuthology.misc.health.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:03:09.166 INFO:teuthology.misc.health.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:03:09.166 INFO:teuthology.misc.health.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:03:09.167 INFO:teuthology.misc.health.smithi062.stderr: 2024-02-09T08:03:09.167 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.159+0000 7f8c6bb7b640 1 librados: starting msgr at 2024-02-09T08:03:09.167 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.159+0000 7f8c6bb7b640 1 librados: starting objecter 2024-02-09T08:03:09.167 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.159+0000 7f8c6bb7b640 1 Processor -- start 2024-02-09T08:03:09.167 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.159+0000 7f8c6bb7b640 1 -- start start 2024-02-09T08:03:09.167 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.159+0000 7f8c6bb7b640 1 librados: setting wanted keys 2024-02-09T08:03:09.167 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.159+0000 7f8c6bb7b640 1 librados: calling monclient init 2024-02-09T08:03:09.167 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.159+0000 7f8c6bb7b640 10 monclient: init 2024-02-09T08:03:09.167 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.160+0000 7f8c6bb7b640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:09.167 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.160+0000 7f8c6bb7b640 10 monclient: _add_conns ranks=[1,0,2] 2024-02-09T08:03:09.167 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.160+0000 7f8c6bb7b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c6406b7f0 0x7f8c641457f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:09.167 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.160+0000 7f8c6bb7b640 10 monclient(hunting): picked mon.noname-b con 0x7f8c6406b7f0 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:03:09.167 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.160+0000 7f8c6bb7b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c641431a0 0x7f8c641d8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:09.167 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.160+0000 7f8c6bb7b640 10 monclient(hunting): picked mon.noname-a con 0x7f8c641431a0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:03:09.167 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.160+0000 7f8c6bb7b640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8c641465b0 0x7f8c6413fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:09.168 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.160+0000 7f8c6bb7b640 10 monclient(hunting): picked mon.noname-c con 0x7f8c641465b0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:09.168 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.160+0000 7f8c6bb7b640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:09.168 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.160+0000 7f8c6bb7b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c640addd0 con 0x7f8c641431a0 2024-02-09T08:03:09.168 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.160+0000 7f8c6bb7b640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:09.168 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.160+0000 7f8c6bb7b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6413f200 con 0x7f8c6406b7f0 2024-02-09T08:03:09.168 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.160+0000 7f8c6bb7b640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:09.168 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.160+0000 7f8c6bb7b640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c640ad8a0 con 0x7f8c641465b0 2024-02-09T08:03:09.168 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.160+0000 7f8c6bb7b640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:09.168 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.160+0000 7f8c6bb7b640 10 monclient(hunting): authenticate will time out at 1432.520336s 2024-02-09T08:03:09.168 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.160+0000 7f8c6a118640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8c641465b0 0x7f8c6413fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:09.168 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.160+0000 7f8c69917640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c6406b7f0 0x7f8c641457f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:09.168 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.160+0000 7f8c69116640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c641431a0 0x7f8c641d8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:09.168 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.160+0000 7f8c69917640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c6406b7f0 0x7f8c641457f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.62:38518/0 (socket says 172.21.15.62:38518) 2024-02-09T08:03:09.168 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.160+0000 7f8c69917640 1 -- 172.21.15.62:0/3758327496 learned_addr learned my addr 172.21.15.62:0/3758327496 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:09.169 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.160+0000 7f8c69917640 10 monclient(hunting): get_auth_request con 0x7f8c6406b7f0 auth_method 0 2024-02-09T08:03:09.169 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.160+0000 7f8c69917640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:09.169 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.160+0000 7f8c69917640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:09.169 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.160+0000 7f8c69917640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:09.169 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.161+0000 7f8c69116640 10 monclient(hunting): get_auth_request con 0x7f8c641431a0 auth_method 0 2024-02-09T08:03:09.169 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.161+0000 7f8c69116640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:09.169 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.161+0000 7f8c69116640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:09.170 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.161+0000 7f8c69116640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:09.170 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.161+0000 7f8c6a118640 10 monclient(hunting): get_auth_request con 0x7f8c641465b0 auth_method 0 2024-02-09T08:03:09.170 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.161+0000 7f8c6a118640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:09.170 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.161+0000 7f8c6a118640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:09.170 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.161+0000 7f8c6a118640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:09.170 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.161+0000 7f8c69917640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:09.170 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.161+0000 7f8c69917640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:09.170 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.161+0000 7f8c69917640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:09.170 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.161+0000 7f8c6a118640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:09.170 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.161+0000 7f8c6a118640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:09.170 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.161+0000 7f8c6a118640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:09.170 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.161+0000 7f8c69116640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:09.170 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.161+0000 7f8c69116640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:09.170 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.161+0000 7f8c69116640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:09.173 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.164+0000 7f8c69917640 10 monclient(hunting): handle_auth_done global_id 4267 payload 824 2024-02-09T08:03:09.173 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.164+0000 7f8c69917640 1 -- 172.21.15.62:0/3758327496 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8c641465b0 msgr2=0x7f8c6413fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:09.173 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.164+0000 7f8c69917640 1 --2- 172.21.15.62:0/3758327496 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8c641465b0 0x7f8c6413fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:09.173 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.164+0000 7f8c69917640 1 -- 172.21.15.62:0/3758327496 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c641431a0 msgr2=0x7f8c641d8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:09.173 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.164+0000 7f8c69917640 1 --2- 172.21.15.62:0/3758327496 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c641431a0 0x7f8c641d8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:09.173 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.164+0000 7f8c69917640 10 monclient: _finish_hunting 0 2024-02-09T08:03:09.173 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.164+0000 7f8c69917640 1 monclient: found mon.noname-b 2024-02-09T08:03:09.173 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.164+0000 7f8c69917640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:09.173 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.164+0000 7f8c69917640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.103:3300/0 2024-02-09T08:03:09.173 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.164+0000 7f8c69917640 1 -- 172.21.15.62:0/3758327496 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c60009400 con 0x7f8c6406b7f0 2024-02-09T08:03:09.173 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.166+0000 7f8c69917640 1 --2- 172.21.15.62:0/3758327496 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c6406b7f0 0x7f8c641457f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8c600098c0 tx=0x7f8c600046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:09.174 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.166+0000 7f8c5a7fc640 10 client.?.objecter ms_handle_connect 0x7f8c6406b7f0 2024-02-09T08:03:09.174 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.166+0000 7f8c5a7fc640 10 client.?.objecter resend_mon_ops 2024-02-09T08:03:09.174 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.170+0000 7f8c5a7fc640 1 -- 172.21.15.62:0/3758327496 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c60032820 con 0x7f8c6406b7f0 2024-02-09T08:03:09.174 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.170+0000 7f8c5a7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:09.174 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.170+0000 7f8c5a7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:03:09.174 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.170+0000 7f8c5a7fc640 10 monclient: dump: 2024-02-09T08:03:09.174 INFO:teuthology.misc.health.smithi062.stderr:epoch 1 2024-02-09T08:03:09.174 INFO:teuthology.misc.health.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:09.174 INFO:teuthology.misc.health.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:09.174 INFO:teuthology.misc.health.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:09.174 INFO:teuthology.misc.health.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:09.174 INFO:teuthology.misc.health.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:09.174 INFO:teuthology.misc.health.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:09.174 INFO:teuthology.misc.health.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:09.174 INFO:teuthology.misc.health.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:09.174 INFO:teuthology.misc.health.smithi062.stderr: 2024-02-09T08:03:09.175 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.170+0000 7f8c5a7fc640 10 monclient: _finish_auth 0 2024-02-09T08:03:09.175 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.170+0000 7f8c5a7fc640 10 monclient: _check_auth_tickets 2024-02-09T08:03:09.175 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.170+0000 7f8c5a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:09.175 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.170+0000 7f8c5a7fc640 1 -- 172.21.15.62:0/3758327496 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c60032980 con 0x7f8c6406b7f0 2024-02-09T08:03:09.175 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.170+0000 7f8c6bb7b640 5 monclient: authenticate success, global_id 4267 2024-02-09T08:03:09.175 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.170+0000 7f8c6bb7b640 10 monclient: _renew_subs 2024-02-09T08:03:09.175 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.170+0000 7f8c6bb7b640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:09.175 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.170+0000 7f8c6bb7b640 1 -- 172.21.15.62:0/3758327496 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c641d85b0 con 0x7f8c6406b7f0 2024-02-09T08:03:09.175 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.170+0000 7f8c5a7fc640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:09.175 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.170+0000 7f8c5a7fc640 1 -- 172.21.15.62:0/3758327496 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c60032d30 con 0x7f8c6406b7f0 2024-02-09T08:03:09.175 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.170+0000 7f8c5a7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:09.175 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.170+0000 7f8c5a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:03:09.175 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.170+0000 7f8c5a7fc640 10 monclient: dump: 2024-02-09T08:03:09.175 INFO:teuthology.misc.health.smithi062.stderr:epoch 1 2024-02-09T08:03:09.176 INFO:teuthology.misc.health.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:09.176 INFO:teuthology.misc.health.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:09.176 INFO:teuthology.misc.health.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:09.176 INFO:teuthology.misc.health.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:09.176 INFO:teuthology.misc.health.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:09.176 INFO:teuthology.misc.health.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:09.176 INFO:teuthology.misc.health.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:09.176 INFO:teuthology.misc.health.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:09.176 INFO:teuthology.misc.health.smithi062.stderr: 2024-02-09T08:03:09.176 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.170+0000 7f8c5bfff640 4 set_mon_vals no callback set 2024-02-09T08:03:09.176 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.170+0000 7f8c6bb7b640 10 client.4267.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:03:09.177 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.170+0000 7f8c6bb7b640 10 monclient: _renew_subs 2024-02-09T08:03:09.177 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.170+0000 7f8c6bb7b640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:09.177 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.170+0000 7f8c6bb7b640 1 -- 172.21.15.62:0/3758327496 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c64140300 con 0x7f8c6406b7f0 2024-02-09T08:03:09.177 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.170+0000 7f8c6bb7b640 1 librados: init done 2024-02-09T08:03:09.177 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.171+0000 7f8c6bb7b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:09.177 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.171+0000 7f8c6bb7b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:09.177 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.171+0000 7f8c6bb7b640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:09.177 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.171+0000 7f8c6bb7b640 1 -- 172.21.15.62:0/3758327496 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c64070340 con 0x7f8c6406b7f0 2024-02-09T08:03:09.422 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.420+0000 7f8c5a7fc640 1 -- 172.21.15.62:0/3758327496 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f8c6004e440 con 0x7f8c6406b7f0 2024-02-09T08:03:09.422 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.420+0000 7f8c5a7fc640 1 --2- 172.21.15.62:0/3758327496 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f8c4806d1f0 0x7f8c4806f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:09.433 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.420+0000 7f8c69116640 1 --2- 172.21.15.62:0/3758327496 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f8c4806d1f0 0x7f8c4806f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:09.433 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.420+0000 7f8c69116640 10 monclient: get_auth_request con 0x7f8c4806d1f0 auth_method 0 2024-02-09T08:03:09.434 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.421+0000 7f8c69116640 1 --2- 172.21.15.62:0/3758327496 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f8c4806d1f0 0x7f8c4806f6b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8c640ae960 tx=0x7f8c54009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:09.434 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.421+0000 7f8c5a7fc640 10 client.4267.objecter ms_handle_connect 0x7f8c4806d1f0 2024-02-09T08:03:09.434 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.422+0000 7f8c5a7fc640 1 -- 172.21.15.62:0/3758327496 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8c6007acf0 con 0x7f8c6406b7f0 2024-02-09T08:03:09.434 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.422+0000 7f8c5a7fc640 10 client.4267.objecter ms_dispatch 0x7f8c64000b90 osd_map(22..22 src has 1..22) v4 2024-02-09T08:03:09.434 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.422+0000 7f8c5a7fc640 3 client.4267.objecter handle_osd_map got epochs [22,22] > 0 2024-02-09T08:03:09.434 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.422+0000 7f8c5a7fc640 3 client.4267.objecter handle_osd_map decoding full epoch 22 2024-02-09T08:03:09.434 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.422+0000 7f8c5a7fc640 20 client.4267.objecter dump_active .. 0 homeless 2024-02-09T08:03:09.439 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.432+0000 7f8c5a7fc640 1 -- 172.21.15.62:0/3758327496 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8c60076f90 con 0x7f8c6406b7f0 2024-02-09T08:03:09.439 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.432+0000 7f8c5a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:09.439 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.432+0000 7f8c5a7fc640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:03:09.621 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.611+0000 7f8c6bb7b640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-02-09T08:03:09.621 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.611+0000 7f8c6bb7b640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-02-09T08:03:09.621 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.611+0000 7f8c6bb7b640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:09.621 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.611+0000 7f8c6bb7b640 1 -- 172.21.15.62:0/3758327496 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c6406a4b0 con 0x7f8c6406b7f0 2024-02-09T08:03:09.638 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.635+0000 7f8c5a7fc640 1 -- 172.21.15.62:0/3758327496 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+12872 (secure 0 0 0) 0x7f8c6007a650 con 0x7f8c6406b7f0 2024-02-09T08:03:09.638 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.635+0000 7f8c5a7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-02-09T08:03:09.638 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.635+0000 7f8c5a7fc640 10 monclient: _finish_command 2 = system:0 2024-02-09T08:03:09.646 INFO:teuthology.misc.health.smithi062.stdout: 2024-02-09T08:03:09.646 INFO:teuthology.misc.health.smithi062.stdout:{"epoch":22,"fsid":"981c5564-eb76-49a1-80ab-97c7647bc34a","created":"2024-02-09T08:02:07.866410+0000","modified":"2024-02-09T08:03:07.429050+0000","last_up_change":"2024-02-09T08:03:05.958254+0000","last_in_change":"2024-02-09T08:02:13.770858+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-09T08:02:56.035293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0e3b17d4-a50f-41d9-b455-0bc1606a5c86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":3842068700},{"type":"v1","addr":"172.21.15.62:6809","nonce":3842068700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3842068700},{"type":"v1","addr":"172.21.15.62:6811","nonce":3842068700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3842068700},{"type":"v1","addr":"172.21.15.62:6815","nonce":3842068700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3842068700},{"type":"v1","addr":"172.21.15.62:6813","nonce":3842068700}]},"public_addr":"172.21.15.62:6809/3842068700","cluster_addr":"172.21.15.62:6811/3842068700","heartbeat_back_addr":"172.21.15.62:6815/3842068700","heartbeat_front_addr":"172.21.15.62:6813/3842068700","state":["exists","up"]},{"osd":1,"uuid":"a0077e6c-220d-46f4-9be2-a707d1710890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":3837949327},{"type":"v1","addr":"172.21.15.62:6801","nonce":3837949327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":3837949327},{"type":"v1","addr":"172.21.15.62:6803","nonce":3837949327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":3837949327},{"type":"v1","addr":"172.21.15.62:6807","nonce":3837949327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":3837949327},{"type":"v1","addr":"172.21.15.62:6805","nonce":3837949327}]},"public_addr":"172.21.15.62:6801/3837949327","cluster_addr":"172.21.15.62:6803/3837949327","heartbeat_back_addr":"172.21.15.62:6807/3837949327","heartbeat_front_addr":"172.21.15.62:6805/3837949327","state":["exists","up"]},{"osd":2,"uuid":"3739882a-5263-4113-840a-afd6acdcf15e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":2695503114},{"type":"v1","addr":"172.21.15.62:6817","nonce":2695503114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2695503114},{"type":"v1","addr":"172.21.15.62:6819","nonce":2695503114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2695503114},{"type":"v1","addr":"172.21.15.62:6823","nonce":2695503114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":2695503114},{"type":"v1","addr":"172.21.15.62:6821","nonce":2695503114}]},"public_addr":"172.21.15.62:6817/2695503114","cluster_addr":"172.21.15.62:6819/2695503114","heartbeat_back_addr":"172.21.15.62:6823/2695503114","heartbeat_front_addr":"172.21.15.62:6821/2695503114","state":["exists","up"]},{"osd":3,"uuid":"3657c103-db3d-46c5-8afc-2b0b9da1e2e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":556356316},{"type":"v1","addr":"172.21.15.62:6825","nonce":556356316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":556356316},{"type":"v1","addr":"172.21.15.62:6827","nonce":556356316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":556356316},{"type":"v1","addr":"172.21.15.62:6831","nonce":556356316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":556356316},{"type":"v1","addr":"172.21.15.62:6829","nonce":556356316}]},"public_addr":"172.21.15.62:6825/556356316","cluster_addr":"172.21.15.62:6827/556356316","heartbeat_back_addr":"172.21.15.62:6831/556356316","heartbeat_front_addr":"172.21.15.62:6829/556356316","state":["exists","up"]},{"osd":4,"uuid":"faf5e721-fa06-43f8-9b72-36ca8132ffea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":20,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2442009417},{"type":"v1","addr":"172.21.15.103:6811","nonce":2442009417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2442009417},{"type":"v1","addr":"172.21.15.103:6815","nonce":2442009417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2442009417},{"type":"v1","addr":"172.21.15.103:6822","nonce":2442009417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2442009417},{"type":"v1","addr":"172.21.15.103:6818","nonce":2442009417}]},"public_addr":"172.21.15.103:6811/2442009417","cluster_addr":"172.21.15.103:6815/2442009417","heartbeat_back_addr":"172.21.15.103:6822/2442009417","heartbeat_front_addr":"172.21.15.103:6818/2442009417","state":["exists","up"]},{"osd":5,"uuid":"5c96dba1-53d2-4c0c-8928-5f09ea17a984","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":262591034},{"type":"v1","addr":"172.21.15.103:6803","nonce":262591034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":262591034},{"type":"v1","addr":"172.21.15.103:6805","nonce":262591034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":262591034},{"type":"v1","addr":"172.21.15.103:6809","nonce":262591034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":262591034},{"type":"v1","addr":"172.21.15.103:6807","nonce":262591034}]},"public_addr":"172.21.15.103:6803/262591034","cluster_addr":"172.21.15.103:6805/262591034","heartbeat_back_addr":"172.21.15.103:6809/262591034","heartbeat_front_addr":"172.21.15.103:6807/262591034","state":["exists","up"]},{"osd":6,"uuid":"3473844d-d631-4ea4-96fb-638eccee5cb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3983655111},{"type":"v1","addr":"172.21.15.103:6827","nonce":3983655111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3983655111},{"type":"v1","addr":"172.21.15.103:6829","nonce":3983655111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3983655111},{"type":"v1","addr":"172.21.15.103:6833","nonce":3983655111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3983655111},{"type":"v1","addr":"172.21.15.103:6831","nonce":3983655111}]},"public_addr":"172.21.15.103:6827/3983655111","cluster_addr":"172.21.15.103:6829/3983655111","heartbeat_back_addr":"172.21.15.103:6833/3983655111","heartbeat_front_addr":"172.21.15.103:6831/3983655111","state":["exists","up"]},{"osd":7,"uuid":"d31bdb4b-8938-4da9-8bf1-57cf730e839d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":1369132028},{"type":"v1","addr":"172.21.15.103:6813","nonce":1369132028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":1369132028},{"type":"v1","addr":"172.21.15.103:6819","nonce":1369132028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1369132028},{"type":"v1","addr":"172.21.15.103:6825","nonce":1369132028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6821","nonce":1369132028},{"type":"v1","addr":"172.21.15.103:6823","nonce":1369132028}]},"public_addr":"172.21.15.103:6813/1369132028","cluster_addr":"172.21.15.103:6819/1369132028","heartbeat_back_addr":"172.21.15.103:6825/1369132028","heartbeat_front_addr":"172.21.15.103:6823/1369132028","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T08:02:53.044658+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T08:02:52.943983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T08:02:53.834176+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T08:02:53.238626+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T08:02:51.878057+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T08:02:50.950607+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T08:02:52.166722+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T08:02:52.154749+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-09T08:03:09.647 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.637+0000 7f8c6bb7b640 10 librados: watch_flush enter 2024-02-09T08:03:09.647 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.637+0000 7f8c6bb7b640 10 librados: watch_flush exit 2024-02-09T08:03:09.647 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.637+0000 7f8c6bb7b640 20 client.4267.objecter shutdown clearing up homeless session... 2024-02-09T08:03:09.647 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.637+0000 7f8c6bb7b640 10 client.4267.objecter successfully canceled tick 2024-02-09T08:03:09.650 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.637+0000 7f8c6bb7b640 1 -- 172.21.15.62:0/3758327496 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f8c4806d1f0 msgr2=0x7f8c4806f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:09.650 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.637+0000 7f8c6bb7b640 1 --2- 172.21.15.62:0/3758327496 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f8c4806d1f0 0x7f8c4806f6b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8c640ae960 tx=0x7f8c54009040 comp rx=0 tx=0).stop 2024-02-09T08:03:09.650 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.637+0000 7f8c6bb7b640 10 monclient: shutdown 2024-02-09T08:03:09.650 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.637+0000 7f8c6bb7b640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:09.650 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.637+0000 7f8c6bb7b640 1 -- 172.21.15.62:0/3758327496 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c6406b7f0 msgr2=0x7f8c641457f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:09.650 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.637+0000 7f8c6bb7b640 1 --2- 172.21.15.62:0/3758327496 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c6406b7f0 0x7f8c641457f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8c600098c0 tx=0x7f8c600046c0 comp rx=0 tx=0).stop 2024-02-09T08:03:09.650 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.637+0000 7f8c6bb7b640 1 -- 172.21.15.62:0/3758327496 shutdown_connections 2024-02-09T08:03:09.650 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.637+0000 7f8c6bb7b640 1 --2- 172.21.15.62:0/3758327496 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f8c4806d1f0 0x7f8c4806f6b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:09.650 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.637+0000 7f8c6bb7b640 1 --2- 172.21.15.62:0/3758327496 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8c641465b0 0x7f8c6413fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:09.650 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.637+0000 7f8c6bb7b640 1 --2- 172.21.15.62:0/3758327496 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c641431a0 0x7f8c641d8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:09.650 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.637+0000 7f8c6bb7b640 1 --2- 172.21.15.62:0/3758327496 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c6406b7f0 0x7f8c641457f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:09.651 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.637+0000 7f8c6bb7b640 1 -- 172.21.15.62:0/3758327496 >> 172.21.15.62:0/3758327496 conn(0x7f8c640b6410 msgr2=0x7f8c640b67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:09.651 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.637+0000 7f8c6bb7b640 1 -- 172.21.15.62:0/3758327496 shutdown_connections 2024-02-09T08:03:09.651 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.637+0000 7f8c6bb7b640 1 -- 172.21.15.62:0/3758327496 wait complete. 2024-02-09T08:03:09.651 INFO:teuthology.misc.health.smithi062.stderr:2024-02-09T08:03:09.637+0000 7f8c6bb7b640 1 librados: shutdown 2024-02-09T08:03:09.651 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-02-09T08:03:09.651 INFO:tasks.ceph:Creating RBD pool 2024-02-09T08:03:09.652 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd pool create rbd 8 2024-02-09T08:03:09.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.774+0000 7f7fed066640 10 monclient: get_monmap_and_config 2024-02-09T08:03:09.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.774+0000 7f7fed066640 10 monclient: build_initial_monmap 2024-02-09T08:03:09.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.774+0000 7f7fed066640 10 monclient: monmap: 2024-02-09T08:03:09.781 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:09.781 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:09.781 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:03:09.775321+0000 2024-02-09T08:03:09.781 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:03:09.775321+0000 2024-02-09T08:03:09.781 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:09.781 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:09.781 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:03:09.782 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:03:09.782 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:03:09.782 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:03:09.782 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:03:09.782 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:09.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.774+0000 7f7fed066640 1 Processor -- start 2024-02-09T08:03:09.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.774+0000 7f7fed066640 1 -- start start 2024-02-09T08:03:09.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.774+0000 7f7fed066640 10 monclient: init 2024-02-09T08:03:09.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.775+0000 7f7fed066640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:09.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.775+0000 7f7fed066640 10 monclient: _add_conns ranks=[1,0,3,2,4] 2024-02-09T08:03:09.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.775+0000 7f7fed066640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f7fe806c320 addr v1:172.21.15.103:6789/0 2024-02-09T08:03:09.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.775+0000 7f7fed066640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f7fe80a9be0 addr v1:172.21.15.62:6789/0 2024-02-09T08:03:09.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.775+0000 7f7fed066640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7fe80b2280 0x7f7fe81461d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:09.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.775+0000 7f7fed066640 10 monclient(hunting): picked mon.noname-a con 0x7f7fe80b2280 addr v2:172.21.15.62:3300/0 2024-02-09T08:03:09.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.775+0000 7f7fed066640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fe80aa130 con 0x7f7fe80a9be0 2024-02-09T08:03:09.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.775+0000 7f7fed066640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fe80aa5c0 con 0x7f7fe806c320 2024-02-09T08:03:09.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.775+0000 7f7fed066640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:09.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.775+0000 7f7fed066640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fe806c700 con 0x7f7fe80b2280 2024-02-09T08:03:09.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.775+0000 7f7fed066640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:09.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.775+0000 7f7fed066640 10 monclient(hunting): authenticate will time out at 1433.135825s 2024-02-09T08:03:09.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.776+0000 7f7fe6d9d640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f7fe806c320 0x7f7fe813f7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.62:50426/0 (socket says 172.21.15.62:50426) 2024-02-09T08:03:09.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.776+0000 7f7fe6d9d640 1 -- 172.21.15.62:0/1232982704 learned_addr learned my addr 172.21.15.62:0/1232982704 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-09T08:03:09.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.776+0000 7f7fe759e640 1 --2- 172.21.15.62:0/1232982704 >> v2:172.21.15.62:3300/0 conn(0x7f7fe80b2280 0x7f7fe81461d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:09.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.777+0000 7f7fe759e640 10 monclient(hunting): get_auth_request con 0x7f7fe80b2280 auth_method 0 2024-02-09T08:03:09.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.777+0000 7f7fe759e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:09.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.777+0000 7f7fe759e640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:09.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.777+0000 7f7fe759e640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:09.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.778+0000 7f7fe5d9b640 1 -- 172.21.15.62:0/1232982704 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1893343151 0 0) 0x7f7fe80aa5c0 con 0x7f7fe806c320 2024-02-09T08:03:09.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.778+0000 7f7fe5d9b640 10 monclient(hunting): _negotiate 2024-02-09T08:03:09.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.778+0000 7f7fe5d9b640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:09.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.778+0000 7f7fe5d9b640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:09.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.778+0000 7f7fe5d9b640 10 monclient(hunting): my global_id is 4270 2024-02-09T08:03:09.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.778+0000 7f7fe5d9b640 1 -- 172.21.15.62:0/1232982704 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fd4003520 con 0x7f7fe806c320 2024-02-09T08:03:09.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.779+0000 7f7fe759e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:09.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.779+0000 7f7fe759e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:09.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.779+0000 7f7fe759e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:09.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.781+0000 7f7fe5d9b640 1 -- 172.21.15.62:0/1232982704 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2836960769 0 0) 0x7f7fd4003520 con 0x7f7fe806c320 2024-02-09T08:03:09.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.781+0000 7f7fe5d9b640 1 -- 172.21.15.62:0/1232982704 >> v2:172.21.15.62:3300/0 conn(0x7f7fe80b2280 msgr2=0x7f7fe81461d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:09.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.781+0000 7f7fe5d9b640 1 --2- 172.21.15.62:0/1232982704 >> v2:172.21.15.62:3300/0 conn(0x7f7fe80b2280 0x7f7fe81461d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:09.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.781+0000 7f7fe5d9b640 1 -- 172.21.15.62:0/1232982704 >> v1:172.21.15.62:6789/0 conn(0x7f7fe80a9be0 legacy=0x7f7fe8145ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:09.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.781+0000 7f7fe5d9b640 10 monclient: _finish_hunting 0 2024-02-09T08:03:09.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.781+0000 7f7fe5d9b640 1 monclient: found mon.noname-c-legacy 2024-02-09T08:03:09.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.781+0000 7f7fe5d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:09.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.781+0000 7f7fe5d9b640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:172.21.15.103:6789/0 2024-02-09T08:03:09.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.781+0000 7f7fe5d9b640 1 -- 172.21.15.62:0/1232982704 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe80ab5f0 con 0x7f7fe806c320 2024-02-09T08:03:09.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.781+0000 7f7fe5d9b640 10 monclient: _finish_auth 0 2024-02-09T08:03:09.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.781+0000 7f7fe5d9b640 10 monclient: _check_auth_tickets 2024-02-09T08:03:09.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.781+0000 7f7fe5d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:09.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.781+0000 7f7fed066640 5 monclient: authenticate success, global_id 4270 2024-02-09T08:03:09.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.781+0000 7f7fe5d9b640 1 -- 172.21.15.62:0/1232982704 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1140318843 0 0) 0x7f7fe0001670 con 0x7f7fe806c320 2024-02-09T08:03:09.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.781+0000 7f7fed066640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-02-09T08:03:09.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.781+0000 7f7fe5d9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:09.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.781+0000 7f7fe5d9b640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2024-02-09T08:03:09.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.781+0000 7f7fe5d9b640 10 monclient: dump: 2024-02-09T08:03:09.791 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:09.791 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:09.791 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:09.791 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:09.791 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:09.791 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:09.791 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:09.791 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:09.792 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:09.792 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:09.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.781+0000 7f7fe5d9b640 1 monclient: mon.b has (v2) addrs [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] but i'm connected to v1:172.21.15.103:6789/0, reconnecting 2024-02-09T08:03:09.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.781+0000 7f7fe5d9b640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:09.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.781+0000 7f7fe5d9b640 1 -- 172.21.15.62:0/1232982704 >> v1:172.21.15.103:6789/0 conn(0x7f7fe806c320 legacy=0x7f7fe813f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:09.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.781+0000 7f7fe5d9b640 10 monclient: _add_conns ranks=[1,2,0] 2024-02-09T08:03:09.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.781+0000 7f7fe5d9b640 1 --2- 172.21.15.62:0/1232982704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fd40039c0 0x7f7fd4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:09.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.781+0000 7f7fe5d9b640 10 monclient(hunting): picked mon.b con 0x7f7fd40039c0 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:03:09.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.781+0000 7f7fe5d9b640 1 --2- 172.21.15.62:0/1232982704 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fd40047c0 0x7f7fd4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:09.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.781+0000 7f7fe5d9b640 10 monclient(hunting): picked mon.c con 0x7f7fd40047c0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:09.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.781+0000 7f7fe5d9b640 1 --2- 172.21.15.62:0/1232982704 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fd40052a0 0x7f7fd400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:09.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.781+0000 7f7fe5d9b640 10 monclient(hunting): picked mon.a con 0x7f7fd40052a0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:03:09.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.781+0000 7f7fe5d9b640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:09.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.781+0000 7f7fe5d9b640 1 -- 172.21.15.62:0/1232982704 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe806c700 con 0x7f7fd40052a0 2024-02-09T08:03:09.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.781+0000 7f7fe5d9b640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:09.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.781+0000 7f7fe5d9b640 1 -- 172.21.15.62:0/1232982704 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd400c1a0 con 0x7f7fd40039c0 2024-02-09T08:03:09.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.781+0000 7f7fe5d9b640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:09.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.781+0000 7f7fe5d9b640 1 -- 172.21.15.62:0/1232982704 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd400c360 con 0x7f7fd40047c0 2024-02-09T08:03:09.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.781+0000 7f7fe5d9b640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:09.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.781+0000 7f7fe5d9b640 10 monclient(hunting): _finish_auth 0 2024-02-09T08:03:09.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.781+0000 7f7fed066640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2024-02-09T08:03:09.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.782+0000 7f7fe659c640 1 --2- 172.21.15.62:0/1232982704 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fd40047c0 0x7f7fd4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:09.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.782+0000 7f7fe659c640 10 monclient(hunting): get_auth_request con 0x7f7fd40047c0 auth_method 0 2024-02-09T08:03:09.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.782+0000 7f7fe659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:09.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.782+0000 7f7fe659c640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:09.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.782+0000 7f7fe659c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-02-09T08:03:09.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.783+0000 7f7fe659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:09.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.783+0000 7f7fe659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:09.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.783+0000 7f7fe659c640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-02-09T08:03:09.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.784+0000 7f7fe6d9d640 1 --2- 172.21.15.62:0/1232982704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fd40039c0 0x7f7fd4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:09.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.784+0000 7f7fe6d9d640 10 monclient(hunting): get_auth_request con 0x7f7fd40039c0 auth_method 0 2024-02-09T08:03:09.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.784+0000 7f7fe6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:09.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.784+0000 7f7fe6d9d640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:09.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.784+0000 7f7fe6d9d640 10 monclient(hunting): _init_auth already have auth, reseting 2024-02-09T08:03:09.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.785+0000 7f7fe659c640 10 monclient(hunting): handle_auth_done global_id 4270 payload 293 2024-02-09T08:03:09.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.785+0000 7f7fe659c640 1 -- 172.21.15.62:0/1232982704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fd40039c0 msgr2=0x7f7fd4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:09.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.785+0000 7f7fe659c640 1 --2- 172.21.15.62:0/1232982704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fd40039c0 0x7f7fd4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:09.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.785+0000 7f7fe659c640 1 -- 172.21.15.62:0/1232982704 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fd40052a0 msgr2=0x7f7fd400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:09.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.785+0000 7f7fe659c640 1 --2- 172.21.15.62:0/1232982704 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fd40052a0 0x7f7fd400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:09.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.785+0000 7f7fe659c640 10 monclient: _finish_hunting 0 2024-02-09T08:03:09.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.785+0000 7f7fe659c640 1 monclient: found mon.c 2024-02-09T08:03:09.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.785+0000 7f7fe659c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:09.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.785+0000 7f7fe659c640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:03:09.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.785+0000 7f7fe759e640 1 -- 172.21.15.62:0/1232982704 reap_dead start 2024-02-09T08:03:09.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.785+0000 7f7fe659c640 1 -- 172.21.15.62:0/1232982704 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd4003520 con 0x7f7fd40047c0 2024-02-09T08:03:09.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.785+0000 7f7fe659c640 10 monclient: _finish_auth 0 2024-02-09T08:03:09.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.785+0000 7f7fe659c640 10 monclient: _check_auth_tickets 2024-02-09T08:03:09.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.785+0000 7f7fe659c640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:09.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.788+0000 7f7fe659c640 1 --2- 172.21.15.62:0/1232982704 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fd40047c0 0x7f7fd4004c40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0001720 tx=0x7f7fd40057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d47520f859be1bc0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:09.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.793+0000 7f7fe5d9b640 1 -- 172.21.15.62:0/1232982704 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd00052d0 con 0x7f7fd40047c0 2024-02-09T08:03:09.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.793+0000 7f7fe5d9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:09.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.793+0000 7f7fe5d9b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-09T08:03:09.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.793+0000 7f7fe5d9b640 10 monclient: dump: 2024-02-09T08:03:09.800 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:09.800 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:09.800 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:09.800 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:09.800 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:09.801 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:09.801 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:09.801 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:09.801 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:09.801 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:09.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.793+0000 7f7fe5d9b640 1 -- 172.21.15.62:0/1232982704 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd002e050 con 0x7f7fd40047c0 2024-02-09T08:03:09.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.793+0000 7f7fe5d9b640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:09.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.793+0000 7f7fe5d9b640 1 -- 172.21.15.62:0/1232982704 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd0003830 con 0x7f7fd40047c0 2024-02-09T08:03:09.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.793+0000 7f7fed066640 10 monclient: get_monmap_and_config success 2024-02-09T08:03:09.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.793+0000 7f7fed066640 4 set_mon_vals no callback set 2024-02-09T08:03:09.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.793+0000 7f7fe5d9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:09.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.793+0000 7f7fe5d9b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-09T08:03:09.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.793+0000 7f7fe5d9b640 10 monclient: dump: 2024-02-09T08:03:09.802 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:09.802 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:09.802 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:09.802 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:09.802 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:09.802 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:09.802 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:09.802 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:09.802 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:09.803 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:09.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.794+0000 7f7fed066640 10 monclient: shutdown 2024-02-09T08:03:09.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.794+0000 7f7fed066640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:09.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.794+0000 7f7fed066640 1 -- 172.21.15.62:0/1232982704 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fd40047c0 msgr2=0x7f7fd4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:09.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.794+0000 7f7fed066640 1 --2- 172.21.15.62:0/1232982704 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fd40047c0 0x7f7fd4004c40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0001720 tx=0x7f7fd40057f0 comp rx=0 tx=0).stop 2024-02-09T08:03:09.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.794+0000 7f7fed066640 1 -- 172.21.15.62:0/1232982704 shutdown_connections 2024-02-09T08:03:09.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.794+0000 7f7fed066640 1 --2- 172.21.15.62:0/1232982704 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fd40047c0 0x7f7fd4004c40 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:09.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.794+0000 7f7fed066640 1 -- 172.21.15.62:0/1232982704 >> 172.21.15.62:0/1232982704 conn(0x7f7fe80b4db0 msgr2=0x7f7fe80b51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:09.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.794+0000 7f7fed066640 1 -- 172.21.15.62:0/1232982704 shutdown_connections 2024-02-09T08:03:09.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.794+0000 7f7fed066640 1 -- 172.21.15.62:0/1232982704 wait complete. 2024-02-09T08:03:09.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.795+0000 7f7fed066640 10 monclient: build_initial_monmap 2024-02-09T08:03:09.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.795+0000 7f7fed066640 10 monclient: monmap: 2024-02-09T08:03:09.804 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:09.804 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:03:09.804 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:03:09.804 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:03:09.804 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:09.804 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:09.804 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:03:09.804 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:03:09.804 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:03:09.804 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:09.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.795+0000 7f7fed066640 1 librados: starting msgr at 2024-02-09T08:03:09.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.795+0000 7f7fed066640 1 librados: starting objecter 2024-02-09T08:03:09.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.795+0000 7f7fed066640 1 Processor -- start 2024-02-09T08:03:09.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.795+0000 7f7fed066640 1 -- start start 2024-02-09T08:03:09.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.795+0000 7f7fed066640 1 librados: setting wanted keys 2024-02-09T08:03:09.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.795+0000 7f7fed066640 1 librados: calling monclient init 2024-02-09T08:03:09.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.795+0000 7f7fed066640 10 monclient: init 2024-02-09T08:03:09.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.796+0000 7f7fed066640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:09.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.796+0000 7f7fed066640 10 monclient: _add_conns ranks=[1,0,2] 2024-02-09T08:03:09.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.796+0000 7f7fed066640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fd40047c0 0x7f7fe80b0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:09.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.796+0000 7f7fed066640 10 monclient(hunting): picked mon.noname-b con 0x7f7fd40047c0 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:03:09.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.796+0000 7f7fed066640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fe80b02d0 0x7f7fe81370a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:09.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.796+0000 7f7fed066640 10 monclient(hunting): picked mon.noname-a con 0x7f7fe80b02d0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:03:09.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.796+0000 7f7fed066640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fe81375e0 0x7f7fe81d7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:09.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.796+0000 7f7fed066640 10 monclient(hunting): picked mon.noname-c con 0x7f7fe81375e0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:09.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.796+0000 7f7fed066640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:09.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.796+0000 7f7fed066640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe80b1a00 con 0x7f7fe80b02d0 2024-02-09T08:03:09.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.796+0000 7f7fed066640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:09.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.796+0000 7f7fed066640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe8137a60 con 0x7f7fd40047c0 2024-02-09T08:03:09.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.796+0000 7f7fed066640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:09.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.796+0000 7f7fed066640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe80b0b70 con 0x7f7fe81375e0 2024-02-09T08:03:09.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.796+0000 7f7fed066640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:09.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.796+0000 7f7fed066640 10 monclient(hunting): authenticate will time out at 1433.156760s 2024-02-09T08:03:09.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.796+0000 7f7fe6d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fd40047c0 0x7f7fe80b0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:09.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.797+0000 7f7fe6d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fd40047c0 0x7f7fe80b0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.62:39866/0 (socket says 172.21.15.62:39866) 2024-02-09T08:03:09.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.797+0000 7f7fe6d9d640 1 -- 172.21.15.62:0/3563521469 learned_addr learned my addr 172.21.15.62:0/3563521469 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:09.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.797+0000 7f7fe6d9d640 10 monclient(hunting): get_auth_request con 0x7f7fd40047c0 auth_method 0 2024-02-09T08:03:09.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.797+0000 7f7fe6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:09.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.797+0000 7f7fe6d9d640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:09.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.797+0000 7f7fe6d9d640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:09.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.797+0000 7f7fe6d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:09.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.797+0000 7f7fe6d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:09.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.797+0000 7f7fe6d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:09.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.799+0000 7f7fe759e640 1 --2- 172.21.15.62:0/3563521469 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fe81375e0 0x7f7fe81d7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:09.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.799+0000 7f7fe759e640 10 monclient(hunting): get_auth_request con 0x7f7fe81375e0 auth_method 0 2024-02-09T08:03:09.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.799+0000 7f7fe759e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:09.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.799+0000 7f7fe759e640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:09.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.799+0000 7f7fe759e640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:09.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.800+0000 7f7fe759e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:09.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.800+0000 7f7fe759e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:09.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.800+0000 7f7fe759e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:09.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.800+0000 7f7fe6d9d640 10 monclient(hunting): handle_auth_done global_id 4273 payload 824 2024-02-09T08:03:09.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.800+0000 7f7fe6d9d640 1 -- 172.21.15.62:0/3563521469 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fe81375e0 msgr2=0x7f7fe81d7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:09.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.800+0000 7f7fe6d9d640 1 --2- 172.21.15.62:0/3563521469 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fe81375e0 0x7f7fe81d7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:09.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.800+0000 7f7fe6d9d640 1 -- 172.21.15.62:0/3563521469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fe80b02d0 msgr2=0x7f7fe81370a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:09.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.800+0000 7f7fe6d9d640 1 --2- 172.21.15.62:0/3563521469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fe80b02d0 0x7f7fe81370a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:09.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.800+0000 7f7fe6d9d640 10 monclient: _finish_hunting 0 2024-02-09T08:03:09.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.800+0000 7f7fe6d9d640 1 monclient: found mon.noname-b 2024-02-09T08:03:09.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.800+0000 7f7fe6d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:09.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.800+0000 7f7fe6d9d640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.103:3300/0 2024-02-09T08:03:09.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.800+0000 7f7fe6d9d640 1 -- 172.21.15.62:0/3563521469 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe8140430 con 0x7f7fd40047c0 2024-02-09T08:03:09.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.802+0000 7f7fe6d9d640 1 --2- 172.21.15.62:0/3563521469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fd40047c0 0x7f7fe80b0fc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7fe000e800 tx=0x7f7fe000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:09.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.802+0000 7f7fdf7fe640 10 client.?.objecter ms_handle_connect 0x7f7fd40047c0 2024-02-09T08:03:09.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.802+0000 7f7fdf7fe640 10 client.?.objecter resend_mon_ops 2024-02-09T08:03:09.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.806+0000 7f7fdf7fe640 1 -- 172.21.15.62:0/3563521469 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe000c6c0 con 0x7f7fd40047c0 2024-02-09T08:03:09.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.806+0000 7f7fdf7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:09.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.806+0000 7f7fdf7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:03:09.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.806+0000 7f7fdf7fe640 10 monclient: dump: 2024-02-09T08:03:09.812 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:09.812 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:09.812 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:09.812 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:09.812 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:09.812 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:09.812 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:09.813 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:09.813 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:09.813 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:09.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.806+0000 7f7fdf7fe640 10 monclient: _finish_auth 0 2024-02-09T08:03:09.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.806+0000 7f7fdf7fe640 10 monclient: _check_auth_tickets 2024-02-09T08:03:09.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.806+0000 7f7fdf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:09.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.806+0000 7f7fdf7fe640 1 -- 172.21.15.62:0/3563521469 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fe000c840 con 0x7f7fd40047c0 2024-02-09T08:03:09.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.806+0000 7f7fdf7fe640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:09.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.806+0000 7f7fdf7fe640 1 -- 172.21.15.62:0/3563521469 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe000cbf0 con 0x7f7fd40047c0 2024-02-09T08:03:09.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.806+0000 7f7fed066640 5 monclient: authenticate success, global_id 4273 2024-02-09T08:03:09.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.806+0000 7f7fed066640 10 monclient: _renew_subs 2024-02-09T08:03:09.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.806+0000 7f7fed066640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:09.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.806+0000 7f7fed066640 1 -- 172.21.15.62:0/3563521469 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fe80b0800 con 0x7f7fd40047c0 2024-02-09T08:03:09.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.806+0000 7f7fe559a640 4 set_mon_vals no callback set 2024-02-09T08:03:09.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.806+0000 7f7fdf7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:09.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.806+0000 7f7fdf7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:03:09.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.806+0000 7f7fdf7fe640 10 monclient: dump: 2024-02-09T08:03:09.814 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:09.814 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:09.814 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:09.814 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:09.814 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:09.814 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:09.814 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:09.814 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:09.814 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:09.814 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:09.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.806+0000 7f7fed066640 10 client.4273.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:03:09.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.806+0000 7f7fed066640 10 monclient: _renew_subs 2024-02-09T08:03:09.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.806+0000 7f7fed066640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:09.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.806+0000 7f7fed066640 1 -- 172.21.15.62:0/3563521469 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fe81d7a90 con 0x7f7fd40047c0 2024-02-09T08:03:09.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.806+0000 7f7fed066640 1 librados: init done 2024-02-09T08:03:09.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.806+0000 7f7fed066640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:09.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.807+0000 7f7fed066640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:09.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.807+0000 7f7fed066640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:09.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.807+0000 7f7fed066640 1 -- 172.21.15.62:0/3563521469 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fe804ef90 con 0x7f7fd40047c0 2024-02-09T08:03:09.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.825+0000 7f7fdf7fe640 1 -- 172.21.15.62:0/3563521469 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f7fe000cd50 con 0x7f7fd40047c0 2024-02-09T08:03:09.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.826+0000 7f7fdf7fe640 1 --2- 172.21.15.62:0/3563521469 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f7fc806d1f0 0x7f7fc806f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:09.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.826+0000 7f7fe659c640 1 --2- 172.21.15.62:0/3563521469 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f7fc806d1f0 0x7f7fc806f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:09.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.826+0000 7f7fe659c640 10 monclient: get_auth_request con 0x7f7fc806d1f0 auth_method 0 2024-02-09T08:03:09.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.827+0000 7f7fdf7fe640 10 client.4273.objecter ms_handle_connect 0x7f7fc806d1f0 2024-02-09T08:03:09.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.827+0000 7f7fe659c640 1 --2- 172.21.15.62:0/3563521469 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f7fc806d1f0 0x7f7fc806f6b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0033000 tx=0x7f7fd002f000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:09.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.827+0000 7f7fdf7fe640 1 -- 172.21.15.62:0/3563521469 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7fe0059970 con 0x7f7fd40047c0 2024-02-09T08:03:09.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.827+0000 7f7fdf7fe640 10 client.4273.objecter ms_dispatch 0x7f7fe8000b90 osd_map(22..22 src has 1..22) v4 2024-02-09T08:03:09.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.827+0000 7f7fdf7fe640 3 client.4273.objecter handle_osd_map got epochs [22,22] > 0 2024-02-09T08:03:09.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.827+0000 7f7fdf7fe640 3 client.4273.objecter handle_osd_map decoding full epoch 22 2024-02-09T08:03:09.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:09.827+0000 7f7fdf7fe640 20 client.4273.objecter dump_active .. 0 homeless 2024-02-09T08:03:10.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:10.060+0000 7f7fdf7fe640 1 -- 172.21.15.62:0/3563521469 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7fe0055510 con 0x7f7fd40047c0 2024-02-09T08:03:10.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:10.060+0000 7f7fdf7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:10.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:10.060+0000 7f7fdf7fe640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:03:10.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:10.253+0000 7f7fed066640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2024-02-09T08:03:10.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:10.253+0000 7f7fed066640 10 monclient: _send_command 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2024-02-09T08:03:10.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:10.253+0000 7f7fed066640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:10.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:10.253+0000 7f7fed066640 1 -- 172.21.15.62:0/3563521469 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f7fe8071270 con 0x7f7fd40047c0 2024-02-09T08:03:10.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:10.913+0000 7f7fdf7fe640 1 -- 172.21.15.62:0/3563521469 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v23) v1 ==== 109+0+0 (secure 0 0 0) 0x7f7fe0001b40 con 0x7f7fd40047c0 2024-02-09T08:03:10.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:10.913+0000 7f7fdf7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2024-02-09T08:03:10.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:10.913+0000 7f7fdf7fe640 10 monclient: _finish_command 2 = system:0 pool 'rbd' created 2024-02-09T08:03:10.916 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'rbd' created 2024-02-09T08:03:10.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:10.915+0000 7f7fed066640 10 librados: watch_flush enter 2024-02-09T08:03:10.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:10.915+0000 7f7fed066640 10 librados: watch_flush exit 2024-02-09T08:03:10.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:10.915+0000 7f7fed066640 20 client.4273.objecter shutdown clearing up homeless session... 2024-02-09T08:03:10.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:10.915+0000 7f7fed066640 10 client.4273.objecter successfully canceled tick 2024-02-09T08:03:10.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:10.915+0000 7f7fed066640 1 -- 172.21.15.62:0/3563521469 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f7fc806d1f0 msgr2=0x7f7fc806f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:10.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:10.915+0000 7f7fed066640 1 --2- 172.21.15.62:0/3563521469 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f7fc806d1f0 0x7f7fc806f6b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0033000 tx=0x7f7fd002f000 comp rx=0 tx=0).stop 2024-02-09T08:03:10.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:10.915+0000 7f7fed066640 10 monclient: shutdown 2024-02-09T08:03:10.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:10.915+0000 7f7fed066640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:10.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:10.915+0000 7f7fed066640 1 -- 172.21.15.62:0/3563521469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fd40047c0 msgr2=0x7f7fe80b0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:10.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:10.915+0000 7f7fed066640 1 --2- 172.21.15.62:0/3563521469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fd40047c0 0x7f7fe80b0fc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7fe000e800 tx=0x7f7fe000ecc0 comp rx=0 tx=0).stop 2024-02-09T08:03:10.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:10.915+0000 7f7fed066640 1 -- 172.21.15.62:0/3563521469 shutdown_connections 2024-02-09T08:03:10.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:10.915+0000 7f7fed066640 1 --2- 172.21.15.62:0/3563521469 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f7fc806d1f0 0x7f7fc806f6b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:10.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:10.915+0000 7f7fed066640 1 --2- 172.21.15.62:0/3563521469 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fe81375e0 0x7f7fe81d7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:10.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:10.915+0000 7f7fed066640 1 --2- 172.21.15.62:0/3563521469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fe80b02d0 0x7f7fe81370a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:10.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:10.915+0000 7f7fed066640 1 --2- 172.21.15.62:0/3563521469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fd40047c0 0x7f7fe80b0fc0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:10.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:10.915+0000 7f7fed066640 1 -- 172.21.15.62:0/3563521469 >> 172.21.15.62:0/3563521469 conn(0x7f7fe80b4db0 msgr2=0x7f7fe80b2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:10.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:10.915+0000 7f7fed066640 1 -- 172.21.15.62:0/3563521469 shutdown_connections 2024-02-09T08:03:10.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:10.915+0000 7f7fed066640 1 -- 172.21.15.62:0/3563521469 wait complete. 2024-02-09T08:03:10.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:10.915+0000 7f7fed066640 1 librados: shutdown 2024-02-09T08:03:10.929 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-02-09T08:03:11.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.034+0000 7f568cfcf640 10 monclient: get_monmap_and_config 2024-02-09T08:03:11.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.034+0000 7f568cfcf640 10 monclient: build_initial_monmap 2024-02-09T08:03:11.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.034+0000 7f568cfcf640 10 monclient: monmap: 2024-02-09T08:03:11.037 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:11.037 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:11.037 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:03:11.035455+0000 2024-02-09T08:03:11.038 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:03:11.035455+0000 2024-02-09T08:03:11.038 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:11.040 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:11.040 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:03:11.040 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:03:11.040 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:03:11.040 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:03:11.040 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:03:11.040 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:11.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.034+0000 7f568cfcf640 1 Processor -- start 2024-02-09T08:03:11.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.035+0000 7f568cfcf640 1 -- start start 2024-02-09T08:03:11.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.035+0000 7f568cfcf640 10 monclient: init 2024-02-09T08:03:11.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.035+0000 7f568cfcf640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:11.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.035+0000 7f568cfcf640 10 monclient: _add_conns ranks=[4,3,0,1,2] 2024-02-09T08:03:11.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.035+0000 7f568cfcf640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f568806be10 0x7f56880a9670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:11.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.035+0000 7f568cfcf640 10 monclient(hunting): picked mon.noname-c con 0x7f568806be10 addr v2:172.21.15.103:3300/0 2024-02-09T08:03:11.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.035+0000 7f568cfcf640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f56880b44c0 0x7f568813f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:11.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.035+0000 7f568cfcf640 10 monclient(hunting): picked mon.noname-a con 0x7f56880b44c0 addr v2:172.21.15.62:3300/0 2024-02-09T08:03:11.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.035+0000 7f568cfcf640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f568813fd70 addr v1:172.21.15.62:6789/0 2024-02-09T08:03:11.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.035+0000 7f568cfcf640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56881401a0 con 0x7f568813fd70 2024-02-09T08:03:11.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.035+0000 7f568cfcf640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:11.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.035+0000 7f568cfcf640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f568806c1f0 con 0x7f56880b44c0 2024-02-09T08:03:11.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.035+0000 7f568cfcf640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:11.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.035+0000 7f568cfcf640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56880a9e90 con 0x7f568806be10 2024-02-09T08:03:11.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.035+0000 7f568cfcf640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:11.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.035+0000 7f568cfcf640 10 monclient(hunting): authenticate will time out at 1434.396074s 2024-02-09T08:03:11.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.036+0000 7f5685d9b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f56880b44c0 0x7f568813f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:11.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.036+0000 7f568659c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f568806be10 0x7f56880a9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:11.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.036+0000 7f5686d9d640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f568813fd70 0x7f5688145a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34402/0 (socket says 172.21.15.62:34402) 2024-02-09T08:03:11.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.036+0000 7f5686d9d640 1 -- 172.21.15.62:0/1391797388 learned_addr learned my addr 172.21.15.62:0/1391797388 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-09T08:03:11.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.036+0000 7f568659c640 10 monclient(hunting): get_auth_request con 0x7f568806be10 auth_method 0 2024-02-09T08:03:11.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.036+0000 7f568659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:11.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.036+0000 7f568659c640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:11.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.036+0000 7f568659c640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:11.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.037+0000 7f5685d9b640 10 monclient(hunting): get_auth_request con 0x7f56880b44c0 auth_method 0 2024-02-09T08:03:11.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.037+0000 7f5685d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:11.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.037+0000 7f5685d9b640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:11.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.037+0000 7f5685d9b640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:11.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.037+0000 7f568659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:11.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.037+0000 7f568659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:11.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.037+0000 7f568659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:11.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.037+0000 7f5685d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:11.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.037+0000 7f5685d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:11.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.037+0000 7f5685d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:11.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.039+0000 7f5685d9b640 10 monclient(hunting): handle_auth_done global_id 4254 payload 274 2024-02-09T08:03:11.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.039+0000 7f5685d9b640 1 -- 172.21.15.62:0/1391797388 >> v2:172.21.15.103:3300/0 conn(0x7f568806be10 msgr2=0x7f56880a9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:11.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.039+0000 7f5685d9b640 1 --2- 172.21.15.62:0/1391797388 >> v2:172.21.15.103:3300/0 conn(0x7f568806be10 0x7f56880a9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:11.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.039+0000 7f5685d9b640 1 -- 172.21.15.62:0/1391797388 >> v1:172.21.15.62:6789/0 conn(0x7f568813fd70 legacy=0x7f5688145a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:11.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.039+0000 7f5685d9b640 10 monclient: _finish_hunting 0 2024-02-09T08:03:11.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.039+0000 7f5685d9b640 1 monclient: found mon.noname-a 2024-02-09T08:03:11.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.039+0000 7f5685d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:11.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.039+0000 7f5685d9b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-02-09T08:03:11.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.039+0000 7f5685d9b640 1 -- 172.21.15.62:0/1391797388 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56880a9bb0 con 0x7f56880b44c0 2024-02-09T08:03:11.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.041+0000 7f5685d9b640 1 --2- 172.21.15.62:0/1391797388 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56880b44c0 0x7f568813f830 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f568806c430 tx=0x7f567002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9403307ceabe5e80 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:11.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.046+0000 7f568559a640 1 -- 172.21.15.62:0/1391797388 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f567002e070 con 0x7f56880b44c0 2024-02-09T08:03:11.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.046+0000 7f568559a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:11.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.046+0000 7f568559a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-09T08:03:11.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.046+0000 7f568559a640 10 monclient: dump: 2024-02-09T08:03:11.049 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:11.049 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:11.049 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:11.049 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:11.049 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:11.049 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:11.049 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:11.049 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:11.049 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:11.049 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:11.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.046+0000 7f568559a640 10 monclient: _finish_auth 0 2024-02-09T08:03:11.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.046+0000 7f568559a640 10 monclient: _check_auth_tickets 2024-02-09T08:03:11.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.046+0000 7f568559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:11.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.046+0000 7f568559a640 1 -- 172.21.15.62:0/1391797388 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56700315a0 con 0x7f56880b44c0 2024-02-09T08:03:11.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.046+0000 7f568559a640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:11.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.046+0000 7f568cfcf640 5 monclient: authenticate success, global_id 4254 2024-02-09T08:03:11.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.046+0000 7f568559a640 1 -- 172.21.15.62:0/1391797388 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5670031930 con 0x7f56880b44c0 2024-02-09T08:03:11.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.046+0000 7f568559a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:11.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.046+0000 7f568559a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-09T08:03:11.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.046+0000 7f568559a640 10 monclient: dump: 2024-02-09T08:03:11.050 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:11.050 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:11.050 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:11.050 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:11.050 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:11.050 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:11.050 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:11.050 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:11.050 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:11.050 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:11.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.046+0000 7f568cfcf640 10 monclient: get_monmap_and_config success 2024-02-09T08:03:11.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.046+0000 7f568cfcf640 4 set_mon_vals no callback set 2024-02-09T08:03:11.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.047+0000 7f568cfcf640 10 monclient: shutdown 2024-02-09T08:03:11.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.047+0000 7f568cfcf640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:11.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.047+0000 7f568cfcf640 1 -- 172.21.15.62:0/1391797388 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56880b44c0 msgr2=0x7f568813f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:11.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.047+0000 7f568cfcf640 1 --2- 172.21.15.62:0/1391797388 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56880b44c0 0x7f568813f830 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f568806c430 tx=0x7f567002b840 comp rx=0 tx=0).stop 2024-02-09T08:03:11.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.047+0000 7f568cfcf640 1 -- 172.21.15.62:0/1391797388 shutdown_connections 2024-02-09T08:03:11.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.047+0000 7f568cfcf640 1 --2- 172.21.15.62:0/1391797388 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56880b44c0 0x7f568813f830 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:11.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.047+0000 7f568cfcf640 1 --2- 172.21.15.62:0/1391797388 >> v2:172.21.15.103:3300/0 conn(0x7f568806be10 0x7f56880a9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:11.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.047+0000 7f568cfcf640 1 -- 172.21.15.62:0/1391797388 >> 172.21.15.62:0/1391797388 conn(0x7f56880b8070 msgr2=0x7f56880b8480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:11.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.047+0000 7f568cfcf640 1 -- 172.21.15.62:0/1391797388 shutdown_connections 2024-02-09T08:03:11.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.047+0000 7f568cfcf640 1 -- 172.21.15.62:0/1391797388 wait complete. 2024-02-09T08:03:11.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.048+0000 7f568cfcf640 10 monclient: build_initial_monmap 2024-02-09T08:03:11.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.048+0000 7f568cfcf640 10 monclient: monmap: 2024-02-09T08:03:11.055 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:11.055 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:03:11.055 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:03:11.055 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:03:11.055 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:11.055 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:11.055 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:03:11.055 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:03:11.055 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:03:11.055 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:11.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.048+0000 7f568cfcf640 1 librados: starting msgr at 2024-02-09T08:03:11.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.048+0000 7f568cfcf640 1 librados: starting objecter 2024-02-09T08:03:11.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.048+0000 7f568cfcf640 1 Processor -- start 2024-02-09T08:03:11.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.048+0000 7f568cfcf640 1 -- start start 2024-02-09T08:03:11.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.048+0000 7f568cfcf640 1 librados: setting wanted keys 2024-02-09T08:03:11.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.048+0000 7f568cfcf640 1 librados: calling monclient init 2024-02-09T08:03:11.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.048+0000 7f568cfcf640 10 monclient: init 2024-02-09T08:03:11.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.049+0000 7f568cfcf640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:11.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.049+0000 7f568cfcf640 10 monclient: _add_conns ranks=[2,1,0] 2024-02-09T08:03:11.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.049+0000 7f568cfcf640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f568806be10 0x7f56881411c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:11.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.049+0000 7f568cfcf640 10 monclient(hunting): picked mon.noname-c con 0x7f568806be10 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:11.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.049+0000 7f568cfcf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56880b44c0 0x7f56881417c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:11.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.049+0000 7f568cfcf640 10 monclient(hunting): picked mon.noname-b con 0x7f56880b44c0 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:03:11.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.049+0000 7f568cfcf640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f568813fd70 0x7f568813a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:11.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.049+0000 7f568cfcf640 10 monclient(hunting): picked mon.noname-a con 0x7f568813fd70 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:03:11.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.049+0000 7f568cfcf640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:11.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.049+0000 7f568cfcf640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56881420f0 con 0x7f568813fd70 2024-02-09T08:03:11.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.049+0000 7f568cfcf640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:11.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.049+0000 7f568cfcf640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5688142580 con 0x7f56880b44c0 2024-02-09T08:03:11.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.049+0000 7f568cfcf640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:11.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.049+0000 7f568cfcf640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5688140350 con 0x7f568806be10 2024-02-09T08:03:11.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.049+0000 7f568cfcf640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:11.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.049+0000 7f568cfcf640 10 monclient(hunting): authenticate will time out at 1434.409696s 2024-02-09T08:03:11.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.049+0000 7f5686d9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f568813fd70 0x7f568813a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:11.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.050+0000 7f5685d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56880b44c0 0x7f56881417c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:11.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.050+0000 7f568659c640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f568806be10 0x7f56881411c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:11.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.050+0000 7f5686d9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f568813fd70 0x7f568813a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:34742/0 (socket says 172.21.15.62:34742) 2024-02-09T08:03:11.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.050+0000 7f5686d9d640 1 -- 172.21.15.62:0/4224264584 learned_addr learned my addr 172.21.15.62:0/4224264584 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:11.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.050+0000 7f5686d9d640 10 monclient(hunting): get_auth_request con 0x7f568813fd70 auth_method 0 2024-02-09T08:03:11.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.050+0000 7f5686d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:11.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.050+0000 7f5686d9d640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:11.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.050+0000 7f5686d9d640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:11.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.050+0000 7f5685d9b640 10 monclient(hunting): get_auth_request con 0x7f56880b44c0 auth_method 0 2024-02-09T08:03:11.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.050+0000 7f5685d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:11.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.050+0000 7f5685d9b640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:11.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.050+0000 7f5685d9b640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:11.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.050+0000 7f568659c640 10 monclient(hunting): get_auth_request con 0x7f568806be10 auth_method 0 2024-02-09T08:03:11.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.050+0000 7f568659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:11.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.050+0000 7f568659c640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:11.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.050+0000 7f568659c640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:11.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.050+0000 7f5685d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:11.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.050+0000 7f5685d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:11.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.050+0000 7f5685d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:11.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.050+0000 7f5686d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:11.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.050+0000 7f5686d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:11.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.050+0000 7f5686d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:11.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.051+0000 7f568659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:11.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.051+0000 7f568659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:11.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.051+0000 7f568659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:11.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.053+0000 7f5685d9b640 10 monclient(hunting): handle_auth_done global_id 4279 payload 824 2024-02-09T08:03:11.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.053+0000 7f5685d9b640 1 -- 172.21.15.62:0/4224264584 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f568806be10 msgr2=0x7f56881411c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:11.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.053+0000 7f5685d9b640 1 --2- 172.21.15.62:0/4224264584 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f568806be10 0x7f56881411c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:11.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.053+0000 7f5685d9b640 1 -- 172.21.15.62:0/4224264584 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f568813fd70 msgr2=0x7f568813a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:11.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.053+0000 7f5685d9b640 1 --2- 172.21.15.62:0/4224264584 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f568813fd70 0x7f568813a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:11.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.053+0000 7f5685d9b640 10 monclient: _finish_hunting 0 2024-02-09T08:03:11.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.053+0000 7f5685d9b640 1 monclient: found mon.noname-b 2024-02-09T08:03:11.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.053+0000 7f5685d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:11.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.053+0000 7f5685d9b640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.103:3300/0 2024-02-09T08:03:11.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.053+0000 7f5685d9b640 1 -- 172.21.15.62:0/4224264584 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5670009400 con 0x7f56880b44c0 2024-02-09T08:03:11.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.056+0000 7f5685d9b640 1 --2- 172.21.15.62:0/4224264584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56880b44c0 0x7f56881417c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5670033000 tx=0x7f56700046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:11.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.056+0000 7f567effd640 10 client.?.objecter ms_handle_connect 0x7f56880b44c0 2024-02-09T08:03:11.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.056+0000 7f567effd640 10 client.?.objecter resend_mon_ops 2024-02-09T08:03:11.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.064+0000 7f567effd640 1 -- 172.21.15.62:0/4224264584 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5670032840 con 0x7f56880b44c0 2024-02-09T08:03:11.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.064+0000 7f567effd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:11.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.064+0000 7f567effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:03:11.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.064+0000 7f567effd640 10 monclient: dump: 2024-02-09T08:03:11.068 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:11.069 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:11.069 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:11.069 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:11.069 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:11.069 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:11.069 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:11.069 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:11.069 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:11.069 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:11.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.064+0000 7f567effd640 10 monclient: _finish_auth 0 2024-02-09T08:03:11.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.064+0000 7f567effd640 10 monclient: _check_auth_tickets 2024-02-09T08:03:11.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.064+0000 7f567effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:11.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.064+0000 7f568cfcf640 5 monclient: authenticate success, global_id 4279 2024-02-09T08:03:11.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.064+0000 7f567effd640 1 -- 172.21.15.62:0/4224264584 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56700329a0 con 0x7f56880b44c0 2024-02-09T08:03:11.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.064+0000 7f567effd640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:11.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.064+0000 7f567effd640 1 -- 172.21.15.62:0/4224264584 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5670032d50 con 0x7f56880b44c0 2024-02-09T08:03:11.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.064+0000 7f567effd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:11.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.064+0000 7f567effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:03:11.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.064+0000 7f567effd640 10 monclient: dump: 2024-02-09T08:03:11.070 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:11.070 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:11.070 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:11.070 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:11.070 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:11.070 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:11.070 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:11.070 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:11.070 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:11.070 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:11.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.064+0000 7f5684d99640 4 set_mon_vals no callback set 2024-02-09T08:03:11.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.064+0000 7f568cfcf640 10 monclient: _renew_subs 2024-02-09T08:03:11.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.064+0000 7f568cfcf640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:11.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.064+0000 7f568cfcf640 1 -- 172.21.15.62:0/4224264584 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5688141d00 con 0x7f56880b44c0 2024-02-09T08:03:11.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.064+0000 7f568cfcf640 10 client.4279.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:03:11.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.064+0000 7f568cfcf640 10 monclient: _renew_subs 2024-02-09T08:03:11.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.064+0000 7f568cfcf640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:11.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.064+0000 7f568cfcf640 1 -- 172.21.15.62:0/4224264584 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f568813afe0 con 0x7f56880b44c0 2024-02-09T08:03:11.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.064+0000 7f568cfcf640 1 librados: init done 2024-02-09T08:03:11.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.065+0000 7f568cfcf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:11.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.065+0000 7f568cfcf640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:11.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.065+0000 7f568cfcf640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:11.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.065+0000 7f568cfcf640 1 -- 172.21.15.62:0/4224264584 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56881422a0 con 0x7f56880b44c0 2024-02-09T08:03:11.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.330+0000 7f567effd640 1 -- 172.21.15.62:0/4224264584 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f567004e430 con 0x7f56880b44c0 2024-02-09T08:03:11.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.330+0000 7f567effd640 1 --2- 172.21.15.62:0/4224264584 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f566806d1f0 0x7f566806f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:11.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.331+0000 7f568659c640 1 --2- 172.21.15.62:0/4224264584 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f566806d1f0 0x7f566806f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:11.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.331+0000 7f568659c640 10 monclient: get_auth_request con 0x7f566806d1f0 auth_method 0 2024-02-09T08:03:11.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.331+0000 7f568659c640 1 --2- 172.21.15.62:0/4224264584 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f566806d1f0 0x7f566806f6b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5680009b40 tx=0x7f5680009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:11.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.331+0000 7f567effd640 10 client.4279.objecter ms_handle_connect 0x7f566806d1f0 2024-02-09T08:03:11.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.335+0000 7f567effd640 1 -- 172.21.15.62:0/4224264584 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5199+0+0 (secure 0 0 0) 0x7f567007aa80 con 0x7f56880b44c0 2024-02-09T08:03:11.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.335+0000 7f567effd640 10 client.4279.objecter ms_dispatch 0x7f5688000b90 osd_map(23..23 src has 1..23) v4 2024-02-09T08:03:11.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.335+0000 7f567effd640 3 client.4279.objecter handle_osd_map got epochs [23,23] > 0 2024-02-09T08:03:11.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.335+0000 7f567effd640 3 client.4279.objecter handle_osd_map decoding full epoch 23 2024-02-09T08:03:11.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.335+0000 7f567effd640 20 client.4279.objecter dump_active .. 0 homeless 2024-02-09T08:03:11.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.346+0000 7f567effd640 1 -- 172.21.15.62:0/4224264584 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5670076d20 con 0x7f56880b44c0 2024-02-09T08:03:11.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.346+0000 7f567effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:11.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.346+0000 7f567effd640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:03:11.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.562+0000 7f568cfcf640 10 start_mon_command cmd=[{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}] 2024-02-09T08:03:11.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.562+0000 7f568cfcf640 10 monclient: _send_command 2 [{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}] 2024-02-09T08:03:11.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.562+0000 7f568cfcf640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:11.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.562+0000 7f568cfcf640 1 -- 172.21.15.62:0/4224264584 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f56881422a0 con 0x7f56880b44c0 2024-02-09T08:03:11.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.984+0000 7f567effd640 1 -- 172.21.15.62:0/4224264584 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v24) v1 ==== 173+0+0 (secure 0 0 0) 0x7f56881422a0 con 0x7f56880b44c0 2024-02-09T08:03:11.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.984+0000 7f567effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}] 2024-02-09T08:03:11.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.984+0000 7f567effd640 10 monclient: _finish_command 2 = system:0 enabled application 'rbd' on pool 'rbd' 2024-02-09T08:03:11.986 INFO:teuthology.orchestra.run.smithi062.stderr:enabled application 'rbd' on pool 'rbd' 2024-02-09T08:03:11.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.986+0000 7f568cfcf640 10 librados: watch_flush enter 2024-02-09T08:03:11.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.986+0000 7f568cfcf640 10 librados: watch_flush exit 2024-02-09T08:03:11.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.986+0000 7f568cfcf640 20 client.4279.objecter shutdown clearing up homeless session... 2024-02-09T08:03:11.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.986+0000 7f568cfcf640 10 client.4279.objecter successfully canceled tick 2024-02-09T08:03:11.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.986+0000 7f568cfcf640 1 -- 172.21.15.62:0/4224264584 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f566806d1f0 msgr2=0x7f566806f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:11.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.986+0000 7f568cfcf640 1 --2- 172.21.15.62:0/4224264584 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f566806d1f0 0x7f566806f6b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5680009b40 tx=0x7f5680009190 comp rx=0 tx=0).stop 2024-02-09T08:03:11.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.986+0000 7f568cfcf640 10 monclient: shutdown 2024-02-09T08:03:11.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.986+0000 7f568cfcf640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:11.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.986+0000 7f568cfcf640 1 -- 172.21.15.62:0/4224264584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56880b44c0 msgr2=0x7f56881417c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:11.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.986+0000 7f568cfcf640 1 --2- 172.21.15.62:0/4224264584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56880b44c0 0x7f56881417c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5670033000 tx=0x7f56700046c0 comp rx=0 tx=0).stop 2024-02-09T08:03:11.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.986+0000 7f568cfcf640 1 -- 172.21.15.62:0/4224264584 shutdown_connections 2024-02-09T08:03:11.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.986+0000 7f568cfcf640 1 --2- 172.21.15.62:0/4224264584 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f566806d1f0 0x7f566806f6b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:11.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.986+0000 7f568cfcf640 1 --2- 172.21.15.62:0/4224264584 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f568813fd70 0x7f568813a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:11.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.986+0000 7f568cfcf640 1 --2- 172.21.15.62:0/4224264584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56880b44c0 0x7f56881417c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:11.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.986+0000 7f568cfcf640 1 --2- 172.21.15.62:0/4224264584 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f568806be10 0x7f56881411c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:11.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.986+0000 7f568cfcf640 1 -- 172.21.15.62:0/4224264584 >> 172.21.15.62:0/4224264584 conn(0x7f56880b8070 msgr2=0x7f56880b48f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:11.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.986+0000 7f568cfcf640 1 -- 172.21.15.62:0/4224264584 shutdown_connections 2024-02-09T08:03:11.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.986+0000 7f568cfcf640 1 -- 172.21.15.62:0/4224264584 wait complete. 2024-02-09T08:03:11.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:11.986+0000 7f568cfcf640 1 librados: shutdown 2024-02-09T08:03:12.000 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-02-09T08:03:12.001 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-02-09T08:03:12.001 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-02-09T08:03:12.001 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-02-09T08:03:12.001 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-02-09T08:03:12.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.105+0000 7fb8af9cf640 10 monclient: get_monmap_and_config 2024-02-09T08:03:12.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.105+0000 7fb8af9cf640 10 monclient: build_initial_monmap 2024-02-09T08:03:12.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.105+0000 7fb8af9cf640 10 monclient: monmap: 2024-02-09T08:03:12.108 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:12.108 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:12.108 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:03:12.106789+0000 2024-02-09T08:03:12.108 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:03:12.106789+0000 2024-02-09T08:03:12.108 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:12.108 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:12.108 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:03:12.108 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:03:12.108 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:03:12.108 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:03:12.108 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:03:12.109 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:12.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.106+0000 7fb8af9cf640 1 Processor -- start 2024-02-09T08:03:12.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.106+0000 7fb8af9cf640 1 -- start start 2024-02-09T08:03:12.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.106+0000 7fb8af9cf640 10 monclient: init 2024-02-09T08:03:12.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.107+0000 7fb8af9cf640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:12.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.107+0000 7fb8af9cf640 10 monclient: _add_conns ranks=[3,2,4,0,1] 2024-02-09T08:03:12.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.107+0000 7fb8af9cf640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb8a80b5000 0x7fb8a813f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:12.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.107+0000 7fb8af9cf640 10 monclient(hunting): picked mon.noname-a con 0x7fb8a80b5000 addr v2:172.21.15.62:3300/0 2024-02-09T08:03:12.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.107+0000 7fb8af9cf640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb8a80a9e30 0x7fb8a813fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:12.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.107+0000 7fb8af9cf640 10 monclient(hunting): picked mon.noname-b con 0x7fb8a80a9e30 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:12.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.107+0000 7fb8af9cf640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb8a8145de0 0x7fb8a81461f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:12.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.107+0000 7fb8af9cf640 10 monclient(hunting): picked mon.noname-c con 0x7fb8a8145de0 addr v2:172.21.15.103:3300/0 2024-02-09T08:03:12.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.107+0000 7fb8af9cf640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:12.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.107+0000 7fb8af9cf640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8a8140160 con 0x7fb8a80b5000 2024-02-09T08:03:12.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.107+0000 7fb8af9cf640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:12.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.107+0000 7fb8af9cf640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8a80b53e0 con 0x7fb8a8145de0 2024-02-09T08:03:12.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.107+0000 7fb8af9cf640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:12.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.107+0000 7fb8af9cf640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a80aa4a0 con 0x7fb8a80a9e30 2024-02-09T08:03:12.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.107+0000 7fb8af9cf640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:12.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.107+0000 7fb8af9cf640 10 monclient(hunting): authenticate will time out at 1435.467436s 2024-02-09T08:03:12.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.107+0000 7fb8acf6a640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb8a80a9e30 0x7fb8a813fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:12.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.108+0000 7fb8acf6a640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb8a80a9e30 0x7fb8a813fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:60854/0 (socket says 172.21.15.62:60854) 2024-02-09T08:03:12.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.108+0000 7fb8acf6a640 1 -- 172.21.15.62:0/2640491538 learned_addr learned my addr 172.21.15.62:0/2640491538 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:12.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.108+0000 7fb8acf6a640 10 monclient(hunting): get_auth_request con 0x7fb8a80a9e30 auth_method 0 2024-02-09T08:03:12.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.108+0000 7fb8acf6a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:12.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.108+0000 7fb8acf6a640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:12.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.108+0000 7fb8acf6a640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:12.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.108+0000 7fb8ad76b640 1 --2- 172.21.15.62:0/2640491538 >> v2:172.21.15.62:3300/0 conn(0x7fb8a80b5000 0x7fb8a813f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:12.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.109+0000 7fb8acf6a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:12.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.109+0000 7fb8acf6a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:12.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.109+0000 7fb8acf6a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:12.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.109+0000 7fb8ad76b640 10 monclient(hunting): get_auth_request con 0x7fb8a80b5000 auth_method 0 2024-02-09T08:03:12.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.109+0000 7fb8ad76b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:12.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.109+0000 7fb8ad76b640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:12.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.109+0000 7fb8ad76b640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:12.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.110+0000 7fb8ad76b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:12.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.110+0000 7fb8ad76b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:12.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.110+0000 7fb8ad76b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:12.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.113+0000 7fb8ad76b640 10 monclient(hunting): handle_auth_done global_id 4260 payload 274 2024-02-09T08:03:12.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.113+0000 7fb8ad76b640 1 -- 172.21.15.62:0/2640491538 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb8a80a9e30 msgr2=0x7fb8a813fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:12.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.113+0000 7fb8ad76b640 1 --2- 172.21.15.62:0/2640491538 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb8a80a9e30 0x7fb8a813fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:12.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.113+0000 7fb8ad76b640 1 -- 172.21.15.62:0/2640491538 >> v2:172.21.15.103:3300/0 conn(0x7fb8a8145de0 msgr2=0x7fb8a81461f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:12.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.113+0000 7fb8ad76b640 1 --2- 172.21.15.62:0/2640491538 >> v2:172.21.15.103:3300/0 conn(0x7fb8a8145de0 0x7fb8a81461f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:12.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.113+0000 7fb8ad76b640 10 monclient: _finish_hunting 0 2024-02-09T08:03:12.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.113+0000 7fb8ad76b640 1 monclient: found mon.noname-a 2024-02-09T08:03:12.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.113+0000 7fb8ad76b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:12.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.113+0000 7fb8ad76b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-02-09T08:03:12.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.113+0000 7fb8ad76b640 1 -- 172.21.15.62:0/2640491538 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a80b2900 con 0x7fb8a80b5000 2024-02-09T08:03:12.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.115+0000 7fb8ad76b640 1 --2- 172.21.15.62:0/2640491538 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8a80b5000 0x7fb8a813f6e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb8a80b27b0 tx=0x7fb8a402b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28cea0df880d8c43 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:12.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.129+0000 7fb89ffff640 1 -- 172.21.15.62:0/2640491538 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a402f050 con 0x7fb8a80b5000 2024-02-09T08:03:12.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.129+0000 7fb89ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:12.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.129+0000 7fb89ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-09T08:03:12.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.129+0000 7fb89ffff640 10 monclient: dump: 2024-02-09T08:03:12.139 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:12.139 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:12.139 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:12.139 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:12.139 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:12.139 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:12.139 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:12.139 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:12.139 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:12.139 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:12.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.129+0000 7fb89ffff640 10 monclient: _finish_auth 0 2024-02-09T08:03:12.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.129+0000 7fb89ffff640 10 monclient: _check_auth_tickets 2024-02-09T08:03:12.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.129+0000 7fb89ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:12.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.129+0000 7fb89ffff640 1 -- 172.21.15.62:0/2640491538 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a4031700 con 0x7fb8a80b5000 2024-02-09T08:03:12.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.129+0000 7fb89ffff640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:12.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.129+0000 7fb89ffff640 1 -- 172.21.15.62:0/2640491538 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a4031a90 con 0x7fb8a80b5000 2024-02-09T08:03:12.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.129+0000 7fb8af9cf640 5 monclient: authenticate success, global_id 4260 2024-02-09T08:03:12.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.129+0000 7fb8af9cf640 10 monclient: get_monmap_and_config success 2024-02-09T08:03:12.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.129+0000 7fb89ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:12.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.129+0000 7fb8af9cf640 4 set_mon_vals no callback set 2024-02-09T08:03:12.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.129+0000 7fb89ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-09T08:03:12.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.129+0000 7fb89ffff640 10 monclient: dump: 2024-02-09T08:03:12.140 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:12.140 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:12.140 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:12.140 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:12.140 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:12.140 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:12.141 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:12.141 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:12.141 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:12.141 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:12.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.130+0000 7fb8af9cf640 10 monclient: shutdown 2024-02-09T08:03:12.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.130+0000 7fb8af9cf640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:12.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.130+0000 7fb8af9cf640 1 -- 172.21.15.62:0/2640491538 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8a80b5000 msgr2=0x7fb8a813f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:12.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.130+0000 7fb8af9cf640 1 --2- 172.21.15.62:0/2640491538 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8a80b5000 0x7fb8a813f6e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb8a80b27b0 tx=0x7fb8a402b7a0 comp rx=0 tx=0).stop 2024-02-09T08:03:12.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.130+0000 7fb8af9cf640 1 -- 172.21.15.62:0/2640491538 shutdown_connections 2024-02-09T08:03:12.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.130+0000 7fb8af9cf640 1 --2- 172.21.15.62:0/2640491538 >> v2:172.21.15.103:3300/0 conn(0x7fb8a8145de0 0x7fb8a81461f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:12.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.130+0000 7fb8af9cf640 1 --2- 172.21.15.62:0/2640491538 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb8a80a9e30 0x7fb8a813fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:12.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.130+0000 7fb8af9cf640 1 --2- 172.21.15.62:0/2640491538 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8a80b5000 0x7fb8a813f6e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:12.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.130+0000 7fb8af9cf640 1 -- 172.21.15.62:0/2640491538 >> 172.21.15.62:0/2640491538 conn(0x7fb8a8066bb0 msgr2=0x7fb8a8066fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:12.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.130+0000 7fb8af9cf640 1 -- 172.21.15.62:0/2640491538 shutdown_connections 2024-02-09T08:03:12.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.130+0000 7fb8af9cf640 1 -- 172.21.15.62:0/2640491538 wait complete. 2024-02-09T08:03:12.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.131+0000 7fb8af9cf640 10 monclient: build_initial_monmap 2024-02-09T08:03:12.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.131+0000 7fb8af9cf640 10 monclient: monmap: 2024-02-09T08:03:12.142 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:12.142 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:03:12.142 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:03:12.142 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:03:12.142 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:12.142 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:12.142 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:03:12.142 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:03:12.142 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:03:12.142 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:12.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.131+0000 7fb8af9cf640 1 librados: starting msgr at 2024-02-09T08:03:12.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.131+0000 7fb8af9cf640 1 librados: starting objecter 2024-02-09T08:03:12.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.131+0000 7fb8af9cf640 1 Processor -- start 2024-02-09T08:03:12.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.132+0000 7fb8af9cf640 1 -- start start 2024-02-09T08:03:12.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.132+0000 7fb8af9cf640 1 librados: setting wanted keys 2024-02-09T08:03:12.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.132+0000 7fb8af9cf640 1 librados: calling monclient init 2024-02-09T08:03:12.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.132+0000 7fb8af9cf640 10 monclient: init 2024-02-09T08:03:12.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.132+0000 7fb8af9cf640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:12.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.132+0000 7fb8af9cf640 10 monclient: _add_conns ranks=[1,2,0] 2024-02-09T08:03:12.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.132+0000 7fb8af9cf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8a80a9e30 0x7fb8a8142f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:12.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.132+0000 7fb8af9cf640 10 monclient(hunting): picked mon.noname-b con 0x7fb8a80a9e30 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:03:12.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.132+0000 7fb8af9cf640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb8a80b5000 0x7fb8a81410d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:12.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.132+0000 7fb8af9cf640 10 monclient(hunting): picked mon.noname-c con 0x7fb8a80b5000 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:12.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.132+0000 7fb8af9cf640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8a8145de0 0x7fb8a8134f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:12.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.132+0000 7fb8af9cf640 10 monclient(hunting): picked mon.noname-a con 0x7fb8a8145de0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:03:12.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.132+0000 7fb8af9cf640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:12.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.132+0000 7fb8af9cf640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a8141910 con 0x7fb8a8145de0 2024-02-09T08:03:12.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.132+0000 7fb8af9cf640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:12.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.132+0000 7fb8af9cf640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a8141610 con 0x7fb8a80a9e30 2024-02-09T08:03:12.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.132+0000 7fb8af9cf640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:12.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.132+0000 7fb8af9cf640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a81404e0 con 0x7fb8a80b5000 2024-02-09T08:03:12.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.132+0000 7fb8af9cf640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:12.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.132+0000 7fb8af9cf640 10 monclient(hunting): authenticate will time out at 1435.493036s 2024-02-09T08:03:12.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.133+0000 7fb8acf6a640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb8a80b5000 0x7fb8a81410d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:12.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.133+0000 7fb8ad76b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8a80a9e30 0x7fb8a8142f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:12.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.133+0000 7fb8acf6a640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb8a80b5000 0x7fb8a81410d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:60864/0 (socket says 172.21.15.62:60864) 2024-02-09T08:03:12.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.133+0000 7fb8acf6a640 1 -- 172.21.15.62:0/3796097404 learned_addr learned my addr 172.21.15.62:0/3796097404 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:12.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.133+0000 7fb8acf6a640 10 monclient(hunting): get_auth_request con 0x7fb8a80b5000 auth_method 0 2024-02-09T08:03:12.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.133+0000 7fb8acf6a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:12.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.133+0000 7fb8acf6a640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:12.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.133+0000 7fb8acf6a640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:12.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.133+0000 7fb8ad76b640 10 monclient(hunting): get_auth_request con 0x7fb8a80a9e30 auth_method 0 2024-02-09T08:03:12.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.133+0000 7fb8ad76b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:12.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.133+0000 7fb8ad76b640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:12.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.133+0000 7fb8ad76b640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:12.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.134+0000 7fb8acf6a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:12.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.134+0000 7fb8acf6a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:12.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.134+0000 7fb8acf6a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:12.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.134+0000 7fb8ad76b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:12.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.134+0000 7fb8ad76b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:12.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.134+0000 7fb8ad76b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:12.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.134+0000 7fb8adf6c640 1 --2- 172.21.15.62:0/3796097404 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8a8145de0 0x7fb8a8134f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:12.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.136+0000 7fb8adf6c640 10 monclient(hunting): get_auth_request con 0x7fb8a8145de0 auth_method 0 2024-02-09T08:03:12.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.136+0000 7fb8adf6c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:12.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.136+0000 7fb8adf6c640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:12.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.136+0000 7fb8adf6c640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:12.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.138+0000 7fb8ad76b640 10 monclient(hunting): handle_auth_done global_id 4282 payload 824 2024-02-09T08:03:12.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.138+0000 7fb8ad76b640 1 -- 172.21.15.62:0/3796097404 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb8a80b5000 msgr2=0x7fb8a81410d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:12.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.138+0000 7fb8ad76b640 1 --2- 172.21.15.62:0/3796097404 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb8a80b5000 0x7fb8a81410d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:12.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.138+0000 7fb8ad76b640 1 -- 172.21.15.62:0/3796097404 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8a8145de0 msgr2=0x7fb8a8134f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:12.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.138+0000 7fb8ad76b640 1 --2- 172.21.15.62:0/3796097404 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8a8145de0 0x7fb8a8134f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:12.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.138+0000 7fb8ad76b640 10 monclient: _finish_hunting 0 2024-02-09T08:03:12.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.138+0000 7fb8ad76b640 1 monclient: found mon.noname-b 2024-02-09T08:03:12.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.138+0000 7fb8ad76b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:12.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.138+0000 7fb8ad76b640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.103:3300/0 2024-02-09T08:03:12.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.138+0000 7fb8ad76b640 1 -- 172.21.15.62:0/3796097404 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a4009400 con 0x7fb8a80a9e30 2024-02-09T08:03:12.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.142+0000 7fb8ad76b640 1 --2- 172.21.15.62:0/3796097404 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8a80a9e30 0x7fb8a8142f60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4033000 tx=0x7fb8a40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:12.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.142+0000 7fb89dffb640 10 client.?.objecter ms_handle_connect 0x7fb8a80a9e30 2024-02-09T08:03:12.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.142+0000 7fb89dffb640 10 client.?.objecter resend_mon_ops 2024-02-09T08:03:12.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.147+0000 7fb89dffb640 1 -- 172.21.15.62:0/3796097404 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a4031500 con 0x7fb8a80a9e30 2024-02-09T08:03:12.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.147+0000 7fb89dffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:12.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.147+0000 7fb89dffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:03:12.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.147+0000 7fb89dffb640 10 monclient: dump: 2024-02-09T08:03:12.150 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:12.150 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:12.150 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:12.150 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:12.150 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:12.150 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:12.150 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:12.150 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:12.150 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:12.150 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:12.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.147+0000 7fb89dffb640 10 monclient: _finish_auth 0 2024-02-09T08:03:12.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.147+0000 7fb89dffb640 10 monclient: _check_auth_tickets 2024-02-09T08:03:12.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.147+0000 7fb89dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:12.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.147+0000 7fb89dffb640 1 -- 172.21.15.62:0/3796097404 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a4033a30 con 0x7fb8a80a9e30 2024-02-09T08:03:12.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.147+0000 7fb8af9cf640 5 monclient: authenticate success, global_id 4282 2024-02-09T08:03:12.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.147+0000 7fb8af9cf640 10 monclient: _renew_subs 2024-02-09T08:03:12.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.147+0000 7fb8af9cf640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:12.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.147+0000 7fb8af9cf640 1 -- 172.21.15.62:0/3796097404 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8a80b4870 con 0x7fb8a80a9e30 2024-02-09T08:03:12.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.147+0000 7fb89dffb640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:12.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.147+0000 7fb89dffb640 1 -- 172.21.15.62:0/3796097404 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a4033de0 con 0x7fb8a80a9e30 2024-02-09T08:03:12.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.147+0000 7fb89dffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:12.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.147+0000 7fb89dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:03:12.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.147+0000 7fb89dffb640 10 monclient: dump: 2024-02-09T08:03:12.151 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:12.151 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:12.151 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:12.151 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:12.152 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:12.152 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:12.152 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:12.152 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:12.152 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:12.152 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:12.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.147+0000 7fb89f7fe640 4 set_mon_vals no callback set 2024-02-09T08:03:12.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.147+0000 7fb8af9cf640 10 client.4282.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:03:12.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.147+0000 7fb8af9cf640 10 monclient: _renew_subs 2024-02-09T08:03:12.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.147+0000 7fb8af9cf640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:12.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.147+0000 7fb8af9cf640 1 -- 172.21.15.62:0/3796097404 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8a81356a0 con 0x7fb8a80a9e30 2024-02-09T08:03:12.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.147+0000 7fb8af9cf640 1 librados: init done 2024-02-09T08:03:12.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.148+0000 7fb8af9cf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:12.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.148+0000 7fb8af9cf640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:12.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.148+0000 7fb8af9cf640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:12.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.148+0000 7fb8af9cf640 1 -- 172.21.15.62:0/3796097404 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8a80a9670 con 0x7fb8a80a9e30 2024-02-09T08:03:12.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.172+0000 7fb89dffb640 1 -- 172.21.15.62:0/3796097404 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fb8a403a040 con 0x7fb8a80a9e30 2024-02-09T08:03:12.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.172+0000 7fb89dffb640 1 --2- 172.21.15.62:0/3796097404 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fb88c06d1d0 0x7fb88c06f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:12.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.173+0000 7fb8acf6a640 1 --2- 172.21.15.62:0/3796097404 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fb88c06d1d0 0x7fb88c06f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:12.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.173+0000 7fb8acf6a640 10 monclient: get_auth_request con 0x7fb88c06d1d0 auth_method 0 2024-02-09T08:03:12.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.173+0000 7fb89dffb640 10 client.4282.objecter ms_handle_connect 0x7fb88c06d1d0 2024-02-09T08:03:12.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.173+0000 7fb8acf6a640 1 --2- 172.21.15.62:0/3796097404 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fb88c06d1d0 0x7fb88c06f690 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb8a81424b0 tx=0x7fb898009240 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:12.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.175+0000 7fb89dffb640 1 -- 172.21.15.62:0/3796097404 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb8a407b000 con 0x7fb8a80a9e30 2024-02-09T08:03:12.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.175+0000 7fb89dffb640 10 client.4282.objecter ms_dispatch 0x7fb8a8000b90 osd_map(24..24 src has 1..24) v4 2024-02-09T08:03:12.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.175+0000 7fb89dffb640 3 client.4282.objecter handle_osd_map got epochs [24,24] > 0 2024-02-09T08:03:12.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.175+0000 7fb89dffb640 3 client.4282.objecter handle_osd_map decoding full epoch 24 2024-02-09T08:03:12.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.176+0000 7fb89dffb640 20 client.4282.objecter dump_active .. 0 homeless 2024-02-09T08:03:12.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.433+0000 7fb89dffb640 1 -- 172.21.15.62:0/3796097404 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb8a4076ba0 con 0x7fb8a80a9e30 2024-02-09T08:03:12.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.433+0000 7fb89dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:12.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.433+0000 7fb89dffb640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:03:12.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.713+0000 7fb8af9cf640 10 start_mon_command cmd=[{"prefix": "mgr dump", "format": "json"}] 2024-02-09T08:03:12.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.713+0000 7fb8af9cf640 10 monclient: _send_command 2 [{"prefix": "mgr dump", "format": "json"}] 2024-02-09T08:03:12.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.714+0000 7fb8af9cf640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:12.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.714+0000 7fb8af9cf640 1 -- 172.21.15.62:0/3796097404 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fb8a80b4670 con 0x7fb8a80a9e30 2024-02-09T08:03:12.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.848+0000 7fb89dffb640 1 -- 172.21.15.62:0/3796097404 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171801 (secure 0 0 0) 0x7fb8a4043090 con 0x7fb8a80a9e30 2024-02-09T08:03:12.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.848+0000 7fb89dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mgr dump", "format": "json"}] 2024-02-09T08:03:12.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.848+0000 7fb89dffb640 10 monclient: _finish_command 2 = system:0 2024-02-09T08:03:12.854 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T08:03:12.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.851+0000 7fb8af9cf640 10 librados: watch_flush enter 2024-02-09T08:03:12.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.851+0000 7fb8af9cf640 10 librados: watch_flush exit 2024-02-09T08:03:12.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.851+0000 7fb8af9cf640 20 client.4282.objecter shutdown clearing up homeless session... 2024-02-09T08:03:12.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.851+0000 7fb8af9cf640 10 client.4282.objecter successfully canceled tick 2024-02-09T08:03:12.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.851+0000 7fb8af9cf640 1 -- 172.21.15.62:0/3796097404 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fb88c06d1d0 msgr2=0x7fb88c06f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:12.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.851+0000 7fb8af9cf640 1 --2- 172.21.15.62:0/3796097404 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fb88c06d1d0 0x7fb88c06f690 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb8a81424b0 tx=0x7fb898009240 comp rx=0 tx=0).stop 2024-02-09T08:03:12.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.851+0000 7fb8af9cf640 10 monclient: shutdown 2024-02-09T08:03:12.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.851+0000 7fb8af9cf640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:12.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.851+0000 7fb8af9cf640 1 -- 172.21.15.62:0/3796097404 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8a80a9e30 msgr2=0x7fb8a8142f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:12.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.851+0000 7fb8af9cf640 1 --2- 172.21.15.62:0/3796097404 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8a80a9e30 0x7fb8a8142f60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4033000 tx=0x7fb8a40046c0 comp rx=0 tx=0).stop 2024-02-09T08:03:12.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.851+0000 7fb8af9cf640 1 -- 172.21.15.62:0/3796097404 shutdown_connections 2024-02-09T08:03:12.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.851+0000 7fb8af9cf640 1 --2- 172.21.15.62:0/3796097404 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fb88c06d1d0 0x7fb88c06f690 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:12.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.851+0000 7fb8af9cf640 1 --2- 172.21.15.62:0/3796097404 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8a8145de0 0x7fb8a8134f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:12.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.851+0000 7fb8af9cf640 1 --2- 172.21.15.62:0/3796097404 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb8a80b5000 0x7fb8a81410d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:12.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.851+0000 7fb8af9cf640 1 --2- 172.21.15.62:0/3796097404 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8a80a9e30 0x7fb8a8142f60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:12.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.851+0000 7fb8af9cf640 1 -- 172.21.15.62:0/3796097404 >> 172.21.15.62:0/3796097404 conn(0x7fb8a8066bb0 msgr2=0x7fb8a80b6aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:12.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.851+0000 7fb8af9cf640 1 -- 172.21.15.62:0/3796097404 shutdown_connections 2024-02-09T08:03:12.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.851+0000 7fb8af9cf640 1 -- 172.21.15.62:0/3796097404 wait complete. 2024-02-09T08:03:12.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.851+0000 7fb8af9cf640 1 librados: shutdown 2024-02-09T08:03:12.865 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":5,"flags":0,"active_gid":4109,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":2270392189},{"type":"v1","addr":"172.21.15.103:6801","nonce":2270392189}]},"active_addr":"172.21.15.103:6801/2270392189","active_change":"2024-02-09T08:02:13.465432+0000","active_mgr_features":4540701272860131327,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540701272860131327,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":893282640}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":4104213939}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":1352160758}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":3916450935}]}]} 2024-02-09T08:03:12.871 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-02-09T08:03:12.872 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-02-09T08:03:12.872 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-09T08:03:12.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.978+0000 7f303c54b640 10 monclient: get_monmap_and_config 2024-02-09T08:03:12.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.978+0000 7f303c54b640 10 monclient: build_initial_monmap 2024-02-09T08:03:12.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.978+0000 7f303c54b640 10 monclient: monmap: 2024-02-09T08:03:12.981 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:12.981 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:12.981 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:03:12.979952+0000 2024-02-09T08:03:12.981 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:03:12.979952+0000 2024-02-09T08:03:12.981 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:12.981 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:12.981 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:03:12.981 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:03:12.982 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:03:12.982 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:03:12.982 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:03:12.982 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:12.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.979+0000 7f303c54b640 1 Processor -- start 2024-02-09T08:03:12.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.979+0000 7f303c54b640 1 -- start start 2024-02-09T08:03:12.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.979+0000 7f303c54b640 10 monclient: init 2024-02-09T08:03:12.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.980+0000 7f303c54b640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:12.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.980+0000 7f303c54b640 10 monclient: _add_conns ranks=[0,2,3,1,4] 2024-02-09T08:03:12.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.980+0000 7f303c54b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f30340b5000 addr v1:172.21.15.62:6789/0 2024-02-09T08:03:12.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.980+0000 7f303c54b640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f30340a9e30 0x7f3034145de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:12.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.980+0000 7f303c54b640 10 monclient(hunting): picked mon.noname-b con 0x7f30340a9e30 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:12.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.980+0000 7f303c54b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f303413fdf0 0x7f3034146320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:12.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.980+0000 7f303c54b640 10 monclient(hunting): picked mon.noname-a con 0x7f303413fdf0 addr v2:172.21.15.62:3300/0 2024-02-09T08:03:12.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.980+0000 7f303c54b640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30340aa4a0 con 0x7f30340b5000 2024-02-09T08:03:12.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.980+0000 7f303c54b640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:12.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.980+0000 7f303c54b640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30340b53e0 con 0x7f303413fdf0 2024-02-09T08:03:12.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.980+0000 7f303c54b640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:12.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.980+0000 7f303c54b640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3034146860 con 0x7f30340a9e30 2024-02-09T08:03:12.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.980+0000 7f303c54b640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:12.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.980+0000 7f303c54b640 10 monclient(hunting): authenticate will time out at 1436.340530s 2024-02-09T08:03:12.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.980+0000 7f3039ae6640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f30340a9e30 0x7f3034145de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:12.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.981+0000 7f303aae8640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f303413fdf0 0x7f3034146320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:12.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.981+0000 7f303a2e7640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f30340b5000 0x7f303413f6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34404/0 (socket says 172.21.15.62:34404) 2024-02-09T08:03:12.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.981+0000 7f303a2e7640 1 -- 172.21.15.62:0/1278107682 learned_addr learned my addr 172.21.15.62:0/1278107682 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-09T08:03:12.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.981+0000 7f3039ae6640 10 monclient(hunting): get_auth_request con 0x7f30340a9e30 auth_method 0 2024-02-09T08:03:12.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.981+0000 7f3039ae6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:12.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.981+0000 7f3039ae6640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:12.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.981+0000 7f3039ae6640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:12.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.981+0000 7f303aae8640 10 monclient(hunting): get_auth_request con 0x7f303413fdf0 auth_method 0 2024-02-09T08:03:12.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.981+0000 7f303aae8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:12.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.981+0000 7f303aae8640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:12.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.981+0000 7f303aae8640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:12.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.982+0000 7f3039ae6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:12.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.982+0000 7f3039ae6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:12.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.982+0000 7f3039ae6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:12.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.982+0000 7f303aae8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:12.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.982+0000 7f303aae8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:12.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.982+0000 7f303aae8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:12.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.983+0000 7f3039ae6640 10 monclient(hunting): handle_auth_done global_id 4262 payload 274 2024-02-09T08:03:12.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.983+0000 7f3039ae6640 1 -- 172.21.15.62:0/1278107682 >> v2:172.21.15.62:3300/0 conn(0x7f303413fdf0 msgr2=0x7f3034146320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:12.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.983+0000 7f3039ae6640 1 --2- 172.21.15.62:0/1278107682 >> v2:172.21.15.62:3300/0 conn(0x7f303413fdf0 0x7f3034146320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:12.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.983+0000 7f3039ae6640 1 -- 172.21.15.62:0/1278107682 >> v1:172.21.15.62:6789/0 conn(0x7f30340b5000 legacy=0x7f303413f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:12.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.983+0000 7f3039ae6640 10 monclient: _finish_hunting 0 2024-02-09T08:03:12.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.983+0000 7f3039ae6640 1 monclient: found mon.noname-b 2024-02-09T08:03:12.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.983+0000 7f3039ae6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:12.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.983+0000 7f3039ae6640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.62:3301/0 2024-02-09T08:03:12.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.983+0000 7f3039ae6640 1 -- 172.21.15.62:0/1278107682 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30340b2900 con 0x7f30340a9e30 2024-02-09T08:03:12.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.986+0000 7f3039ae6640 1 --2- 172.21.15.62:0/1278107682 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f30340a9e30 0x7f3034145de0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f30240097a0 tx=0x7f302402b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cff94e26b111b072 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:12.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.990+0000 7f30392e5640 1 -- 172.21.15.62:0/1278107682 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302402e070 con 0x7f30340a9e30 2024-02-09T08:03:12.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.990+0000 7f30392e5640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:12.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.990+0000 7f30392e5640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:03:12.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.990+0000 7f30392e5640 10 monclient: dump: 2024-02-09T08:03:12.993 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:12.993 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:12.993 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:12.993 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:12.993 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:12.993 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:12.993 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:12.993 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:12.993 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:12.993 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:12.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.990+0000 7f30392e5640 10 monclient: _finish_auth 0 2024-02-09T08:03:12.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.990+0000 7f30392e5640 10 monclient: _check_auth_tickets 2024-02-09T08:03:12.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.990+0000 7f30392e5640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:12.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.990+0000 7f30392e5640 1 -- 172.21.15.62:0/1278107682 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30240315a0 con 0x7f30340a9e30 2024-02-09T08:03:12.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.990+0000 7f303c54b640 5 monclient: authenticate success, global_id 4262 2024-02-09T08:03:12.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.990+0000 7f303c54b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-02-09T08:03:12.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.990+0000 7f30392e5640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:12.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.990+0000 7f303c54b640 10 monclient: get_monmap_and_config success 2024-02-09T08:03:12.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.990+0000 7f303c54b640 4 set_mon_vals no callback set 2024-02-09T08:03:12.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.990+0000 7f30392e5640 1 -- 172.21.15.62:0/1278107682 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3024031930 con 0x7f30340a9e30 2024-02-09T08:03:12.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.990+0000 7f30392e5640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:12.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.990+0000 7f30392e5640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-09T08:03:12.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.990+0000 7f30392e5640 10 monclient: dump: 2024-02-09T08:03:12.994 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:12.994 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:12.994 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:12.994 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:12.995 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:12.995 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:12.995 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:12.995 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:12.995 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:12.995 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:12.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.991+0000 7f303c54b640 10 monclient: shutdown 2024-02-09T08:03:12.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.991+0000 7f303c54b640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:12.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.991+0000 7f303c54b640 1 -- 172.21.15.62:0/1278107682 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f30340a9e30 msgr2=0x7f3034145de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:12.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.991+0000 7f303c54b640 1 --2- 172.21.15.62:0/1278107682 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f30340a9e30 0x7f3034145de0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f30240097a0 tx=0x7f302402b840 comp rx=0 tx=0).stop 2024-02-09T08:03:12.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.991+0000 7f303c54b640 1 -- 172.21.15.62:0/1278107682 shutdown_connections 2024-02-09T08:03:12.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.991+0000 7f303c54b640 1 --2- 172.21.15.62:0/1278107682 >> v2:172.21.15.62:3300/0 conn(0x7f303413fdf0 0x7f3034146320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:12.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.991+0000 7f303c54b640 1 --2- 172.21.15.62:0/1278107682 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f30340a9e30 0x7f3034145de0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:12.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.991+0000 7f303c54b640 1 -- 172.21.15.62:0/1278107682 >> 172.21.15.62:0/1278107682 conn(0x7f3034066bb0 msgr2=0x7f3034066fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:12.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.991+0000 7f303c54b640 1 -- 172.21.15.62:0/1278107682 shutdown_connections 2024-02-09T08:03:12.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.991+0000 7f303c54b640 1 -- 172.21.15.62:0/1278107682 wait complete. 2024-02-09T08:03:12.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.992+0000 7f303c54b640 10 monclient: build_initial_monmap 2024-02-09T08:03:12.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.992+0000 7f303c54b640 10 monclient: monmap: 2024-02-09T08:03:12.999 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:12.999 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:03:12.999 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:03:12.999 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:03:12.999 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:12.999 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:12.999 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:03:12.999 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:03:13.000 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:03:13.000 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:13.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.992+0000 7f303c54b640 1 librados: starting msgr at 2024-02-09T08:03:13.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.992+0000 7f303c54b640 1 librados: starting objecter 2024-02-09T08:03:13.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.992+0000 7f303c54b640 1 Processor -- start 2024-02-09T08:03:13.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.992+0000 7f303c54b640 1 -- start start 2024-02-09T08:03:13.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.992+0000 7f303c54b640 1 librados: setting wanted keys 2024-02-09T08:03:13.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.992+0000 7f303c54b640 1 librados: calling monclient init 2024-02-09T08:03:13.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.992+0000 7f303c54b640 10 monclient: init 2024-02-09T08:03:13.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.993+0000 7f303c54b640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:13.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.993+0000 7f303c54b640 10 monclient: _add_conns ranks=[0,2,1] 2024-02-09T08:03:13.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.993+0000 7f303c54b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30340a9e30 0x7f3034144fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:13.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.993+0000 7f303c54b640 10 monclient(hunting): picked mon.noname-a con 0x7f30340a9e30 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:03:13.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.993+0000 7f303c54b640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f30340b5000 0x7f3034142560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:13.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.993+0000 7f303c54b640 10 monclient(hunting): picked mon.noname-c con 0x7f30340b5000 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:13.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.993+0000 7f303c54b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f303413fdf0 0x7f3034140cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:13.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.993+0000 7f303c54b640 10 monclient(hunting): picked mon.noname-b con 0x7f303413fdf0 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:03:13.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.993+0000 7f303c54b640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:13.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.993+0000 7f303c54b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3034141df0 con 0x7f30340a9e30 2024-02-09T08:03:13.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.993+0000 7f303c54b640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:13.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.993+0000 7f303c54b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3034134e20 con 0x7f303413fdf0 2024-02-09T08:03:13.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.993+0000 7f303c54b640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:13.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.993+0000 7f303c54b640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3034134a40 con 0x7f30340b5000 2024-02-09T08:03:13.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.993+0000 7f303c54b640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:13.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.993+0000 7f303c54b640 10 monclient(hunting): authenticate will time out at 1436.353943s 2024-02-09T08:03:13.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.994+0000 7f303aae8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f303413fdf0 0x7f3034140cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:13.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.994+0000 7f303aae8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f303413fdf0 0x7f3034140cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.62:39914/0 (socket says 172.21.15.62:39914) 2024-02-09T08:03:13.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.994+0000 7f303aae8640 1 -- 172.21.15.62:0/599325242 learned_addr learned my addr 172.21.15.62:0/599325242 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:13.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.994+0000 7f303aae8640 10 monclient(hunting): get_auth_request con 0x7f303413fdf0 auth_method 0 2024-02-09T08:03:13.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.994+0000 7f303aae8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:13.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.994+0000 7f303aae8640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:13.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.994+0000 7f303aae8640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:13.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.995+0000 7f303a2e7640 1 --2- 172.21.15.62:0/599325242 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30340a9e30 0x7f3034144fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:13.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.995+0000 7f3039ae6640 1 --2- 172.21.15.62:0/599325242 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f30340b5000 0x7f3034142560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:13.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.995+0000 7f303a2e7640 10 monclient(hunting): get_auth_request con 0x7f30340a9e30 auth_method 0 2024-02-09T08:03:13.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.995+0000 7f303a2e7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:13.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.995+0000 7f303a2e7640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:13.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.995+0000 7f303a2e7640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:13.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.995+0000 7f303aae8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:13.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.995+0000 7f303aae8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:13.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.995+0000 7f303aae8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:13.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.995+0000 7f3039ae6640 10 monclient(hunting): get_auth_request con 0x7f30340b5000 auth_method 0 2024-02-09T08:03:13.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.995+0000 7f3039ae6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:13.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.995+0000 7f3039ae6640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:13.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.995+0000 7f3039ae6640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:13.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.996+0000 7f303a2e7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:13.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.996+0000 7f303a2e7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:13.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.996+0000 7f303a2e7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:13.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.996+0000 7f3039ae6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:13.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.996+0000 7f3039ae6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:13.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:12.996+0000 7f3039ae6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:13.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.000+0000 7f303aae8640 10 monclient(hunting): handle_auth_done global_id 4285 payload 824 2024-02-09T08:03:13.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.000+0000 7f303aae8640 1 -- 172.21.15.62:0/599325242 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f30340b5000 msgr2=0x7f3034142560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:13.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.000+0000 7f303aae8640 1 --2- 172.21.15.62:0/599325242 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f30340b5000 0x7f3034142560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:13.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.000+0000 7f303aae8640 1 -- 172.21.15.62:0/599325242 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30340a9e30 msgr2=0x7f3034144fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:13.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.000+0000 7f303aae8640 1 --2- 172.21.15.62:0/599325242 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30340a9e30 0x7f3034144fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:13.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.000+0000 7f303aae8640 10 monclient: _finish_hunting 0 2024-02-09T08:03:13.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.000+0000 7f303aae8640 1 monclient: found mon.noname-b 2024-02-09T08:03:13.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.000+0000 7f303aae8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:13.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.000+0000 7f303aae8640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.103:3300/0 2024-02-09T08:03:13.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.000+0000 7f303aae8640 1 -- 172.21.15.62:0/599325242 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3024009400 con 0x7f303413fdf0 2024-02-09T08:03:13.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.002+0000 7f303aae8640 1 --2- 172.21.15.62:0/599325242 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f303413fdf0 0x7f3034140cd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f302c00efc0 tx=0x7f302c00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:13.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.002+0000 7f302affd640 10 client.?.objecter ms_handle_connect 0x7f303413fdf0 2024-02-09T08:03:13.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.002+0000 7f302affd640 10 client.?.objecter resend_mon_ops 2024-02-09T08:03:13.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.007+0000 7f302affd640 1 -- 172.21.15.62:0/599325242 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c009ba0 con 0x7f303413fdf0 2024-02-09T08:03:13.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.007+0000 7f302affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:13.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.007+0000 7f302affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:03:13.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.007+0000 7f302affd640 10 monclient: dump: 2024-02-09T08:03:13.010 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:13.010 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:13.010 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:13.010 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:13.010 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:13.010 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:13.010 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:13.010 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:13.010 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:13.010 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:13.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.007+0000 7f302affd640 10 monclient: _finish_auth 0 2024-02-09T08:03:13.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.007+0000 7f302affd640 10 monclient: _check_auth_tickets 2024-02-09T08:03:13.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.007+0000 7f302affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:13.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.007+0000 7f302affd640 1 -- 172.21.15.62:0/599325242 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302c00f040 con 0x7f303413fdf0 2024-02-09T08:03:13.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.007+0000 7f302affd640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:13.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.007+0000 7f302affd640 1 -- 172.21.15.62:0/599325242 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c0146c0 con 0x7f303413fdf0 2024-02-09T08:03:13.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.007+0000 7f302affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:13.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.007+0000 7f302affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:03:13.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.007+0000 7f302affd640 10 monclient: dump: 2024-02-09T08:03:13.011 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:13.011 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:13.011 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:13.011 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:13.011 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:13.011 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:13.011 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:13.011 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:13.011 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:13.011 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:13.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.007+0000 7f303c54b640 5 monclient: authenticate success, global_id 4285 2024-02-09T08:03:13.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.007+0000 7f303c54b640 10 monclient: _renew_subs 2024-02-09T08:03:13.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.007+0000 7f303c54b640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:13.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.007+0000 7f303c54b640 1 -- 172.21.15.62:0/599325242 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30340b4870 con 0x7f303413fdf0 2024-02-09T08:03:13.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.007+0000 7f3038ae4640 4 set_mon_vals no callback set 2024-02-09T08:03:13.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.007+0000 7f303c54b640 10 client.4285.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:03:13.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.007+0000 7f303c54b640 10 monclient: _renew_subs 2024-02-09T08:03:13.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.007+0000 7f303c54b640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:13.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.007+0000 7f303c54b640 1 -- 172.21.15.62:0/599325242 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3034140460 con 0x7f303413fdf0 2024-02-09T08:03:13.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.007+0000 7f303c54b640 1 librados: init done 2024-02-09T08:03:13.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.008+0000 7f303c54b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:13.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.008+0000 7f303c54b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:13.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.008+0000 7f303c54b640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:13.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.008+0000 7f303c54b640 1 -- 172.21.15.62:0/599325242 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f303404ef90 con 0x7f303413fdf0 2024-02-09T08:03:13.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.032+0000 7f302affd640 1 -- 172.21.15.62:0/599325242 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f302c014820 con 0x7f303413fdf0 2024-02-09T08:03:13.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.033+0000 7f302affd640 1 --2- 172.21.15.62:0/599325242 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f301806d1d0 0x7f301806f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:13.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.033+0000 7f303a2e7640 1 --2- 172.21.15.62:0/599325242 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f301806d1d0 0x7f301806f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:13.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.033+0000 7f303a2e7640 10 monclient: get_auth_request con 0x7f301806d1d0 auth_method 0 2024-02-09T08:03:13.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.033+0000 7f302affd640 10 client.4285.objecter ms_handle_connect 0x7f301806d1d0 2024-02-09T08:03:13.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.033+0000 7f303a2e7640 1 --2- 172.21.15.62:0/599325242 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f301806d1d0 0x7f301806f690 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3030007fd0 tx=0x7f3030007e80 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:13.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.040+0000 7f302affd640 1 -- 172.21.15.62:0/599325242 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f302c059b40 con 0x7f303413fdf0 2024-02-09T08:03:13.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.040+0000 7f302affd640 10 client.4285.objecter ms_dispatch 0x7f3034000b90 osd_map(24..24 src has 1..24) v4 2024-02-09T08:03:13.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.040+0000 7f302affd640 3 client.4285.objecter handle_osd_map got epochs [24,24] > 0 2024-02-09T08:03:13.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.040+0000 7f302affd640 3 client.4285.objecter handle_osd_map decoding full epoch 24 2024-02-09T08:03:13.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.040+0000 7f302affd640 20 client.4285.objecter dump_active .. 0 homeless 2024-02-09T08:03:13.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.276+0000 7f302affd640 1 -- 172.21.15.62:0/599325242 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f302c055de0 con 0x7f303413fdf0 2024-02-09T08:03:13.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.276+0000 7f302affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:13.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.276+0000 7f302affd640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:03:13.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.475+0000 7f303c54b640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-02-09T08:03:13.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.475+0000 7f303c54b640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-02-09T08:03:13.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.475+0000 7f303c54b640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:13.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.475+0000 7f303c54b640 1 -- 172.21.15.62:0/599325242 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3034071270 con 0x7f303413fdf0 2024-02-09T08:03:13.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.512+0000 7f302affd640 1 -- 172.21.15.62:0/599325242 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+14730 (secure 0 0 0) 0x7f302c018070 con 0x7f303413fdf0 2024-02-09T08:03:13.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.512+0000 7f302affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-02-09T08:03:13.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.512+0000 7f302affd640 10 monclient: _finish_command 2 = system:0 2024-02-09T08:03:13.514 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T08:03:13.514 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":25,"fsid":"981c5564-eb76-49a1-80ab-97c7647bc34a","created":"2024-02-09T08:02:07.866410+0000","modified":"2024-02-09T08:03:13.136855+0000","last_up_change":"2024-02-09T08:03:05.958254+0000","last_in_change":"2024-02-09T08:02:13.770858+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-09T08:02:56.035293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-09T08:03:10.267347+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0e3b17d4-a50f-41d9-b455-0bc1606a5c86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":3842068700},{"type":"v1","addr":"172.21.15.62:6809","nonce":3842068700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3842068700},{"type":"v1","addr":"172.21.15.62:6811","nonce":3842068700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3842068700},{"type":"v1","addr":"172.21.15.62:6815","nonce":3842068700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3842068700},{"type":"v1","addr":"172.21.15.62:6813","nonce":3842068700}]},"public_addr":"172.21.15.62:6809/3842068700","cluster_addr":"172.21.15.62:6811/3842068700","heartbeat_back_addr":"172.21.15.62:6815/3842068700","heartbeat_front_addr":"172.21.15.62:6813/3842068700","state":["exists","up"]},{"osd":1,"uuid":"a0077e6c-220d-46f4-9be2-a707d1710890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":3837949327},{"type":"v1","addr":"172.21.15.62:6801","nonce":3837949327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":3837949327},{"type":"v1","addr":"172.21.15.62:6803","nonce":3837949327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":3837949327},{"type":"v1","addr":"172.21.15.62:6807","nonce":3837949327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":3837949327},{"type":"v1","addr":"172.21.15.62:6805","nonce":3837949327}]},"public_addr":"172.21.15.62:6801/3837949327","cluster_addr":"172.21.15.62:6803/3837949327","heartbeat_back_addr":"172.21.15.62:6807/3837949327","heartbeat_front_addr":"172.21.15.62:6805/3837949327","state":["exists","up"]},{"osd":2,"uuid":"3739882a-5263-4113-840a-afd6acdcf15e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":2695503114},{"type":"v1","addr":"172.21.15.62:6817","nonce":2695503114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2695503114},{"type":"v1","addr":"172.21.15.62:6819","nonce":2695503114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2695503114},{"type":"v1","addr":"172.21.15.62:6823","nonce":2695503114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":2695503114},{"type":"v1","addr":"172.21.15.62:6821","nonce":2695503114}]},"public_addr":"172.21.15.62:6817/2695503114","cluster_addr":"172.21.15.62:6819/2695503114","heartbeat_back_addr":"172.21.15.62:6823/2695503114","heartbeat_front_addr":"172.21.15.62:6821/2695503114","state":["exists","up"]},{"osd":3,"uuid":"3657c103-db3d-46c5-8afc-2b0b9da1e2e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":556356316},{"type":"v1","addr":"172.21.15.62:6825","nonce":556356316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":556356316},{"type":"v1","addr":"172.21.15.62:6827","nonce":556356316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":556356316},{"type":"v1","addr":"172.21.15.62:6831","nonce":556356316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":556356316},{"type":"v1","addr":"172.21.15.62:6829","nonce":556356316}]},"public_addr":"172.21.15.62:6825/556356316","cluster_addr":"172.21.15.62:6827/556356316","heartbeat_back_addr":"172.21.15.62:6831/556356316","heartbeat_front_addr":"172.21.15.62:6829/556356316","state":["exists","up"]},{"osd":4,"uuid":"faf5e721-fa06-43f8-9b72-36ca8132ffea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":20,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2442009417},{"type":"v1","addr":"172.21.15.103:6811","nonce":2442009417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2442009417},{"type":"v1","addr":"172.21.15.103:6815","nonce":2442009417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2442009417},{"type":"v1","addr":"172.21.15.103:6822","nonce":2442009417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2442009417},{"type":"v1","addr":"172.21.15.103:6818","nonce":2442009417}]},"public_addr":"172.21.15.103:6811/2442009417","cluster_addr":"172.21.15.103:6815/2442009417","heartbeat_back_addr":"172.21.15.103:6822/2442009417","heartbeat_front_addr":"172.21.15.103:6818/2442009417","state":["exists","up"]},{"osd":5,"uuid":"5c96dba1-53d2-4c0c-8928-5f09ea17a984","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":262591034},{"type":"v1","addr":"172.21.15.103:6803","nonce":262591034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":262591034},{"type":"v1","addr":"172.21.15.103:6805","nonce":262591034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":262591034},{"type":"v1","addr":"172.21.15.103:6809","nonce":262591034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":262591034},{"type":"v1","addr":"172.21.15.103:6807","nonce":262591034}]},"public_addr":"172.21.15.103:6803/262591034","cluster_addr":"172.21.15.103:6805/262591034","heartbeat_back_addr":"172.21.15.103:6809/262591034","heartbeat_front_addr":"172.21.15.103:6807/262591034","state":["exists","up"]},{"osd":6,"uuid":"3473844d-d631-4ea4-96fb-638eccee5cb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3983655111},{"type":"v1","addr":"172.21.15.103:6827","nonce":3983655111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3983655111},{"type":"v1","addr":"172.21.15.103:6829","nonce":3983655111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3983655111},{"type":"v1","addr":"172.21.15.103:6833","nonce":3983655111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3983655111},{"type":"v1","addr":"172.21.15.103:6831","nonce":3983655111}]},"public_addr":"172.21.15.103:6827/3983655111","cluster_addr":"172.21.15.103:6829/3983655111","heartbeat_back_addr":"172.21.15.103:6833/3983655111","heartbeat_front_addr":"172.21.15.103:6831/3983655111","state":["exists","up"]},{"osd":7,"uuid":"d31bdb4b-8938-4da9-8bf1-57cf730e839d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":1369132028},{"type":"v1","addr":"172.21.15.103:6813","nonce":1369132028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":1369132028},{"type":"v1","addr":"172.21.15.103:6819","nonce":1369132028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1369132028},{"type":"v1","addr":"172.21.15.103:6825","nonce":1369132028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6821","nonce":1369132028},{"type":"v1","addr":"172.21.15.103:6823","nonce":1369132028}]},"public_addr":"172.21.15.103:6813/1369132028","cluster_addr":"172.21.15.103:6819/1369132028","heartbeat_back_addr":"172.21.15.103:6825/1369132028","heartbeat_front_addr":"172.21.15.103:6823/1369132028","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T08:02:53.044658+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T08:02:52.943983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T08:02:53.834176+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T08:02:53.238626+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T08:02:51.878057+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T08:02:50.950607+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T08:02:52.166722+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T08:02:52.154749+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-09T08:03:13.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.513+0000 7f303c54b640 10 librados: watch_flush enter 2024-02-09T08:03:13.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.513+0000 7f303c54b640 10 librados: watch_flush exit 2024-02-09T08:03:13.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.513+0000 7f303c54b640 20 client.4285.objecter shutdown clearing up homeless session... 2024-02-09T08:03:13.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.513+0000 7f303c54b640 10 client.4285.objecter successfully canceled tick 2024-02-09T08:03:13.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.513+0000 7f303c54b640 1 -- 172.21.15.62:0/599325242 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f301806d1d0 msgr2=0x7f301806f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:13.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.513+0000 7f303c54b640 1 --2- 172.21.15.62:0/599325242 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f301806d1d0 0x7f301806f690 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3030007fd0 tx=0x7f3030007e80 comp rx=0 tx=0).stop 2024-02-09T08:03:13.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.513+0000 7f303c54b640 10 monclient: shutdown 2024-02-09T08:03:13.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.513+0000 7f303c54b640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:13.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.513+0000 7f303c54b640 1 -- 172.21.15.62:0/599325242 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f303413fdf0 msgr2=0x7f3034140cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:13.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.513+0000 7f303c54b640 1 --2- 172.21.15.62:0/599325242 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f303413fdf0 0x7f3034140cd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f302c00efc0 tx=0x7f302c00c490 comp rx=0 tx=0).stop 2024-02-09T08:03:13.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.513+0000 7f303c54b640 1 -- 172.21.15.62:0/599325242 shutdown_connections 2024-02-09T08:03:13.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.513+0000 7f303c54b640 1 --2- 172.21.15.62:0/599325242 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f301806d1d0 0x7f301806f690 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:13.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.513+0000 7f303c54b640 1 --2- 172.21.15.62:0/599325242 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f303413fdf0 0x7f3034140cd0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:13.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.513+0000 7f303c54b640 1 --2- 172.21.15.62:0/599325242 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f30340b5000 0x7f3034142560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:13.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.513+0000 7f303c54b640 1 --2- 172.21.15.62:0/599325242 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30340a9e30 0x7f3034144fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:13.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.513+0000 7f303c54b640 1 -- 172.21.15.62:0/599325242 >> 172.21.15.62:0/599325242 conn(0x7f3034066bb0 msgr2=0x7f303413c580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:13.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.514+0000 7f303c54b640 1 -- 172.21.15.62:0/599325242 shutdown_connections 2024-02-09T08:03:13.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.514+0000 7f303c54b640 1 -- 172.21.15.62:0/599325242 wait complete. 2024-02-09T08:03:13.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.514+0000 7f303c54b640 1 librados: shutdown 2024-02-09T08:03:13.526 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-02-09T08:03:13.527 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-09T08:03:13.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.625+0000 7f77615cf640 10 monclient: get_monmap_and_config 2024-02-09T08:03:13.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.625+0000 7f77615cf640 10 monclient: build_initial_monmap 2024-02-09T08:03:13.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.625+0000 7f77615cf640 10 monclient: monmap: 2024-02-09T08:03:13.628 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:13.628 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:13.628 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:03:13.626304+0000 2024-02-09T08:03:13.628 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:03:13.626304+0000 2024-02-09T08:03:13.628 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:13.628 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:13.628 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:03:13.628 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:03:13.628 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:03:13.628 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:03:13.628 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:03:13.629 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:13.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.625+0000 7f77615cf640 1 Processor -- start 2024-02-09T08:03:13.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.625+0000 7f77615cf640 1 -- start start 2024-02-09T08:03:13.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.625+0000 7f77615cf640 10 monclient: init 2024-02-09T08:03:13.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.626+0000 7f77615cf640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:13.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.626+0000 7f77615cf640 10 monclient: _add_conns ranks=[0,1,2,4,3] 2024-02-09T08:03:13.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.626+0000 7f77615cf640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f775c0b5000 addr v1:172.21.15.62:6789/0 2024-02-09T08:03:13.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.626+0000 7f77615cf640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f775c0a9e30 addr v1:172.21.15.103:6789/0 2024-02-09T08:03:13.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.626+0000 7f77615cf640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f775c13fdf0 0x7f775c1464f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:13.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.626+0000 7f77615cf640 10 monclient(hunting): picked mon.noname-b con 0x7f775c13fdf0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:13.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.626+0000 7f77615cf640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f775c0aa4a0 con 0x7f775c0b5000 2024-02-09T08:03:13.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.626+0000 7f77615cf640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f775c0b2900 con 0x7f775c0a9e30 2024-02-09T08:03:13.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.626+0000 7f77615cf640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:13.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.626+0000 7f77615cf640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f775c0b53e0 con 0x7f775c13fdf0 2024-02-09T08:03:13.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.626+0000 7f77615cf640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:13.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.626+0000 7f77615cf640 10 monclient(hunting): authenticate will time out at 1436.986672s 2024-02-09T08:03:13.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.626+0000 7f775affd640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f775c0b5000 0x7f775c13f6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34412/0 (socket says 172.21.15.62:34412) 2024-02-09T08:03:13.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.626+0000 7f775affd640 1 -- 172.21.15.62:0/2389546186 learned_addr learned my addr 172.21.15.62:0/2389546186 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-09T08:03:13.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.626+0000 7f775b7fe640 1 --2- 172.21.15.62:0/2389546186 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f775c13fdf0 0x7f775c1464f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:13.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.627+0000 7f775b7fe640 10 monclient(hunting): get_auth_request con 0x7f775c13fdf0 auth_method 0 2024-02-09T08:03:13.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.627+0000 7f775b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:13.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.627+0000 7f775b7fe640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:13.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.627+0000 7f775b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:13.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.627+0000 7f775b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:13.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.627+0000 7f775b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:13.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.627+0000 7f775b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:13.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.629+0000 7f7759ffb640 1 -- 172.21.15.62:0/2389546186 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3098716583 0 0) 0x7f775c0aa4a0 con 0x7f775c0b5000 2024-02-09T08:03:13.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.629+0000 7f7759ffb640 10 monclient(hunting): _negotiate 2024-02-09T08:03:13.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.629+0000 7f7759ffb640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:13.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.629+0000 7f7759ffb640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:13.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.629+0000 7f7759ffb640 10 monclient(hunting): my global_id is 4275 2024-02-09T08:03:13.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.629+0000 7f7759ffb640 1 -- 172.21.15.62:0/2389546186 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7744003520 con 0x7f775c0b5000 2024-02-09T08:03:13.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.629+0000 7f7759ffb640 1 -- 172.21.15.62:0/2389546186 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3167467193 0 0) 0x7f775c0b2900 con 0x7f775c0a9e30 2024-02-09T08:03:13.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.629+0000 7f7759ffb640 10 monclient(hunting): _negotiate 2024-02-09T08:03:13.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.629+0000 7f7759ffb640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:13.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.629+0000 7f7759ffb640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:13.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.629+0000 7f7759ffb640 10 monclient(hunting): my global_id is 4288 2024-02-09T08:03:13.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.629+0000 7f7759ffb640 1 -- 172.21.15.62:0/2389546186 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f775c0aa4a0 con 0x7f775c0a9e30 2024-02-09T08:03:13.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.629+0000 7f775b7fe640 10 monclient(hunting): handle_auth_done global_id 4268 payload 274 2024-02-09T08:03:13.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.629+0000 7f775b7fe640 1 -- 172.21.15.62:0/2389546186 >> v1:172.21.15.103:6789/0 conn(0x7f775c0a9e30 legacy=0x7f775c145de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:13.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.629+0000 7f775b7fe640 1 -- 172.21.15.62:0/2389546186 >> v1:172.21.15.62:6789/0 conn(0x7f775c0b5000 legacy=0x7f775c13f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:13.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.629+0000 7f775b7fe640 10 monclient: _finish_hunting 0 2024-02-09T08:03:13.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.629+0000 7f775b7fe640 1 monclient: found mon.noname-b 2024-02-09T08:03:13.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.629+0000 7f775b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:13.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.629+0000 7f775b7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.62:3301/0 2024-02-09T08:03:13.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.629+0000 7f775b7fe640 1 -- 172.21.15.62:0/2389546186 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f775c0ab5f0 con 0x7f775c13fdf0 2024-02-09T08:03:13.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.631+0000 7f775b7fe640 1 --2- 172.21.15.62:0/2389546186 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f775c13fdf0 0x7f775c1464f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f774c009dc0 tx=0x7f774c02be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ea7fbc832677717 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:13.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.635+0000 7f7759ffb640 1 -- 172.21.15.62:0/2389546186 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774c02cc40 con 0x7f775c13fdf0 2024-02-09T08:03:13.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.635+0000 7f7759ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:13.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.635+0000 7f7759ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:03:13.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.635+0000 7f7759ffb640 10 monclient: dump: 2024-02-09T08:03:13.637 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:13.638 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:13.638 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:13.638 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:13.638 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:13.638 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:13.638 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:13.638 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:13.638 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:13.638 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:13.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.635+0000 7f7759ffb640 10 monclient: _finish_auth 0 2024-02-09T08:03:13.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.635+0000 7f7759ffb640 10 monclient: _check_auth_tickets 2024-02-09T08:03:13.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.635+0000 7f7759ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:13.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.635+0000 7f7759ffb640 1 -- 172.21.15.62:0/2389546186 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f774c02cda0 con 0x7f775c13fdf0 2024-02-09T08:03:13.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.635+0000 7f7759ffb640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:13.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.635+0000 7f7759ffb640 1 -- 172.21.15.62:0/2389546186 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774c034660 con 0x7f775c13fdf0 2024-02-09T08:03:13.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.635+0000 7f7759ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:13.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.635+0000 7f7759ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-09T08:03:13.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.635+0000 7f7759ffb640 10 monclient: dump: 2024-02-09T08:03:13.639 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:13.639 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:13.639 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:13.639 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:13.639 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:13.639 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:13.639 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:13.639 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:13.639 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:13.639 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:13.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.635+0000 7f77615cf640 5 monclient: authenticate success, global_id 4268 2024-02-09T08:03:13.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.635+0000 7f77615cf640 10 monclient: get_monmap_and_config success 2024-02-09T08:03:13.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.635+0000 7f77615cf640 4 set_mon_vals no callback set 2024-02-09T08:03:13.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.636+0000 7f77615cf640 10 monclient: shutdown 2024-02-09T08:03:13.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.636+0000 7f77615cf640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:13.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.636+0000 7f77615cf640 1 -- 172.21.15.62:0/2389546186 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f775c13fdf0 msgr2=0x7f775c1464f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:13.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.636+0000 7f77615cf640 1 --2- 172.21.15.62:0/2389546186 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f775c13fdf0 0x7f775c1464f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f774c009dc0 tx=0x7f774c02be90 comp rx=0 tx=0).stop 2024-02-09T08:03:13.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.636+0000 7f77615cf640 1 -- 172.21.15.62:0/2389546186 shutdown_connections 2024-02-09T08:03:13.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.636+0000 7f77615cf640 1 --2- 172.21.15.62:0/2389546186 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f775c13fdf0 0x7f775c1464f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:13.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.636+0000 7f77615cf640 1 -- 172.21.15.62:0/2389546186 >> 172.21.15.62:0/2389546186 conn(0x7f775c066bb0 msgr2=0x7f775c066fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:13.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.636+0000 7f77615cf640 1 -- 172.21.15.62:0/2389546186 shutdown_connections 2024-02-09T08:03:13.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.636+0000 7f77615cf640 1 -- 172.21.15.62:0/2389546186 wait complete. 2024-02-09T08:03:13.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.636+0000 7f77615cf640 10 monclient: build_initial_monmap 2024-02-09T08:03:13.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.636+0000 7f77615cf640 10 monclient: monmap: 2024-02-09T08:03:13.644 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:13.644 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:03:13.644 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:03:13.644 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:03:13.644 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:13.644 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:13.644 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:03:13.644 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:03:13.644 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:03:13.644 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:13.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.637+0000 7f77615cf640 1 librados: starting msgr at 2024-02-09T08:03:13.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.637+0000 7f77615cf640 1 librados: starting objecter 2024-02-09T08:03:13.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.637+0000 7f77615cf640 1 Processor -- start 2024-02-09T08:03:13.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.637+0000 7f77615cf640 1 -- start start 2024-02-09T08:03:13.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.637+0000 7f77615cf640 1 librados: setting wanted keys 2024-02-09T08:03:13.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.637+0000 7f77615cf640 1 librados: calling monclient init 2024-02-09T08:03:13.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.637+0000 7f77615cf640 10 monclient: init 2024-02-09T08:03:13.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.637+0000 7f77615cf640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:13.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.637+0000 7f77615cf640 10 monclient: _add_conns ranks=[0,2,1] 2024-02-09T08:03:13.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.638+0000 7f77615cf640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f775c0a9e30 0x7f775c141480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:13.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.638+0000 7f77615cf640 10 monclient(hunting): picked mon.noname-a con 0x7f775c0a9e30 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:03:13.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.638+0000 7f77615cf640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f775c0b5000 0x7f775c136c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:13.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.638+0000 7f77615cf640 10 monclient(hunting): picked mon.noname-c con 0x7f775c0b5000 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:13.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.638+0000 7f77615cf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f775c13fdf0 0x7f775c134e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:13.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.638+0000 7f77615cf640 10 monclient(hunting): picked mon.noname-b con 0x7f775c13fdf0 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:03:13.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.638+0000 7f77615cf640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:13.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.638+0000 7f77615cf640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f775c135f50 con 0x7f775c0a9e30 2024-02-09T08:03:13.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.638+0000 7f77615cf640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:13.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.638+0000 7f77615cf640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f775c1361c0 con 0x7f775c13fdf0 2024-02-09T08:03:13.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.638+0000 7f77615cf640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:13.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.638+0000 7f77615cf640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f775c1364a0 con 0x7f775c0b5000 2024-02-09T08:03:13.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.638+0000 7f77615cf640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:13.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.638+0000 7f77615cf640 10 monclient(hunting): authenticate will time out at 1436.998306s 2024-02-09T08:03:13.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.638+0000 7f775a7fc640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f775c0b5000 0x7f775c136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:13.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.638+0000 7f775affd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f775c0a9e30 0x7f775c141480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:13.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.638+0000 7f775b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f775c13fdf0 0x7f775c134e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:13.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.638+0000 7f775a7fc640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f775c0b5000 0x7f775c136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:60910/0 (socket says 172.21.15.62:60910) 2024-02-09T08:03:13.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.638+0000 7f775a7fc640 1 -- 172.21.15.62:0/3137010299 learned_addr learned my addr 172.21.15.62:0/3137010299 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:13.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.638+0000 7f775a7fc640 10 monclient(hunting): get_auth_request con 0x7f775c0b5000 auth_method 0 2024-02-09T08:03:13.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.638+0000 7f775a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:13.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.638+0000 7f775a7fc640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:13.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.638+0000 7f775a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:13.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.638+0000 7f775affd640 10 monclient(hunting): get_auth_request con 0x7f775c0a9e30 auth_method 0 2024-02-09T08:03:13.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.638+0000 7f775affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:13.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.638+0000 7f775affd640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:13.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.638+0000 7f775affd640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:13.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.638+0000 7f775b7fe640 10 monclient(hunting): get_auth_request con 0x7f775c13fdf0 auth_method 0 2024-02-09T08:03:13.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.638+0000 7f775b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:13.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.638+0000 7f775b7fe640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:13.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.638+0000 7f775b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:13.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.639+0000 7f775affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:13.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.639+0000 7f775affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:13.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.639+0000 7f775affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:13.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.639+0000 7f775a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:13.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.639+0000 7f775a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:13.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.639+0000 7f775a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:13.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.639+0000 7f775b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:13.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.639+0000 7f775b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:13.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.639+0000 7f775b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:13.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.642+0000 7f775b7fe640 10 monclient(hunting): handle_auth_done global_id 4291 payload 824 2024-02-09T08:03:13.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.642+0000 7f775b7fe640 1 -- 172.21.15.62:0/3137010299 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f775c0b5000 msgr2=0x7f775c136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:13.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.642+0000 7f775b7fe640 1 --2- 172.21.15.62:0/3137010299 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f775c0b5000 0x7f775c136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:13.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.642+0000 7f775b7fe640 1 -- 172.21.15.62:0/3137010299 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f775c0a9e30 msgr2=0x7f775c141480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:13.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.642+0000 7f775b7fe640 1 --2- 172.21.15.62:0/3137010299 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f775c0a9e30 0x7f775c141480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:13.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.642+0000 7f775b7fe640 10 monclient: _finish_hunting 0 2024-02-09T08:03:13.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.642+0000 7f775b7fe640 1 monclient: found mon.noname-b 2024-02-09T08:03:13.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.642+0000 7f775b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:13.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.642+0000 7f775b7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.103:3300/0 2024-02-09T08:03:13.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.642+0000 7f775b7fe640 1 -- 172.21.15.62:0/3137010299 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f774c009a70 con 0x7f775c13fdf0 2024-02-09T08:03:13.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.644+0000 7f775b7fe640 1 --2- 172.21.15.62:0/3137010299 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f775c13fdf0 0x7f775c134e40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f774c033000 tx=0x7f774c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:13.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.644+0000 7f77437fe640 10 client.?.objecter ms_handle_connect 0x7f775c13fdf0 2024-02-09T08:03:13.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.644+0000 7f77437fe640 10 client.?.objecter resend_mon_ops 2024-02-09T08:03:13.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.648+0000 7f77437fe640 1 -- 172.21.15.62:0/3137010299 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774c040650 con 0x7f775c13fdf0 2024-02-09T08:03:13.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.648+0000 7f77437fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:13.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.648+0000 7f77437fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:03:13.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.648+0000 7f77437fe640 10 monclient: dump: 2024-02-09T08:03:13.652 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:13.652 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:13.652 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:13.652 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:13.652 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:13.652 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:13.652 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:13.652 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:13.653 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:13.653 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:13.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.648+0000 7f77437fe640 10 monclient: _finish_auth 0 2024-02-09T08:03:13.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.648+0000 7f77437fe640 10 monclient: _check_auth_tickets 2024-02-09T08:03:13.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.648+0000 7f77437fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:13.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.648+0000 7f77437fe640 1 -- 172.21.15.62:0/3137010299 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f774c0407b0 con 0x7f775c13fdf0 2024-02-09T08:03:13.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.648+0000 7f77437fe640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:13.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.648+0000 7f77437fe640 1 -- 172.21.15.62:0/3137010299 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774c040b60 con 0x7f775c13fdf0 2024-02-09T08:03:13.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.648+0000 7f77615cf640 5 monclient: authenticate success, global_id 4291 2024-02-09T08:03:13.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.648+0000 7f77615cf640 10 monclient: _renew_subs 2024-02-09T08:03:13.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.648+0000 7f77615cf640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:13.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.648+0000 7f77615cf640 1 -- 172.21.15.62:0/3137010299 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f775c143140 con 0x7f775c13fdf0 2024-02-09T08:03:13.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.648+0000 7f77437fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:13.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.648+0000 7f77437fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:03:13.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.648+0000 7f77437fe640 10 monclient: dump: 2024-02-09T08:03:13.654 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:13.654 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:13.654 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:13.654 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:13.654 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:13.654 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:13.655 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:13.655 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:13.655 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:13.655 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:13.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.648+0000 7f77597fa640 4 set_mon_vals no callback set 2024-02-09T08:03:13.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.648+0000 7f77615cf640 10 client.4291.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:03:13.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.648+0000 7f77615cf640 10 monclient: _renew_subs 2024-02-09T08:03:13.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.648+0000 7f77615cf640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:13.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.648+0000 7f77615cf640 1 -- 172.21.15.62:0/3137010299 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f775c142790 con 0x7f775c13fdf0 2024-02-09T08:03:13.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.648+0000 7f77615cf640 1 librados: init done 2024-02-09T08:03:13.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.649+0000 7f77615cf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:13.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.649+0000 7f77615cf640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:13.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.649+0000 7f77615cf640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:13.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.649+0000 7f77615cf640 1 -- 172.21.15.62:0/3137010299 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f775c142920 con 0x7f775c13fdf0 2024-02-09T08:03:13.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.906+0000 7f77437fe640 1 -- 172.21.15.62:0/3137010299 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f774c040cc0 con 0x7f775c13fdf0 2024-02-09T08:03:13.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.906+0000 7f77437fe640 1 --2- 172.21.15.62:0/3137010299 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f774806d1f0 0x7f774806f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:13.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.906+0000 7f775affd640 1 --2- 172.21.15.62:0/3137010299 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f774806d1f0 0x7f774806f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:13.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.906+0000 7f775affd640 10 monclient: get_auth_request con 0x7f774806d1f0 auth_method 0 2024-02-09T08:03:13.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.907+0000 7f77437fe640 10 client.4291.objecter ms_handle_connect 0x7f774806d1f0 2024-02-09T08:03:13.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.907+0000 7f775affd640 1 --2- 172.21.15.62:0/3137010299 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f774806d1f0 0x7f774806f6b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7754005880 tx=0x7f7754009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:13.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.908+0000 7f77437fe640 1 -- 172.21.15.62:0/3137010299 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f774c07b8b0 con 0x7f775c13fdf0 2024-02-09T08:03:13.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.909+0000 7f77437fe640 10 client.4291.objecter ms_dispatch 0x7f775c000b90 osd_map(25..25 src has 1..25) v4 2024-02-09T08:03:13.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.909+0000 7f77437fe640 3 client.4291.objecter handle_osd_map got epochs [25,25] > 0 2024-02-09T08:03:13.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.909+0000 7f77437fe640 3 client.4291.objecter handle_osd_map decoding full epoch 25 2024-02-09T08:03:13.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.909+0000 7f77437fe640 20 client.4291.objecter dump_active .. 0 homeless 2024-02-09T08:03:13.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.919+0000 7f77437fe640 1 -- 172.21.15.62:0/3137010299 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f774c077b50 con 0x7f775c13fdf0 2024-02-09T08:03:13.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.919+0000 7f77437fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:13.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:13.919+0000 7f77437fe640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:03:14.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.105+0000 7f77615cf640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-02-09T08:03:14.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.105+0000 7f77615cf640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-02-09T08:03:14.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.105+0000 7f77615cf640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:14.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.105+0000 7f77615cf640 1 -- 172.21.15.62:0/3137010299 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f775c1365e0 con 0x7f775c13fdf0 2024-02-09T08:03:14.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.133+0000 7f77437fe640 1 -- 172.21.15.62:0/3137010299 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+14730 (secure 0 0 0) 0x7f775c1365e0 con 0x7f775c13fdf0 2024-02-09T08:03:14.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.133+0000 7f77437fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-02-09T08:03:14.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.133+0000 7f77437fe640 10 monclient: _finish_command 2 = system:0 2024-02-09T08:03:14.136 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T08:03:14.136 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":25,"fsid":"981c5564-eb76-49a1-80ab-97c7647bc34a","created":"2024-02-09T08:02:07.866410+0000","modified":"2024-02-09T08:03:13.136855+0000","last_up_change":"2024-02-09T08:03:05.958254+0000","last_in_change":"2024-02-09T08:02:13.770858+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-09T08:02:56.035293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-09T08:03:10.267347+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0e3b17d4-a50f-41d9-b455-0bc1606a5c86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":3842068700},{"type":"v1","addr":"172.21.15.62:6809","nonce":3842068700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3842068700},{"type":"v1","addr":"172.21.15.62:6811","nonce":3842068700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3842068700},{"type":"v1","addr":"172.21.15.62:6815","nonce":3842068700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3842068700},{"type":"v1","addr":"172.21.15.62:6813","nonce":3842068700}]},"public_addr":"172.21.15.62:6809/3842068700","cluster_addr":"172.21.15.62:6811/3842068700","heartbeat_back_addr":"172.21.15.62:6815/3842068700","heartbeat_front_addr":"172.21.15.62:6813/3842068700","state":["exists","up"]},{"osd":1,"uuid":"a0077e6c-220d-46f4-9be2-a707d1710890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":3837949327},{"type":"v1","addr":"172.21.15.62:6801","nonce":3837949327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":3837949327},{"type":"v1","addr":"172.21.15.62:6803","nonce":3837949327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":3837949327},{"type":"v1","addr":"172.21.15.62:6807","nonce":3837949327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":3837949327},{"type":"v1","addr":"172.21.15.62:6805","nonce":3837949327}]},"public_addr":"172.21.15.62:6801/3837949327","cluster_addr":"172.21.15.62:6803/3837949327","heartbeat_back_addr":"172.21.15.62:6807/3837949327","heartbeat_front_addr":"172.21.15.62:6805/3837949327","state":["exists","up"]},{"osd":2,"uuid":"3739882a-5263-4113-840a-afd6acdcf15e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":2695503114},{"type":"v1","addr":"172.21.15.62:6817","nonce":2695503114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2695503114},{"type":"v1","addr":"172.21.15.62:6819","nonce":2695503114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2695503114},{"type":"v1","addr":"172.21.15.62:6823","nonce":2695503114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":2695503114},{"type":"v1","addr":"172.21.15.62:6821","nonce":2695503114}]},"public_addr":"172.21.15.62:6817/2695503114","cluster_addr":"172.21.15.62:6819/2695503114","heartbeat_back_addr":"172.21.15.62:6823/2695503114","heartbeat_front_addr":"172.21.15.62:6821/2695503114","state":["exists","up"]},{"osd":3,"uuid":"3657c103-db3d-46c5-8afc-2b0b9da1e2e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":556356316},{"type":"v1","addr":"172.21.15.62:6825","nonce":556356316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":556356316},{"type":"v1","addr":"172.21.15.62:6827","nonce":556356316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":556356316},{"type":"v1","addr":"172.21.15.62:6831","nonce":556356316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":556356316},{"type":"v1","addr":"172.21.15.62:6829","nonce":556356316}]},"public_addr":"172.21.15.62:6825/556356316","cluster_addr":"172.21.15.62:6827/556356316","heartbeat_back_addr":"172.21.15.62:6831/556356316","heartbeat_front_addr":"172.21.15.62:6829/556356316","state":["exists","up"]},{"osd":4,"uuid":"faf5e721-fa06-43f8-9b72-36ca8132ffea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":20,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2442009417},{"type":"v1","addr":"172.21.15.103:6811","nonce":2442009417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2442009417},{"type":"v1","addr":"172.21.15.103:6815","nonce":2442009417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2442009417},{"type":"v1","addr":"172.21.15.103:6822","nonce":2442009417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2442009417},{"type":"v1","addr":"172.21.15.103:6818","nonce":2442009417}]},"public_addr":"172.21.15.103:6811/2442009417","cluster_addr":"172.21.15.103:6815/2442009417","heartbeat_back_addr":"172.21.15.103:6822/2442009417","heartbeat_front_addr":"172.21.15.103:6818/2442009417","state":["exists","up"]},{"osd":5,"uuid":"5c96dba1-53d2-4c0c-8928-5f09ea17a984","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":262591034},{"type":"v1","addr":"172.21.15.103:6803","nonce":262591034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":262591034},{"type":"v1","addr":"172.21.15.103:6805","nonce":262591034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":262591034},{"type":"v1","addr":"172.21.15.103:6809","nonce":262591034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":262591034},{"type":"v1","addr":"172.21.15.103:6807","nonce":262591034}]},"public_addr":"172.21.15.103:6803/262591034","cluster_addr":"172.21.15.103:6805/262591034","heartbeat_back_addr":"172.21.15.103:6809/262591034","heartbeat_front_addr":"172.21.15.103:6807/262591034","state":["exists","up"]},{"osd":6,"uuid":"3473844d-d631-4ea4-96fb-638eccee5cb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3983655111},{"type":"v1","addr":"172.21.15.103:6827","nonce":3983655111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3983655111},{"type":"v1","addr":"172.21.15.103:6829","nonce":3983655111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3983655111},{"type":"v1","addr":"172.21.15.103:6833","nonce":3983655111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3983655111},{"type":"v1","addr":"172.21.15.103:6831","nonce":3983655111}]},"public_addr":"172.21.15.103:6827/3983655111","cluster_addr":"172.21.15.103:6829/3983655111","heartbeat_back_addr":"172.21.15.103:6833/3983655111","heartbeat_front_addr":"172.21.15.103:6831/3983655111","state":["exists","up"]},{"osd":7,"uuid":"d31bdb4b-8938-4da9-8bf1-57cf730e839d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":1369132028},{"type":"v1","addr":"172.21.15.103:6813","nonce":1369132028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":1369132028},{"type":"v1","addr":"172.21.15.103:6819","nonce":1369132028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1369132028},{"type":"v1","addr":"172.21.15.103:6825","nonce":1369132028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6821","nonce":1369132028},{"type":"v1","addr":"172.21.15.103:6823","nonce":1369132028}]},"public_addr":"172.21.15.103:6813/1369132028","cluster_addr":"172.21.15.103:6819/1369132028","heartbeat_back_addr":"172.21.15.103:6825/1369132028","heartbeat_front_addr":"172.21.15.103:6823/1369132028","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T08:02:53.044658+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T08:02:52.943983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T08:02:53.834176+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T08:02:53.238626+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T08:02:51.878057+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T08:02:50.950607+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T08:02:52.166722+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T08:02:52.154749+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-09T08:03:14.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.135+0000 7f77615cf640 10 librados: watch_flush enter 2024-02-09T08:03:14.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.135+0000 7f77615cf640 10 librados: watch_flush exit 2024-02-09T08:03:14.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.135+0000 7f77615cf640 20 client.4291.objecter shutdown clearing up homeless session... 2024-02-09T08:03:14.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.135+0000 7f77615cf640 10 client.4291.objecter successfully canceled tick 2024-02-09T08:03:14.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.135+0000 7f77615cf640 1 -- 172.21.15.62:0/3137010299 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f774806d1f0 msgr2=0x7f774806f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.135+0000 7f77615cf640 1 --2- 172.21.15.62:0/3137010299 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f774806d1f0 0x7f774806f6b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7754005880 tx=0x7f7754009040 comp rx=0 tx=0).stop 2024-02-09T08:03:14.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.135+0000 7f77615cf640 10 monclient: shutdown 2024-02-09T08:03:14.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.135+0000 7f77615cf640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:14.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.135+0000 7f77615cf640 1 -- 172.21.15.62:0/3137010299 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f775c13fdf0 msgr2=0x7f775c134e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.135+0000 7f77615cf640 1 --2- 172.21.15.62:0/3137010299 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f775c13fdf0 0x7f775c134e40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f774c033000 tx=0x7f774c004a40 comp rx=0 tx=0).stop 2024-02-09T08:03:14.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.135+0000 7f77615cf640 1 -- 172.21.15.62:0/3137010299 shutdown_connections 2024-02-09T08:03:14.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.135+0000 7f77615cf640 1 --2- 172.21.15.62:0/3137010299 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f774806d1f0 0x7f774806f6b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.135+0000 7f77615cf640 1 --2- 172.21.15.62:0/3137010299 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f775c13fdf0 0x7f775c134e40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.136+0000 7f77615cf640 1 --2- 172.21.15.62:0/3137010299 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f775c0b5000 0x7f775c136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.136+0000 7f77615cf640 1 --2- 172.21.15.62:0/3137010299 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f775c0a9e30 0x7f775c141480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.136+0000 7f77615cf640 1 -- 172.21.15.62:0/3137010299 >> 172.21.15.62:0/3137010299 conn(0x7f775c066bb0 msgr2=0x7f775c144f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:14.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.136+0000 7f77615cf640 1 -- 172.21.15.62:0/3137010299 shutdown_connections 2024-02-09T08:03:14.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.136+0000 7f77615cf640 1 -- 172.21.15.62:0/3137010299 wait complete. 2024-02-09T08:03:14.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.136+0000 7f77615cf640 1 librados: shutdown 2024-02-09T08:03:14.149 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-02-09T08:03:14.149 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-02-09T08:03:14.150 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-02-09T08:03:14.150 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-02-09T08:03:14.151 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-02-09T08:03:14.151 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-02-09T08:03:14.151 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-02-09T08:03:14.152 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-02-09T08:03:14.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.321+0000 7fefed174640 10 monclient: get_monmap_and_config 2024-02-09T08:03:14.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.321+0000 7fefed174640 10 monclient: build_initial_monmap 2024-02-09T08:03:14.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.321+0000 7fefed174640 10 monclient: monmap: 2024-02-09T08:03:14.324 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:14.324 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.324 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:03:14.322676+0000 2024-02-09T08:03:14.324 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:03:14.322676+0000 2024-02-09T08:03:14.324 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:14.324 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.324 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:03:14.324 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:03:14.324 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:03:14.325 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:03:14.325 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:03:14.325 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.321+0000 7f364b2a6640 10 monclient: get_monmap_and_config 2024-02-09T08:03:14.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.321+0000 7f364b2a6640 10 monclient: build_initial_monmap 2024-02-09T08:03:14.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.321+0000 7f364b2a6640 10 monclient: monmap: 2024-02-09T08:03:14.325 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:14.325 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.325 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:03:14.322241+0000 2024-02-09T08:03:14.326 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:03:14.322241+0000 2024-02-09T08:03:14.326 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:14.326 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.326 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:03:14.326 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:03:14.326 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:03:14.326 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:03:14.326 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:03:14.326 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.322+0000 7f364b2a6640 1 Processor -- start 2024-02-09T08:03:14.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.322+0000 7fefed174640 1 Processor -- start 2024-02-09T08:03:14.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.322+0000 7fbcb8077640 10 monclient: get_monmap_and_config 2024-02-09T08:03:14.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.322+0000 7fbcb8077640 10 monclient: build_initial_monmap 2024-02-09T08:03:14.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.322+0000 7fbcb8077640 10 monclient: monmap: 2024-02-09T08:03:14.327 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:14.327 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.327 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:03:14.323599+0000 2024-02-09T08:03:14.327 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:03:14.323599+0000 2024-02-09T08:03:14.327 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:14.327 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.327 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:03:14.327 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:03:14.327 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:03:14.327 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:03:14.328 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:03:14.328 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.322+0000 7f364b2a6640 1 -- start start 2024-02-09T08:03:14.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.322+0000 7f364b2a6640 10 monclient: init 2024-02-09T08:03:14.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.322+0000 7f3e7a92e640 10 monclient: get_monmap_and_config 2024-02-09T08:03:14.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.322+0000 7f3e7a92e640 10 monclient: build_initial_monmap 2024-02-09T08:03:14.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.322+0000 7f3e7a92e640 10 monclient: monmap: 2024-02-09T08:03:14.329 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:14.329 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.329 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:03:14.323683+0000 2024-02-09T08:03:14.329 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:03:14.323683+0000 2024-02-09T08:03:14.329 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:14.329 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.329 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:03:14.329 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:03:14.329 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:03:14.329 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:03:14.329 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:03:14.330 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.323+0000 7f83a574b640 10 monclient: get_monmap_and_config 2024-02-09T08:03:14.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.323+0000 7f83a574b640 10 monclient: build_initial_monmap 2024-02-09T08:03:14.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.323+0000 7f83a574b640 10 monclient: monmap: 2024-02-09T08:03:14.330 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:14.330 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.330 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:03:14.324262+0000 2024-02-09T08:03:14.331 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:03:14.324262+0000 2024-02-09T08:03:14.331 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:14.331 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.331 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:03:14.331 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:03:14.331 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:03:14.331 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:03:14.331 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:03:14.331 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.322+0000 7fefed174640 1 -- start start 2024-02-09T08:03:14.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.322+0000 7fefed174640 10 monclient: init 2024-02-09T08:03:14.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.323+0000 7fbcb8077640 1 Processor -- start 2024-02-09T08:03:14.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.323+0000 7f364b2a6640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:14.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.323+0000 7f364b2a6640 10 monclient: _add_conns ranks=[1,2,0,3,4] 2024-02-09T08:03:14.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.323+0000 7f364b2a6640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f36440abfc0 addr v1:172.21.15.103:6789/0 2024-02-09T08:03:14.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.323+0000 7f364b2a6640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f36440ac3a0 0x7f3644140dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.323+0000 7f364b2a6640 10 monclient(hunting): picked mon.noname-b con 0x7f36440ac3a0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:14.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.323+0000 7f364b2a6640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f364413d620 addr v1:172.21.15.62:6789/0 2024-02-09T08:03:14.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.323+0000 7fbcb8077640 1 -- start start 2024-02-09T08:03:14.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.323+0000 7fbcb8077640 10 monclient: init 2024-02-09T08:03:14.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.323+0000 7f364b2a6640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3644141300 con 0x7f364413d620 2024-02-09T08:03:14.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.323+0000 7f364b2a6640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f364406df40 con 0x7f36440abfc0 2024-02-09T08:03:14.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.323+0000 7f364b2a6640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.323+0000 7f364b2a6640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36440ae030 con 0x7f36440ac3a0 2024-02-09T08:03:14.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.323+0000 7f364b2a6640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:14.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.323+0000 7f364b2a6640 10 monclient(hunting): authenticate will time out at 1437.684007s 2024-02-09T08:03:14.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.323+0000 7fefed174640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:14.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.323+0000 7fefed174640 10 monclient: _add_conns ranks=[3,0,2,4,1] 2024-02-09T08:03:14.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.323+0000 7fefed174640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fefe8067110 0x7fefe80a9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.323+0000 7fefed174640 10 monclient(hunting): picked mon.noname-a con 0x7fefe8067110 addr v2:172.21.15.62:3300/0 2024-02-09T08:03:14.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.323+0000 7fefed174640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fefe813f830 addr v1:172.21.15.62:6789/0 2024-02-09T08:03:14.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.323+0000 7fefed174640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fefe8142bd0 0x7fefe813fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.323+0000 7fefed174640 10 monclient(hunting): picked mon.noname-b con 0x7fefe8142bd0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:14.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.323+0000 7fefed174640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefe80aa090 con 0x7fefe813f830 2024-02-09T08:03:14.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.323+0000 7fefed174640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.323+0000 7fefed174640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefe80674f0 con 0x7fefe8067110 2024-02-09T08:03:14.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.323+0000 7fefed174640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.323+0000 7fefed174640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe8143020 con 0x7fefe8142bd0 2024-02-09T08:03:14.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.323+0000 7fefed174640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:14.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.323+0000 7fefed174640 10 monclient(hunting): authenticate will time out at 1437.683984s 2024-02-09T08:03:14.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.324+0000 7f83a574b640 1 Processor -- start 2024-02-09T08:03:14.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.324+0000 7fbcb8077640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:14.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.324+0000 7fbcb8077640 10 monclient: _add_conns ranks=[4,1,3,2,0] 2024-02-09T08:03:14.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.324+0000 7fbcb8077640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbcb006e5c0 0x7fbcb006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.324+0000 7fbcb8077640 10 monclient(hunting): picked mon.noname-c con 0x7fbcb006e5c0 addr v2:172.21.15.103:3300/0 2024-02-09T08:03:14.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.324+0000 7fbcb8077640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fbcb0143bc0 addr v1:172.21.15.103:6789/0 2024-02-09T08:03:14.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.324+0000 7fbcb8077640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbcb0146c10 0x7fbcb01470a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.324+0000 7fbcb8077640 10 monclient(hunting): picked mon.noname-a con 0x7fbcb0146c10 addr v2:172.21.15.62:3300/0 2024-02-09T08:03:14.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.324+0000 7fbcb8077640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcb00724b0 con 0x7fbcb0143bc0 2024-02-09T08:03:14.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.324+0000 7fbcb8077640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.324+0000 7fbcb8077640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcb0144740 con 0x7fbcb0146c10 2024-02-09T08:03:14.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.324+0000 7fbcb8077640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.324+0000 7fbcb8077640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcb00705a0 con 0x7fbcb006e5c0 2024-02-09T08:03:14.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.324+0000 7fbcb8077640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:14.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.324+0000 7fbcb8077640 10 monclient(hunting): authenticate will time out at 1437.684923s 2024-02-09T08:03:14.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.324+0000 7f3649042640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f36440abfc0 0x7f36440ae4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.62:50456/0 (socket says 172.21.15.62:50456) 2024-02-09T08:03:14.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.324+0000 7f3649042640 1 -- 172.21.15.62:0/3053047174 learned_addr learned my addr 172.21.15.62:0/3053047174 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-09T08:03:14.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.324+0000 7f83a574b640 1 -- start start 2024-02-09T08:03:14.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.324+0000 7f83a574b640 10 monclient: init 2024-02-09T08:03:14.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.324+0000 7fefe6d9d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fefe8067110 0x7fefe80a9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.324+0000 7f3e7a92e640 1 Processor -- start 2024-02-09T08:03:14.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.324+0000 7f3e7a92e640 1 -- start start 2024-02-09T08:03:14.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.324+0000 7f3e7a92e640 10 monclient: init 2024-02-09T08:03:14.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.323+0000 7fc74fa70640 10 monclient: get_monmap_and_config 2024-02-09T08:03:14.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.323+0000 7fc74fa70640 10 monclient: build_initial_monmap 2024-02-09T08:03:14.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.323+0000 7fc74fa70640 10 monclient: monmap: 2024-02-09T08:03:14.340 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:14.340 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.340 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:03:14.324777+0000 2024-02-09T08:03:14.340 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:03:14.324777+0000 2024-02-09T08:03:14.340 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:14.340 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.340 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:03:14.340 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:03:14.340 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:03:14.340 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:03:14.340 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:03:14.340 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.325+0000 7fc74fa70640 1 Processor -- start 2024-02-09T08:03:14.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.325+0000 7fbcb5e13640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbcb006e5c0 0x7fbcb006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.325+0000 7fc74fa70640 1 -- start start 2024-02-09T08:03:14.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.325+0000 7fc74fa70640 10 monclient: init 2024-02-09T08:03:14.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.325+0000 7f83a574b640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:14.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.325+0000 7f3e7a92e640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:14.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.325+0000 7f83a574b640 10 monclient: _add_conns ranks=[3,2,1,0,4] 2024-02-09T08:03:14.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.325+0000 7f83a574b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8398038da0 0x7f83980c5250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.325+0000 7f83a574b640 10 monclient(hunting): picked mon.noname-a con 0x7f8398038da0 addr v2:172.21.15.62:3300/0 2024-02-09T08:03:14.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.325+0000 7f83a574b640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8398039180 0x7f83980c8340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.325+0000 7f83a574b640 10 monclient(hunting): picked mon.noname-b con 0x7f8398039180 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:14.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.325+0000 7f83a574b640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f83980c5790 addr v1:172.21.15.103:6789/0 2024-02-09T08:03:14.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.325+0000 7f83a574b640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83980c7e90 con 0x7f83980c5790 2024-02-09T08:03:14.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.325+0000 7f83a574b640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.325+0000 7f83a574b640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8398037630 con 0x7f8398038da0 2024-02-09T08:03:14.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.325+0000 7f83a574b640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.325+0000 7f83a574b640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8398035460 con 0x7f8398039180 2024-02-09T08:03:14.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.325+0000 7f83a574b640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:14.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.325+0000 7f83a574b640 10 monclient(hunting): authenticate will time out at 1437.685873s 2024-02-09T08:03:14.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.325+0000 7f3e7a92e640 10 monclient: _add_conns ranks=[3,4,2,1,0] 2024-02-09T08:03:14.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.325+0000 7f3e7a92e640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3e7406cb00 0x7f3e740a9f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.325+0000 7fefe759e640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fefe8142bd0 0x7fefe813fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.325+0000 7fefe759e640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fefe8142bd0 0x7fefe813fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:60920/0 (socket says 172.21.15.62:60920) 2024-02-09T08:03:14.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.325+0000 7fefe759e640 1 -- 172.21.15.62:0/2486308345 learned_addr learned my addr 172.21.15.62:0/2486308345 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:14.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.325+0000 7fefe759e640 10 monclient(hunting): get_auth_request con 0x7fefe8142bd0 auth_method 0 2024-02-09T08:03:14.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.325+0000 7fefe759e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:14.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.325+0000 7fbcb5e13640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbcb006e5c0 0x7fbcb006e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.62:39936/0 (socket says 172.21.15.62:39936) 2024-02-09T08:03:14.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.325+0000 7fbcb5e13640 1 -- 172.21.15.62:0/847899243 learned_addr learned my addr 172.21.15.62:0/847899243 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:14.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.325+0000 7fbcb5e13640 10 monclient(hunting): get_auth_request con 0x7fbcb006e5c0 auth_method 0 2024-02-09T08:03:14.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.325+0000 7fbcb5e13640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:14.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.325+0000 7fbcb5e13640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:14.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.325+0000 7fbcb5e13640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:14.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.326+0000 7fefe759e640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:14.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.326+0000 7fefe759e640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:14.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.326+0000 7f3e7a92e640 10 monclient(hunting): picked mon.noname-a con 0x7f3e7406cb00 addr v2:172.21.15.62:3300/0 2024-02-09T08:03:14.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.326+0000 7f3e7a92e640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3e740aada0 0x7f3e7413b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.326+0000 7f3e7a92e640 10 monclient(hunting): picked mon.noname-c con 0x7f3e740aada0 addr v2:172.21.15.103:3300/0 2024-02-09T08:03:14.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.326+0000 7f3e7a92e640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e7413bdf0 0x7f3e740ace80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.326+0000 7f3e7a92e640 10 monclient(hunting): picked mon.noname-b con 0x7f3e7413bdf0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:14.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.326+0000 7f3e7a92e640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.326+0000 7f3e7a92e640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e740ac100 con 0x7f3e7406cb00 2024-02-09T08:03:14.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.326+0000 7f3e7a92e640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.326+0000 7f3e7a92e640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e740ac3e0 con 0x7f3e740aada0 2024-02-09T08:03:14.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.326+0000 7f3e7a92e640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.326+0000 7f3e7a92e640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e740ac6c0 con 0x7f3e7413bdf0 2024-02-09T08:03:14.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.326+0000 7f3e7a92e640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:14.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.326+0000 7f3e7a92e640 10 monclient(hunting): authenticate will time out at 1437.686408s 2024-02-09T08:03:14.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.326+0000 7f3648841640 1 --2- 172.21.15.62:0/3053047174 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f36440ac3a0 0x7f3644140dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.326+0000 7fc74fa70640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:14.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.326+0000 7fc74fa70640 10 monclient: _add_conns ranks=[2,4,0,1,3] 2024-02-09T08:03:14.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.326+0000 7fc74fa70640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc748072490 0x7fc748142ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.326+0000 7fefe6d9d640 10 monclient(hunting): get_auth_request con 0x7fefe8067110 auth_method 0 2024-02-09T08:03:14.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.326+0000 7fefe6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:14.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.326+0000 7fefe6d9d640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:14.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.326+0000 7fefe6d9d640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:14.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.326+0000 7f83a4f4a640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f83980c5790 0x7f83980cb2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.62:50470/0 (socket says 172.21.15.62:50470) 2024-02-09T08:03:14.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.326+0000 7f83a4f4a640 1 -- 172.21.15.62:0/925965846 learned_addr learned my addr 172.21.15.62:0/925965846 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-09T08:03:14.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.326+0000 7fc74fa70640 10 monclient(hunting): picked mon.noname-b con 0x7fc748072490 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:14.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.326+0000 7fc74fa70640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc7480a9e50 0x7fc748143000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.326+0000 7fc74fa70640 10 monclient(hunting): picked mon.noname-c con 0x7fc7480a9e50 addr v2:172.21.15.103:3300/0 2024-02-09T08:03:14.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.326+0000 7fc74fa70640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc74813f7d0 addr v1:172.21.15.62:6789/0 2024-02-09T08:03:14.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.326+0000 7fc74fa70640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7480ab310 con 0x7fc74813f7d0 2024-02-09T08:03:14.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.326+0000 7fc74fa70640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.326+0000 7fc74fa70640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc748072870 con 0x7fc7480a9e50 2024-02-09T08:03:14.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.326+0000 7fc74fa70640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.326+0000 7fc74fa70640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7480ab5f0 con 0x7fc748072490 2024-02-09T08:03:14.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.326+0000 7fc74fa70640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:14.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.326+0000 7fc74fa70640 10 monclient(hunting): authenticate will time out at 1437.686655s 2024-02-09T08:03:14.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.326+0000 7ff2d769d640 10 monclient: get_monmap_and_config 2024-02-09T08:03:14.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.326+0000 7ff2d769d640 10 monclient: build_initial_monmap 2024-02-09T08:03:14.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.326+0000 7ff2d769d640 10 monclient: monmap: 2024-02-09T08:03:14.350 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:14.350 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.350 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:03:14.327607+0000 2024-02-09T08:03:14.350 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:03:14.327607+0000 2024-02-09T08:03:14.350 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:14.350 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.351 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:03:14.351 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:03:14.351 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:03:14.351 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:03:14.351 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:03:14.351 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.326+0000 7fbcb5e13640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:14.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.326+0000 7fbcb5e13640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:14.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.326+0000 7fbcb5e13640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:14.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.327+0000 7fbcb6614640 1 --2- 172.21.15.62:0/847899243 >> v2:172.21.15.62:3300/0 conn(0x7fbcb0146c10 0x7fbcb01470a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.327+0000 7fefe759e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:14.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.327+0000 7fefe759e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:14.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.327+0000 7ff2d769d640 1 Processor -- start 2024-02-09T08:03:14.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.327+0000 7fefe759e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:14.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.327+0000 7ff2d769d640 1 -- start start 2024-02-09T08:03:14.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.327+0000 7ff2d769d640 10 monclient: init 2024-02-09T08:03:14.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.327+0000 7fbcb6614640 10 monclient(hunting): get_auth_request con 0x7fbcb0146c10 auth_method 0 2024-02-09T08:03:14.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.327+0000 7fbcb6614640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:14.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.327+0000 7fbcb6614640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:14.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.327+0000 7fbcb6614640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:14.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.328+0000 7f3648841640 10 monclient(hunting): get_auth_request con 0x7f36440ac3a0 auth_method 0 2024-02-09T08:03:14.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.328+0000 7f3648841640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:14.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.328+0000 7f3648841640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:14.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.328+0000 7f3648841640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:14.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.328+0000 7f839f7fe640 1 --2- 172.21.15.62:0/925965846 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8398039180 0x7f83980c8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.328+0000 7f839f7fe640 10 monclient(hunting): get_auth_request con 0x7f8398039180 auth_method 0 2024-02-09T08:03:14.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.328+0000 7ff2d769d640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:14.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.328+0000 7ff2d769d640 10 monclient: _add_conns ranks=[4,2,1,3,0] 2024-02-09T08:03:14.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.328+0000 7ff2d769d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff2d0074680 0x7ff2d013f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.328+0000 7ff2d769d640 10 monclient(hunting): picked mon.noname-c con 0x7ff2d0074680 addr v2:172.21.15.103:3300/0 2024-02-09T08:03:14.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.328+0000 7ff2d769d640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff2d013f7b0 0x7ff2d0145ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.328+0000 7ff2d769d640 10 monclient(hunting): picked mon.noname-b con 0x7ff2d013f7b0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:14.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.328+0000 7f839f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:14.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.328+0000 7f839f7fe640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:14.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.328+0000 7f839f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:14.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.328+0000 7ff2d769d640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ff2d0146020 addr v1:172.21.15.103:6789/0 2024-02-09T08:03:14.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.328+0000 7ff2d769d640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2d006fae0 con 0x7ff2d0146020 2024-02-09T08:03:14.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.328+0000 7fbcb5e13640 10 monclient(hunting): handle_auth_done global_id 4294 payload 274 2024-02-09T08:03:14.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.328+0000 7fbcb5e13640 1 -- 172.21.15.62:0/847899243 >> v2:172.21.15.62:3300/0 conn(0x7fbcb0146c10 msgr2=0x7fbcb01470a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:14.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.328+0000 7ff2d769d640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.328+0000 7ff2d769d640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2d0074a60 con 0x7ff2d0074680 2024-02-09T08:03:14.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.328+0000 7fbcb5e13640 1 --2- 172.21.15.62:0/847899243 >> v2:172.21.15.62:3300/0 conn(0x7fbcb0146c10 0x7fbcb01470a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.328+0000 7fbcb5e13640 1 -- 172.21.15.62:0/847899243 >> v1:172.21.15.103:6789/0 conn(0x7fbcb0143bc0 legacy=0x7fbcb0144030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:14.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.328+0000 7ff2d769d640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.328+0000 7ff2d769d640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d006fdc0 con 0x7ff2d013f7b0 2024-02-09T08:03:14.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.328+0000 7ff2d769d640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:14.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.328+0000 7ff2d769d640 10 monclient(hunting): authenticate will time out at 1437.688958s 2024-02-09T08:03:14.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.328+0000 7fbcb5e13640 10 monclient: _finish_hunting 0 2024-02-09T08:03:14.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.328+0000 7fbcb5e13640 1 monclient: found mon.noname-c 2024-02-09T08:03:14.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.328+0000 7fbcb5e13640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:14.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.328+0000 7fbcb5e13640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.103:3300/0 2024-02-09T08:03:14.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.328+0000 7fbcb5e13640 1 -- 172.21.15.62:0/847899243 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb0070810 con 0x7fbcb006e5c0 2024-02-09T08:03:14.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.329+0000 7f3648841640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:14.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.329+0000 7f3648841640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:14.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.329+0000 7f3648841640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:14.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.329+0000 7fea733be640 10 monclient: get_monmap_and_config 2024-02-09T08:03:14.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.329+0000 7fea733be640 10 monclient: build_initial_monmap 2024-02-09T08:03:14.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.329+0000 7fea733be640 10 monclient: monmap: 2024-02-09T08:03:14.361 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:14.361 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.361 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:03:14.330525+0000 2024-02-09T08:03:14.361 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:03:14.330525+0000 2024-02-09T08:03:14.361 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:14.361 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.361 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:03:14.361 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:03:14.361 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:03:14.362 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:03:14.362 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:03:14.362 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.330+0000 7fea733be640 1 Processor -- start 2024-02-09T08:03:14.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.330+0000 7fea733be640 1 -- start start 2024-02-09T08:03:14.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.330+0000 7fea733be640 10 monclient: init 2024-02-09T08:03:14.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.330+0000 7fc74e00d640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fc74813f7d0 0x7fc74813fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34446/0 (socket says 172.21.15.62:34446) 2024-02-09T08:03:14.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.330+0000 7fc74e00d640 1 -- 172.21.15.62:0/515247343 learned_addr learned my addr 172.21.15.62:0/515247343 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-09T08:03:14.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.330+0000 7fea733be640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:14.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.330+0000 7fea733be640 10 monclient: _add_conns ranks=[1,0,3,2,4] 2024-02-09T08:03:14.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.330+0000 7fea733be640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fea6c0b5000 addr v1:172.21.15.103:6789/0 2024-02-09T08:03:14.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.330+0000 7fea733be640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fea6c0a9e30 addr v1:172.21.15.62:6789/0 2024-02-09T08:03:14.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.330+0000 7fea733be640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fea6c13fdf0 0x7fea6c1464f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.330+0000 7fefe759e640 10 monclient(hunting): handle_auth_done global_id 4274 payload 274 2024-02-09T08:03:14.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.331+0000 7fefe759e640 1 -- 172.21.15.62:0/2486308345 >> v2:172.21.15.62:3300/0 conn(0x7fefe8067110 msgr2=0x7fefe80a9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:14.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.331+0000 7fefe759e640 1 --2- 172.21.15.62:0/2486308345 >> v2:172.21.15.62:3300/0 conn(0x7fefe8067110 0x7fefe80a9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.331+0000 7fea733be640 10 monclient(hunting): picked mon.noname-a con 0x7fea6c13fdf0 addr v2:172.21.15.62:3300/0 2024-02-09T08:03:14.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.331+0000 7fea733be640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea6c0aa4a0 con 0x7fea6c0a9e30 2024-02-09T08:03:14.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.331+0000 7fefe759e640 1 -- 172.21.15.62:0/2486308345 >> v1:172.21.15.62:6789/0 conn(0x7fefe813f830 legacy=0x7fefe81424c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:14.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.331+0000 7fea733be640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea6c0b2900 con 0x7fea6c0b5000 2024-02-09T08:03:14.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.331+0000 7fefe759e640 10 monclient: _finish_hunting 0 2024-02-09T08:03:14.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.331+0000 7fea733be640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.331+0000 7fea733be640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea6c0b53e0 con 0x7fea6c13fdf0 2024-02-09T08:03:14.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.331+0000 7fea733be640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:14.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.331+0000 7fea733be640 10 monclient(hunting): authenticate will time out at 1437.691455s 2024-02-09T08:03:14.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.331+0000 7fefe759e640 1 monclient: found mon.noname-b 2024-02-09T08:03:14.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.331+0000 7fefe759e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:14.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.331+0000 7fefe759e640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.62:3301/0 2024-02-09T08:03:14.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.331+0000 7fefe759e640 1 -- 172.21.15.62:0/2486308345 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe80ab5b0 con 0x7fefe8142bd0 2024-02-09T08:03:14.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.331+0000 7f839f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:14.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.331+0000 7f839f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:14.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.331+0000 7f839f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:14.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.331+0000 7f3e73fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3e7406cb00 0x7f3e740a9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.332+0000 7f839f7fe640 10 monclient(hunting): handle_auth_done global_id 4280 payload 274 2024-02-09T08:03:14.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.332+0000 7f839f7fe640 1 -- 172.21.15.62:0/925965846 >> v2:172.21.15.62:3300/0 conn(0x7f8398038da0 msgr2=0x7f83980c5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:14.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.332+0000 7f839f7fe640 1 --2- 172.21.15.62:0/925965846 >> v2:172.21.15.62:3300/0 conn(0x7f8398038da0 0x7f83980c5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.332+0000 7f839f7fe640 1 -- 172.21.15.62:0/925965846 >> v1:172.21.15.103:6789/0 conn(0x7f83980c5790 legacy=0x7f83980cb2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.332+0000 7f839f7fe640 10 monclient: _finish_hunting 0 2024-02-09T08:03:14.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.332+0000 7f839f7fe640 1 monclient: found mon.noname-b 2024-02-09T08:03:14.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.332+0000 7f839f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:14.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.332+0000 7f839f7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.62:3301/0 2024-02-09T08:03:14.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.332+0000 7f839f7fe640 1 -- 172.21.15.62:0/925965846 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8398035890 con 0x7f8398039180 2024-02-09T08:03:14.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.333+0000 7f3e73fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3e7406cb00 0x7f3e740a9f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:34828/0 (socket says 172.21.15.62:34828) 2024-02-09T08:03:14.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.333+0000 7f3e73fff640 1 -- 172.21.15.62:0/2473651188 learned_addr learned my addr 172.21.15.62:0/2473651188 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:14.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.333+0000 7f3e73fff640 10 monclient(hunting): get_auth_request con 0x7f3e7406cb00 auth_method 0 2024-02-09T08:03:14.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.333+0000 7f3e73fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:14.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.333+0000 7f3e73fff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:14.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.333+0000 7f3e73fff640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:14.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.334+0000 7f3e73fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:14.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.334+0000 7f3e73fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:14.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.334+0000 7f3e73fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:14.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.334+0000 7f3648841640 10 monclient(hunting): handle_auth_done global_id 4277 payload 274 2024-02-09T08:03:14.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.334+0000 7f3648841640 1 -- 172.21.15.62:0/3053047174 >> v1:172.21.15.103:6789/0 conn(0x7f36440abfc0 legacy=0x7f36440ae4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.334+0000 7f3648841640 1 -- 172.21.15.62:0/3053047174 >> v1:172.21.15.62:6789/0 conn(0x7f364413d620 legacy=0x7f364414aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.334+0000 7f3648841640 10 monclient: _finish_hunting 0 2024-02-09T08:03:14.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.334+0000 7f3648841640 1 monclient: found mon.noname-b 2024-02-09T08:03:14.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.334+0000 7f3648841640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:14.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.334+0000 7f3648841640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.62:3301/0 2024-02-09T08:03:14.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.334+0000 7f3648841640 1 -- 172.21.15.62:0/3053047174 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36440b0340 con 0x7f36440ac3a0 2024-02-09T08:03:14.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.335+0000 7fbcb5e13640 1 --2- 172.21.15.62:0/847899243 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcb006e5c0 0x7fbcb006e9a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbcb006cd90 tx=0x7fbca802bdc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=524fb43c1446285f server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:14.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.336+0000 7fc74d00b640 1 --2- 172.21.15.62:0/515247343 >> v2:172.21.15.103:3300/0 conn(0x7fc7480a9e50 0x7fc748143000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.337+0000 7fc74d00b640 10 monclient(hunting): get_auth_request con 0x7fc7480a9e50 auth_method 0 2024-02-09T08:03:14.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.337+0000 7fc74d00b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:14.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.337+0000 7fc74d00b640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:14.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.337+0000 7fc74d00b640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:14.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.337+0000 7f3e73fff640 10 monclient(hunting): handle_auth_done global_id 4287 payload 274 2024-02-09T08:03:14.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.337+0000 7f3e73fff640 1 -- 172.21.15.62:0/2473651188 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e7413bdf0 msgr2=0x7f3e740ace80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:14.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.337+0000 7f3e73fff640 1 --2- 172.21.15.62:0/2473651188 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e7413bdf0 0x7f3e740ace80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.337+0000 7f3e73fff640 1 -- 172.21.15.62:0/2473651188 >> v2:172.21.15.103:3300/0 conn(0x7f3e740aada0 msgr2=0x7f3e7413b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:14.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.337+0000 7f3e73fff640 1 --2- 172.21.15.62:0/2473651188 >> v2:172.21.15.103:3300/0 conn(0x7f3e740aada0 0x7f3e7413b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.337+0000 7f3e73fff640 10 monclient: _finish_hunting 0 2024-02-09T08:03:14.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.337+0000 7f3e73fff640 1 monclient: found mon.noname-a 2024-02-09T08:03:14.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.337+0000 7f3e73fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:14.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.337+0000 7f3e73fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-02-09T08:03:14.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.337+0000 7f3e73fff640 1 -- 172.21.15.62:0/2473651188 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e740aa460 con 0x7f3e7406cb00 2024-02-09T08:03:14.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.339+0000 7fefe759e640 1 --2- 172.21.15.62:0/2486308345 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fefe8142bd0 0x7fefe813fc70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fefd8009870 tx=0x7fefd802b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11a3fc360376dd5b server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:14.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.339+0000 7fc74d00b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:14.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.339+0000 7fc74d00b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:14.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.339+0000 7fc74d00b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:14.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.339+0000 7f839f7fe640 1 --2- 172.21.15.62:0/925965846 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8398039180 0x7f83980c8340 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f83940097d0 tx=0x7f839402b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4f0a3d0116624a0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:14.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.340+0000 7f3648841640 1 --2- 172.21.15.62:0/3053047174 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f36440ac3a0 0x7f3644140dc0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f36400097d0 tx=0x7f364002b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b9ecacc1daf5dba server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:14.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.340+0000 7f3e73fff640 1 --2- 172.21.15.62:0/2473651188 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e7406cb00 0x7f3e740a9f20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3e740a9c40 tx=0x7f3e6c02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e455534c2a4db451 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:14.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.342+0000 7fc74d00b640 10 monclient(hunting): handle_auth_done global_id 4303 payload 274 2024-02-09T08:03:14.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.342+0000 7fc74d00b640 1 -- 172.21.15.62:0/515247343 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc748072490 msgr2=0x7fc748142ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:14.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.342+0000 7fc74d00b640 1 --2- 172.21.15.62:0/515247343 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc748072490 0x7fc748142ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.342+0000 7fc74d00b640 1 -- 172.21.15.62:0/515247343 >> v1:172.21.15.62:6789/0 conn(0x7fc74813f7d0 legacy=0x7fc74813fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.342+0000 7fc74d00b640 10 monclient: _finish_hunting 0 2024-02-09T08:03:14.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.342+0000 7fc74d00b640 1 monclient: found mon.noname-c 2024-02-09T08:03:14.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.342+0000 7fc74d00b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:14.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.342+0000 7fc74d00b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.103:3300/0 2024-02-09T08:03:14.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.342+0000 7fc74d00b640 1 -- 172.21.15.62:0/515247343 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7481425a0 con 0x7fc7480a9e50 2024-02-09T08:03:14.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.348+0000 7ff2d5439640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff2d0074680 0x7ff2d013f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.349+0000 7fc74d00b640 1 --2- 172.21.15.62:0/515247343 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7480a9e50 0x7fc748143000 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc7380097a0 tx=0x7fc73802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36b2452588eae8be server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:14.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.350+0000 7ff2d5439640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff2d0074680 0x7ff2d013f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.62:39966/0 (socket says 172.21.15.62:39966) 2024-02-09T08:03:14.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.350+0000 7ff2d5439640 1 -- 172.21.15.62:0/1084998290 learned_addr learned my addr 172.21.15.62:0/1084998290 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:14.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.350+0000 7ff2d5439640 10 monclient(hunting): get_auth_request con 0x7ff2d0074680 auth_method 0 2024-02-09T08:03:14.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.350+0000 7ff2d5439640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:14.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.350+0000 7ff2d5439640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:14.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.350+0000 7ff2d5439640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:14.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.351+0000 7fea7195b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fea6c13fdf0 0x7fea6c1464f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.352+0000 7fea7115a640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fea6c0b5000 0x7fea6c13f6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.62:50480/0 (socket says 172.21.15.62:50480) 2024-02-09T08:03:14.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.352+0000 7fea7115a640 1 -- 172.21.15.62:0/3414525613 learned_addr learned my addr 172.21.15.62:0/3414525613 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-09T08:03:14.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.352+0000 7fea7195b640 10 monclient(hunting): get_auth_request con 0x7fea6c13fdf0 auth_method 0 2024-02-09T08:03:14.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.352+0000 7f839effd640 1 -- 172.21.15.62:0/925965846 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839402e070 con 0x7f8398039180 2024-02-09T08:03:14.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.352+0000 7f839effd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:14.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.352+0000 7f839effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:03:14.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.352+0000 7f839effd640 10 monclient: dump: 2024-02-09T08:03:14.379 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:14.379 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.379 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.379 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.379 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:14.379 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.379 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:14.379 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:14.379 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:14.380 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.352+0000 7f839effd640 10 monclient: _finish_auth 0 2024-02-09T08:03:14.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.352+0000 7f839effd640 10 monclient: _check_auth_tickets 2024-02-09T08:03:14.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.352+0000 7f839effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:14.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.352+0000 7f83a574b640 5 monclient: authenticate success, global_id 4280 2024-02-09T08:03:14.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.352+0000 7f83a574b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-02-09T08:03:14.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.352+0000 7f839effd640 1 -- 172.21.15.62:0/925965846 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83940315a0 con 0x7f8398039180 2024-02-09T08:03:14.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.352+0000 7f839effd640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:14.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.352+0000 7f83a574b640 10 monclient: get_monmap_and_config success 2024-02-09T08:03:14.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.352+0000 7f83a574b640 4 set_mon_vals no callback set 2024-02-09T08:03:14.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.352+0000 7ff2d5439640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:14.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.352+0000 7ff2d5439640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:14.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.352+0000 7ff2d5439640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:14.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.352+0000 7fea7195b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:14.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.352+0000 7fea7195b640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:14.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.352+0000 7fea7195b640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:14.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.352+0000 7f839effd640 1 -- 172.21.15.62:0/925965846 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8394031930 con 0x7f8398039180 2024-02-09T08:03:14.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.352+0000 7f839effd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:14.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.352+0000 7f839effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-09T08:03:14.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.352+0000 7f839effd640 10 monclient: dump: 2024-02-09T08:03:14.382 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:14.382 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.382 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.382 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.382 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:14.382 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.382 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:14.382 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:14.383 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:14.383 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.353+0000 7f3e72ffd640 1 -- 172.21.15.62:0/2473651188 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6c02cb00 con 0x7f3e7406cb00 2024-02-09T08:03:14.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.353+0000 7f3e72ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:14.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.353+0000 7f3e72ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-09T08:03:14.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.353+0000 7f3e72ffd640 10 monclient: dump: 2024-02-09T08:03:14.383 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:14.383 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.384 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.384 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.384 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:14.384 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.384 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:14.384 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:14.384 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:14.384 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.353+0000 7f3e72ffd640 10 monclient: _finish_auth 0 2024-02-09T08:03:14.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.353+0000 7f3e72ffd640 10 monclient: _check_auth_tickets 2024-02-09T08:03:14.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.353+0000 7f3e72ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:14.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.353+0000 7f3e72ffd640 1 -- 172.21.15.62:0/2473651188 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e6c02cc60 con 0x7f3e7406cb00 2024-02-09T08:03:14.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.353+0000 7f3e72ffd640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:14.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.353+0000 7f3e72ffd640 1 -- 172.21.15.62:0/2473651188 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6c0343f0 con 0x7f3e7406cb00 2024-02-09T08:03:14.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.353+0000 7f3e72ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:14.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.353+0000 7f3e72ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-09T08:03:14.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.353+0000 7f3e72ffd640 10 monclient: dump: 2024-02-09T08:03:14.385 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:14.385 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.385 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.385 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.385 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:14.385 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.385 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:14.385 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:14.385 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:14.385 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.353+0000 7f83a574b640 10 monclient: shutdown 2024-02-09T08:03:14.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.353+0000 7f83a574b640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:14.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.353+0000 7f83a574b640 1 -- 172.21.15.62:0/925965846 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8398039180 msgr2=0x7f83980c8340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.353+0000 7f83a574b640 1 --2- 172.21.15.62:0/925965846 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8398039180 0x7f83980c8340 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f83940097d0 tx=0x7f839402b840 comp rx=0 tx=0).stop 2024-02-09T08:03:14.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.353+0000 7ff2d4c38640 1 --2- 172.21.15.62:0/1084998290 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff2d013f7b0 0x7ff2d0145ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.353+0000 7f83a574b640 1 -- 172.21.15.62:0/925965846 shutdown_connections 2024-02-09T08:03:14.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.353+0000 7f83a574b640 1 --2- 172.21.15.62:0/925965846 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8398039180 0x7f83980c8340 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.353+0000 7f83a574b640 1 --2- 172.21.15.62:0/925965846 >> v2:172.21.15.62:3300/0 conn(0x7f8398038da0 0x7f83980c5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.353+0000 7f83a574b640 1 -- 172.21.15.62:0/925965846 >> 172.21.15.62:0/925965846 conn(0x7f8398006600 msgr2=0x7f8398006a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:14.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.353+0000 7f83a574b640 1 -- 172.21.15.62:0/925965846 shutdown_connections 2024-02-09T08:03:14.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.353+0000 7f83a574b640 1 -- 172.21.15.62:0/925965846 wait complete. 2024-02-09T08:03:14.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.354+0000 7f3e7a92e640 5 monclient: authenticate success, global_id 4287 2024-02-09T08:03:14.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.354+0000 7f3e7a92e640 10 monclient: get_monmap_and_config success 2024-02-09T08:03:14.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.354+0000 7f3e7a92e640 4 set_mon_vals no callback set 2024-02-09T08:03:14.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.354+0000 7fefe5d9b640 1 -- 172.21.15.62:0/2486308345 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd80317c0 con 0x7fefe8142bd0 2024-02-09T08:03:14.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.354+0000 7fefe5d9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:14.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.354+0000 7fefe5d9b640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:03:14.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.354+0000 7fefe5d9b640 10 monclient: dump: 2024-02-09T08:03:14.389 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:14.389 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.389 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.389 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.389 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:14.389 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.389 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:14.389 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:14.389 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:14.389 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.354+0000 7fefe5d9b640 10 monclient: _finish_auth 0 2024-02-09T08:03:14.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.354+0000 7fefe5d9b640 10 monclient: _check_auth_tickets 2024-02-09T08:03:14.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.354+0000 7fefe5d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:14.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.354+0000 7fefe5d9b640 1 -- 172.21.15.62:0/2486308345 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd8031920 con 0x7fefe8142bd0 2024-02-09T08:03:14.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.354+0000 7fefe5d9b640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:14.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.354+0000 7fefe5d9b640 1 -- 172.21.15.62:0/2486308345 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd8031cb0 con 0x7fefe8142bd0 2024-02-09T08:03:14.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.354+0000 7fefed174640 5 monclient: authenticate success, global_id 4274 2024-02-09T08:03:14.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.354+0000 7fefed174640 10 monclient: get_monmap_and_config success 2024-02-09T08:03:14.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.354+0000 7fefed174640 4 set_mon_vals no callback set 2024-02-09T08:03:14.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.354+0000 7fefe5d9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:14.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.354+0000 7fefe5d9b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-09T08:03:14.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.354+0000 7fefe5d9b640 10 monclient: dump: 2024-02-09T08:03:14.390 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:14.390 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.390 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.390 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.390 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:14.390 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.390 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:14.391 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:14.391 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:14.391 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.354+0000 7f83a574b640 10 monclient: build_initial_monmap 2024-02-09T08:03:14.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.354+0000 7f83a574b640 10 monclient: monmap: 2024-02-09T08:03:14.391 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:14.391 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:03:14.391 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:03:14.391 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:03:14.392 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:14.392 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.392 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:03:14.392 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:03:14.392 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:03:14.392 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.354+0000 7f363bfff640 1 -- 172.21.15.62:0/3053047174 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3640031890 con 0x7f36440ac3a0 2024-02-09T08:03:14.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.354+0000 7f363bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:14.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.354+0000 7f363bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:03:14.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.354+0000 7f363bfff640 10 monclient: dump: 2024-02-09T08:03:14.393 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:14.393 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.393 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.393 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.393 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:14.393 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.393 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:14.393 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:14.393 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:14.393 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.354+0000 7f363bfff640 10 monclient: _finish_auth 0 2024-02-09T08:03:14.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.354+0000 7f363bfff640 10 monclient: _check_auth_tickets 2024-02-09T08:03:14.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.354+0000 7f363bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:14.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.354+0000 7f363bfff640 1 -- 172.21.15.62:0/3053047174 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36400319f0 con 0x7f36440ac3a0 2024-02-09T08:03:14.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.354+0000 7f363bfff640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:14.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.354+0000 7f363bfff640 1 -- 172.21.15.62:0/3053047174 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3640031d80 con 0x7f36440ac3a0 2024-02-09T08:03:14.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.354+0000 7f363bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:14.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.354+0000 7f363bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-09T08:03:14.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.354+0000 7f363bfff640 10 monclient: dump: 2024-02-09T08:03:14.394 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:14.394 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.394 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.394 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.394 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:14.394 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.394 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:14.394 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:14.395 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:14.395 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.354+0000 7f364b2a6640 5 monclient: authenticate success, global_id 4277 2024-02-09T08:03:14.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.354+0000 7f364b2a6640 10 monclient: get_monmap_and_config success 2024-02-09T08:03:14.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.354+0000 7f364b2a6640 4 set_mon_vals no callback set 2024-02-09T08:03:14.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.354+0000 7f3e7a92e640 10 monclient: shutdown 2024-02-09T08:03:14.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.354+0000 7f3e7a92e640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:14.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.354+0000 7f3e7a92e640 1 -- 172.21.15.62:0/2473651188 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e7406cb00 msgr2=0x7f3e740a9f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.354+0000 7f3e7a92e640 1 --2- 172.21.15.62:0/2473651188 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e7406cb00 0x7f3e740a9f20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3e740a9c40 tx=0x7f3e6c02bf60 comp rx=0 tx=0).stop 2024-02-09T08:03:14.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.354+0000 7f83a574b640 1 librados: starting msgr at 2024-02-09T08:03:14.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.355+0000 7f83a574b640 1 librados: starting objecter 2024-02-09T08:03:14.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.355+0000 7f3e7a92e640 1 -- 172.21.15.62:0/2473651188 shutdown_connections 2024-02-09T08:03:14.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.355+0000 7f3e7a92e640 1 --2- 172.21.15.62:0/2473651188 >> v2:172.21.15.103:3300/0 conn(0x7f3e740aada0 0x7f3e7413b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.355+0000 7f3e7a92e640 1 --2- 172.21.15.62:0/2473651188 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e7413bdf0 0x7f3e740ace80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.355+0000 7f3e7a92e640 1 --2- 172.21.15.62:0/2473651188 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e7406cb00 0x7f3e740a9f20 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.355+0000 7f3e7a92e640 1 -- 172.21.15.62:0/2473651188 >> 172.21.15.62:0/2473651188 conn(0x7f3e740b3ef0 msgr2=0x7f3e740b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:14.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.355+0000 7fefed174640 10 monclient: shutdown 2024-02-09T08:03:14.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.355+0000 7fefed174640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:14.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.355+0000 7fefed174640 1 -- 172.21.15.62:0/2486308345 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fefe8142bd0 msgr2=0x7fefe813fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.355+0000 7fefed174640 1 --2- 172.21.15.62:0/2486308345 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fefe8142bd0 0x7fefe813fc70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fefd8009870 tx=0x7fefd802b860 comp rx=0 tx=0).stop 2024-02-09T08:03:14.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.355+0000 7f3e7a92e640 1 -- 172.21.15.62:0/2473651188 shutdown_connections 2024-02-09T08:03:14.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.355+0000 7f83a574b640 1 Processor -- start 2024-02-09T08:03:14.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.355+0000 7fefed174640 1 -- 172.21.15.62:0/2486308345 shutdown_connections 2024-02-09T08:03:14.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.355+0000 7fefed174640 1 --2- 172.21.15.62:0/2486308345 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fefe8142bd0 0x7fefe813fc70 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.355+0000 7fefed174640 1 --2- 172.21.15.62:0/2486308345 >> v2:172.21.15.62:3300/0 conn(0x7fefe8067110 0x7fefe80a9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.355+0000 7fefed174640 1 -- 172.21.15.62:0/2486308345 >> 172.21.15.62:0/2486308345 conn(0x7fefe80b4e20 msgr2=0x7fefe80b5230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:14.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.355+0000 7fefed174640 1 -- 172.21.15.62:0/2486308345 shutdown_connections 2024-02-09T08:03:14.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.355+0000 7fefed174640 1 -- 172.21.15.62:0/2486308345 wait complete. 2024-02-09T08:03:14.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.355+0000 7ff2d4c38640 10 monclient(hunting): get_auth_request con 0x7ff2d013f7b0 auth_method 0 2024-02-09T08:03:14.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.355+0000 7ff2d4c38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:14.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.355+0000 7ff2d4c38640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:14.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.355+0000 7ff2d4c38640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:14.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.355+0000 7f83a574b640 1 -- start start 2024-02-09T08:03:14.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.355+0000 7f83a574b640 1 librados: setting wanted keys 2024-02-09T08:03:14.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.355+0000 7f83a574b640 1 librados: calling monclient init 2024-02-09T08:03:14.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.355+0000 7f83a574b640 10 monclient: init 2024-02-09T08:03:14.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.355+0000 7f364b2a6640 10 monclient: shutdown 2024-02-09T08:03:14.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.355+0000 7f364b2a6640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:14.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.355+0000 7f3e7a92e640 1 -- 172.21.15.62:0/2473651188 wait complete. 2024-02-09T08:03:14.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.355+0000 7f364b2a6640 1 -- 172.21.15.62:0/3053047174 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f36440ac3a0 msgr2=0x7f3644140dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.355+0000 7f364b2a6640 1 --2- 172.21.15.62:0/3053047174 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f36440ac3a0 0x7f3644140dc0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f36400097d0 tx=0x7f364002b930 comp rx=0 tx=0).stop 2024-02-09T08:03:14.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.355+0000 7ff2d4c38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:14.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.355+0000 7ff2d4c38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:14.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.355+0000 7ff2d4c38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:14.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.355+0000 7f364b2a6640 1 -- 172.21.15.62:0/3053047174 shutdown_connections 2024-02-09T08:03:14.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.355+0000 7f364b2a6640 1 --2- 172.21.15.62:0/3053047174 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f36440ac3a0 0x7f3644140dc0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.355+0000 7f364b2a6640 1 -- 172.21.15.62:0/3053047174 >> 172.21.15.62:0/3053047174 conn(0x7f36440b3cb0 msgr2=0x7f36440b40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:14.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.356+0000 7f364b2a6640 1 -- 172.21.15.62:0/3053047174 shutdown_connections 2024-02-09T08:03:14.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.356+0000 7f364b2a6640 1 -- 172.21.15.62:0/3053047174 wait complete. 2024-02-09T08:03:14.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.356+0000 7f3e7a92e640 10 monclient: build_initial_monmap 2024-02-09T08:03:14.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.356+0000 7f3e7a92e640 10 monclient: monmap: 2024-02-09T08:03:14.403 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:14.403 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:03:14.403 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:03:14.403 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:03:14.403 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:14.403 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.403 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:03:14.403 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:03:14.403 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:03:14.404 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.356+0000 7f83a574b640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:14.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.356+0000 7f83a574b640 10 monclient: _add_conns ranks=[0,2,1] 2024-02-09T08:03:14.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.356+0000 7f83a574b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8398038da0 0x7f839802de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.356+0000 7f83a574b640 10 monclient(hunting): picked mon.noname-a con 0x7f8398038da0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:03:14.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.356+0000 7f83a574b640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f83980c5790 0x7f83981615b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.356+0000 7f83a574b640 10 monclient(hunting): picked mon.noname-c con 0x7f83980c5790 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:14.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.356+0000 7f83a574b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f83980cbaf0 0x7f839802fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.356+0000 7f83a574b640 10 monclient(hunting): picked mon.noname-b con 0x7f83980cbaf0 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:03:14.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.356+0000 7f83a574b640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.356+0000 7f83a574b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839802f740 con 0x7f8398038da0 2024-02-09T08:03:14.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.356+0000 7f83a574b640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.356+0000 7f83a574b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839802fa00 con 0x7f83980cbaf0 2024-02-09T08:03:14.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.356+0000 7f83a574b640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.356+0000 7f83a574b640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f839802f040 con 0x7f83980c5790 2024-02-09T08:03:14.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.356+0000 7f83a574b640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:14.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.356+0000 7f83a574b640 10 monclient(hunting): authenticate will time out at 1437.716578s 2024-02-09T08:03:14.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.356+0000 7fefed174640 10 monclient: build_initial_monmap 2024-02-09T08:03:14.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.356+0000 7fefed174640 10 monclient: monmap: 2024-02-09T08:03:14.406 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:14.406 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:03:14.406 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:03:14.406 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:03:14.406 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:14.406 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.406 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:03:14.406 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:03:14.406 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:03:14.406 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.356+0000 7fefed174640 1 librados: starting msgr at 2024-02-09T08:03:14.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.356+0000 7fefed174640 1 librados: starting objecter 2024-02-09T08:03:14.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.356+0000 7ff2d5439640 10 monclient(hunting): handle_auth_done global_id 4306 payload 274 2024-02-09T08:03:14.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.356+0000 7ff2d5439640 1 -- 172.21.15.62:0/1084998290 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff2d013f7b0 msgr2=0x7ff2d0145ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:14.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.356+0000 7ff2d5439640 1 --2- 172.21.15.62:0/1084998290 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff2d013f7b0 0x7ff2d0145ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.356+0000 7ff2d5439640 1 -- 172.21.15.62:0/1084998290 >> v1:172.21.15.103:6789/0 conn(0x7ff2d0146020 legacy=0x7ff2d00ad870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:14.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.356+0000 7ff2d5439640 10 monclient: _finish_hunting 0 2024-02-09T08:03:14.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.356+0000 7ff2d5439640 1 monclient: found mon.noname-c 2024-02-09T08:03:14.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.356+0000 7ff2d5439640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:14.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.356+0000 7ff2d5439640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.103:3300/0 2024-02-09T08:03:14.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.356+0000 7ff2d5439640 1 -- 172.21.15.62:0/1084998290 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d00b05f0 con 0x7ff2d0074680 2024-02-09T08:03:14.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.357+0000 7fefed174640 1 Processor -- start 2024-02-09T08:03:14.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.357+0000 7f3e7a92e640 1 librados: starting msgr at 2024-02-09T08:03:14.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.357+0000 7f3e7a92e640 1 librados: starting objecter 2024-02-09T08:03:14.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.357+0000 7f364b2a6640 10 monclient: build_initial_monmap 2024-02-09T08:03:14.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.357+0000 7fefed174640 1 -- start start 2024-02-09T08:03:14.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.357+0000 7fefed174640 1 librados: setting wanted keys 2024-02-09T08:03:14.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.357+0000 7fefed174640 1 librados: calling monclient init 2024-02-09T08:03:14.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.357+0000 7fefed174640 10 monclient: init 2024-02-09T08:03:14.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.357+0000 7f364b2a6640 10 monclient: monmap: 2024-02-09T08:03:14.410 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:14.410 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:03:14.410 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:03:14.410 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:03:14.410 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:14.410 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.410 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:03:14.410 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:03:14.410 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:03:14.410 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.357+0000 7f3e7a92e640 1 Processor -- start 2024-02-09T08:03:14.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.357+0000 7f3e7a92e640 1 -- start start 2024-02-09T08:03:14.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.357+0000 7f3e7a92e640 1 librados: setting wanted keys 2024-02-09T08:03:14.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.357+0000 7f3e7a92e640 1 librados: calling monclient init 2024-02-09T08:03:14.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.357+0000 7f3e7a92e640 10 monclient: init 2024-02-09T08:03:14.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.357+0000 7f364b2a6640 1 librados: starting msgr at 2024-02-09T08:03:14.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.357+0000 7f364b2a6640 1 librados: starting objecter 2024-02-09T08:03:14.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.357+0000 7f364b2a6640 1 Processor -- start 2024-02-09T08:03:14.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.357+0000 7f364b2a6640 1 -- start start 2024-02-09T08:03:14.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.357+0000 7f364b2a6640 1 librados: setting wanted keys 2024-02-09T08:03:14.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.357+0000 7f364b2a6640 1 librados: calling monclient init 2024-02-09T08:03:14.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.357+0000 7f364b2a6640 10 monclient: init 2024-02-09T08:03:14.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.357+0000 7fefed174640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:14.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.357+0000 7fefed174640 10 monclient: _add_conns ranks=[2,0,1] 2024-02-09T08:03:14.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.357+0000 7fefed174640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fefe8067110 0x7fefe8138df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.357+0000 7fefed174640 10 monclient(hunting): picked mon.noname-c con 0x7fefe8067110 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:14.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.357+0000 7fefed174640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fefe813f830 0x7fefe813ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.357+0000 7fefed174640 10 monclient(hunting): picked mon.noname-a con 0x7fefe813f830 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:03:14.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.357+0000 7fefed174640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefe8142bd0 0x7fefe813bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.357+0000 7fefed174640 10 monclient(hunting): picked mon.noname-b con 0x7fefe8142bd0 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:03:14.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.357+0000 7fefed174640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.357+0000 7fefed174640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe80b8860 con 0x7fefe813f830 2024-02-09T08:03:14.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.357+0000 7fefed174640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.357+0000 7fefed174640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe813c490 con 0x7fefe8142bd0 2024-02-09T08:03:14.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.357+0000 7fefed174640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.357+0000 7fefed174640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe81383c0 con 0x7fefe8067110 2024-02-09T08:03:14.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.357+0000 7fefed174640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:14.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.357+0000 7fefed174640 10 monclient(hunting): authenticate will time out at 1437.718086s 2024-02-09T08:03:14.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.358+0000 7f364b2a6640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:14.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.358+0000 7f364b2a6640 10 monclient: _add_conns ranks=[2,1,0] 2024-02-09T08:03:14.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.358+0000 7f364b2a6640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f36440abfc0 0x7f3644143080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.358+0000 7f364b2a6640 10 monclient(hunting): picked mon.noname-c con 0x7f36440abfc0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:14.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.358+0000 7f364b2a6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f36440ac3a0 0x7f3644139500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.358+0000 7f364b2a6640 10 monclient(hunting): picked mon.noname-b con 0x7f36440ac3a0 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:03:14.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.358+0000 7f364b2a6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f364413d620 0x7f3644139a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.358+0000 7f364b2a6640 10 monclient(hunting): picked mon.noname-a con 0x7f364413d620 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:03:14.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.358+0000 7f364b2a6640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.358+0000 7f3e7a92e640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:14.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.358+0000 7f364b2a6640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36441442d0 con 0x7f364413d620 2024-02-09T08:03:14.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.358+0000 7f3e7a92e640 10 monclient: _add_conns ranks=[1,2,0] 2024-02-09T08:03:14.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.358+0000 7f364b2a6640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.358+0000 7f364b2a6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36441445b0 con 0x7f36440ac3a0 2024-02-09T08:03:14.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.358+0000 7f364b2a6640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.358+0000 7f364b2a6640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36441436b0 con 0x7f36440abfc0 2024-02-09T08:03:14.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.358+0000 7f364b2a6640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:14.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.358+0000 7f364b2a6640 10 monclient(hunting): authenticate will time out at 1437.718830s 2024-02-09T08:03:14.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.358+0000 7f3e7a92e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e7406cb00 0x7f3e74142bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.358+0000 7f3e7a92e640 10 monclient(hunting): picked mon.noname-b con 0x7f3e7406cb00 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:03:14.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.358+0000 7f3e7a92e640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e740aada0 0x7f3e74144590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.358+0000 7f3e7a92e640 10 monclient(hunting): picked mon.noname-c con 0x7f3e740aada0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:14.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.358+0000 7f3e7a92e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e7413bdf0 0x7f3e74142240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.358+0000 7f3e7a92e640 10 monclient(hunting): picked mon.noname-a con 0x7f3e7413bdf0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:03:14.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.358+0000 7f3e7a92e640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.358+0000 7f3e7a92e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e74143510 con 0x7f3e7413bdf0 2024-02-09T08:03:14.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.358+0000 7f3e7a92e640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.358+0000 7f3e7a92e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e741d7ab0 con 0x7f3e7406cb00 2024-02-09T08:03:14.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.358+0000 7f3e7a92e640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.358+0000 7f3e7a92e640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e74144ad0 con 0x7f3e740aada0 2024-02-09T08:03:14.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.358+0000 7f3e7a92e640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:14.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.358+0000 7f3e7a92e640 10 monclient(hunting): authenticate will time out at 1437.719169s 2024-02-09T08:03:14.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.360+0000 7fea7195b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:14.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.360+0000 7fea7195b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:14.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.360+0000 7fea7195b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:14.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.360+0000 7fc74c80a640 1 -- 172.21.15.62:0/515247343 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc738031830 con 0x7fc7480a9e50 2024-02-09T08:03:14.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.360+0000 7fc74c80a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:14.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.360+0000 7fc74c80a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-09T08:03:14.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.360+0000 7fc74c80a640 10 monclient: dump: 2024-02-09T08:03:14.421 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:14.421 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.422 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.422 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.422 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:14.422 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.422 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:14.422 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:14.422 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:14.422 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.360+0000 7fc74c80a640 10 monclient: _finish_auth 0 2024-02-09T08:03:14.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.360+0000 7fc74c80a640 10 monclient: _check_auth_tickets 2024-02-09T08:03:14.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.360+0000 7fc74c80a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:14.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.360+0000 7fc74c80a640 1 -- 172.21.15.62:0/515247343 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc738031990 con 0x7fc7480a9e50 2024-02-09T08:03:14.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.360+0000 7fc74fa70640 5 monclient: authenticate success, global_id 4303 2024-02-09T08:03:14.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.360+0000 7fc74fa70640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-02-09T08:03:14.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.360+0000 7fc74c80a640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:14.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.360+0000 7fc74fa70640 10 monclient: get_monmap_and_config success 2024-02-09T08:03:14.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.360+0000 7fc74fa70640 4 set_mon_vals no callback set 2024-02-09T08:03:14.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.360+0000 7fc74c80a640 1 -- 172.21.15.62:0/515247343 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc738031d20 con 0x7fc7480a9e50 2024-02-09T08:03:14.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.360+0000 7fc74c80a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:14.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.360+0000 7fc74c80a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:03:14.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.360+0000 7fc74c80a640 10 monclient: dump: 2024-02-09T08:03:14.423 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:14.423 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.423 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.423 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.423 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:14.423 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.423 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:14.423 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:14.423 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:14.424 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.361+0000 7fc74fa70640 10 monclient: shutdown 2024-02-09T08:03:14.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.361+0000 7fc74fa70640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:14.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.361+0000 7fc74fa70640 1 -- 172.21.15.62:0/515247343 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7480a9e50 msgr2=0x7fc748143000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.361+0000 7fc74fa70640 1 --2- 172.21.15.62:0/515247343 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7480a9e50 0x7fc748143000 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc7380097a0 tx=0x7fc73802b8d0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.361+0000 7fc74fa70640 1 -- 172.21.15.62:0/515247343 shutdown_connections 2024-02-09T08:03:14.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.361+0000 7fc74fa70640 1 --2- 172.21.15.62:0/515247343 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7480a9e50 0x7fc748143000 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.361+0000 7fc74fa70640 1 --2- 172.21.15.62:0/515247343 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc748072490 0x7fc748142ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.361+0000 7fc74fa70640 1 -- 172.21.15.62:0/515247343 >> 172.21.15.62:0/515247343 conn(0x7fc7480b3cb0 msgr2=0x7fc7480b40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:14.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.361+0000 7fc74fa70640 1 -- 172.21.15.62:0/515247343 shutdown_connections 2024-02-09T08:03:14.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.361+0000 7fc74fa70640 1 -- 172.21.15.62:0/515247343 wait complete. 2024-02-09T08:03:14.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.362+0000 7fc74fa70640 10 monclient: build_initial_monmap 2024-02-09T08:03:14.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.362+0000 7fc74fa70640 10 monclient: monmap: 2024-02-09T08:03:14.424 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:14.424 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:03:14.425 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:03:14.425 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:03:14.425 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:14.425 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.425 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:03:14.425 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:03:14.425 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:03:14.425 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.362+0000 7fc74fa70640 1 librados: starting msgr at 2024-02-09T08:03:14.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.362+0000 7fc74fa70640 1 librados: starting objecter 2024-02-09T08:03:14.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.362+0000 7fc74fa70640 1 Processor -- start 2024-02-09T08:03:14.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.362+0000 7fc74fa70640 1 -- start start 2024-02-09T08:03:14.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.362+0000 7fc74fa70640 1 librados: setting wanted keys 2024-02-09T08:03:14.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.362+0000 7fc74fa70640 1 librados: calling monclient init 2024-02-09T08:03:14.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.362+0000 7fc74fa70640 10 monclient: init 2024-02-09T08:03:14.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.362+0000 7fea63fff640 1 -- 172.21.15.62:0/3414525613 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1755000224 0 0) 0x7fea6c0b2900 con 0x7fea6c0b5000 2024-02-09T08:03:14.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.362+0000 7fea63fff640 10 monclient(hunting): _negotiate 2024-02-09T08:03:14.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.362+0000 7fea63fff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:14.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.362+0000 7fea63fff640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:14.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.362+0000 7fea63fff640 10 monclient(hunting): my global_id is 4309 2024-02-09T08:03:14.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.362+0000 7fea63fff640 1 -- 172.21.15.62:0/3414525613 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea58003520 con 0x7fea6c0b5000 2024-02-09T08:03:14.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.363+0000 7fbcb4e11640 1 -- 172.21.15.62:0/847899243 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca802c960 con 0x7fbcb006e5c0 2024-02-09T08:03:14.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.363+0000 7fbcb4e11640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:14.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.363+0000 7fbcb4e11640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-09T08:03:14.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.363+0000 7fbcb4e11640 10 monclient: dump: 2024-02-09T08:03:14.427 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:14.427 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.427 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.427 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.427 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:14.427 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.428 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:14.428 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:14.428 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:14.428 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.363+0000 7fbcb4e11640 10 monclient: _finish_auth 0 2024-02-09T08:03:14.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.363+0000 7fbcb4e11640 10 monclient: _check_auth_tickets 2024-02-09T08:03:14.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.363+0000 7fbcb4e11640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:14.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.363+0000 7fbcb8077640 5 monclient: authenticate success, global_id 4294 2024-02-09T08:03:14.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.363+0000 7fbcb8077640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-02-09T08:03:14.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.363+0000 7fbcb4e11640 1 -- 172.21.15.62:0/847899243 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca802cac0 con 0x7fbcb006e5c0 2024-02-09T08:03:14.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.363+0000 7fbcb4e11640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:14.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.363+0000 7fbcb8077640 10 monclient: get_monmap_and_config success 2024-02-09T08:03:14.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.363+0000 7fbcb8077640 4 set_mon_vals no callback set 2024-02-09T08:03:14.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.363+0000 7fc74fa70640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:14.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.363+0000 7fc74fa70640 10 monclient: _add_conns ranks=[0,1,2] 2024-02-09T08:03:14.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.363+0000 7fbcb4e11640 1 -- 172.21.15.62:0/847899243 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca802ce50 con 0x7fbcb006e5c0 2024-02-09T08:03:14.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.363+0000 7fc74fa70640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc748072490 0x7fc748136c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.363+0000 7fc74fa70640 10 monclient(hunting): picked mon.noname-a con 0x7fc748072490 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:03:14.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.363+0000 7fc74fa70640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7480a9e50 0x7fc748131c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.363+0000 7fc74fa70640 10 monclient(hunting): picked mon.noname-b con 0x7fc7480a9e50 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:03:14.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.363+0000 7fc74fa70640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc74813f7d0 0x7fc7481321a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.363+0000 7fc74fa70640 10 monclient(hunting): picked mon.noname-c con 0x7fc74813f7d0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:14.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.363+0000 7fc74fa70640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.363+0000 7fc74fa70640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc748137870 con 0x7fc748072490 2024-02-09T08:03:14.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.363+0000 7fc74fa70640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.363+0000 7fc74fa70640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7481326e0 con 0x7fc7480a9e50 2024-02-09T08:03:14.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.363+0000 7fc74fa70640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.363+0000 7fc74fa70640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc748138520 con 0x7fc74813f7d0 2024-02-09T08:03:14.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.363+0000 7fc74fa70640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:14.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.363+0000 7fc74fa70640 10 monclient(hunting): authenticate will time out at 1437.723738s 2024-02-09T08:03:14.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.363+0000 7fbcb4e11640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:14.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.363+0000 7fbcb4e11640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:03:14.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.363+0000 7fbcb4e11640 10 monclient: dump: 2024-02-09T08:03:14.432 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:14.432 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.432 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.432 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.432 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:14.432 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.433 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:14.433 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:14.433 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:14.433 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.364+0000 7fbcb8077640 10 monclient: shutdown 2024-02-09T08:03:14.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.364+0000 7fbcb8077640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:14.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.364+0000 7fbcb8077640 1 -- 172.21.15.62:0/847899243 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcb006e5c0 msgr2=0x7fbcb006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.364+0000 7fbcb8077640 1 --2- 172.21.15.62:0/847899243 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcb006e5c0 0x7fbcb006e9a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbcb006cd90 tx=0x7fbca802bdc0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.364+0000 7fbcb8077640 1 -- 172.21.15.62:0/847899243 shutdown_connections 2024-02-09T08:03:14.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.364+0000 7fbcb8077640 1 --2- 172.21.15.62:0/847899243 >> v2:172.21.15.62:3300/0 conn(0x7fbcb0146c10 0x7fbcb01470a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.364+0000 7fbcb8077640 1 --2- 172.21.15.62:0/847899243 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcb006e5c0 0x7fbcb006e9a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.364+0000 7fbcb8077640 1 -- 172.21.15.62:0/847899243 >> 172.21.15.62:0/847899243 conn(0x7fbcb00b3db0 msgr2=0x7fbcb00b41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:14.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.364+0000 7fbcb8077640 1 -- 172.21.15.62:0/847899243 shutdown_connections 2024-02-09T08:03:14.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.364+0000 7fbcb8077640 1 -- 172.21.15.62:0/847899243 wait complete. 2024-02-09T08:03:14.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.365+0000 7f839f7fe640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f83980c5790 0x7f83981615b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.365+0000 7fbcb8077640 10 monclient: build_initial_monmap 2024-02-09T08:03:14.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.365+0000 7fbcb8077640 10 monclient: monmap: 2024-02-09T08:03:14.434 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:14.435 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:03:14.435 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:03:14.435 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:03:14.435 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:14.435 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.435 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:03:14.435 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:03:14.435 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:03:14.435 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.365+0000 7fbcb8077640 1 librados: starting msgr at 2024-02-09T08:03:14.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.365+0000 7fbcb8077640 1 librados: starting objecter 2024-02-09T08:03:14.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.365+0000 7fbcb8077640 1 Processor -- start 2024-02-09T08:03:14.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.365+0000 7fbcb8077640 1 -- start start 2024-02-09T08:03:14.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.365+0000 7fbcb8077640 1 librados: setting wanted keys 2024-02-09T08:03:14.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.365+0000 7fbcb8077640 1 librados: calling monclient init 2024-02-09T08:03:14.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.365+0000 7fbcb8077640 10 monclient: init 2024-02-09T08:03:14.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.366+0000 7f839f7fe640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f83980c5790 0x7f83981615b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:60976/0 (socket says 172.21.15.62:60976) 2024-02-09T08:03:14.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.366+0000 7f839f7fe640 1 -- 172.21.15.62:0/1401922854 learned_addr learned my addr 172.21.15.62:0/1401922854 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:14.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.366+0000 7f839f7fe640 10 monclient(hunting): get_auth_request con 0x7f83980c5790 auth_method 0 2024-02-09T08:03:14.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.366+0000 7f839f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:14.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.366+0000 7f839f7fe640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:14.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.366+0000 7f839f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:14.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.366+0000 7fbcb8077640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:14.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.366+0000 7fbcb8077640 10 monclient: _add_conns ranks=[1,0,2] 2024-02-09T08:03:14.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.366+0000 7fbcb8077640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcb006e5c0 0x7fbcb00b1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.366+0000 7fbcb8077640 10 monclient(hunting): picked mon.noname-b con 0x7fbcb006e5c0 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:03:14.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.366+0000 7fbcb8077640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcb0143bc0 0x7fbcb00b2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.366+0000 7fbcb8077640 10 monclient(hunting): picked mon.noname-a con 0x7fbcb0143bc0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:03:14.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.366+0000 7fbcb8077640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbcb0146c10 0x7fbcb0144dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.366+0000 7fbcb8077640 10 monclient(hunting): picked mon.noname-c con 0x7fbcb0146c10 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:14.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.366+0000 7fbcb8077640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.366+0000 7fbcb8077640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb01448a0 con 0x7fbcb0143bc0 2024-02-09T08:03:14.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.366+0000 7fbcb8077640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.366+0000 7fbcb8077640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb00b2e70 con 0x7fbcb006e5c0 2024-02-09T08:03:14.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.366+0000 7fbcb8077640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.366+0000 7fbcb8077640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb00b3030 con 0x7fbcb0146c10 2024-02-09T08:03:14.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.366+0000 7fbcb8077640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:14.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.366+0000 7fbcb8077640 10 monclient(hunting): authenticate will time out at 1437.726684s 2024-02-09T08:03:14.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.366+0000 7fea7195b640 10 monclient(hunting): handle_auth_done global_id 4296 payload 274 2024-02-09T08:03:14.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.366+0000 7fea7195b640 1 -- 172.21.15.62:0/3414525613 >> v1:172.21.15.103:6789/0 conn(0x7fea6c0b5000 legacy=0x7fea6c13f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.366+0000 7fea7195b640 1 -- 172.21.15.62:0/3414525613 >> v1:172.21.15.62:6789/0 conn(0x7fea6c0a9e30 legacy=0x7fea6c145de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:14.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.366+0000 7fea7195b640 10 monclient: _finish_hunting 0 2024-02-09T08:03:14.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.366+0000 7fea7195b640 1 monclient: found mon.noname-a 2024-02-09T08:03:14.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.366+0000 7fea7195b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:14.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.366+0000 7fea7195b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-02-09T08:03:14.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.366+0000 7fea7195b640 1 -- 172.21.15.62:0/3414525613 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea6c0ab5f0 con 0x7fea6c13fdf0 2024-02-09T08:03:14.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.366+0000 7fefe759e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefe8142bd0 0x7fefe813bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.366+0000 7f839f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:14.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.366+0000 7f839f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:14.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.366+0000 7f839f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:14.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.367+0000 7fefe6d9d640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fefe8067110 0x7fefe8138df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.369+0000 7fefe759e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefe8142bd0 0x7fefe813bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.62:39984/0 (socket says 172.21.15.62:39984) 2024-02-09T08:03:14.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.369+0000 7fefe759e640 1 -- 172.21.15.62:0/3363588394 learned_addr learned my addr 172.21.15.62:0/3363588394 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:14.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.369+0000 7fefe759e640 10 monclient(hunting): get_auth_request con 0x7fefe8142bd0 auth_method 0 2024-02-09T08:03:14.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.369+0000 7fefe759e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:14.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.369+0000 7fefe759e640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:14.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.369+0000 7fefe759e640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:14.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.369+0000 7fefe759e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:14.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.369+0000 7fefe759e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:14.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.369+0000 7fefe759e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:14.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.369+0000 7f839f7fe640 10 monclient(hunting): handle_auth_done global_id 4286 payload 824 2024-02-09T08:03:14.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.369+0000 7f839f7fe640 1 -- 172.21.15.62:0/1401922854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f83980cbaf0 msgr2=0x7f839802fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.369+0000 7f839f7fe640 1 --2- 172.21.15.62:0/1401922854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f83980cbaf0 0x7f839802fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.369+0000 7f839f7fe640 1 -- 172.21.15.62:0/1401922854 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8398038da0 msgr2=0x7f839802de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.369+0000 7f839f7fe640 1 --2- 172.21.15.62:0/1401922854 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8398038da0 0x7f839802de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.369+0000 7f839f7fe640 10 monclient: _finish_hunting 0 2024-02-09T08:03:14.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.369+0000 7f839f7fe640 1 monclient: found mon.noname-c 2024-02-09T08:03:14.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.369+0000 7f839f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:14.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.369+0000 7f839f7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-02-09T08:03:14.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.369+0000 7f839f7fe640 1 -- 172.21.15.62:0/1401922854 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8394009400 con 0x7f83980c5790 2024-02-09T08:03:14.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.370+0000 7fefe6d9d640 10 monclient(hunting): get_auth_request con 0x7fefe8067110 auth_method 0 2024-02-09T08:03:14.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.370+0000 7fefe6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:14.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.370+0000 7fefe6d9d640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:14.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.370+0000 7fefe6d9d640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:14.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.371+0000 7fea7195b640 1 --2- 172.21.15.62:0/3414525613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea6c13fdf0 0x7fea6c1464f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fea64009dc0 tx=0x7fea6402be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b31cf7fa1947612e server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:14.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.371+0000 7f3648841640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f36440ac3a0 0x7f3644139500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.372+0000 7fefe6d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:14.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.372+0000 7fefe6d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:14.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.372+0000 7f3648841640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f36440ac3a0 0x7f3644139500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.62:39996/0 (socket says 172.21.15.62:39996) 2024-02-09T08:03:14.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.372+0000 7f3648841640 1 -- 172.21.15.62:0/1164071636 learned_addr learned my addr 172.21.15.62:0/1164071636 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:14.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.372+0000 7f3648841640 10 monclient(hunting): get_auth_request con 0x7f36440ac3a0 auth_method 0 2024-02-09T08:03:14.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.372+0000 7f3648841640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:14.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.372+0000 7f3648841640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:14.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.372+0000 7f3648841640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:14.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.372+0000 7fefe6d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:14.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.373+0000 7ff2d5439640 1 --2- 172.21.15.62:0/1084998290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2d0074680 0x7ff2d013f270 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc009870 tx=0x7ff2cc02b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86e4b70307c5c5c7 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:14.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.376+0000 7fefe6d9d640 10 monclient(hunting): handle_auth_done global_id 4289 payload 824 2024-02-09T08:03:14.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.376+0000 7fefe6d9d640 1 -- 172.21.15.62:0/3363588394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefe8142bd0 msgr2=0x7fefe813bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.376+0000 7fefe6d9d640 1 --2- 172.21.15.62:0/3363588394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefe8142bd0 0x7fefe813bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.376+0000 7fefe6d9d640 1 -- 172.21.15.62:0/3363588394 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fefe813f830 msgr2=0x7fefe813ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.376+0000 7fefe6d9d640 1 --2- 172.21.15.62:0/3363588394 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fefe813f830 0x7fefe813ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.376+0000 7fefe6d9d640 10 monclient: _finish_hunting 0 2024-02-09T08:03:14.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.376+0000 7fefe6d9d640 1 monclient: found mon.noname-c 2024-02-09T08:03:14.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.376+0000 7fefe6d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:14.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.376+0000 7fefe6d9d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-02-09T08:03:14.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.376+0000 7fefe6d9d640 1 -- 172.21.15.62:0/3363588394 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd80094d0 con 0x7fefe8067110 2024-02-09T08:03:14.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.376+0000 7f3648841640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:14.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.376+0000 7f3648841640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:14.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.376+0000 7f3648841640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:14.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.378+0000 7f839f7fe640 1 --2- 172.21.15.62:0/1401922854 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f83980c5790 0x7f83981615b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8394034040 tx=0x7f83940046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:14.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.378+0000 7f839cff9640 10 client.?.objecter ms_handle_connect 0x7f83980c5790 2024-02-09T08:03:14.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.378+0000 7f839cff9640 10 client.?.objecter resend_mon_ops 2024-02-09T08:03:14.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.378+0000 7f3649042640 1 --2- 172.21.15.62:0/1164071636 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f36440abfc0 0x7f3644143080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.379+0000 7f3e737fe640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e740aada0 0x7f3e74144590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.380+0000 7fea63fff640 1 -- 172.21.15.62:0/3414525613 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6402cbb0 con 0x7fea6c13fdf0 2024-02-09T08:03:14.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.380+0000 7fea63fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:14.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.380+0000 7fea63fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-09T08:03:14.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.380+0000 7fea63fff640 10 monclient: dump: 2024-02-09T08:03:14.449 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:14.449 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.450 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.450 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.450 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:14.450 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.450 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:14.450 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:14.450 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:14.450 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.380+0000 7fea63fff640 10 monclient: _finish_auth 0 2024-02-09T08:03:14.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.380+0000 7fea63fff640 10 monclient: _check_auth_tickets 2024-02-09T08:03:14.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.380+0000 7fea63fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:14.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.380+0000 7fea63fff640 1 -- 172.21.15.62:0/3414525613 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea6402cd10 con 0x7fea6c13fdf0 2024-02-09T08:03:14.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.380+0000 7fea63fff640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:14.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.380+0000 7fea63fff640 1 -- 172.21.15.62:0/3414525613 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea64034660 con 0x7fea6c13fdf0 2024-02-09T08:03:14.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.380+0000 7fea63fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:14.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.380+0000 7fea63fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-09T08:03:14.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.380+0000 7fea63fff640 10 monclient: dump: 2024-02-09T08:03:14.451 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:14.451 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.451 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.451 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.451 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:14.451 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.451 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:14.451 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:14.451 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:14.451 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.380+0000 7fea733be640 5 monclient: authenticate success, global_id 4296 2024-02-09T08:03:14.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.380+0000 7fea733be640 10 monclient: get_monmap_and_config success 2024-02-09T08:03:14.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.380+0000 7fea733be640 4 set_mon_vals no callback set 2024-02-09T08:03:14.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.380+0000 7f3649843640 1 --2- 172.21.15.62:0/1164071636 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f364413d620 0x7f3644139a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.380+0000 7f3e78ecb640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e7413bdf0 0x7f3e74142240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.380+0000 7f3649843640 10 monclient(hunting): get_auth_request con 0x7f364413d620 auth_method 0 2024-02-09T08:03:14.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.380+0000 7f3649843640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:14.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.380+0000 7f3649843640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:14.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.380+0000 7f3649843640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:14.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.380+0000 7fea733be640 10 monclient: shutdown 2024-02-09T08:03:14.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.380+0000 7fea733be640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:14.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.380+0000 7fea733be640 1 -- 172.21.15.62:0/3414525613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea6c13fdf0 msgr2=0x7fea6c1464f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.380+0000 7fea733be640 1 --2- 172.21.15.62:0/3414525613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea6c13fdf0 0x7fea6c1464f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fea64009dc0 tx=0x7fea6402be00 comp rx=0 tx=0).stop 2024-02-09T08:03:14.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.380+0000 7fea733be640 1 -- 172.21.15.62:0/3414525613 shutdown_connections 2024-02-09T08:03:14.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.380+0000 7fea733be640 1 --2- 172.21.15.62:0/3414525613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea6c13fdf0 0x7fea6c1464f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.380+0000 7fea733be640 1 -- 172.21.15.62:0/3414525613 >> 172.21.15.62:0/3414525613 conn(0x7fea6c066bb0 msgr2=0x7fea6c066fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:14.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.380+0000 7f3e73fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e7406cb00 0x7f3e74142bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.381+0000 7f3649042640 10 monclient(hunting): get_auth_request con 0x7f36440abfc0 auth_method 0 2024-02-09T08:03:14.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.381+0000 7f3649042640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:14.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.381+0000 7f3649042640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:14.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.381+0000 7f3649042640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:14.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.381+0000 7fea733be640 1 -- 172.21.15.62:0/3414525613 shutdown_connections 2024-02-09T08:03:14.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.381+0000 7fea733be640 1 -- 172.21.15.62:0/3414525613 wait complete. 2024-02-09T08:03:14.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.381+0000 7fefe6d9d640 1 --2- 172.21.15.62:0/3363588394 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fefe8067110 0x7fefe8138df0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fefe0007e10 tx=0x7fefe000e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:14.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.381+0000 7fefcf7fe640 10 client.?.objecter ms_handle_connect 0x7fefe8067110 2024-02-09T08:03:14.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.381+0000 7fefcf7fe640 10 client.?.objecter resend_mon_ops 2024-02-09T08:03:14.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.381+0000 7fea733be640 10 monclient: build_initial_monmap 2024-02-09T08:03:14.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.381+0000 7fea733be640 10 monclient: monmap: 2024-02-09T08:03:14.456 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:14.456 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:03:14.456 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:03:14.456 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:03:14.456 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:14.456 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.456 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:03:14.456 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:03:14.456 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:03:14.456 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.382+0000 7f3649843640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:14.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.382+0000 7f3649843640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:14.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.382+0000 7f3649843640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:14.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.382+0000 7fea733be640 1 librados: starting msgr at 2024-02-09T08:03:14.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.382+0000 7fea733be640 1 librados: starting objecter 2024-02-09T08:03:14.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.382+0000 7f3e737fe640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e740aada0 0x7f3e74144590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:32776/0 (socket says 172.21.15.62:32776) 2024-02-09T08:03:14.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.382+0000 7f3e737fe640 1 -- 172.21.15.62:0/3425683466 learned_addr learned my addr 172.21.15.62:0/3425683466 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:14.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.382+0000 7f3e737fe640 10 monclient(hunting): get_auth_request con 0x7f3e740aada0 auth_method 0 2024-02-09T08:03:14.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.382+0000 7f3e737fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:14.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.382+0000 7f3e737fe640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:14.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.382+0000 7f3e737fe640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:14.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.382+0000 7fea733be640 1 Processor -- start 2024-02-09T08:03:14.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.382+0000 7f3e78ecb640 10 monclient(hunting): get_auth_request con 0x7f3e7413bdf0 auth_method 0 2024-02-09T08:03:14.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.382+0000 7f3e78ecb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:14.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.382+0000 7f3e78ecb640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:14.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.382+0000 7f3e78ecb640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:14.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.382+0000 7fea733be640 1 -- start start 2024-02-09T08:03:14.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.382+0000 7fea733be640 1 librados: setting wanted keys 2024-02-09T08:03:14.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.382+0000 7fea733be640 1 librados: calling monclient init 2024-02-09T08:03:14.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.382+0000 7fea733be640 10 monclient: init 2024-02-09T08:03:14.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.383+0000 7fea733be640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:14.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.383+0000 7fea733be640 10 monclient: _add_conns ranks=[2,0,1] 2024-02-09T08:03:14.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.383+0000 7fea733be640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fea6c0a9e30 0x7fea6c1351b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.383+0000 7fea733be640 10 monclient(hunting): picked mon.noname-c con 0x7fea6c0a9e30 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:14.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.383+0000 7fea733be640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea6c0b5000 0x7fea6c136f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.383+0000 7fea733be640 10 monclient(hunting): picked mon.noname-a con 0x7fea6c0b5000 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:03:14.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.383+0000 7fea733be640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea6c13fdf0 0x7fea6c132ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.383+0000 7fea733be640 10 monclient(hunting): picked mon.noname-b con 0x7fea6c13fdf0 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:03:14.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.383+0000 7fea733be640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.383+0000 7fea733be640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c135810 con 0x7fea6c0b5000 2024-02-09T08:03:14.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.383+0000 7fea733be640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.383+0000 7fea733be640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c1374c0 con 0x7fea6c13fdf0 2024-02-09T08:03:14.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.383+0000 7fea733be640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.383+0000 7fea733be640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c1365d0 con 0x7fea6c0a9e30 2024-02-09T08:03:14.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.383+0000 7fea733be640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:14.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.383+0000 7fea733be640 10 monclient(hunting): authenticate will time out at 1437.743645s 2024-02-09T08:03:14.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.384+0000 7f3648841640 10 monclient(hunting): handle_auth_done global_id 4315 payload 824 2024-02-09T08:03:14.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.384+0000 7f3648841640 1 -- 172.21.15.62:0/1164071636 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f36440abfc0 msgr2=0x7f3644143080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.384+0000 7f3648841640 1 --2- 172.21.15.62:0/1164071636 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f36440abfc0 0x7f3644143080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.384+0000 7f3648841640 1 -- 172.21.15.62:0/1164071636 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f364413d620 msgr2=0x7f3644139a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.384+0000 7f3648841640 1 --2- 172.21.15.62:0/1164071636 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f364413d620 0x7f3644139a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.384+0000 7f3648841640 10 monclient: _finish_hunting 0 2024-02-09T08:03:14.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.384+0000 7f3648841640 1 monclient: found mon.noname-b 2024-02-09T08:03:14.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.384+0000 7f3648841640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:14.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.384+0000 7f3648841640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.103:3300/0 2024-02-09T08:03:14.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.384+0000 7f3648841640 1 -- 172.21.15.62:0/1164071636 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3640009400 con 0x7f36440ac3a0 2024-02-09T08:03:14.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.384+0000 7f3e737fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:14.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.384+0000 7f3e737fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:14.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.384+0000 7f3e737fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:14.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.387+0000 7fc74d00b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7480a9e50 0x7fc748131c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.387+0000 7f3e73fff640 10 monclient(hunting): get_auth_request con 0x7f3e7406cb00 auth_method 0 2024-02-09T08:03:14.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.387+0000 7f3e73fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:14.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.387+0000 7f3e73fff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:14.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.387+0000 7f3e73fff640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:14.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.387+0000 7f3e78ecb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:14.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.387+0000 7f3e78ecb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:14.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.387+0000 7f3e78ecb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:14.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.388+0000 7f3648841640 1 --2- 172.21.15.62:0/1164071636 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f36440ac3a0 0x7f3644139500 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f36400098f0 tx=0x7f36400046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:14.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.388+0000 7f3639ffb640 10 client.?.objecter ms_handle_connect 0x7f36440ac3a0 2024-02-09T08:03:14.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.388+0000 7f3639ffb640 10 client.?.objecter resend_mon_ops 2024-02-09T08:03:14.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.388+0000 7fc74e00d640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc74813f7d0 0x7fc7481321a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.388+0000 7fc74d00b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7480a9e50 0x7fc748131c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.62:40024/0 (socket says 172.21.15.62:40024) 2024-02-09T08:03:14.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.388+0000 7fc74d00b640 1 -- 172.21.15.62:0/1851226421 learned_addr learned my addr 172.21.15.62:0/1851226421 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:14.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.388+0000 7fc74d00b640 10 monclient(hunting): get_auth_request con 0x7fc7480a9e50 auth_method 0 2024-02-09T08:03:14.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.388+0000 7fc74d00b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:14.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.388+0000 7fc74d00b640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:14.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.388+0000 7fc74d00b640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:14.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.389+0000 7f3e73fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:14.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.389+0000 7f3e73fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:14.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.389+0000 7f3e73fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:14.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.390+0000 7fbcb5e13640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcb006e5c0 0x7fbcb00b1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.391+0000 7fbcb5e13640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcb006e5c0 0x7fbcb00b1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.62:40040/0 (socket says 172.21.15.62:40040) 2024-02-09T08:03:14.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.391+0000 7fbcb5e13640 1 -- 172.21.15.62:0/348553430 learned_addr learned my addr 172.21.15.62:0/348553430 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:14.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.391+0000 7fbcb5e13640 10 monclient(hunting): get_auth_request con 0x7fbcb006e5c0 auth_method 0 2024-02-09T08:03:14.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.391+0000 7fbcb5e13640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:14.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.391+0000 7fbcb5e13640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:14.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.391+0000 7fbcb5e13640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:14.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.392+0000 7fc74d00b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:14.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.392+0000 7fc74d00b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:14.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.392+0000 7fc74d00b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:14.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.392+0000 7f3e737fe640 10 monclient(hunting): handle_auth_done global_id 4292 payload 824 2024-02-09T08:03:14.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.392+0000 7f3e737fe640 1 -- 172.21.15.62:0/3425683466 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e7406cb00 msgr2=0x7f3e74142bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.392+0000 7f3e737fe640 1 --2- 172.21.15.62:0/3425683466 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e7406cb00 0x7f3e74142bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.392+0000 7f3e737fe640 1 -- 172.21.15.62:0/3425683466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e7413bdf0 msgr2=0x7f3e74142240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.392+0000 7f3e737fe640 1 --2- 172.21.15.62:0/3425683466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e7413bdf0 0x7f3e74142240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.392+0000 7f3e737fe640 10 monclient: _finish_hunting 0 2024-02-09T08:03:14.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.392+0000 7f3e737fe640 1 monclient: found mon.noname-c 2024-02-09T08:03:14.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.392+0000 7f3e737fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:14.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.392+0000 7f3e737fe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-02-09T08:03:14.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.392+0000 7f3e737fe640 1 -- 172.21.15.62:0/3425683466 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e6c009b30 con 0x7f3e740aada0 2024-02-09T08:03:14.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.393+0000 7fbcb5e13640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:14.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.393+0000 7fbcb5e13640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:14.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.393+0000 7fbcb5e13640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:14.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.393+0000 7ff2c7fff640 1 -- 172.21.15.62:0/1084998290 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc031640 con 0x7ff2d0074680 2024-02-09T08:03:14.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.393+0000 7ff2c7fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:14.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.393+0000 7ff2c7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-09T08:03:14.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.393+0000 7ff2c7fff640 10 monclient: dump: 2024-02-09T08:03:14.471 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:14.471 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.471 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.472 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.472 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:14.472 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.472 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:14.472 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:14.472 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:14.472 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.393+0000 7ff2c7fff640 10 monclient: _finish_auth 0 2024-02-09T08:03:14.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.393+0000 7ff2c7fff640 10 monclient: _check_auth_tickets 2024-02-09T08:03:14.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.393+0000 7ff2c7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:14.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.393+0000 7ff2c7fff640 1 -- 172.21.15.62:0/1084998290 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2cc0317a0 con 0x7ff2d0074680 2024-02-09T08:03:14.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.393+0000 7ff2d769d640 5 monclient: authenticate success, global_id 4306 2024-02-09T08:03:14.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.393+0000 7ff2d769d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-02-09T08:03:14.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.394+0000 7ff2c7fff640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:14.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.394+0000 7ff2d769d640 10 monclient: get_monmap_and_config success 2024-02-09T08:03:14.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.394+0000 7ff2c7fff640 1 -- 172.21.15.62:0/1084998290 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc031b30 con 0x7ff2d0074680 2024-02-09T08:03:14.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.394+0000 7ff2d769d640 4 set_mon_vals no callback set 2024-02-09T08:03:14.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.394+0000 7ff2c7fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:14.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.394+0000 7ff2c7fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:03:14.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.394+0000 7ff2c7fff640 10 monclient: dump: 2024-02-09T08:03:14.473 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:14.473 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.473 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.473 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.473 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:14.474 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.474 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:14.474 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:14.474 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:14.474 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.394+0000 7ff2d769d640 10 monclient: shutdown 2024-02-09T08:03:14.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.394+0000 7ff2d769d640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:14.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.394+0000 7ff2d769d640 1 -- 172.21.15.62:0/1084998290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2d0074680 msgr2=0x7ff2d013f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.394+0000 7ff2d769d640 1 --2- 172.21.15.62:0/1084998290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2d0074680 0x7ff2d013f270 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc009870 tx=0x7ff2cc02b8f0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.394+0000 7ff2d769d640 1 -- 172.21.15.62:0/1084998290 shutdown_connections 2024-02-09T08:03:14.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.394+0000 7ff2d769d640 1 --2- 172.21.15.62:0/1084998290 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff2d013f7b0 0x7ff2d0145ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.394+0000 7ff2d769d640 1 --2- 172.21.15.62:0/1084998290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2d0074680 0x7ff2d013f270 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.394+0000 7ff2d769d640 1 -- 172.21.15.62:0/1084998290 >> 172.21.15.62:0/1084998290 conn(0x7ff2d00b44c0 msgr2=0x7ff2d00b48d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:14.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.394+0000 7fc74e00d640 10 monclient(hunting): get_auth_request con 0x7fc74813f7d0 auth_method 0 2024-02-09T08:03:14.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.394+0000 7fc74e00d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:14.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.394+0000 7fc74e00d640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:14.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.394+0000 7fc74e00d640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:14.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.394+0000 7ff2d769d640 1 -- 172.21.15.62:0/1084998290 shutdown_connections 2024-02-09T08:03:14.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.394+0000 7ff2d769d640 1 -- 172.21.15.62:0/1084998290 wait complete. 2024-02-09T08:03:14.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.395+0000 7fbcb6614640 1 --2- 172.21.15.62:0/348553430 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbcb0146c10 0x7fbcb0144dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.395+0000 7ff2d769d640 10 monclient: build_initial_monmap 2024-02-09T08:03:14.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.395+0000 7ff2d769d640 10 monclient: monmap: 2024-02-09T08:03:14.477 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:14.477 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:03:14.477 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:03:14.477 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:03:14.477 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:14.477 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.477 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:03:14.478 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:03:14.478 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:03:14.478 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.395+0000 7ff2d769d640 1 librados: starting msgr at 2024-02-09T08:03:14.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.395+0000 7ff2d769d640 1 librados: starting objecter 2024-02-09T08:03:14.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.396+0000 7ff2d769d640 1 Processor -- start 2024-02-09T08:03:14.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.396+0000 7ff2d769d640 1 -- start start 2024-02-09T08:03:14.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.396+0000 7ff2d769d640 1 librados: setting wanted keys 2024-02-09T08:03:14.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.396+0000 7ff2d769d640 1 librados: calling monclient init 2024-02-09T08:03:14.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.396+0000 7ff2d769d640 10 monclient: init 2024-02-09T08:03:14.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.396+0000 7fbcb5612640 1 --2- 172.21.15.62:0/348553430 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcb0143bc0 0x7fbcb00b2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.396+0000 7ff2d769d640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:14.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.396+0000 7ff2d769d640 10 monclient: _add_conns ranks=[2,0,1] 2024-02-09T08:03:14.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.396+0000 7ff2d769d640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff2d0074680 0x7ff2d0071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.396+0000 7ff2d769d640 10 monclient(hunting): picked mon.noname-c con 0x7ff2d0074680 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:14.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.396+0000 7ff2d769d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2d013f7b0 0x7ff2d01cb370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.396+0000 7ff2d769d640 10 monclient(hunting): picked mon.noname-a con 0x7ff2d013f7b0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:03:14.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.396+0000 7ff2d769d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2d0146020 0x7ff2d01cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.396+0000 7ff2d769d640 10 monclient(hunting): picked mon.noname-b con 0x7ff2d0146020 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:03:14.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.396+0000 7ff2d769d640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.396+0000 7ff2d769d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d01ccc00 con 0x7ff2d013f7b0 2024-02-09T08:03:14.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.396+0000 7ff2d769d640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.396+0000 7ff2d769d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d00b3a60 con 0x7ff2d0146020 2024-02-09T08:03:14.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.396+0000 7ff2d769d640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.396+0000 7ff2d769d640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d00b1c90 con 0x7ff2d0074680 2024-02-09T08:03:14.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.396+0000 7ff2d769d640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:14.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.396+0000 7ff2d769d640 10 monclient(hunting): authenticate will time out at 1437.757189s 2024-02-09T08:03:14.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.397+0000 7fbcb5612640 10 monclient(hunting): get_auth_request con 0x7fbcb0143bc0 auth_method 0 2024-02-09T08:03:14.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.397+0000 7fbcb5612640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:14.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.397+0000 7fbcb5612640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:14.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.397+0000 7fbcb5612640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:14.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.398+0000 7fbcb6614640 10 monclient(hunting): get_auth_request con 0x7fbcb0146c10 auth_method 0 2024-02-09T08:03:14.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.398+0000 7fbcb6614640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:14.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.398+0000 7fbcb6614640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:14.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.398+0000 7fbcb6614640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:14.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.398+0000 7fc74e00d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:14.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.398+0000 7fc74e00d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:14.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.398+0000 7fc74e00d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:14.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.399+0000 7fc74d80c640 1 --2- 172.21.15.62:0/1851226421 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc748072490 0x7fc748136c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.399+0000 7fbcb5612640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:14.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.399+0000 7fbcb5612640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:14.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.399+0000 7fbcb5612640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:14.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.400+0000 7fc74d80c640 10 monclient(hunting): get_auth_request con 0x7fc748072490 auth_method 0 2024-02-09T08:03:14.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.400+0000 7fc74d80c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:14.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.400+0000 7fc74d80c640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:14.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.400+0000 7fc74d80c640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:14.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.402+0000 7fc74e00d640 10 monclient(hunting): handle_auth_done global_id 4298 payload 824 2024-02-09T08:03:14.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.402+0000 7fc74e00d640 1 -- 172.21.15.62:0/1851226421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7480a9e50 msgr2=0x7fc748131c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.402+0000 7fc74e00d640 1 --2- 172.21.15.62:0/1851226421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7480a9e50 0x7fc748131c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.402+0000 7fc74e00d640 1 -- 172.21.15.62:0/1851226421 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc748072490 msgr2=0x7fc748136c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.402+0000 7fc74e00d640 1 --2- 172.21.15.62:0/1851226421 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc748072490 0x7fc748136c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.402+0000 7fc74e00d640 10 monclient: _finish_hunting 0 2024-02-09T08:03:14.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.402+0000 7fc74e00d640 1 monclient: found mon.noname-c 2024-02-09T08:03:14.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.402+0000 7fc74e00d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:14.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.402+0000 7fc74e00d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-02-09T08:03:14.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.402+0000 7fc74e00d640 1 -- 172.21.15.62:0/1851226421 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc738009400 con 0x7fc74813f7d0 2024-02-09T08:03:14.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.403+0000 7fbcb6614640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:14.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.403+0000 7fbcb6614640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:14.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.403+0000 7fbcb6614640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:14.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.403+0000 7fbcb5612640 10 monclient(hunting): handle_auth_done global_id 4305 payload 824 2024-02-09T08:03:14.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.403+0000 7f3639ffb640 1 -- 172.21.15.62:0/1164071636 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36400453f0 con 0x7f36440ac3a0 2024-02-09T08:03:14.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.403+0000 7f3639ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:14.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.403+0000 7f3639ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:03:14.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.403+0000 7f3639ffb640 10 monclient: dump: 2024-02-09T08:03:14.485 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:14.485 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.485 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.485 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.485 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:14.485 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.485 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:14.485 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:14.486 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:14.486 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.403+0000 7fbcb5612640 1 -- 172.21.15.62:0/348553430 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbcb0146c10 msgr2=0x7fbcb0144dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.403+0000 7fbcb5612640 1 --2- 172.21.15.62:0/348553430 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbcb0146c10 0x7fbcb0144dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.403+0000 7f3639ffb640 10 monclient: _finish_auth 0 2024-02-09T08:03:14.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.403+0000 7f3639ffb640 10 monclient: _check_auth_tickets 2024-02-09T08:03:14.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.403+0000 7f3639ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:14.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.403+0000 7f3639ffb640 1 -- 172.21.15.62:0/1164071636 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3640045590 con 0x7f36440ac3a0 2024-02-09T08:03:14.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.403+0000 7f3639ffb640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:14.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.403+0000 7f3639ffb640 1 -- 172.21.15.62:0/1164071636 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3640045940 con 0x7f36440ac3a0 2024-02-09T08:03:14.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.403+0000 7f3639ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:14.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.403+0000 7f3639ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:03:14.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.403+0000 7fbcb5612640 1 -- 172.21.15.62:0/348553430 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcb006e5c0 msgr2=0x7fbcb00b1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.403+0000 7fbcb5612640 1 --2- 172.21.15.62:0/348553430 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcb006e5c0 0x7fbcb00b1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.403+0000 7fbcb5612640 10 monclient: _finish_hunting 0 2024-02-09T08:03:14.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.403+0000 7fbcb5612640 1 monclient: found mon.noname-a 2024-02-09T08:03:14.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.403+0000 7fbcb5612640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:14.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.403+0000 7fbcb5612640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-02-09T08:03:14.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.403+0000 7fbcb5612640 1 -- 172.21.15.62:0/348553430 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca8009b30 con 0x7fbcb0143bc0 2024-02-09T08:03:14.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.403+0000 7fea7195b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea6c13fdf0 0x7fea6c132ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.403+0000 7f3639ffb640 10 monclient: dump: 2024-02-09T08:03:14.489 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:14.489 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.489 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.489 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.489 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:14.489 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.489 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:14.489 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:14.489 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:14.490 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.403+0000 7f363b7fe640 4 set_mon_vals no callback set 2024-02-09T08:03:14.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.403+0000 7f364b2a6640 5 monclient: authenticate success, global_id 4315 2024-02-09T08:03:14.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.403+0000 7f364b2a6640 10 monclient: _renew_subs 2024-02-09T08:03:14.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.403+0000 7f364b2a6640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:14.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.403+0000 7f364b2a6640 1 -- 172.21.15.62:0/1164071636 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3644139f80 con 0x7f36440ac3a0 2024-02-09T08:03:14.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.403+0000 7f364b2a6640 10 client.4315.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:03:14.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.403+0000 7f364b2a6640 10 monclient: _renew_subs 2024-02-09T08:03:14.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.403+0000 7f364b2a6640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:14.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.403+0000 7f364b2a6640 1 -- 172.21.15.62:0/1164071636 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36441423a0 con 0x7f36440ac3a0 2024-02-09T08:03:14.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.403+0000 7f364b2a6640 1 librados: init done 2024-02-09T08:03:14.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.404+0000 7f364b2a6640 10 client.4315.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:14.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.404+0000 7f364b2a6640 15 client.4315.objecter _session_command_op_assign -1 1 2024-02-09T08:03:14.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.404+0000 7f364b2a6640 20 client.4315.objecter _get_session osd=-1 returning homeless 2024-02-09T08:03:14.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.404+0000 7f364b2a6640 10 client.4315.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:03:14.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.404+0000 7f364b2a6640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:14.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.404+0000 7f364b2a6640 1 -- 172.21.15.62:0/1164071636 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f364413a230 con 0x7f36440ac3a0 2024-02-09T08:03:14.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.405+0000 7f3e737fe640 1 --2- 172.21.15.62:0/3425683466 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e740aada0 0x7f3e74144590 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3e6400b4a0 tx=0x7f3e6400b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:14.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.405+0000 7f3e70ff9640 10 client.?.objecter ms_handle_connect 0x7f3e740aada0 2024-02-09T08:03:14.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.405+0000 7f3e70ff9640 10 client.?.objecter resend_mon_ops 2024-02-09T08:03:14.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.406+0000 7fea7195b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea6c13fdf0 0x7fea6c132ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.62:40042/0 (socket says 172.21.15.62:40042) 2024-02-09T08:03:14.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.406+0000 7fea7195b640 1 -- 172.21.15.62:0/2954043784 learned_addr learned my addr 172.21.15.62:0/2954043784 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:14.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.406+0000 7fea7195b640 10 monclient(hunting): get_auth_request con 0x7fea6c13fdf0 auth_method 0 2024-02-09T08:03:14.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.406+0000 7fea7195b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:14.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.406+0000 7fea7195b640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:14.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.406+0000 7fea7195b640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:14.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.408+0000 7fea7195b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:14.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.408+0000 7fea7195b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:14.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.408+0000 7fea7195b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:14.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.409+0000 7fc74e00d640 1 --2- 172.21.15.62:0/1851226421 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc74813f7d0 0x7fc7481321a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc74400c180 tx=0x7fc74400c640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:14.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.409+0000 7fc73e7fc640 10 client.?.objecter ms_handle_connect 0x7fc74813f7d0 2024-02-09T08:03:14.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.409+0000 7fc73e7fc640 10 client.?.objecter resend_mon_ops 2024-02-09T08:03:14.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.409+0000 7ff2d5c3a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2d0146020 0x7ff2d01cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.409+0000 7ff2d4c38640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2d013f7b0 0x7ff2d01cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.410+0000 7fbcb5612640 1 --2- 172.21.15.62:0/348553430 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcb0143bc0 0x7fbcb00b2930 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbcac00c410 tx=0x7fbcac00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:14.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.410+0000 7fbca67fc640 10 client.?.objecter ms_handle_connect 0x7fbcb0143bc0 2024-02-09T08:03:14.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.410+0000 7fbca67fc640 10 client.?.objecter resend_mon_ops 2024-02-09T08:03:14.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.411+0000 7fea70959640 1 --2- 172.21.15.62:0/2954043784 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea6c0b5000 0x7fea6c136f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.411+0000 7ff2d4c38640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2d013f7b0 0x7ff2d01cb370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:34882/0 (socket says 172.21.15.62:34882) 2024-02-09T08:03:14.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.411+0000 7ff2d4c38640 1 -- 172.21.15.62:0/493264404 learned_addr learned my addr 172.21.15.62:0/493264404 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:14.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.411+0000 7ff2d4c38640 10 monclient(hunting): get_auth_request con 0x7ff2d013f7b0 auth_method 0 2024-02-09T08:03:14.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.411+0000 7ff2d4c38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:14.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.411+0000 7ff2d4c38640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:14.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.411+0000 7ff2d4c38640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:14.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.412+0000 7fea70959640 10 monclient(hunting): get_auth_request con 0x7fea6c0b5000 auth_method 0 2024-02-09T08:03:14.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.412+0000 7fea70959640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:14.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.412+0000 7fea70959640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:14.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.412+0000 7fea70959640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:14.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.413+0000 7ff2d4c38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:14.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.413+0000 7ff2d4c38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:14.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.413+0000 7ff2d4c38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:14.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.413+0000 7f839cff9640 1 -- 172.21.15.62:0/1401922854 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8394032900 con 0x7f83980c5790 2024-02-09T08:03:14.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.413+0000 7f839cff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:14.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.413+0000 7f839cff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-09T08:03:14.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.413+0000 7f839cff9640 10 monclient: dump: 2024-02-09T08:03:14.497 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:14.497 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.497 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.497 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.497 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:14.497 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.497 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:14.498 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:14.498 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:14.498 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.413+0000 7f839cff9640 10 monclient: _finish_auth 0 2024-02-09T08:03:14.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.413+0000 7f839cff9640 10 monclient: _check_auth_tickets 2024-02-09T08:03:14.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.413+0000 7f839cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:14.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.413+0000 7f839cff9640 1 -- 172.21.15.62:0/1401922854 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8394032a60 con 0x7f83980c5790 2024-02-09T08:03:14.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.413+0000 7f839cff9640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:14.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.413+0000 7f839cff9640 1 -- 172.21.15.62:0/1401922854 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8394032e10 con 0x7f83980c5790 2024-02-09T08:03:14.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.413+0000 7f83a574b640 5 monclient: authenticate success, global_id 4286 2024-02-09T08:03:14.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.413+0000 7f83a574b640 10 monclient: _renew_subs 2024-02-09T08:03:14.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.413+0000 7f83a574b640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:03:14.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.413+0000 7f83a574b640 1 -- 172.21.15.62:0/1401922854 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83980cbfa0 con 0x7f83980c5790 2024-02-09T08:03:14.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.413+0000 7f839cff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:14.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.413+0000 7f839cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-09T08:03:14.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.413+0000 7f839cff9640 10 monclient: dump: 2024-02-09T08:03:14.499 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:14.499 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.499 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.499 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.499 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:14.499 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.499 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:14.499 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:14.499 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:14.499 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.413+0000 7f839e7fc640 4 set_mon_vals no callback set 2024-02-09T08:03:14.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.413+0000 7f83a574b640 10 client.4286.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:03:14.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.413+0000 7f83a574b640 10 monclient: _renew_subs 2024-02-09T08:03:14.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.413+0000 7f83a574b640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:03:14.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.413+0000 7f83a574b640 1 -- 172.21.15.62:0/1401922854 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83980303d0 con 0x7f83980c5790 2024-02-09T08:03:14.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.413+0000 7f83a574b640 1 librados: init done 2024-02-09T08:03:14.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.414+0000 7f83a574b640 10 client.4286.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:14.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.414+0000 7f83a574b640 15 client.4286.objecter _session_command_op_assign -1 1 2024-02-09T08:03:14.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.414+0000 7f83a574b640 20 client.4286.objecter _get_session osd=-1 returning homeless 2024-02-09T08:03:14.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.414+0000 7f83a574b640 10 client.4286.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:03:14.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.414+0000 7f83a574b640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:03:14.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.414+0000 7f83a574b640 1 -- 172.21.15.62:0/1401922854 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f839803b050 con 0x7f83980c5790 2024-02-09T08:03:14.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.415+0000 7fea7195b640 10 monclient(hunting): handle_auth_done global_id 4327 payload 824 2024-02-09T08:03:14.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.415+0000 7fea7195b640 1 -- 172.21.15.62:0/2954043784 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fea6c0a9e30 msgr2=0x7fea6c1351b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.415+0000 7fea7195b640 1 --2- 172.21.15.62:0/2954043784 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fea6c0a9e30 0x7fea6c1351b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.415+0000 7fea7195b640 1 -- 172.21.15.62:0/2954043784 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea6c0b5000 msgr2=0x7fea6c136f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.415+0000 7fea7195b640 1 --2- 172.21.15.62:0/2954043784 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea6c0b5000 0x7fea6c136f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.415+0000 7fea7195b640 10 monclient: _finish_hunting 0 2024-02-09T08:03:14.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.415+0000 7fea7195b640 1 monclient: found mon.noname-b 2024-02-09T08:03:14.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.415+0000 7fea7195b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:14.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.415+0000 7fea7195b640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.103:3300/0 2024-02-09T08:03:14.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.415+0000 7fea7195b640 1 -- 172.21.15.62:0/2954043784 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea64009a70 con 0x7fea6c13fdf0 2024-02-09T08:03:14.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.418+0000 7ff2d5c3a640 10 monclient(hunting): get_auth_request con 0x7ff2d0146020 auth_method 0 2024-02-09T08:03:14.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.418+0000 7ff2d5c3a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:14.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.418+0000 7ff2d5c3a640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:14.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.418+0000 7ff2d5c3a640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:14.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.418+0000 7ff2d4c38640 10 monclient(hunting): handle_auth_done global_id 4311 payload 824 2024-02-09T08:03:14.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.418+0000 7ff2d4c38640 1 -- 172.21.15.62:0/493264404 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff2d0074680 msgr2=0x7ff2d0071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.418+0000 7ff2d4c38640 1 --2- 172.21.15.62:0/493264404 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff2d0074680 0x7ff2d0071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.418+0000 7ff2d4c38640 1 -- 172.21.15.62:0/493264404 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2d0146020 msgr2=0x7ff2d01cb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.418+0000 7ff2d4c38640 1 --2- 172.21.15.62:0/493264404 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2d0146020 0x7ff2d01cb8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.418+0000 7ff2d4c38640 10 monclient: _finish_hunting 0 2024-02-09T08:03:14.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.418+0000 7ff2d4c38640 1 monclient: found mon.noname-a 2024-02-09T08:03:14.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.418+0000 7ff2d4c38640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:14.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.418+0000 7ff2d4c38640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-02-09T08:03:14.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.418+0000 7ff2d4c38640 1 -- 172.21.15.62:0/493264404 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2cc0094d0 con 0x7ff2d013f7b0 2024-02-09T08:03:14.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.421+0000 7fea7195b640 1 --2- 172.21.15.62:0/2954043784 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea6c13fdf0 0x7fea6c132ea0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fea64009ee0 tx=0x7fea64004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:14.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.421+0000 7fea61ffb640 10 client.?.objecter ms_handle_connect 0x7fea6c13fdf0 2024-02-09T08:03:14.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.421+0000 7fea61ffb640 10 client.?.objecter resend_mon_ops 2024-02-09T08:03:14.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.421+0000 7fbca67fc640 1 -- 172.21.15.62:0/348553430 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcac005230 con 0x7fbcb0143bc0 2024-02-09T08:03:14.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.421+0000 7fbca67fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:14.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.421+0000 7fbca67fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-09T08:03:14.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.421+0000 7fbca67fc640 10 monclient: dump: 2024-02-09T08:03:14.505 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:14.505 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.505 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.505 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.505 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:14.505 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.505 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:14.505 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:14.506 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:14.506 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.421+0000 7fbca67fc640 10 monclient: _finish_auth 0 2024-02-09T08:03:14.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.421+0000 7fbca67fc640 10 monclient: _check_auth_tickets 2024-02-09T08:03:14.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.421+0000 7fbca67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:14.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.421+0000 7fbca67fc640 1 -- 172.21.15.62:0/348553430 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcac005390 con 0x7fbcb0143bc0 2024-02-09T08:03:14.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.421+0000 7fbca67fc640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:14.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.421+0000 7fbca67fc640 1 -- 172.21.15.62:0/348553430 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcac004820 con 0x7fbcb0143bc0 2024-02-09T08:03:14.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.421+0000 7fbca67fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:14.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.421+0000 7fbca67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-09T08:03:14.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.421+0000 7fbca67fc640 10 monclient: dump: 2024-02-09T08:03:14.506 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:14.506 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.506 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.506 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.506 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:14.507 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.507 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:14.507 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:14.507 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:14.507 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.421+0000 7fbca7fff640 4 set_mon_vals no callback set 2024-02-09T08:03:14.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.421+0000 7fbcb8077640 5 monclient: authenticate success, global_id 4305 2024-02-09T08:03:14.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.421+0000 7fbcb8077640 10 monclient: _renew_subs 2024-02-09T08:03:14.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.421+0000 7fbcb8077640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:03:14.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.421+0000 7fbcb8077640 1 -- 172.21.15.62:0/348553430 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcb0145300 con 0x7fbcb0143bc0 2024-02-09T08:03:14.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.421+0000 7fbcb8077640 10 client.4305.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:03:14.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.421+0000 7fbcb8077640 10 monclient: _renew_subs 2024-02-09T08:03:14.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.421+0000 7fbcb8077640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:03:14.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.422+0000 7fbcb8077640 1 -- 172.21.15.62:0/348553430 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcb01457c0 con 0x7fbcb0143bc0 2024-02-09T08:03:14.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.422+0000 7fbcb8077640 1 librados: init done 2024-02-09T08:03:14.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.422+0000 7fbcb8077640 10 client.4305.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:14.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.422+0000 7fbcb8077640 15 client.4305.objecter _session_command_op_assign -1 1 2024-02-09T08:03:14.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.422+0000 7fbcb8077640 20 client.4305.objecter _get_session osd=-1 returning homeless 2024-02-09T08:03:14.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.422+0000 7fbcb8077640 10 client.4305.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:03:14.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.422+0000 7fbcb8077640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:03:14.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.422+0000 7fbcb8077640 1 -- 172.21.15.62:0/348553430 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbcb0145a90 con 0x7fbcb0143bc0 2024-02-09T08:03:14.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.425+0000 7ff2d4c38640 1 --2- 172.21.15.62:0/493264404 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2d013f7b0 0x7ff2d01cb370 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff2c000e9b0 tx=0x7ff2c000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:14.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.425+0000 7ff2c5ffb640 10 client.?.objecter ms_handle_connect 0x7ff2d013f7b0 2024-02-09T08:03:14.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.425+0000 7ff2c5ffb640 10 client.?.objecter resend_mon_ops 2024-02-09T08:03:14.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.428+0000 7fefcf7fe640 1 -- 172.21.15.62:0/3363588394 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe0018070 con 0x7fefe8067110 2024-02-09T08:03:14.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.428+0000 7fefcf7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:14.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.428+0000 7fefcf7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-09T08:03:14.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.428+0000 7fefcf7fe640 10 monclient: dump: 2024-02-09T08:03:14.510 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:14.510 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.510 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.510 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.510 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:14.510 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.510 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:14.510 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:14.510 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:14.510 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.428+0000 7fefcf7fe640 10 monclient: _finish_auth 0 2024-02-09T08:03:14.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.428+0000 7fefcf7fe640 10 monclient: _check_auth_tickets 2024-02-09T08:03:14.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.428+0000 7fefcf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:14.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.428+0000 7fefcf7fe640 1 -- 172.21.15.62:0/3363588394 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefe000ee90 con 0x7fefe8067110 2024-02-09T08:03:14.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.428+0000 7fefcf7fe640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:14.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.428+0000 7fefcf7fe640 1 -- 172.21.15.62:0/3363588394 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe0003bb0 con 0x7fefe8067110 2024-02-09T08:03:14.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.428+0000 7fefcf7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:14.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.428+0000 7fefcf7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-09T08:03:14.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.428+0000 7fefcf7fe640 10 monclient: dump: 2024-02-09T08:03:14.511 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:14.511 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.511 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.511 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.511 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:14.511 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.511 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:14.511 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:14.512 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:14.512 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.428+0000 7fefed174640 5 monclient: authenticate success, global_id 4289 2024-02-09T08:03:14.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.428+0000 7fefed174640 10 monclient: _renew_subs 2024-02-09T08:03:14.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.428+0000 7fefed174640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:03:14.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.428+0000 7fefe559a640 4 set_mon_vals no callback set 2024-02-09T08:03:14.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.428+0000 7fefed174640 1 -- 172.21.15.62:0/3363588394 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefe81386a0 con 0x7fefe8067110 2024-02-09T08:03:14.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.428+0000 7fefed174640 10 client.4289.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:03:14.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.428+0000 7fefed174640 10 monclient: _renew_subs 2024-02-09T08:03:14.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.428+0000 7fefed174640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:03:14.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.428+0000 7fefed174640 1 -- 172.21.15.62:0/3363588394 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefe80b5f50 con 0x7fefe8067110 2024-02-09T08:03:14.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.428+0000 7fefed174640 1 librados: init done 2024-02-09T08:03:14.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.428+0000 7f3e70ff9640 1 -- 172.21.15.62:0/3425683466 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e64010610 con 0x7f3e740aada0 2024-02-09T08:03:14.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.428+0000 7f3e70ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:14.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.428+0000 7f3e70ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-09T08:03:14.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.428+0000 7f3e70ff9640 10 monclient: dump: 2024-02-09T08:03:14.514 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:14.514 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.514 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.514 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.514 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:14.514 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.514 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:14.515 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:14.515 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:14.515 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.428+0000 7f3e70ff9640 10 monclient: _finish_auth 0 2024-02-09T08:03:14.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.428+0000 7f3e70ff9640 10 monclient: _check_auth_tickets 2024-02-09T08:03:14.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.428+0000 7f3e70ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:14.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.428+0000 7f3e70ff9640 1 -- 172.21.15.62:0/3425683466 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e64010770 con 0x7f3e740aada0 2024-02-09T08:03:14.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.428+0000 7f3e7a92e640 5 monclient: authenticate success, global_id 4292 2024-02-09T08:03:14.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.428+0000 7f3e7a92e640 10 monclient: _renew_subs 2024-02-09T08:03:14.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.428+0000 7f3e7a92e640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:03:14.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.428+0000 7f3e7a92e640 1 -- 172.21.15.62:0/3425683466 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e74142840 con 0x7f3e740aada0 2024-02-09T08:03:14.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.428+0000 7f3e7a92e640 10 client.4292.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:03:14.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.428+0000 7f3e7a92e640 10 monclient: _renew_subs 2024-02-09T08:03:14.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.428+0000 7f3e7a92e640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:03:14.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.428+0000 7f3e7a92e640 1 -- 172.21.15.62:0/3425683466 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e741d8120 con 0x7f3e740aada0 2024-02-09T08:03:14.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.428+0000 7f3e7a92e640 1 librados: init done 2024-02-09T08:03:14.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.428+0000 7f3e70ff9640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:14.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.429+0000 7f3e70ff9640 1 -- 172.21.15.62:0/3425683466 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e64010b20 con 0x7f3e740aada0 2024-02-09T08:03:14.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.429+0000 7f3e70ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:14.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.429+0000 7f3e70ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-09T08:03:14.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.429+0000 7f3e70ff9640 10 monclient: dump: 2024-02-09T08:03:14.516 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:14.516 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.516 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.516 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.516 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:14.516 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.516 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:14.516 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:14.516 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:14.517 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.429+0000 7f3e727fc640 4 set_mon_vals no callback set 2024-02-09T08:03:14.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.429+0000 7fefed174640 10 client.4289.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:14.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.429+0000 7fefed174640 15 client.4289.objecter _session_command_op_assign -1 1 2024-02-09T08:03:14.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.429+0000 7fefed174640 20 client.4289.objecter _get_session osd=-1 returning homeless 2024-02-09T08:03:14.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.429+0000 7fefed174640 10 client.4289.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:03:14.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.429+0000 7fefed174640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:03:14.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.429+0000 7fefed174640 1 -- 172.21.15.62:0/3363588394 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fefe804ef90 con 0x7fefe8067110 2024-02-09T08:03:14.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.429+0000 7f3e7a92e640 10 client.4292.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:14.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.429+0000 7f3e7a92e640 15 client.4292.objecter _session_command_op_assign -1 1 2024-02-09T08:03:14.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.429+0000 7f3e7a92e640 20 client.4292.objecter _get_session osd=-1 returning homeless 2024-02-09T08:03:14.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.430+0000 7f3e7a92e640 10 client.4292.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:03:14.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.430+0000 7f3e7a92e640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:03:14.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.430+0000 7f3e7a92e640 1 -- 172.21.15.62:0/3425683466 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3e54002910 con 0x7f3e740aada0 2024-02-09T08:03:14.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.433+0000 7fea61ffb640 1 -- 172.21.15.62:0/2954043784 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea64040650 con 0x7fea6c13fdf0 2024-02-09T08:03:14.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.433+0000 7fea61ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:14.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.433+0000 7fea61ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:03:14.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.433+0000 7fea61ffb640 10 monclient: dump: 2024-02-09T08:03:14.519 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:14.519 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.519 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.519 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.519 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:14.520 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.520 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:14.520 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:14.520 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:14.520 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.433+0000 7fea61ffb640 10 monclient: _finish_auth 0 2024-02-09T08:03:14.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.433+0000 7fea61ffb640 10 monclient: _check_auth_tickets 2024-02-09T08:03:14.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.433+0000 7fea61ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:14.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.433+0000 7fea61ffb640 1 -- 172.21.15.62:0/2954043784 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea640407b0 con 0x7fea6c13fdf0 2024-02-09T08:03:14.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.433+0000 7fea61ffb640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:14.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.433+0000 7fea61ffb640 1 -- 172.21.15.62:0/2954043784 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea64040b40 con 0x7fea6c13fdf0 2024-02-09T08:03:14.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.433+0000 7fea61ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:14.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.433+0000 7fea61ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:03:14.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.433+0000 7fea61ffb640 10 monclient: dump: 2024-02-09T08:03:14.520 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:14.521 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.521 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.521 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.521 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:14.521 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.521 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:14.521 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:14.521 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:14.521 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.433+0000 7fea637fe640 4 set_mon_vals no callback set 2024-02-09T08:03:14.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.433+0000 7fea733be640 5 monclient: authenticate success, global_id 4327 2024-02-09T08:03:14.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.433+0000 7fea733be640 10 monclient: _renew_subs 2024-02-09T08:03:14.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.433+0000 7fea733be640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:14.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.433+0000 7fea733be640 1 -- 172.21.15.62:0/2954043784 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea6c1368e0 con 0x7fea6c13fdf0 2024-02-09T08:03:14.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.433+0000 7fea733be640 10 client.4327.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:03:14.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.433+0000 7fea733be640 10 monclient: _renew_subs 2024-02-09T08:03:14.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.433+0000 7fea733be640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:14.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.433+0000 7fea733be640 1 -- 172.21.15.62:0/2954043784 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea6c142f90 con 0x7fea6c13fdf0 2024-02-09T08:03:14.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.433+0000 7fea733be640 1 librados: init done 2024-02-09T08:03:14.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.434+0000 7fea733be640 10 client.4327.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:14.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.434+0000 7fea733be640 15 client.4327.objecter _session_command_op_assign -1 1 2024-02-09T08:03:14.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.434+0000 7fea733be640 20 client.4327.objecter _get_session osd=-1 returning homeless 2024-02-09T08:03:14.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.434+0000 7fea733be640 10 client.4327.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:03:14.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.434+0000 7fea733be640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:14.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.434+0000 7fea733be640 1 -- 172.21.15.62:0/2954043784 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fea6c04ef90 con 0x7fea6c13fdf0 2024-02-09T08:03:14.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.438+0000 7ff2c5ffb640 1 -- 172.21.15.62:0/493264404 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c0009670 con 0x7ff2d013f7b0 2024-02-09T08:03:14.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.438+0000 7ff2c5ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:14.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.438+0000 7ff2c5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-09T08:03:14.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.438+0000 7ff2c5ffb640 10 monclient: dump: 2024-02-09T08:03:14.524 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:14.524 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.524 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.524 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.524 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:14.524 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.524 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:14.524 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:14.524 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:14.524 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.438+0000 7ff2c5ffb640 10 monclient: _finish_auth 0 2024-02-09T08:03:14.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.438+0000 7ff2c5ffb640 10 monclient: _check_auth_tickets 2024-02-09T08:03:14.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.438+0000 7ff2c5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:14.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.438+0000 7ff2c5ffb640 1 -- 172.21.15.62:0/493264404 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c000c9a0 con 0x7ff2d013f7b0 2024-02-09T08:03:14.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.438+0000 7ff2c5ffb640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:14.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.438+0000 7ff2c5ffb640 1 -- 172.21.15.62:0/493264404 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c000cd50 con 0x7ff2d013f7b0 2024-02-09T08:03:14.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.438+0000 7ff2c5ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:14.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.438+0000 7ff2c5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-09T08:03:14.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.438+0000 7ff2c5ffb640 10 monclient: dump: 2024-02-09T08:03:14.525 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:14.525 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.525 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.525 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.525 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:14.525 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.525 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:14.525 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:14.526 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:14.526 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.438+0000 7ff2d769d640 5 monclient: authenticate success, global_id 4311 2024-02-09T08:03:14.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.438+0000 7ff2d769d640 10 monclient: _renew_subs 2024-02-09T08:03:14.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.438+0000 7ff2d769d640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:03:14.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.438+0000 7ff2d769d640 1 -- 172.21.15.62:0/493264404 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2d00b3580 con 0x7ff2d013f7b0 2024-02-09T08:03:14.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.438+0000 7ff2c77fe640 4 set_mon_vals no callback set 2024-02-09T08:03:14.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.438+0000 7ff2d769d640 10 client.4311.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:03:14.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.438+0000 7ff2d769d640 10 monclient: _renew_subs 2024-02-09T08:03:14.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.438+0000 7ff2d769d640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:03:14.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.438+0000 7ff2d769d640 1 -- 172.21.15.62:0/493264404 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2d013a1d0 con 0x7ff2d013f7b0 2024-02-09T08:03:14.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.438+0000 7ff2d769d640 1 librados: init done 2024-02-09T08:03:14.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.439+0000 7ff2d769d640 10 client.4311.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:14.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.439+0000 7ff2d769d640 15 client.4311.objecter _session_command_op_assign -1 1 2024-02-09T08:03:14.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.439+0000 7ff2d769d640 20 client.4311.objecter _get_session osd=-1 returning homeless 2024-02-09T08:03:14.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.439+0000 7ff2d769d640 10 client.4311.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:03:14.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.439+0000 7ff2d769d640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:03:14.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.439+0000 7ff2d769d640 1 -- 172.21.15.62:0/493264404 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff2d01ccd70 con 0x7ff2d013f7b0 2024-02-09T08:03:14.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.446+0000 7f839cff9640 1 -- 172.21.15.62:0/1401922854 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f839403b3f0 con 0x7f83980c5790 2024-02-09T08:03:14.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.446+0000 7f839cff9640 1 --2- 172.21.15.62:0/1401922854 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f838406d1f0 0x7f838406f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.447+0000 7f839ffff640 1 --2- 172.21.15.62:0/1401922854 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f838406d1f0 0x7f838406f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.447+0000 7f839ffff640 10 monclient: get_auth_request con 0x7f838406d1f0 auth_method 0 2024-02-09T08:03:14.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.447+0000 7f839ffff640 1 --2- 172.21.15.62:0/1401922854 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f838406d1f0 0x7f838406f6b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f83a0050770 tx=0x7f83a00668a0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:14.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.447+0000 7f839cff9640 10 client.4286.objecter ms_handle_connect 0x7f838406d1f0 2024-02-09T08:03:14.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.448+0000 7f3639ffb640 1 -- 172.21.15.62:0/1164071636 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f364004e450 con 0x7f36440ac3a0 2024-02-09T08:03:14.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.448+0000 7f3639ffb640 1 --2- 172.21.15.62:0/1164071636 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f362806d1f0 0x7f362806f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.448+0000 7f3649042640 1 --2- 172.21.15.62:0/1164071636 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f362806d1f0 0x7f362806f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.448+0000 7f3649042640 10 monclient: get_auth_request con 0x7f362806d1f0 auth_method 0 2024-02-09T08:03:14.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.449+0000 7f3639ffb640 10 client.4315.objecter ms_handle_connect 0x7f362806d1f0 2024-02-09T08:03:14.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.449+0000 7f3649042640 1 --2- 172.21.15.62:0/1164071636 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f362806d1f0 0x7f362806f6b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3634005880 tx=0x7f3634009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:14.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.449+0000 7f839cff9640 1 -- 172.21.15.62:0/1401922854 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f839407b290 con 0x7f83980c5790 2024-02-09T08:03:14.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.449+0000 7f839cff9640 10 client.4286.objecter ms_dispatch 0x7f83a0000b90 osd_map(25..25 src has 1..25) v4 2024-02-09T08:03:14.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.449+0000 7f839cff9640 3 client.4286.objecter handle_osd_map got epochs [25,25] > 0 2024-02-09T08:03:14.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.449+0000 7f839cff9640 3 client.4286.objecter handle_osd_map decoding full epoch 25 2024-02-09T08:03:14.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.449+0000 7f839cff9640 10 client.4286.objecter checking command 1 2024-02-09T08:03:14.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.449+0000 7f839cff9640 1 --2- 172.21.15.62:0/1401922854 >> [v2:172.21.15.103:6826/3983655111,v1:172.21.15.103:6827/3983655111] conn(0x7f83840735d0 0x7f83840759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.449+0000 7f839cff9640 20 client.4286.objecter _get_session s=0x7f8384072f00 osd=6 3 2024-02-09T08:03:14.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.449+0000 7f839cff9640 20 client.4286.objecter put_session s=0x7f8384072f00 osd=6 3 2024-02-09T08:03:14.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.449+0000 7f839cff9640 15 client.4286.objecter _session_command_op_remove -1 1 2024-02-09T08:03:14.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.449+0000 7f839cff9640 20 client.4286.objecter _get_session s=0x7f8384072f00 osd=6 3 2024-02-09T08:03:14.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.449+0000 7f839cff9640 20 client.4286.objecter get_session s=0x7f8384072f00 osd=6 3 2024-02-09T08:03:14.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.449+0000 7f839cff9640 15 client.4286.objecter _session_command_op_assign 6 1 2024-02-09T08:03:14.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.449+0000 7f839cff9640 20 client.4286.objecter put_session s=0x7f8384072f00 osd=6 4 2024-02-09T08:03:14.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.449+0000 7f839cff9640 10 client.4286.objecter _send_command 1 2024-02-09T08:03:14.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.449+0000 7f839cff9640 1 -- 172.21.15.62:0/1401922854 --> [v2:172.21.15.103:6826/3983655111,v1:172.21.15.103:6827/3983655111] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f83840760a0 con 0x7f83840735d0 2024-02-09T08:03:14.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.449+0000 7f839cff9640 20 client.4286.objecter dump_active .. 0 homeless 2024-02-09T08:03:14.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.450+0000 7f83a4f4a640 1 --2- 172.21.15.62:0/1401922854 >> [v2:172.21.15.103:6826/3983655111,v1:172.21.15.103:6827/3983655111] conn(0x7f83840735d0 0x7f83840759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.450+0000 7f83a4f4a640 10 monclient: get_auth_request con 0x7f83840735d0 auth_method 0 2024-02-09T08:03:14.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.452+0000 7fbca67fc640 1 -- 172.21.15.62:0/348553430 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fbcac004980 con 0x7fbcb0143bc0 2024-02-09T08:03:14.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.452+0000 7fbca67fc640 1 --2- 172.21.15.62:0/348553430 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fbc9406d1a0 0x7fbc9406f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.452+0000 7fbcb5e13640 1 --2- 172.21.15.62:0/348553430 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fbc9406d1a0 0x7fbc9406f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.452+0000 7fbcb5e13640 10 monclient: get_auth_request con 0x7fbc9406d1a0 auth_method 0 2024-02-09T08:03:14.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.453+0000 7fbca67fc640 10 client.4305.objecter ms_handle_connect 0x7fbc9406d1a0 2024-02-09T08:03:14.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.453+0000 7fbcb5e13640 1 --2- 172.21.15.62:0/348553430 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fbc9406d1a0 0x7fbc9406f660 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbca80093e0 tx=0x7fbca8030000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:14.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.453+0000 7f839cff9640 10 client.4286.objecter ms_handle_connect 0x7f83840735d0 2024-02-09T08:03:14.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.453+0000 7f83a4f4a640 1 --2- 172.21.15.62:0/1401922854 >> [v2:172.21.15.103:6826/3983655111,v1:172.21.15.103:6827/3983655111] conn(0x7f83840735d0 0x7f83840759f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:14.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.457+0000 7fbca67fc640 1 -- 172.21.15.62:0/348553430 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fbcac058140 con 0x7fbcb0143bc0 2024-02-09T08:03:14.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.457+0000 7fbca67fc640 10 client.4305.objecter ms_dispatch 0x7fbcb0000b90 osd_map(25..25 src has 1..25) v4 2024-02-09T08:03:14.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.457+0000 7fbca67fc640 3 client.4305.objecter handle_osd_map got epochs [25,25] > 0 2024-02-09T08:03:14.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.457+0000 7fbca67fc640 3 client.4305.objecter handle_osd_map decoding full epoch 25 2024-02-09T08:03:14.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.457+0000 7fbca67fc640 10 client.4305.objecter checking command 1 2024-02-09T08:03:14.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.457+0000 7fbca67fc640 1 --2- 172.21.15.62:0/348553430 >> [v2:172.21.15.62:6816/2695503114,v1:172.21.15.62:6817/2695503114] conn(0x7fbc94073580 0x7fbc940759a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.457+0000 7fbca67fc640 20 client.4305.objecter _get_session s=0x7fbc94072eb0 osd=2 3 2024-02-09T08:03:14.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.457+0000 7fbca67fc640 20 client.4305.objecter put_session s=0x7fbc94072eb0 osd=2 3 2024-02-09T08:03:14.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.457+0000 7fbca67fc640 15 client.4305.objecter _session_command_op_remove -1 1 2024-02-09T08:03:14.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.457+0000 7fbca67fc640 20 client.4305.objecter _get_session s=0x7fbc94072eb0 osd=2 3 2024-02-09T08:03:14.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.457+0000 7fbca67fc640 20 client.4305.objecter get_session s=0x7fbc94072eb0 osd=2 3 2024-02-09T08:03:14.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.457+0000 7fbca67fc640 15 client.4305.objecter _session_command_op_assign 2 1 2024-02-09T08:03:14.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.457+0000 7fbca67fc640 20 client.4305.objecter put_session s=0x7fbc94072eb0 osd=2 4 2024-02-09T08:03:14.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.457+0000 7fbca67fc640 10 client.4305.objecter _send_command 1 2024-02-09T08:03:14.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.457+0000 7fbca67fc640 1 -- 172.21.15.62:0/348553430 --> [v2:172.21.15.62:6816/2695503114,v1:172.21.15.62:6817/2695503114] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbc94076050 con 0x7fbc94073580 2024-02-09T08:03:14.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.457+0000 7fbca67fc640 20 client.4305.objecter dump_active .. 0 homeless 2024-02-09T08:03:14.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.458+0000 7fbcb6614640 1 --2- 172.21.15.62:0/348553430 >> [v2:172.21.15.62:6816/2695503114,v1:172.21.15.62:6817/2695503114] conn(0x7fbc94073580 0x7fbc940759a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.458+0000 7fbcb6614640 10 monclient: get_auth_request con 0x7fbc94073580 auth_method 0 2024-02-09T08:03:14.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.459+0000 7f3639ffb640 1 -- 172.21.15.62:0/1164071636 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f364007bc60 con 0x7f36440ac3a0 2024-02-09T08:03:14.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.459+0000 7f3639ffb640 10 client.4315.objecter ms_dispatch 0x7f3644000b90 osd_map(25..25 src has 1..25) v4 2024-02-09T08:03:14.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.459+0000 7f3639ffb640 3 client.4315.objecter handle_osd_map got epochs [25,25] > 0 2024-02-09T08:03:14.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.459+0000 7f3639ffb640 3 client.4315.objecter handle_osd_map decoding full epoch 25 2024-02-09T08:03:14.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.459+0000 7f3639ffb640 10 client.4315.objecter checking command 1 2024-02-09T08:03:14.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.459+0000 7f3639ffb640 1 --2- 172.21.15.62:0/1164071636 >> [v2:172.21.15.62:6808/3842068700,v1:172.21.15.62:6809/3842068700] conn(0x7f36280735d0 0x7f36280759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.459+0000 7f3639ffb640 20 client.4315.objecter _get_session s=0x7f3628072f00 osd=0 3 2024-02-09T08:03:14.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.459+0000 7f3639ffb640 20 client.4315.objecter put_session s=0x7f3628072f00 osd=0 3 2024-02-09T08:03:14.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.459+0000 7f3639ffb640 15 client.4315.objecter _session_command_op_remove -1 1 2024-02-09T08:03:14.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.459+0000 7f3639ffb640 20 client.4315.objecter _get_session s=0x7f3628072f00 osd=0 3 2024-02-09T08:03:14.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.459+0000 7f3639ffb640 20 client.4315.objecter get_session s=0x7f3628072f00 osd=0 3 2024-02-09T08:03:14.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.459+0000 7f3639ffb640 15 client.4315.objecter _session_command_op_assign 0 1 2024-02-09T08:03:14.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.459+0000 7f3639ffb640 20 client.4315.objecter put_session s=0x7f3628072f00 osd=0 4 2024-02-09T08:03:14.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.459+0000 7f3639ffb640 10 client.4315.objecter _send_command 1 2024-02-09T08:03:14.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.459+0000 7f3639ffb640 1 -- 172.21.15.62:0/1164071636 --> [v2:172.21.15.62:6808/3842068700,v1:172.21.15.62:6809/3842068700] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f36280760a0 con 0x7f36280735d0 2024-02-09T08:03:14.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.459+0000 7f3639ffb640 20 client.4315.objecter dump_active .. 0 homeless 2024-02-09T08:03:14.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.460+0000 7f3649843640 1 --2- 172.21.15.62:0/1164071636 >> [v2:172.21.15.62:6808/3842068700,v1:172.21.15.62:6809/3842068700] conn(0x7f36280735d0 0x7f36280759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.460+0000 7f3649843640 10 monclient: get_auth_request con 0x7f36280735d0 auth_method 0 2024-02-09T08:03:14.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.461+0000 7fbca67fc640 1 -- 172.21.15.62:0/348553430 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbcac0543e0 con 0x7fbcb0143bc0 2024-02-09T08:03:14.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.461+0000 7fbca67fc640 10 monclient: handle_get_version_reply finishing 1 version 25 2024-02-09T08:03:14.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.463+0000 7fbca67fc640 10 client.4305.objecter ms_handle_connect 0x7fbc94073580 2024-02-09T08:03:14.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.463+0000 7fbcb6614640 1 --2- 172.21.15.62:0/348553430 >> [v2:172.21.15.62:6816/2695503114,v1:172.21.15.62:6817/2695503114] conn(0x7fbc94073580 0x7fbc940759a0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:14.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.465+0000 7f3649843640 1 --2- 172.21.15.62:0/1164071636 >> [v2:172.21.15.62:6808/3842068700,v1:172.21.15.62:6809/3842068700] conn(0x7f36280735d0 0x7f36280759f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:14.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.465+0000 7f3639ffb640 10 client.4315.objecter ms_handle_connect 0x7f36280735d0 2024-02-09T08:03:14.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.470+0000 7fc73e7fc640 1 -- 172.21.15.62:0/1851226421 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc744005ce0 con 0x7fc74813f7d0 2024-02-09T08:03:14.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.470+0000 7fc73e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:14.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.470+0000 7fc73e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-09T08:03:14.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.470+0000 7fc73e7fc640 10 monclient: dump: 2024-02-09T08:03:14.539 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:14.539 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.539 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.539 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.539 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:14.539 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.539 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:14.539 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:14.540 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:14.540 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.470+0000 7fc73e7fc640 10 monclient: _finish_auth 0 2024-02-09T08:03:14.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.470+0000 7fc73e7fc640 10 monclient: _check_auth_tickets 2024-02-09T08:03:14.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.470+0000 7fc73e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:14.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.470+0000 7fc73e7fc640 1 -- 172.21.15.62:0/1851226421 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc744005e40 con 0x7fc74813f7d0 2024-02-09T08:03:14.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.470+0000 7fc74fa70640 5 monclient: authenticate success, global_id 4298 2024-02-09T08:03:14.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.470+0000 7fc73e7fc640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:14.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.470+0000 7fc73e7fc640 1 -- 172.21.15.62:0/1851226421 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7440072f0 con 0x7fc74813f7d0 2024-02-09T08:03:14.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.470+0000 7fc73e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:14.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.470+0000 7fc73e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-09T08:03:14.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.470+0000 7fc73e7fc640 10 monclient: dump: 2024-02-09T08:03:14.540 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:14.540 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.540 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.541 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.541 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:14.541 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.541 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:14.541 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:14.541 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:14.541 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.470+0000 7fc74fa70640 10 monclient: _renew_subs 2024-02-09T08:03:14.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.470+0000 7fc74fa70640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:03:14.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.470+0000 7fc73ffff640 4 set_mon_vals no callback set 2024-02-09T08:03:14.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.470+0000 7fc74fa70640 1 -- 172.21.15.62:0/1851226421 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc748138800 con 0x7fc74813f7d0 2024-02-09T08:03:14.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.470+0000 7fc74fa70640 10 client.4298.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:03:14.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.470+0000 7fc74fa70640 10 monclient: _renew_subs 2024-02-09T08:03:14.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.470+0000 7fc74fa70640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:03:14.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.470+0000 7fc74fa70640 1 -- 172.21.15.62:0/1851226421 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7481371a0 con 0x7fc74813f7d0 2024-02-09T08:03:14.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.471+0000 7fc74fa70640 1 librados: init done 2024-02-09T08:03:14.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.472+0000 7fc74fa70640 10 client.4298.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:14.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.472+0000 7fc74fa70640 15 client.4298.objecter _session_command_op_assign -1 1 2024-02-09T08:03:14.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.472+0000 7fc74fa70640 20 client.4298.objecter _get_session osd=-1 returning homeless 2024-02-09T08:03:14.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.472+0000 7fc74fa70640 10 client.4298.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:03:14.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.472+0000 7fc74fa70640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:03:14.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.472+0000 7fc74fa70640 1 -- 172.21.15.62:0/1851226421 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc74814ceb0 con 0x7fc74813f7d0 2024-02-09T08:03:14.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.475+0000 7fea61ffb640 1 -- 172.21.15.62:0/2954043784 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fea64040ca0 con 0x7fea6c13fdf0 2024-02-09T08:03:14.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.475+0000 7fea61ffb640 1 --2- 172.21.15.62:0/2954043784 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fea5006d1a0 0x7fea5006f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.476+0000 7fea61ffb640 1 -- 172.21.15.62:0/2954043784 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fea640ad210 con 0x7fea6c13fdf0 2024-02-09T08:03:14.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.476+0000 7fea61ffb640 10 client.4327.objecter ms_dispatch 0x7fea6c000b90 osd_map(25..25 src has 1..25) v4 2024-02-09T08:03:14.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.476+0000 7fea61ffb640 3 client.4327.objecter handle_osd_map got epochs [25,25] > 0 2024-02-09T08:03:14.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.476+0000 7fea61ffb640 3 client.4327.objecter handle_osd_map decoding full epoch 25 2024-02-09T08:03:14.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.476+0000 7fea7115a640 1 --2- 172.21.15.62:0/2954043784 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fea5006d1a0 0x7fea5006f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.476+0000 7fea7115a640 10 monclient: get_auth_request con 0x7fea5006d1a0 auth_method 0 2024-02-09T08:03:14.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.476+0000 7fea61ffb640 10 client.4327.objecter checking command 1 2024-02-09T08:03:14.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.476+0000 7fea61ffb640 1 --2- 172.21.15.62:0/2954043784 >> [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] conn(0x7fea50073580 0x7fea500759a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.476+0000 7fea61ffb640 20 client.4327.objecter _get_session s=0x7fea50072eb0 osd=3 3 2024-02-09T08:03:14.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.476+0000 7fea61ffb640 20 client.4327.objecter put_session s=0x7fea50072eb0 osd=3 3 2024-02-09T08:03:14.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.476+0000 7fea61ffb640 15 client.4327.objecter _session_command_op_remove -1 1 2024-02-09T08:03:14.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.476+0000 7fea61ffb640 20 client.4327.objecter _get_session s=0x7fea50072eb0 osd=3 3 2024-02-09T08:03:14.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.476+0000 7fea61ffb640 20 client.4327.objecter get_session s=0x7fea50072eb0 osd=3 3 2024-02-09T08:03:14.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.476+0000 7fea61ffb640 15 client.4327.objecter _session_command_op_assign 3 1 2024-02-09T08:03:14.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.476+0000 7fea61ffb640 20 client.4327.objecter put_session s=0x7fea50072eb0 osd=3 4 2024-02-09T08:03:14.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.476+0000 7fea61ffb640 10 client.4327.objecter _send_command 1 2024-02-09T08:03:14.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.476+0000 7fea61ffb640 1 -- 172.21.15.62:0/2954043784 --> [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fea50076050 con 0x7fea50073580 2024-02-09T08:03:14.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.476+0000 7fea61ffb640 20 client.4327.objecter dump_active .. 0 homeless 2024-02-09T08:03:14.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.476+0000 7fea7115a640 1 --2- 172.21.15.62:0/2954043784 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fea5006d1a0 0x7fea5006f660 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fea680011e0 tx=0x7fea68007890 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:14.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.476+0000 7fea61ffb640 10 client.4327.objecter ms_handle_connect 0x7fea5006d1a0 2024-02-09T08:03:14.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.477+0000 7fea70959640 1 --2- 172.21.15.62:0/2954043784 >> [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] conn(0x7fea50073580 0x7fea500759a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.477+0000 7fea70959640 10 monclient: get_auth_request con 0x7fea50073580 auth_method 0 2024-02-09T08:03:14.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.483+0000 7fea70959640 1 --2- 172.21.15.62:0/2954043784 >> [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] conn(0x7fea50073580 0x7fea500759a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:14.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.483+0000 7fea61ffb640 10 client.4327.objecter ms_handle_connect 0x7fea50073580 2024-02-09T08:03:14.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.491+0000 7fefcf7fe640 1 -- 172.21.15.62:0/3363588394 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fefe0027430 con 0x7fefe8067110 2024-02-09T08:03:14.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.492+0000 7fefcf7fe640 1 --2- 172.21.15.62:0/3363588394 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fefd406d1a0 0x7fefd406f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.492+0000 7fefe659c640 1 --2- 172.21.15.62:0/3363588394 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fefd406d1a0 0x7fefd406f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.492+0000 7fefe659c640 10 monclient: get_auth_request con 0x7fefd406d1a0 auth_method 0 2024-02-09T08:03:14.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.493+0000 7fefcf7fe640 10 client.4289.objecter ms_handle_connect 0x7fefd406d1a0 2024-02-09T08:03:14.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.493+0000 7fefe659c640 1 --2- 172.21.15.62:0/3363588394 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fefd406d1a0 0x7fefd406f660 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fefe8134fd0 tx=0x7fefdc0079b0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:14.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.502+0000 7f839cff9640 1 -- 172.21.15.62:0/1401922854 <== osd.6 v2:172.21.15.103:6826/3983655111 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f83840760a0 con 0x7f83840735d0 2024-02-09T08:03:14.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.502+0000 7f839cff9640 10 client.4286.objecter ms_dispatch 0x7f83a0000b90 command_reply(tid 1: 0 ) v1 2024-02-09T08:03:14.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.502+0000 7f839cff9640 10 client.4286.objecter _finish_command 1 = system:0 2024-02-09T08:03:14.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.502+0000 7f839cff9640 20 client.4286.objecter put_session s=0x7f8384072f00 osd=6 4 2024-02-09T08:03:14.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.502+0000 7f839cff9640 15 client.4286.objecter _session_command_op_remove 6 1 2024-02-09T08:03:14.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.518+0000 7f83a574b640 10 client.4286.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2024-02-09T08:03:14.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.518+0000 7f83a574b640 15 client.4286.objecter _session_command_op_assign -1 2 2024-02-09T08:03:14.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.518+0000 7f83a574b640 20 client.4286.objecter _get_session s=0x7f8384072f00 osd=6 3 2024-02-09T08:03:14.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.518+0000 7f83a574b640 20 client.4286.objecter put_session s=0x7f8384072f00 osd=6 3 2024-02-09T08:03:14.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.518+0000 7f83a574b640 20 client.4286.objecter _get_session s=0x7f8384072f00 osd=6 3 2024-02-09T08:03:14.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.518+0000 7f83a574b640 15 client.4286.objecter _session_command_op_remove -1 2 2024-02-09T08:03:14.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.518+0000 7f83a574b640 20 client.4286.objecter get_session s=0x7f8384072f00 osd=6 3 2024-02-09T08:03:14.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.518+0000 7f83a574b640 15 client.4286.objecter _session_command_op_assign 6 2 2024-02-09T08:03:14.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.518+0000 7f83a574b640 20 client.4286.objecter put_session s=0x7f8384072f00 osd=6 4 2024-02-09T08:03:14.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.518+0000 7f83a574b640 10 client.4286.objecter _send_command 2 2024-02-09T08:03:14.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.518+0000 7f83a574b640 1 -- 172.21.15.62:0/1401922854 --> [v2:172.21.15.103:6826/3983655111,v1:172.21.15.103:6827/3983655111] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f83980393d0 con 0x7f83840735d0 2024-02-09T08:03:14.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.523+0000 7f3639ffb640 1 -- 172.21.15.62:0/1164071636 <== osd.0 v2:172.21.15.62:6808/3842068700 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f36280760a0 con 0x7f36280735d0 2024-02-09T08:03:14.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.523+0000 7f3639ffb640 10 client.4315.objecter ms_dispatch 0x7f3644000b90 command_reply(tid 1: 0 ) v1 2024-02-09T08:03:14.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.523+0000 7f3639ffb640 10 client.4315.objecter _finish_command 1 = system:0 2024-02-09T08:03:14.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.523+0000 7f3639ffb640 20 client.4315.objecter put_session s=0x7f3628072f00 osd=0 4 2024-02-09T08:03:14.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.523+0000 7f3639ffb640 15 client.4315.objecter _session_command_op_remove 0 1 2024-02-09T08:03:14.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.524+0000 7f3e70ff9640 1 -- 172.21.15.62:0/3425683466 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f3e64010c80 con 0x7f3e740aada0 2024-02-09T08:03:14.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.525+0000 7f3e70ff9640 1 --2- 172.21.15.62:0/3425683466 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f3e6006d1f0 0x7f3e6006f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.525+0000 7f3e73fff640 1 --2- 172.21.15.62:0/3425683466 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f3e6006d1f0 0x7f3e6006f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.525+0000 7f3e73fff640 10 monclient: get_auth_request con 0x7f3e6006d1f0 auth_method 0 2024-02-09T08:03:14.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.526+0000 7f3e70ff9640 10 client.4292.objecter ms_handle_connect 0x7f3e6006d1f0 2024-02-09T08:03:14.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.526+0000 7f3e73fff640 1 --2- 172.21.15.62:0/3425683466 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f3e6006d1f0 0x7f3e6006f6b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c035000 tx=0x7f3e6c030000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:14.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.529+0000 7f839cff9640 1 -- 172.21.15.62:0/1401922854 <== osd.6 v2:172.21.15.103:6826/3983655111 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f83980393d0 con 0x7f83840735d0 2024-02-09T08:03:14.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.529+0000 7f839cff9640 10 client.4286.objecter ms_dispatch 0x7f83a0000b90 command_reply(tid 2: 0 ) v1 2024-02-09T08:03:14.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.529+0000 7f839cff9640 10 client.4286.objecter _finish_command 2 = system:0 2024-02-09T08:03:14.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.529+0000 7f839cff9640 20 client.4286.objecter put_session s=0x7f8384072f00 osd=6 4 2024-02-09T08:03:14.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.529+0000 7f839cff9640 15 client.4286.objecter _session_command_op_remove 6 2 2024-02-09T08:03:14.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.529+0000 7f83a574b640 10 librados: watch_flush enter 2024-02-09T08:03:14.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.529+0000 7f83a574b640 10 librados: watch_flush exit 2024-02-09T08:03:14.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.529+0000 7f83a574b640 10 client.4286.objecter close_session for osd.6 2024-02-09T08:03:14.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.529+0000 7f83a574b640 1 -- 172.21.15.62:0/1401922854 >> [v2:172.21.15.103:6826/3983655111,v1:172.21.15.103:6827/3983655111] conn(0x7f83840735d0 msgr2=0x7f83840759f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.529+0000 7f83a574b640 1 --2- 172.21.15.62:0/1401922854 >> [v2:172.21.15.103:6826/3983655111,v1:172.21.15.103:6827/3983655111] conn(0x7f83840735d0 0x7f83840759f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.529+0000 7f83a574b640 20 client.4286.objecter put_session s=0x7f8384072f00 osd=6 1 2024-02-09T08:03:14.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.529+0000 7f83a574b640 20 client.4286.objecter shutdown clearing up homeless session... 2024-02-09T08:03:14.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.529+0000 7f83a574b640 10 client.4286.objecter successfully canceled tick 2024-02-09T08:03:14.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.530+0000 7f83a574b640 1 -- 172.21.15.62:0/1401922854 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f838406d1f0 msgr2=0x7f838406f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.530+0000 7f83a574b640 1 --2- 172.21.15.62:0/1401922854 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f838406d1f0 0x7f838406f6b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f83a0050770 tx=0x7f83a00668a0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.530+0000 7f83a574b640 10 monclient: shutdown 2024-02-09T08:03:14.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.530+0000 7f83a574b640 20 monclient: shutdown canceling and discarding version request 1 2024-02-09T08:03:14.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.530+0000 7f83a574b640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:14.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.530+0000 7f83a574b640 1 -- 172.21.15.62:0/1401922854 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f83980c5790 msgr2=0x7f83981615b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.530+0000 7f83a574b640 1 --2- 172.21.15.62:0/1401922854 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f83980c5790 0x7f83981615b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8394034040 tx=0x7f83940046c0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.530+0000 7f83a4f4a640 1 -- 172.21.15.62:0/1401922854 reap_dead start 2024-02-09T08:03:14.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.530+0000 7f83a574b640 1 -- 172.21.15.62:0/1401922854 shutdown_connections 2024-02-09T08:03:14.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.530+0000 7f83a574b640 1 -- 172.21.15.62:0/1401922854 >> 172.21.15.62:0/1401922854 conn(0x7f8398006600 msgr2=0x7f83980384e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:14.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.530+0000 7fbca67fc640 1 -- 172.21.15.62:0/348553430 <== osd.2 v2:172.21.15.62:6816/2695503114 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fbc94076050 con 0x7fbc94073580 2024-02-09T08:03:14.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.530+0000 7fbca67fc640 10 client.4305.objecter ms_dispatch 0x7fbcb0000b90 command_reply(tid 1: 0 ) v1 2024-02-09T08:03:14.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.530+0000 7fbca67fc640 10 client.4305.objecter _finish_command 1 = system:0 2024-02-09T08:03:14.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.530+0000 7fbca67fc640 20 client.4305.objecter put_session s=0x7fbc94072eb0 osd=2 4 2024-02-09T08:03:14.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.530+0000 7fbca67fc640 15 client.4305.objecter _session_command_op_remove 2 1 2024-02-09T08:03:14.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.530+0000 7f83a574b640 1 -- 172.21.15.62:0/1401922854 shutdown_connections 2024-02-09T08:03:14.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.530+0000 7f83a574b640 1 -- 172.21.15.62:0/1401922854 wait complete. 2024-02-09T08:03:14.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.531+0000 7f83a574b640 1 librados: shutdown 2024-02-09T08:03:14.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.531+0000 7fefcf7fe640 1 -- 172.21.15.62:0/3363588394 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fefe005a140 con 0x7fefe8067110 2024-02-09T08:03:14.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.531+0000 7fefcf7fe640 10 client.4289.objecter ms_dispatch 0x7fefe8000b90 osd_map(25..25 src has 1..25) v4 2024-02-09T08:03:14.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.531+0000 7fefcf7fe640 3 client.4289.objecter handle_osd_map got epochs [25,25] > 0 2024-02-09T08:03:14.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.531+0000 7fefcf7fe640 3 client.4289.objecter handle_osd_map decoding full epoch 25 2024-02-09T08:03:14.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.531+0000 7fefcf7fe640 10 client.4289.objecter checking command 1 2024-02-09T08:03:14.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.531+0000 7fefcf7fe640 1 --2- 172.21.15.62:0/3363588394 >> [v2:172.21.15.103:6810/2442009417,v1:172.21.15.103:6811/2442009417] conn(0x7fefd4073580 0x7fefd40759a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.531+0000 7fefcf7fe640 20 client.4289.objecter _get_session s=0x7fefd4072eb0 osd=4 3 2024-02-09T08:03:14.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.531+0000 7fefcf7fe640 20 client.4289.objecter put_session s=0x7fefd4072eb0 osd=4 3 2024-02-09T08:03:14.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.531+0000 7fefcf7fe640 15 client.4289.objecter _session_command_op_remove -1 1 2024-02-09T08:03:14.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.531+0000 7fefcf7fe640 20 client.4289.objecter _get_session s=0x7fefd4072eb0 osd=4 3 2024-02-09T08:03:14.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.531+0000 7fefcf7fe640 20 client.4289.objecter get_session s=0x7fefd4072eb0 osd=4 3 2024-02-09T08:03:14.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.531+0000 7fefcf7fe640 15 client.4289.objecter _session_command_op_assign 4 1 2024-02-09T08:03:14.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.531+0000 7fefcf7fe640 20 client.4289.objecter put_session s=0x7fefd4072eb0 osd=4 4 2024-02-09T08:03:14.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.531+0000 7fefcf7fe640 10 client.4289.objecter _send_command 1 2024-02-09T08:03:14.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.531+0000 7fefcf7fe640 1 -- 172.21.15.62:0/3363588394 --> [v2:172.21.15.103:6810/2442009417,v1:172.21.15.103:6811/2442009417] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fefd4076050 con 0x7fefd4073580 2024-02-09T08:03:14.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.531+0000 7fefcf7fe640 20 client.4289.objecter dump_active .. 0 homeless 2024-02-09T08:03:14.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.532+0000 7fefe759e640 1 --2- 172.21.15.62:0/3363588394 >> [v2:172.21.15.103:6810/2442009417,v1:172.21.15.103:6811/2442009417] conn(0x7fefd4073580 0x7fefd40759a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.532+0000 7fefe759e640 10 monclient: get_auth_request con 0x7fefd4073580 auth_method 0 2024-02-09T08:03:14.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.537+0000 7f3639ffb640 1 -- 172.21.15.62:0/1164071636 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3640077800 con 0x7f36440ac3a0 2024-02-09T08:03:14.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.537+0000 7f3639ffb640 10 monclient: handle_get_version_reply finishing 1 version 26 2024-02-09T08:03:14.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.537+0000 7fea61ffb640 1 -- 172.21.15.62:0/2954043784 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea64077eb0 con 0x7fea6c13fdf0 2024-02-09T08:03:14.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.537+0000 7fea61ffb640 10 monclient: handle_get_version_reply finishing 1 version 26 2024-02-09T08:03:14.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.537+0000 7fefcf7fe640 10 client.4289.objecter ms_handle_connect 0x7fefd4073580 2024-02-09T08:03:14.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.537+0000 7fefe759e640 1 --2- 172.21.15.62:0/3363588394 >> [v2:172.21.15.103:6810/2442009417,v1:172.21.15.103:6811/2442009417] conn(0x7fefd4073580 0x7fefd40759a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:14.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.538+0000 7f3e70ff9640 1 -- 172.21.15.62:0/3425683466 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3e64058aa0 con 0x7f3e740aada0 2024-02-09T08:03:14.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.538+0000 7f3e70ff9640 10 client.4292.objecter ms_dispatch 0x7f3e74000b90 osd_map(25..25 src has 1..25) v4 2024-02-09T08:03:14.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.538+0000 7f3e70ff9640 3 client.4292.objecter handle_osd_map got epochs [25,25] > 0 2024-02-09T08:03:14.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.538+0000 7f3e70ff9640 3 client.4292.objecter handle_osd_map decoding full epoch 25 2024-02-09T08:03:14.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.538+0000 7f3e70ff9640 10 client.4292.objecter checking command 1 2024-02-09T08:03:14.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.538+0000 7f3e70ff9640 1 --2- 172.21.15.62:0/3425683466 >> [v2:172.21.15.103:6802/262591034,v1:172.21.15.103:6803/262591034] conn(0x7f3e600735d0 0x7f3e600759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.538+0000 7f3e70ff9640 20 client.4292.objecter _get_session s=0x7f3e60072f00 osd=5 3 2024-02-09T08:03:14.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.538+0000 7f3e70ff9640 20 client.4292.objecter put_session s=0x7f3e60072f00 osd=5 3 2024-02-09T08:03:14.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.538+0000 7f3e70ff9640 15 client.4292.objecter _session_command_op_remove -1 1 2024-02-09T08:03:14.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.538+0000 7f3e70ff9640 20 client.4292.objecter _get_session s=0x7f3e60072f00 osd=5 3 2024-02-09T08:03:14.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.538+0000 7f3e70ff9640 20 client.4292.objecter get_session s=0x7f3e60072f00 osd=5 3 2024-02-09T08:03:14.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.538+0000 7f3e70ff9640 15 client.4292.objecter _session_command_op_assign 5 1 2024-02-09T08:03:14.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.538+0000 7f3e70ff9640 20 client.4292.objecter put_session s=0x7f3e60072f00 osd=5 4 2024-02-09T08:03:14.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.538+0000 7f3e70ff9640 10 client.4292.objecter _send_command 1 2024-02-09T08:03:14.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.538+0000 7f3e70ff9640 1 -- 172.21.15.62:0/3425683466 --> [v2:172.21.15.103:6802/262591034,v1:172.21.15.103:6803/262591034] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3e600760a0 con 0x7f3e600735d0 2024-02-09T08:03:14.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.539+0000 7f3e70ff9640 20 client.4292.objecter dump_active .. 0 homeless 2024-02-09T08:03:14.560 INFO:teuthology.orchestra.run.smithi062.stdout:64424509447 2024-02-09T08:03:14.560 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-02-09T08:03:14.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.554+0000 7fbcb8077640 10 client.4305.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2024-02-09T08:03:14.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.554+0000 7fbcb8077640 15 client.4305.objecter _session_command_op_assign -1 2 2024-02-09T08:03:14.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.554+0000 7fbcb8077640 20 client.4305.objecter _get_session s=0x7fbc94072eb0 osd=2 3 2024-02-09T08:03:14.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.554+0000 7fbcb8077640 20 client.4305.objecter put_session s=0x7fbc94072eb0 osd=2 3 2024-02-09T08:03:14.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.554+0000 7fbcb8077640 20 client.4305.objecter _get_session s=0x7fbc94072eb0 osd=2 3 2024-02-09T08:03:14.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.554+0000 7fbcb8077640 15 client.4305.objecter _session_command_op_remove -1 2 2024-02-09T08:03:14.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.554+0000 7fbcb8077640 20 client.4305.objecter get_session s=0x7fbc94072eb0 osd=2 3 2024-02-09T08:03:14.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.554+0000 7fbcb8077640 15 client.4305.objecter _session_command_op_assign 2 2 2024-02-09T08:03:14.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.554+0000 7fbcb8077640 20 client.4305.objecter put_session s=0x7fbc94072eb0 osd=2 4 2024-02-09T08:03:14.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.554+0000 7fbcb8077640 10 client.4305.objecter _send_command 2 2024-02-09T08:03:14.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.554+0000 7fbcb8077640 1 -- 172.21.15.62:0/348553430 --> [v2:172.21.15.62:6816/2695503114,v1:172.21.15.62:6817/2695503114] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbcb0145a90 con 0x7fbc94073580 2024-02-09T08:03:14.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.555+0000 7f364b2a6640 10 client.4315.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2024-02-09T08:03:14.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.555+0000 7f364b2a6640 15 client.4315.objecter _session_command_op_assign -1 2 2024-02-09T08:03:14.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.555+0000 7f364b2a6640 20 client.4315.objecter _get_session s=0x7f3628072f00 osd=0 3 2024-02-09T08:03:14.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.555+0000 7f364b2a6640 20 client.4315.objecter put_session s=0x7f3628072f00 osd=0 3 2024-02-09T08:03:14.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.555+0000 7f364b2a6640 20 client.4315.objecter _get_session s=0x7f3628072f00 osd=0 3 2024-02-09T08:03:14.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.555+0000 7f364b2a6640 15 client.4315.objecter _session_command_op_remove -1 2 2024-02-09T08:03:14.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.555+0000 7f364b2a6640 20 client.4315.objecter get_session s=0x7f3628072f00 osd=0 3 2024-02-09T08:03:14.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.555+0000 7f364b2a6640 15 client.4315.objecter _session_command_op_assign 0 2 2024-02-09T08:03:14.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.555+0000 7f364b2a6640 20 client.4315.objecter put_session s=0x7f3628072f00 osd=0 4 2024-02-09T08:03:14.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.555+0000 7f364b2a6640 10 client.4315.objecter _send_command 2 2024-02-09T08:03:14.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.555+0000 7f364b2a6640 1 -- 172.21.15.62:0/1164071636 --> [v2:172.21.15.62:6808/3842068700,v1:172.21.15.62:6809/3842068700] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f364413dad0 con 0x7f36280735d0 2024-02-09T08:03:14.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.557+0000 7fc73e7fc640 1 -- 172.21.15.62:0/1851226421 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fc744007450 con 0x7fc74813f7d0 2024-02-09T08:03:14.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.557+0000 7fc73e7fc640 1 --2- 172.21.15.62:0/1851226421 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fc72c06d1d0 0x7fc72c06f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.557+0000 7fc74d80c640 1 --2- 172.21.15.62:0/1851226421 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fc72c06d1d0 0x7fc72c06f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.557+0000 7fc74d80c640 10 monclient: get_auth_request con 0x7fc72c06d1d0 auth_method 0 2024-02-09T08:03:14.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.558+0000 7fc74d80c640 1 --2- 172.21.15.62:0/1851226421 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fc72c06d1d0 0x7fc72c06f690 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc748139040 tx=0x7fc7400094f0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:14.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.558+0000 7fc73e7fc640 10 client.4298.objecter ms_handle_connect 0x7fc72c06d1d0 2024-02-09T08:03:14.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.560+0000 7f3e78ecb640 1 --2- 172.21.15.62:0/3425683466 >> [v2:172.21.15.103:6802/262591034,v1:172.21.15.103:6803/262591034] conn(0x7f3e600735d0 0x7f3e600759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.561+0000 7f3e78ecb640 10 monclient: get_auth_request con 0x7f3e600735d0 auth_method 0 2024-02-09T08:03:14.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.563+0000 7fc73e7fc640 1 -- 172.21.15.62:0/1851226421 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc744058360 con 0x7fc74813f7d0 2024-02-09T08:03:14.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.563+0000 7fc73e7fc640 10 client.4298.objecter ms_dispatch 0x7fc748000b90 osd_map(25..25 src has 1..25) v4 2024-02-09T08:03:14.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.563+0000 7fc73e7fc640 3 client.4298.objecter handle_osd_map got epochs [25,25] > 0 2024-02-09T08:03:14.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.563+0000 7fc73e7fc640 3 client.4298.objecter handle_osd_map decoding full epoch 25 2024-02-09T08:03:14.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.563+0000 7fc73e7fc640 10 client.4298.objecter checking command 1 2024-02-09T08:03:14.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.563+0000 7fc73e7fc640 1 --2- 172.21.15.62:0/1851226421 >> [v2:172.21.15.103:6812/1369132028,v1:172.21.15.103:6813/1369132028] conn(0x7fc72c0735b0 0x7fc72c0759d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.563+0000 7fc73e7fc640 20 client.4298.objecter _get_session s=0x7fc72c072ee0 osd=7 3 2024-02-09T08:03:14.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.563+0000 7fc73e7fc640 20 client.4298.objecter put_session s=0x7fc72c072ee0 osd=7 3 2024-02-09T08:03:14.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.563+0000 7fc73e7fc640 15 client.4298.objecter _session_command_op_remove -1 1 2024-02-09T08:03:14.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.563+0000 7fc73e7fc640 20 client.4298.objecter _get_session s=0x7fc72c072ee0 osd=7 3 2024-02-09T08:03:14.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.563+0000 7fc73e7fc640 20 client.4298.objecter get_session s=0x7fc72c072ee0 osd=7 3 2024-02-09T08:03:14.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.563+0000 7fc73e7fc640 15 client.4298.objecter _session_command_op_assign 7 1 2024-02-09T08:03:14.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.563+0000 7fc73e7fc640 20 client.4298.objecter put_session s=0x7fc72c072ee0 osd=7 4 2024-02-09T08:03:14.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.563+0000 7fc73e7fc640 10 client.4298.objecter _send_command 1 2024-02-09T08:03:14.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.563+0000 7fc73e7fc640 1 -- 172.21.15.62:0/1851226421 --> [v2:172.21.15.103:6812/1369132028,v1:172.21.15.103:6813/1369132028] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc72c076080 con 0x7fc72c0735b0 2024-02-09T08:03:14.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.563+0000 7fc73e7fc640 20 client.4298.objecter dump_active .. 0 homeless 2024-02-09T08:03:14.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.564+0000 7fc74d00b640 1 --2- 172.21.15.62:0/1851226421 >> [v2:172.21.15.103:6812/1369132028,v1:172.21.15.103:6813/1369132028] conn(0x7fc72c0735b0 0x7fc72c0759d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.564+0000 7fc74d00b640 10 monclient: get_auth_request con 0x7fc72c0735b0 auth_method 0 2024-02-09T08:03:14.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.564+0000 7f3e78ecb640 1 --2- 172.21.15.62:0/3425683466 >> [v2:172.21.15.103:6802/262591034,v1:172.21.15.103:6803/262591034] conn(0x7f3e600735d0 0x7f3e600759f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:14.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.564+0000 7f3e70ff9640 10 client.4292.objecter ms_handle_connect 0x7f3e600735d0 2024-02-09T08:03:14.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.568+0000 7fc74d00b640 1 --2- 172.21.15.62:0/1851226421 >> [v2:172.21.15.103:6812/1369132028,v1:172.21.15.103:6813/1369132028] conn(0x7fc72c0735b0 0x7fc72c0759d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:14.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.568+0000 7fc73e7fc640 10 client.4298.objecter ms_handle_connect 0x7fc72c0735b0 2024-02-09T08:03:14.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.570+0000 7fbca67fc640 1 -- 172.21.15.62:0/348553430 <== osd.2 v2:172.21.15.62:6816/2695503114 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbcb0145a90 con 0x7fbc94073580 2024-02-09T08:03:14.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.570+0000 7fbca67fc640 10 client.4305.objecter ms_dispatch 0x7fbcb0000b90 command_reply(tid 2: 0 ) v1 2024-02-09T08:03:14.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.570+0000 7fbca67fc640 10 client.4305.objecter _finish_command 2 = system:0 2024-02-09T08:03:14.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.570+0000 7fbca67fc640 20 client.4305.objecter put_session s=0x7fbc94072eb0 osd=2 4 2024-02-09T08:03:14.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.570+0000 7fbca67fc640 15 client.4305.objecter _session_command_op_remove 2 2 2024-02-09T08:03:14.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.571+0000 7f3639ffb640 1 -- 172.21.15.62:0/1164071636 <== osd.0 v2:172.21.15.62:6808/3842068700 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f363c001aa0 con 0x7f36280735d0 2024-02-09T08:03:14.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.571+0000 7f3639ffb640 10 client.4315.objecter ms_dispatch 0x7f3644000b90 command_reply(tid 2: 0 ) v1 2024-02-09T08:03:14.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.571+0000 7f3639ffb640 10 client.4315.objecter _finish_command 2 = system:0 2024-02-09T08:03:14.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.571+0000 7f3639ffb640 20 client.4315.objecter put_session s=0x7f3628072f00 osd=0 4 2024-02-09T08:03:14.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.571+0000 7f3639ffb640 15 client.4315.objecter _session_command_op_remove 0 2 2024-02-09T08:03:14.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.571+0000 7fbcb8077640 10 librados: watch_flush enter 2024-02-09T08:03:14.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.571+0000 7fbcb8077640 10 librados: watch_flush exit 2024-02-09T08:03:14.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.571+0000 7fbcb8077640 10 client.4305.objecter close_session for osd.2 2024-02-09T08:03:14.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.571+0000 7fbcb8077640 1 -- 172.21.15.62:0/348553430 >> [v2:172.21.15.62:6816/2695503114,v1:172.21.15.62:6817/2695503114] conn(0x7fbc94073580 msgr2=0x7fbc940759a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.571+0000 7fbcb8077640 1 --2- 172.21.15.62:0/348553430 >> [v2:172.21.15.62:6816/2695503114,v1:172.21.15.62:6817/2695503114] conn(0x7fbc94073580 0x7fbc940759a0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.571+0000 7fbcb8077640 20 client.4305.objecter put_session s=0x7fbc94072eb0 osd=2 1 2024-02-09T08:03:14.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.571+0000 7fbcb8077640 20 client.4305.objecter shutdown clearing up homeless session... 2024-02-09T08:03:14.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.571+0000 7fbcb8077640 10 client.4305.objecter successfully canceled tick 2024-02-09T08:03:14.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.571+0000 7fbcb8077640 1 -- 172.21.15.62:0/348553430 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fbc9406d1a0 msgr2=0x7fbc9406f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.571+0000 7fbcb8077640 1 --2- 172.21.15.62:0/348553430 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fbc9406d1a0 0x7fbc9406f660 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbca80093e0 tx=0x7fbca8030000 comp rx=0 tx=0).stop 2024-02-09T08:03:14.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.571+0000 7fbcb8077640 10 monclient: shutdown 2024-02-09T08:03:14.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.571+0000 7fbcb8077640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:14.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.571+0000 7fbcb8077640 1 -- 172.21.15.62:0/348553430 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcb0143bc0 msgr2=0x7fbcb00b2930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.571+0000 7fbcb8077640 1 --2- 172.21.15.62:0/348553430 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcb0143bc0 0x7fbcb00b2930 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbcac00c410 tx=0x7fbcac00c8d0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.571+0000 7fbcb6614640 1 -- 172.21.15.62:0/348553430 reap_dead start 2024-02-09T08:03:14.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.571+0000 7fbcb8077640 1 -- 172.21.15.62:0/348553430 shutdown_connections 2024-02-09T08:03:14.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.571+0000 7fbcb8077640 1 -- 172.21.15.62:0/348553430 >> 172.21.15.62:0/348553430 conn(0x7fbcb00b3db0 msgr2=0x7fbcb00b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:14.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.572+0000 7fbcb8077640 1 -- 172.21.15.62:0/348553430 shutdown_connections 2024-02-09T08:03:14.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.572+0000 7fbcb8077640 1 -- 172.21.15.62:0/348553430 wait complete. 2024-02-09T08:03:14.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.572+0000 7fbcb8077640 1 librados: shutdown 2024-02-09T08:03:14.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.571+0000 7ff2c5ffb640 1 -- 172.21.15.62:0/493264404 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7ff2c0013470 con 0x7ff2d013f7b0 2024-02-09T08:03:14.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.571+0000 7ff2c5ffb640 1 --2- 172.21.15.62:0/493264404 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7ff2b406d1f0 0x7ff2b406f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.572+0000 7ff2d5439640 1 --2- 172.21.15.62:0/493264404 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7ff2b406d1f0 0x7ff2b406f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.572+0000 7ff2d5439640 10 monclient: get_auth_request con 0x7ff2b406d1f0 auth_method 0 2024-02-09T08:03:14.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.572+0000 7f364b2a6640 10 librados: watch_flush enter 2024-02-09T08:03:14.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.573+0000 7f364b2a6640 10 librados: watch_flush exit 2024-02-09T08:03:14.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.573+0000 7f364b2a6640 10 client.4315.objecter close_session for osd.0 2024-02-09T08:03:14.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.573+0000 7f364b2a6640 1 -- 172.21.15.62:0/1164071636 >> [v2:172.21.15.62:6808/3842068700,v1:172.21.15.62:6809/3842068700] conn(0x7f36280735d0 msgr2=0x7f36280759f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.573+0000 7f364b2a6640 1 --2- 172.21.15.62:0/1164071636 >> [v2:172.21.15.62:6808/3842068700,v1:172.21.15.62:6809/3842068700] conn(0x7f36280735d0 0x7f36280759f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.573+0000 7f364b2a6640 20 client.4315.objecter put_session s=0x7f3628072f00 osd=0 1 2024-02-09T08:03:14.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.573+0000 7f364b2a6640 20 client.4315.objecter shutdown clearing up homeless session... 2024-02-09T08:03:14.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.573+0000 7f364b2a6640 10 client.4315.objecter successfully canceled tick 2024-02-09T08:03:14.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.573+0000 7f364b2a6640 1 -- 172.21.15.62:0/1164071636 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f362806d1f0 msgr2=0x7f362806f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.573+0000 7f364b2a6640 1 --2- 172.21.15.62:0/1164071636 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f362806d1f0 0x7f362806f6b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3634005880 tx=0x7f3634009040 comp rx=0 tx=0).stop 2024-02-09T08:03:14.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.573+0000 7f364b2a6640 10 monclient: shutdown 2024-02-09T08:03:14.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.573+0000 7f364b2a6640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:14.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.573+0000 7f364b2a6640 1 -- 172.21.15.62:0/1164071636 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f36440ac3a0 msgr2=0x7f3644139500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.573+0000 7f364b2a6640 1 --2- 172.21.15.62:0/1164071636 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f36440ac3a0 0x7f3644139500 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f36400098f0 tx=0x7f36400046c0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.573+0000 7f3649843640 1 -- 172.21.15.62:0/1164071636 reap_dead start 2024-02-09T08:03:14.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.573+0000 7f364b2a6640 1 -- 172.21.15.62:0/1164071636 shutdown_connections 2024-02-09T08:03:14.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.573+0000 7f364b2a6640 1 -- 172.21.15.62:0/1164071636 >> 172.21.15.62:0/1164071636 conn(0x7f36440b3cb0 msgr2=0x7f36440af3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:14.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.573+0000 7f364b2a6640 1 -- 172.21.15.62:0/1164071636 shutdown_connections 2024-02-09T08:03:14.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.573+0000 7f364b2a6640 1 -- 172.21.15.62:0/1164071636 wait complete. 2024-02-09T08:03:14.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.573+0000 7f364b2a6640 1 librados: shutdown 2024-02-09T08:03:14.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.573+0000 7ff2c5ffb640 10 client.4311.objecter ms_handle_connect 0x7ff2b406d1f0 2024-02-09T08:03:14.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.573+0000 7ff2d5439640 1 --2- 172.21.15.62:0/493264404 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7ff2b406d1f0 0x7ff2b406f6b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc036000 tx=0x7ff2cc030000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:14.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.578+0000 7ff2c5ffb640 1 -- 172.21.15.62:0/493264404 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff2c0059640 con 0x7ff2d013f7b0 2024-02-09T08:03:14.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.578+0000 7ff2c5ffb640 10 client.4311.objecter ms_dispatch 0x7ff2d0000b90 osd_map(26..26 src has 1..26) v4 2024-02-09T08:03:14.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.578+0000 7ff2c5ffb640 3 client.4311.objecter handle_osd_map got epochs [26,26] > 0 2024-02-09T08:03:14.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.578+0000 7ff2c5ffb640 3 client.4311.objecter handle_osd_map decoding full epoch 26 2024-02-09T08:03:14.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.578+0000 7ff2c5ffb640 10 client.4311.objecter checking command 1 2024-02-09T08:03:14.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.578+0000 7ff2c5ffb640 1 --2- 172.21.15.62:0/493264404 >> [v2:172.21.15.62:6800/3837949327,v1:172.21.15.62:6801/3837949327] conn(0x7ff2b4074040 0x7ff2b40764e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.578+0000 7ff2c5ffb640 20 client.4311.objecter _get_session s=0x7ff2b4073970 osd=1 3 2024-02-09T08:03:14.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.578+0000 7ff2c5ffb640 20 client.4311.objecter put_session s=0x7ff2b4073970 osd=1 3 2024-02-09T08:03:14.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.578+0000 7ff2c5ffb640 15 client.4311.objecter _session_command_op_remove -1 1 2024-02-09T08:03:14.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.578+0000 7ff2c5ffb640 20 client.4311.objecter _get_session s=0x7ff2b4073970 osd=1 3 2024-02-09T08:03:14.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.578+0000 7ff2c5ffb640 20 client.4311.objecter get_session s=0x7ff2b4073970 osd=1 3 2024-02-09T08:03:14.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.578+0000 7ff2c5ffb640 15 client.4311.objecter _session_command_op_assign 1 1 2024-02-09T08:03:14.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.578+0000 7ff2c5ffb640 20 client.4311.objecter put_session s=0x7ff2b4073970 osd=1 4 2024-02-09T08:03:14.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.578+0000 7ff2c5ffb640 10 client.4311.objecter _send_command 1 2024-02-09T08:03:14.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.578+0000 7ff2c5ffb640 1 -- 172.21.15.62:0/493264404 --> [v2:172.21.15.62:6800/3837949327,v1:172.21.15.62:6801/3837949327] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff2b4076bb0 con 0x7ff2b4074040 2024-02-09T08:03:14.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.578+0000 7ff2c5ffb640 20 client.4311.objecter dump_active .. 0 homeless 2024-02-09T08:03:14.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.578+0000 7ff2c5ffb640 1 -- 172.21.15.62:0/493264404 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff2c0058d10 con 0x7ff2d013f7b0 2024-02-09T08:03:14.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.578+0000 7ff2c5ffb640 10 monclient: handle_get_version_reply finishing 1 version 26 2024-02-09T08:03:14.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.580+0000 7ff2d5c3a640 1 --2- 172.21.15.62:0/493264404 >> [v2:172.21.15.62:6800/3837949327,v1:172.21.15.62:6801/3837949327] conn(0x7ff2b4074040 0x7ff2b40764e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.580+0000 7ff2d5c3a640 10 monclient: get_auth_request con 0x7ff2b4074040 auth_method 0 2024-02-09T08:03:14.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.585+0000 7ff2d5c3a640 1 --2- 172.21.15.62:0/493264404 >> [v2:172.21.15.62:6800/3837949327,v1:172.21.15.62:6801/3837949327] conn(0x7ff2b4074040 0x7ff2b40764e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:14.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.585+0000 7ff2c5ffb640 10 client.4311.objecter ms_handle_connect 0x7ff2b4074040 2024-02-09T08:03:14.590 INFO:teuthology.orchestra.run.smithi062.stdout:64424509446 2024-02-09T08:03:14.590 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-02-09T08:03:14.592 INFO:teuthology.orchestra.run.smithi062.stdout:64424509446 2024-02-09T08:03:14.592 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-02-09T08:03:14.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.591+0000 7fefcf7fe640 1 -- 172.21.15.62:0/3363588394 <== osd.4 v2:172.21.15.103:6810/2442009417 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fefd4076050 con 0x7fefd4073580 2024-02-09T08:03:14.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.591+0000 7fefcf7fe640 10 client.4289.objecter ms_dispatch 0x7fefe8000b90 command_reply(tid 1: 0 ) v1 2024-02-09T08:03:14.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.591+0000 7fefcf7fe640 10 client.4289.objecter _finish_command 1 = system:0 2024-02-09T08:03:14.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.591+0000 7fefcf7fe640 20 client.4289.objecter put_session s=0x7fefd4072eb0 osd=4 4 2024-02-09T08:03:14.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.591+0000 7fefcf7fe640 15 client.4289.objecter _session_command_op_remove 4 1 2024-02-09T08:03:14.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.603+0000 7fea61ffb640 1 -- 172.21.15.62:0/2954043784 <== osd.3 v2:172.21.15.62:6824/556356316 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fea50076050 con 0x7fea50073580 2024-02-09T08:03:14.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.603+0000 7fea61ffb640 10 client.4327.objecter ms_dispatch 0x7fea6c000b90 command_reply(tid 1: 0 ) v1 2024-02-09T08:03:14.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.603+0000 7fea61ffb640 10 client.4327.objecter _finish_command 1 = system:0 2024-02-09T08:03:14.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.603+0000 7fea61ffb640 20 client.4327.objecter put_session s=0x7fea50072eb0 osd=3 4 2024-02-09T08:03:14.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.603+0000 7fea61ffb640 15 client.4327.objecter _session_command_op_remove 3 1 2024-02-09T08:03:14.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.607+0000 7f3e70ff9640 1 -- 172.21.15.62:0/3425683466 <== osd.5 v2:172.21.15.103:6802/262591034 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f3e600760a0 con 0x7f3e600735d0 2024-02-09T08:03:14.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.608+0000 7f3e70ff9640 10 client.4292.objecter ms_dispatch 0x7f3e74000b90 command_reply(tid 1: 0 ) v1 2024-02-09T08:03:14.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.608+0000 7f3e70ff9640 10 client.4292.objecter _finish_command 1 = system:0 2024-02-09T08:03:14.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.620+0000 7f3e70ff9640 20 client.4292.objecter put_session s=0x7f3e60072f00 osd=5 4 2024-02-09T08:03:14.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.620+0000 7f3e70ff9640 15 client.4292.objecter _session_command_op_remove 5 1 2024-02-09T08:03:14.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.621+0000 7fefed174640 10 client.4289.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2024-02-09T08:03:14.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.621+0000 7fefed174640 15 client.4289.objecter _session_command_op_assign -1 2 2024-02-09T08:03:14.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.621+0000 7fefed174640 20 client.4289.objecter _get_session s=0x7fefd4072eb0 osd=4 3 2024-02-09T08:03:14.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.621+0000 7fefed174640 20 client.4289.objecter put_session s=0x7fefd4072eb0 osd=4 3 2024-02-09T08:03:14.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.621+0000 7fefed174640 20 client.4289.objecter _get_session s=0x7fefd4072eb0 osd=4 3 2024-02-09T08:03:14.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.621+0000 7fefed174640 15 client.4289.objecter _session_command_op_remove -1 2 2024-02-09T08:03:14.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.621+0000 7fefed174640 20 client.4289.objecter get_session s=0x7fefd4072eb0 osd=4 3 2024-02-09T08:03:14.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.621+0000 7fefed174640 15 client.4289.objecter _session_command_op_assign 4 2 2024-02-09T08:03:14.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.621+0000 7fefed174640 20 client.4289.objecter put_session s=0x7fefd4072eb0 osd=4 4 2024-02-09T08:03:14.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.621+0000 7fefed174640 10 client.4289.objecter _send_command 2 2024-02-09T08:03:14.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.621+0000 7fefed174640 1 -- 172.21.15.62:0/3363588394 --> [v2:172.21.15.103:6810/2442009417,v1:172.21.15.103:6811/2442009417] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fefe8141d70 con 0x7fefd4073580 2024-02-09T08:03:14.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.627+0000 7fc73e7fc640 1 -- 172.21.15.62:0/1851226421 <== osd.7 v2:172.21.15.103:6812/1369132028 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fc72c076080 con 0x7fc72c0735b0 2024-02-09T08:03:14.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.627+0000 7fc73e7fc640 10 client.4298.objecter ms_dispatch 0x7fc748000b90 command_reply(tid 1: 0 ) v1 2024-02-09T08:03:14.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.627+0000 7fc73e7fc640 10 client.4298.objecter _finish_command 1 = system:0 2024-02-09T08:03:14.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.627+0000 7fc73e7fc640 20 client.4298.objecter put_session s=0x7fc72c072ee0 osd=7 4 2024-02-09T08:03:14.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.627+0000 7fc73e7fc640 15 client.4298.objecter _session_command_op_remove 7 1 2024-02-09T08:03:14.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.637+0000 7fea733be640 10 client.4327.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2024-02-09T08:03:14.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.637+0000 7fea733be640 15 client.4327.objecter _session_command_op_assign -1 2 2024-02-09T08:03:14.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.637+0000 7fea733be640 20 client.4327.objecter _get_session s=0x7fea50072eb0 osd=3 3 2024-02-09T08:03:14.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.637+0000 7fea733be640 20 client.4327.objecter put_session s=0x7fea50072eb0 osd=3 3 2024-02-09T08:03:14.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.637+0000 7fea733be640 20 client.4327.objecter _get_session s=0x7fea50072eb0 osd=3 3 2024-02-09T08:03:14.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.637+0000 7fea733be640 15 client.4327.objecter _session_command_op_remove -1 2 2024-02-09T08:03:14.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.637+0000 7fea733be640 20 client.4327.objecter get_session s=0x7fea50072eb0 osd=3 3 2024-02-09T08:03:14.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.637+0000 7fea733be640 15 client.4327.objecter _session_command_op_assign 3 2 2024-02-09T08:03:14.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.637+0000 7fea733be640 20 client.4327.objecter put_session s=0x7fea50072eb0 osd=3 4 2024-02-09T08:03:14.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.637+0000 7fea733be640 10 client.4327.objecter _send_command 2 2024-02-09T08:03:14.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.637+0000 7fea733be640 1 -- 172.21.15.62:0/2954043784 --> [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fea6c135950 con 0x7fea50073580 2024-02-09T08:03:14.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.642+0000 7fefcf7fe640 1 -- 172.21.15.62:0/3363588394 <== osd.4 v2:172.21.15.103:6810/2442009417 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fefe8141d70 con 0x7fefd4073580 2024-02-09T08:03:14.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.642+0000 7fefcf7fe640 10 client.4289.objecter ms_dispatch 0x7fefe8000b90 command_reply(tid 2: 0 ) v1 2024-02-09T08:03:14.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.642+0000 7fefcf7fe640 10 client.4289.objecter _finish_command 2 = system:0 2024-02-09T08:03:14.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.642+0000 7fefcf7fe640 20 client.4289.objecter put_session s=0x7fefd4072eb0 osd=4 4 2024-02-09T08:03:14.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.642+0000 7fefcf7fe640 15 client.4289.objecter _session_command_op_remove 4 2 2024-02-09T08:03:14.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.643+0000 7fefed174640 10 librados: watch_flush enter 2024-02-09T08:03:14.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.643+0000 7fefed174640 10 librados: watch_flush exit 2024-02-09T08:03:14.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.643+0000 7fefed174640 10 client.4289.objecter close_session for osd.4 2024-02-09T08:03:14.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.643+0000 7fefed174640 1 -- 172.21.15.62:0/3363588394 >> [v2:172.21.15.103:6810/2442009417,v1:172.21.15.103:6811/2442009417] conn(0x7fefd4073580 msgr2=0x7fefd40759a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.643+0000 7fefed174640 1 --2- 172.21.15.62:0/3363588394 >> [v2:172.21.15.103:6810/2442009417,v1:172.21.15.103:6811/2442009417] conn(0x7fefd4073580 0x7fefd40759a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.643+0000 7fefed174640 20 client.4289.objecter put_session s=0x7fefd4072eb0 osd=4 1 2024-02-09T08:03:14.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.643+0000 7fefed174640 20 client.4289.objecter shutdown clearing up homeless session... 2024-02-09T08:03:14.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.643+0000 7fefed174640 10 client.4289.objecter successfully canceled tick 2024-02-09T08:03:14.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.645+0000 7fefed174640 1 -- 172.21.15.62:0/3363588394 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fefd406d1a0 msgr2=0x7fefd406f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.645+0000 7fefed174640 1 --2- 172.21.15.62:0/3363588394 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fefd406d1a0 0x7fefd406f660 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fefe8134fd0 tx=0x7fefdc0079b0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.645+0000 7fefed174640 10 monclient: shutdown 2024-02-09T08:03:14.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.645+0000 7fefed174640 20 monclient: shutdown canceling and discarding version request 1 2024-02-09T08:03:14.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.645+0000 7fefed174640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:14.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.645+0000 7fefed174640 1 -- 172.21.15.62:0/3363588394 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fefe8067110 msgr2=0x7fefe8138df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.645+0000 7fefed174640 1 --2- 172.21.15.62:0/3363588394 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fefe8067110 0x7fefe8138df0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fefe0007e10 tx=0x7fefe000e4b0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.645+0000 7fefe759e640 1 -- 172.21.15.62:0/3363588394 reap_dead start 2024-02-09T08:03:14.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.645+0000 7fefed174640 1 -- 172.21.15.62:0/3363588394 shutdown_connections 2024-02-09T08:03:14.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.645+0000 7fefed174640 1 -- 172.21.15.62:0/3363588394 >> 172.21.15.62:0/3363588394 conn(0x7fefe80b4e20 msgr2=0x7fefe8136900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:14.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.647+0000 7fefed174640 1 -- 172.21.15.62:0/3363588394 shutdown_connections 2024-02-09T08:03:14.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.647+0000 7fefed174640 1 -- 172.21.15.62:0/3363588394 wait complete. 2024-02-09T08:03:14.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.647+0000 7fefed174640 1 librados: shutdown 2024-02-09T08:03:14.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.647+0000 7f3e7a92e640 10 client.4292.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2024-02-09T08:03:14.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.647+0000 7f3e7a92e640 15 client.4292.objecter _session_command_op_assign -1 2 2024-02-09T08:03:14.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.647+0000 7f3e7a92e640 20 client.4292.objecter _get_session s=0x7f3e60072f00 osd=5 3 2024-02-09T08:03:14.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.647+0000 7f3e7a92e640 20 client.4292.objecter put_session s=0x7f3e60072f00 osd=5 3 2024-02-09T08:03:14.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.647+0000 7f3e7a92e640 20 client.4292.objecter _get_session s=0x7f3e60072f00 osd=5 3 2024-02-09T08:03:14.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.647+0000 7f3e7a92e640 15 client.4292.objecter _session_command_op_remove -1 2 2024-02-09T08:03:14.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.647+0000 7f3e7a92e640 20 client.4292.objecter get_session s=0x7f3e60072f00 osd=5 3 2024-02-09T08:03:14.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.647+0000 7f3e7a92e640 15 client.4292.objecter _session_command_op_assign 5 2 2024-02-09T08:03:14.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.647+0000 7f3e7a92e640 20 client.4292.objecter put_session s=0x7f3e60072f00 osd=5 4 2024-02-09T08:03:14.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.647+0000 7f3e7a92e640 10 client.4292.objecter _send_command 2 2024-02-09T08:03:14.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.647+0000 7f3e7a92e640 1 -- 172.21.15.62:0/3425683466 --> [v2:172.21.15.103:6802/262591034,v1:172.21.15.103:6803/262591034] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3e54001240 con 0x7f3e600735d0 2024-02-09T08:03:14.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.656+0000 7f3e70ff9640 1 -- 172.21.15.62:0/3425683466 <== osd.5 v2:172.21.15.103:6802/262591034 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3e54001240 con 0x7f3e600735d0 2024-02-09T08:03:14.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.656+0000 7f3e70ff9640 10 client.4292.objecter ms_dispatch 0x7f3e74000b90 command_reply(tid 2: 0 ) v1 2024-02-09T08:03:14.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.656+0000 7f3e70ff9640 10 client.4292.objecter _finish_command 2 = system:0 2024-02-09T08:03:14.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.656+0000 7f3e70ff9640 20 client.4292.objecter put_session s=0x7f3e60072f00 osd=5 4 2024-02-09T08:03:14.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.656+0000 7f3e70ff9640 15 client.4292.objecter _session_command_op_remove 5 2 2024-02-09T08:03:14.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.657+0000 7f3e7a92e640 10 librados: watch_flush enter 2024-02-09T08:03:14.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.657+0000 7f3e7a92e640 10 librados: watch_flush exit 2024-02-09T08:03:14.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.657+0000 7f3e7a92e640 10 client.4292.objecter close_session for osd.5 2024-02-09T08:03:14.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.657+0000 7f3e7a92e640 1 -- 172.21.15.62:0/3425683466 >> [v2:172.21.15.103:6802/262591034,v1:172.21.15.103:6803/262591034] conn(0x7f3e600735d0 msgr2=0x7f3e600759f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.657+0000 7f3e7a92e640 1 --2- 172.21.15.62:0/3425683466 >> [v2:172.21.15.103:6802/262591034,v1:172.21.15.103:6803/262591034] conn(0x7f3e600735d0 0x7f3e600759f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.657+0000 7f3e7a92e640 20 client.4292.objecter put_session s=0x7f3e60072f00 osd=5 1 2024-02-09T08:03:14.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.657+0000 7f3e7a92e640 20 client.4292.objecter shutdown clearing up homeless session... 2024-02-09T08:03:14.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.657+0000 7f3e7a92e640 10 client.4292.objecter successfully canceled tick 2024-02-09T08:03:14.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.657+0000 7f3e7a92e640 1 -- 172.21.15.62:0/3425683466 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f3e6006d1f0 msgr2=0x7f3e6006f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.657+0000 7f3e7a92e640 1 --2- 172.21.15.62:0/3425683466 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f3e6006d1f0 0x7f3e6006f6b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c035000 tx=0x7f3e6c030000 comp rx=0 tx=0).stop 2024-02-09T08:03:14.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.657+0000 7f3e7a92e640 10 monclient: shutdown 2024-02-09T08:03:14.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.657+0000 7f3e7a92e640 20 monclient: shutdown canceling and discarding version request 1 2024-02-09T08:03:14.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.657+0000 7f3e7a92e640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:14.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.657+0000 7f3e7a92e640 1 -- 172.21.15.62:0/3425683466 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e740aada0 msgr2=0x7f3e74144590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.657+0000 7f3e7a92e640 1 --2- 172.21.15.62:0/3425683466 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e740aada0 0x7f3e74144590 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3e6400b4a0 tx=0x7f3e6400b960 comp rx=0 tx=0).stop 2024-02-09T08:03:14.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.658+0000 7f3e78ecb640 1 -- 172.21.15.62:0/3425683466 reap_dead start 2024-02-09T08:03:14.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.658+0000 7f3e7a92e640 1 -- 172.21.15.62:0/3425683466 shutdown_connections 2024-02-09T08:03:14.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.658+0000 7f3e7a92e640 1 -- 172.21.15.62:0/3425683466 >> 172.21.15.62:0/3425683466 conn(0x7f3e740b3ef0 msgr2=0x7f3e7413afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:14.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.663+0000 7f3e7a92e640 1 -- 172.21.15.62:0/3425683466 shutdown_connections 2024-02-09T08:03:14.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.666+0000 7fc73e7fc640 1 -- 172.21.15.62:0/1851226421 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc744007e80 con 0x7fc74813f7d0 2024-02-09T08:03:14.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.666+0000 7fc73e7fc640 10 monclient: handle_get_version_reply finishing 1 version 26 2024-02-09T08:03:14.669 INFO:teuthology.orchestra.run.smithi062.stdout:85899345930 2024-02-09T08:03:14.669 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-02-09T08:03:14.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.667+0000 7fc74fa70640 10 client.4298.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2024-02-09T08:03:14.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.667+0000 7fc74fa70640 15 client.4298.objecter _session_command_op_assign -1 2 2024-02-09T08:03:14.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.667+0000 7fc74fa70640 20 client.4298.objecter _get_session s=0x7fc72c072ee0 osd=7 3 2024-02-09T08:03:14.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.667+0000 7fc74fa70640 20 client.4298.objecter put_session s=0x7fc72c072ee0 osd=7 3 2024-02-09T08:03:14.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.667+0000 7fc74fa70640 20 client.4298.objecter _get_session s=0x7fc72c072ee0 osd=7 3 2024-02-09T08:03:14.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.667+0000 7fc74fa70640 15 client.4298.objecter _session_command_op_remove -1 2 2024-02-09T08:03:14.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.667+0000 7fc74fa70640 20 client.4298.objecter get_session s=0x7fc72c072ee0 osd=7 3 2024-02-09T08:03:14.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.667+0000 7fc74fa70640 15 client.4298.objecter _session_command_op_assign 7 2 2024-02-09T08:03:14.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.667+0000 7fc74fa70640 20 client.4298.objecter put_session s=0x7fc72c072ee0 osd=7 4 2024-02-09T08:03:14.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.667+0000 7fc74fa70640 10 client.4298.objecter _send_command 2 2024-02-09T08:03:14.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.667+0000 7fc74fa70640 1 -- 172.21.15.62:0/1851226421 --> [v2:172.21.15.103:6812/1369132028,v1:172.21.15.103:6813/1369132028] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc74804ef90 con 0x7fc72c0735b0 2024-02-09T08:03:14.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.668+0000 7f3e7a92e640 1 -- 172.21.15.62:0/3425683466 wait complete. 2024-02-09T08:03:14.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.668+0000 7f3e7a92e640 1 librados: shutdown 2024-02-09T08:03:14.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.658+0000 7ff2c5ffb640 1 -- 172.21.15.62:0/493264404 <== osd.1 v2:172.21.15.62:6800/3837949327 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7ff2b4076bb0 con 0x7ff2b4074040 2024-02-09T08:03:14.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.658+0000 7ff2c5ffb640 10 client.4311.objecter ms_dispatch 0x7ff2d0000b90 command_reply(tid 1: 0 ) v1 2024-02-09T08:03:14.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.658+0000 7ff2c5ffb640 10 client.4311.objecter _finish_command 1 = system:0 2024-02-09T08:03:14.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.658+0000 7ff2c5ffb640 20 client.4311.objecter put_session s=0x7ff2b4073970 osd=1 4 2024-02-09T08:03:14.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.658+0000 7ff2c5ffb640 15 client.4311.objecter _session_command_op_remove 1 1 2024-02-09T08:03:14.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.682+0000 7fc73e7fc640 1 -- 172.21.15.62:0/1851226421 <== osd.7 v2:172.21.15.103:6812/1369132028 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc74804ef90 con 0x7fc72c0735b0 2024-02-09T08:03:14.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.682+0000 7fc73e7fc640 10 client.4298.objecter ms_dispatch 0x7fc748000b90 command_reply(tid 2: 0 ) v1 2024-02-09T08:03:14.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.682+0000 7fc73e7fc640 10 client.4298.objecter _finish_command 2 = system:0 2024-02-09T08:03:14.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.682+0000 7fc73e7fc640 20 client.4298.objecter put_session s=0x7fc72c072ee0 osd=7 4 2024-02-09T08:03:14.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.682+0000 7fc73e7fc640 15 client.4298.objecter _session_command_op_remove 7 2 2024-02-09T08:03:14.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.683+0000 7fc72bfff640 10 librados: watch_flush enter 2024-02-09T08:03:14.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.683+0000 7fc72bfff640 10 librados: watch_flush exit 2024-02-09T08:03:14.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.683+0000 7fc72bfff640 10 client.4298.objecter close_session for osd.7 2024-02-09T08:03:14.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.683+0000 7fc72bfff640 1 -- 172.21.15.62:0/1851226421 >> [v2:172.21.15.103:6812/1369132028,v1:172.21.15.103:6813/1369132028] conn(0x7fc72c0735b0 msgr2=0x7fc72c0759d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.683+0000 7fc72bfff640 1 --2- 172.21.15.62:0/1851226421 >> [v2:172.21.15.103:6812/1369132028,v1:172.21.15.103:6813/1369132028] conn(0x7fc72c0735b0 0x7fc72c0759d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.683+0000 7fc72bfff640 20 client.4298.objecter put_session s=0x7fc72c072ee0 osd=7 1 2024-02-09T08:03:14.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.683+0000 7fc72bfff640 20 client.4298.objecter shutdown clearing up homeless session... 2024-02-09T08:03:14.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.683+0000 7fc72bfff640 10 client.4298.objecter successfully canceled tick 2024-02-09T08:03:14.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.683+0000 7fc72bfff640 1 -- 172.21.15.62:0/1851226421 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fc72c06d1d0 msgr2=0x7fc72c06f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.684+0000 7fc72bfff640 1 --2- 172.21.15.62:0/1851226421 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fc72c06d1d0 0x7fc72c06f690 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc748139040 tx=0x7fc7400094f0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.684+0000 7fc72bfff640 10 monclient: shutdown 2024-02-09T08:03:14.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.684+0000 7fc72bfff640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:14.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.684+0000 7fc72bfff640 1 -- 172.21.15.62:0/1851226421 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc74813f7d0 msgr2=0x7fc7481321a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.684+0000 7fc72bfff640 1 --2- 172.21.15.62:0/1851226421 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc74813f7d0 0x7fc7481321a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc74400c180 tx=0x7fc74400c640 comp rx=0 tx=0).stop 2024-02-09T08:03:14.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.684+0000 7fc74e00d640 1 -- 172.21.15.62:0/1851226421 reap_dead start 2024-02-09T08:03:14.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.684+0000 7fc72bfff640 1 -- 172.21.15.62:0/1851226421 shutdown_connections 2024-02-09T08:03:14.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.684+0000 7fc72bfff640 1 -- 172.21.15.62:0/1851226421 >> 172.21.15.62:0/1851226421 conn(0x7fc7480b3cb0 msgr2=0x7fc748069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:14.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.684+0000 7fc72bfff640 1 -- 172.21.15.62:0/1851226421 shutdown_connections 2024-02-09T08:03:14.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.684+0000 7fc72bfff640 1 -- 172.21.15.62:0/1851226421 wait complete. 2024-02-09T08:03:14.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.684+0000 7fc72bfff640 1 librados: shutdown 2024-02-09T08:03:14.691 INFO:teuthology.orchestra.run.smithi062.stdout:55834574855 2024-02-09T08:03:14.692 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-02-09T08:03:14.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.692+0000 7ff2d769d640 10 client.4311.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2024-02-09T08:03:14.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.692+0000 7ff2d769d640 15 client.4311.objecter _session_command_op_assign -1 2 2024-02-09T08:03:14.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.692+0000 7ff2d769d640 20 client.4311.objecter _get_session s=0x7ff2b4073970 osd=1 3 2024-02-09T08:03:14.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.692+0000 7ff2d769d640 20 client.4311.objecter put_session s=0x7ff2b4073970 osd=1 3 2024-02-09T08:03:14.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.692+0000 7ff2d769d640 20 client.4311.objecter _get_session s=0x7ff2b4073970 osd=1 3 2024-02-09T08:03:14.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.692+0000 7ff2d769d640 15 client.4311.objecter _session_command_op_remove -1 2 2024-02-09T08:03:14.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.692+0000 7ff2d769d640 20 client.4311.objecter get_session s=0x7ff2b4073970 osd=1 3 2024-02-09T08:03:14.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.692+0000 7ff2d769d640 15 client.4311.objecter _session_command_op_assign 1 2 2024-02-09T08:03:14.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.692+0000 7ff2d769d640 20 client.4311.objecter put_session s=0x7ff2b4073970 osd=1 4 2024-02-09T08:03:14.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.692+0000 7ff2d769d640 10 client.4311.objecter _send_command 2 2024-02-09T08:03:14.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.692+0000 7ff2d769d640 1 -- 172.21.15.62:0/493264404 --> [v2:172.21.15.62:6800/3837949327,v1:172.21.15.62:6801/3837949327] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff2d006eac0 con 0x7ff2b4074040 2024-02-09T08:03:14.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.703+0000 7ff2c5ffb640 1 -- 172.21.15.62:0/493264404 <== osd.1 v2:172.21.15.62:6800/3837949327 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff2c80018c0 con 0x7ff2b4074040 2024-02-09T08:03:14.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.703+0000 7ff2c5ffb640 10 client.4311.objecter ms_dispatch 0x7ff2d0000b90 command_reply(tid 2: 0 ) v1 2024-02-09T08:03:14.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.703+0000 7ff2c5ffb640 10 client.4311.objecter _finish_command 2 = system:0 2024-02-09T08:03:14.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.703+0000 7ff2c5ffb640 20 client.4311.objecter put_session s=0x7ff2b4073970 osd=1 4 2024-02-09T08:03:14.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.703+0000 7ff2c5ffb640 15 client.4311.objecter _session_command_op_remove 1 2 2024-02-09T08:03:14.706 INFO:teuthology.orchestra.run.smithi062.stdout:64424509447 2024-02-09T08:03:14.707 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-02-09T08:03:14.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.704+0000 7ff2d769d640 10 librados: watch_flush enter 2024-02-09T08:03:14.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.704+0000 7ff2d769d640 10 librados: watch_flush exit 2024-02-09T08:03:14.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.704+0000 7ff2d769d640 10 client.4311.objecter close_session for osd.1 2024-02-09T08:03:14.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.704+0000 7ff2d769d640 1 -- 172.21.15.62:0/493264404 >> [v2:172.21.15.62:6800/3837949327,v1:172.21.15.62:6801/3837949327] conn(0x7ff2b4074040 msgr2=0x7ff2b40764e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.704+0000 7ff2d769d640 1 --2- 172.21.15.62:0/493264404 >> [v2:172.21.15.62:6800/3837949327,v1:172.21.15.62:6801/3837949327] conn(0x7ff2b4074040 0x7ff2b40764e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.706+0000 7ff2d769d640 20 client.4311.objecter put_session s=0x7ff2b4073970 osd=1 1 2024-02-09T08:03:14.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.706+0000 7ff2d769d640 20 client.4311.objecter shutdown clearing up homeless session... 2024-02-09T08:03:14.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.706+0000 7ff2d769d640 10 client.4311.objecter successfully canceled tick 2024-02-09T08:03:14.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.706+0000 7ff2d769d640 1 -- 172.21.15.62:0/493264404 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7ff2b406d1f0 msgr2=0x7ff2b406f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.706+0000 7ff2d769d640 1 --2- 172.21.15.62:0/493264404 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7ff2b406d1f0 0x7ff2b406f6b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc036000 tx=0x7ff2cc030000 comp rx=0 tx=0).stop 2024-02-09T08:03:14.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.706+0000 7ff2d769d640 10 monclient: shutdown 2024-02-09T08:03:14.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.706+0000 7ff2d769d640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:14.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.706+0000 7ff2d769d640 1 -- 172.21.15.62:0/493264404 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2d013f7b0 msgr2=0x7ff2d01cb370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.706+0000 7ff2d769d640 1 --2- 172.21.15.62:0/493264404 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2d013f7b0 0x7ff2d01cb370 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff2c000e9b0 tx=0x7ff2c000ee70 comp rx=0 tx=0).stop 2024-02-09T08:03:14.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.706+0000 7ff2d5c3a640 1 -- 172.21.15.62:0/493264404 reap_dead start 2024-02-09T08:03:14.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.706+0000 7ff2d769d640 1 -- 172.21.15.62:0/493264404 shutdown_connections 2024-02-09T08:03:14.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.706+0000 7ff2d769d640 1 -- 172.21.15.62:0/493264404 >> 172.21.15.62:0/493264404 conn(0x7ff2d00b44c0 msgr2=0x7ff2d0069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:14.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.708+0000 7ff2d769d640 1 -- 172.21.15.62:0/493264404 shutdown_connections 2024-02-09T08:03:14.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.708+0000 7ff2d769d640 1 -- 172.21.15.62:0/493264404 wait complete. 2024-02-09T08:03:14.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.708+0000 7ff2d769d640 1 librados: shutdown 2024-02-09T08:03:14.734 INFO:teuthology.orchestra.run.smithi062.stdout:68719476743 2024-02-09T08:03:14.735 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-02-09T08:03:14.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.739+0000 7fd71b59e640 10 monclient: get_monmap_and_config 2024-02-09T08:03:14.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.739+0000 7fd71b59e640 10 monclient: build_initial_monmap 2024-02-09T08:03:14.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.739+0000 7fd71b59e640 10 monclient: monmap: 2024-02-09T08:03:14.742 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:14.742 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.743 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:03:14.740499+0000 2024-02-09T08:03:14.743 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:03:14.740499+0000 2024-02-09T08:03:14.743 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:14.743 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.743 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:03:14.743 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:03:14.743 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:03:14.743 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:03:14.743 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:03:14.743 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.740+0000 7fd71b59e640 1 Processor -- start 2024-02-09T08:03:14.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.740+0000 7fd71b59e640 1 -- start start 2024-02-09T08:03:14.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.740+0000 7fd71b59e640 10 monclient: init 2024-02-09T08:03:14.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.741+0000 7fd71b59e640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:14.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.741+0000 7fd71b59e640 10 monclient: _add_conns ranks=[0,4,2,1,3] 2024-02-09T08:03:14.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.742+0000 7fd71b59e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd7140349b0 addr v1:172.21.15.62:6789/0 2024-02-09T08:03:14.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.742+0000 7fd71b59e640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd714034d90 0x7fd7140c3c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.742+0000 7fd71b59e640 10 monclient(hunting): picked mon.noname-c con 0x7fd714034d90 addr v2:172.21.15.103:3300/0 2024-02-09T08:03:14.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.742+0000 7fd71b59e640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd714031fc0 0x7fd7140c4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.742+0000 7fd71b59e640 10 monclient(hunting): picked mon.noname-b con 0x7fd714031fc0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:14.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.742+0000 7fd71b59e640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd714031800 con 0x7fd7140349b0 2024-02-09T08:03:14.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.742+0000 7fd71b59e640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.742+0000 7fd71b59e640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd714031aa0 con 0x7fd714034d90 2024-02-09T08:03:14.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.742+0000 7fd71b59e640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.742+0000 7fd71b59e640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7140291f0 con 0x7fd714031fc0 2024-02-09T08:03:14.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.742+0000 7fd71b59e640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:14.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.742+0000 7fd71b59e640 10 monclient(hunting): authenticate will time out at 1438.102316s 2024-02-09T08:03:14.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.744+0000 7fd71a59c640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fd7140349b0 0x7fd7140c1090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34476/0 (socket says 172.21.15.62:34476) 2024-02-09T08:03:14.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.744+0000 7fd71a59c640 1 -- 172.21.15.62:0/92905204 learned_addr learned my addr 172.21.15.62:0/92905204 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-09T08:03:14.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.746+0000 7fd719d9b640 1 --2- 172.21.15.62:0/92905204 >> v2:172.21.15.103:3300/0 conn(0x7fd714034d90 0x7fd7140c3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.746+0000 7fd719d9b640 10 monclient(hunting): get_auth_request con 0x7fd714034d90 auth_method 0 2024-02-09T08:03:14.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.746+0000 7fd719d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:14.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.746+0000 7fd719d9b640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:14.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.746+0000 7fd719d9b640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:14.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.748+0000 7fd71ad9d640 1 --2- 172.21.15.62:0/92905204 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd714031fc0 0x7fd7140c4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.750+0000 7fd71ad9d640 10 monclient(hunting): get_auth_request con 0x7fd714031fc0 auth_method 0 2024-02-09T08:03:14.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.750+0000 7fd71ad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:14.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.750+0000 7fd71ad9d640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:14.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.750+0000 7fd71ad9d640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:14.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.751+0000 7fd71ad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:14.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.751+0000 7fd71ad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:14.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.751+0000 7fd71ad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:14.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.754+0000 7fd719d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:14.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.754+0000 7fd719d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:14.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.754+0000 7fd719d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:14.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.757+0000 7fd71ad9d640 10 monclient(hunting): handle_auth_done global_id 4304 payload 274 2024-02-09T08:03:14.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.757+0000 7fd71ad9d640 1 -- 172.21.15.62:0/92905204 >> v2:172.21.15.103:3300/0 conn(0x7fd714034d90 msgr2=0x7fd7140c3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:14.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.757+0000 7fd71ad9d640 1 --2- 172.21.15.62:0/92905204 >> v2:172.21.15.103:3300/0 conn(0x7fd714034d90 0x7fd7140c3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.757+0000 7fd71ad9d640 1 -- 172.21.15.62:0/92905204 >> v1:172.21.15.62:6789/0 conn(0x7fd7140349b0 legacy=0x7fd7140c1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.757+0000 7fd71ad9d640 10 monclient: _finish_hunting 0 2024-02-09T08:03:14.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.757+0000 7fd71ad9d640 1 monclient: found mon.noname-b 2024-02-09T08:03:14.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.757+0000 7fd71ad9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:14.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.757+0000 7fd71ad9d640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.62:3301/0 2024-02-09T08:03:14.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.757+0000 7fd71ad9d640 1 -- 172.21.15.62:0/92905204 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7140333c0 con 0x7fd714031fc0 2024-02-09T08:03:14.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.760+0000 7fd71ad9d640 1 --2- 172.21.15.62:0/92905204 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd714031fc0 0x7fd7140c4190 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd7100097a0 tx=0x7fd71002b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a0782be3e145774 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:14.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.781+0000 7fdfcae95640 10 monclient: get_monmap_and_config 2024-02-09T08:03:14.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.781+0000 7fdfcae95640 10 monclient: build_initial_monmap 2024-02-09T08:03:14.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.781+0000 7fdfcae95640 10 monclient: monmap: 2024-02-09T08:03:14.784 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:14.784 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.784 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:03:14.782997+0000 2024-02-09T08:03:14.784 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:03:14.782997+0000 2024-02-09T08:03:14.784 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:14.784 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.785 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:03:14.785 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:03:14.785 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:03:14.785 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:03:14.785 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:03:14.785 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.783+0000 7fdfcae95640 1 Processor -- start 2024-02-09T08:03:14.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.783+0000 7fdfcae95640 1 -- start start 2024-02-09T08:03:14.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.783+0000 7fdfcae95640 10 monclient: init 2024-02-09T08:03:14.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.784+0000 7fdfcae95640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:14.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.784+0000 7fdfcae95640 10 monclient: _add_conns ranks=[1,2,3,4,0] 2024-02-09T08:03:14.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.784+0000 7fdfcae95640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fdfc40b5000 addr v1:172.21.15.103:6789/0 2024-02-09T08:03:14.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.784+0000 7fdfcae95640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdfc40a9e30 0x7fdfc4145de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.784+0000 7fdfcae95640 10 monclient(hunting): picked mon.noname-b con 0x7fdfc40a9e30 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:14.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.784+0000 7fdfcae95640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdfc413fdf0 0x7fdfc4146320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.784+0000 7fdfcae95640 10 monclient(hunting): picked mon.noname-a con 0x7fdfc413fdf0 addr v2:172.21.15.62:3300/0 2024-02-09T08:03:14.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.784+0000 7fdfcae95640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfc40aa4a0 con 0x7fdfc40b5000 2024-02-09T08:03:14.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.784+0000 7fdfcae95640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.784+0000 7fdfcae95640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfc40b53e0 con 0x7fdfc413fdf0 2024-02-09T08:03:14.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.784+0000 7fdfcae95640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.784+0000 7fdfcae95640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc4146860 con 0x7fdfc40a9e30 2024-02-09T08:03:14.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.784+0000 7fdfcae95640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:14.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.784+0000 7fdfcae95640 10 monclient(hunting): authenticate will time out at 1438.144460s 2024-02-09T08:03:14.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.786+0000 7fdfc8c31640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fdfc40b5000 0x7fdfc413f6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.62:50482/0 (socket says 172.21.15.62:50482) 2024-02-09T08:03:14.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.786+0000 7fdfc8c31640 1 -- 172.21.15.62:0/2636228579 learned_addr learned my addr 172.21.15.62:0/2636228579 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-09T08:03:14.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.785+0000 7f744de26640 10 monclient: get_monmap_and_config 2024-02-09T08:03:14.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.785+0000 7f744de26640 10 monclient: build_initial_monmap 2024-02-09T08:03:14.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.785+0000 7f744de26640 10 monclient: monmap: 2024-02-09T08:03:14.789 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:14.789 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.789 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:03:14.786764+0000 2024-02-09T08:03:14.789 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:03:14.786764+0000 2024-02-09T08:03:14.789 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:14.789 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.789 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:03:14.789 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:03:14.789 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:03:14.790 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:03:14.790 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:03:14.790 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.787+0000 7fdfc9432640 1 --2- 172.21.15.62:0/2636228579 >> v2:172.21.15.62:3300/0 conn(0x7fdfc413fdf0 0x7fdfc4146320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.787+0000 7f744de26640 1 Processor -- start 2024-02-09T08:03:14.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.787+0000 7fdfc9432640 10 monclient(hunting): get_auth_request con 0x7fdfc413fdf0 auth_method 0 2024-02-09T08:03:14.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.787+0000 7fdfc9432640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:14.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.787+0000 7fdfc9432640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:14.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.787+0000 7fdfc9432640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:14.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.787+0000 7f744de26640 1 -- start start 2024-02-09T08:03:14.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.787+0000 7f744de26640 10 monclient: init 2024-02-09T08:03:14.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.788+0000 7f744de26640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:14.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.788+0000 7f744de26640 10 monclient: _add_conns ranks=[2,1,0,4,3] 2024-02-09T08:03:14.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.788+0000 7f744de26640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7440006a00 0x7f74400349b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.788+0000 7f744de26640 10 monclient(hunting): picked mon.noname-b con 0x7f7440006a00 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:14.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.788+0000 7f744de26640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f7440031fc0 addr v1:172.21.15.103:6789/0 2024-02-09T08:03:14.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.788+0000 7f744de26640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f74400c3c50 addr v1:172.21.15.62:6789/0 2024-02-09T08:03:14.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.788+0000 7f744de26640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7440031800 con 0x7f74400c3c50 2024-02-09T08:03:14.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.788+0000 7f744de26640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74400c1830 con 0x7f7440031fc0 2024-02-09T08:03:14.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.788+0000 7f744de26640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.788+0000 7f744de26640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7440031aa0 con 0x7f7440006a00 2024-02-09T08:03:14.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.788+0000 7f744de26640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:14.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.788+0000 7f744de26640 10 monclient(hunting): authenticate will time out at 1438.148847s 2024-02-09T08:03:14.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.788+0000 7fdfc9432640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:14.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.788+0000 7fdfc9432640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:14.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.788+0000 7fdfc9432640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:14.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.789+0000 7f7447fff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f7440031fc0 0x7f74400c1120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.62:50492/0 (socket says 172.21.15.62:50492) 2024-02-09T08:03:14.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.789+0000 7f7447fff640 1 -- 172.21.15.62:0/4129897387 learned_addr learned my addr 172.21.15.62:0/4129897387 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-09T08:03:14.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.790+0000 7fdfc3fff640 1 --2- 172.21.15.62:0/2636228579 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdfc40a9e30 0x7fdfc4145de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.790+0000 7fdfc3fff640 10 monclient(hunting): get_auth_request con 0x7fdfc40a9e30 auth_method 0 2024-02-09T08:03:14.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.790+0000 7fdfc3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:14.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.790+0000 7fdfc3fff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:14.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.790+0000 7fdfc3fff640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:14.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.791+0000 7fdfc3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:14.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.791+0000 7fdfc3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:14.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.791+0000 7fdfc3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:14.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.792+0000 7f744ce24640 1 --2- 172.21.15.62:0/4129897387 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7440006a00 0x7f74400349b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.808+0000 7fea61ffb640 1 -- 172.21.15.62:0/2954043784 <== osd.3 v2:172.21.15.62:6824/556356316 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fea6c135950 con 0x7fea50073580 2024-02-09T08:03:14.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.808+0000 7fea61ffb640 10 client.4327.objecter ms_dispatch 0x7fea6c000b90 command_reply(tid 2: 0 ) v1 2024-02-09T08:03:14.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.808+0000 7fea61ffb640 10 client.4327.objecter _finish_command 2 = system:0 2024-02-09T08:03:14.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.808+0000 7fea61ffb640 20 client.4327.objecter put_session s=0x7fea50072eb0 osd=3 4 2024-02-09T08:03:14.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.808+0000 7fea61ffb640 15 client.4327.objecter _session_command_op_remove 3 2 2024-02-09T08:03:14.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.808+0000 7fea733be640 10 librados: watch_flush enter 2024-02-09T08:03:14.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.808+0000 7fea733be640 10 librados: watch_flush exit 2024-02-09T08:03:14.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.808+0000 7fea733be640 10 client.4327.objecter close_session for osd.3 2024-02-09T08:03:14.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.808+0000 7fea733be640 1 -- 172.21.15.62:0/2954043784 >> [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] conn(0x7fea50073580 msgr2=0x7fea500759a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.808+0000 7fea733be640 1 --2- 172.21.15.62:0/2954043784 >> [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] conn(0x7fea50073580 0x7fea500759a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.808+0000 7fea733be640 20 client.4327.objecter put_session s=0x7fea50072eb0 osd=3 1 2024-02-09T08:03:14.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.808+0000 7fea733be640 20 client.4327.objecter shutdown clearing up homeless session... 2024-02-09T08:03:14.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.808+0000 7fea733be640 10 client.4327.objecter successfully canceled tick 2024-02-09T08:03:14.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.804+0000 7fdfc9432640 10 monclient(hunting): handle_auth_done global_id 4317 payload 274 2024-02-09T08:03:14.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.804+0000 7fdfc9432640 1 -- 172.21.15.62:0/2636228579 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdfc40a9e30 msgr2=0x7fdfc4145de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:14.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.804+0000 7fdfc9432640 1 --2- 172.21.15.62:0/2636228579 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdfc40a9e30 0x7fdfc4145de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.804+0000 7fdfc9432640 1 -- 172.21.15.62:0/2636228579 >> v1:172.21.15.103:6789/0 conn(0x7fdfc40b5000 legacy=0x7fdfc413f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.804+0000 7fdfc9432640 10 monclient: _finish_hunting 0 2024-02-09T08:03:14.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.804+0000 7fdfc9432640 1 monclient: found mon.noname-a 2024-02-09T08:03:14.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.804+0000 7fdfc9432640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:14.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.804+0000 7fdfc9432640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-02-09T08:03:14.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.804+0000 7fdfc9432640 1 -- 172.21.15.62:0/2636228579 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc40b2900 con 0x7fdfc413fdf0 2024-02-09T08:03:14.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.809+0000 7fea733be640 1 -- 172.21.15.62:0/2954043784 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fea5006d1a0 msgr2=0x7fea5006f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.809+0000 7fea733be640 1 --2- 172.21.15.62:0/2954043784 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fea5006d1a0 0x7fea5006f660 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fea680011e0 tx=0x7fea68007890 comp rx=0 tx=0).stop 2024-02-09T08:03:14.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.809+0000 7fea733be640 10 monclient: shutdown 2024-02-09T08:03:14.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.809+0000 7fea733be640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:14.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.809+0000 7fea733be640 1 -- 172.21.15.62:0/2954043784 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea6c13fdf0 msgr2=0x7fea6c132ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.809+0000 7fea733be640 1 --2- 172.21.15.62:0/2954043784 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea6c13fdf0 0x7fea6c132ea0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fea64009ee0 tx=0x7fea64004a40 comp rx=0 tx=0).stop 2024-02-09T08:03:14.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.811+0000 7fea7195b640 1 -- 172.21.15.62:0/2954043784 reap_dead start 2024-02-09T08:03:14.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.811+0000 7fea733be640 1 -- 172.21.15.62:0/2954043784 shutdown_connections 2024-02-09T08:03:14.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.811+0000 7fea733be640 1 -- 172.21.15.62:0/2954043784 >> 172.21.15.62:0/2954043784 conn(0x7fea6c066bb0 msgr2=0x7fea6c139550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:14.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.814+0000 7f74477fe640 1 -- 172.21.15.62:0/4129897387 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4271519507 0 0) 0x7f74400c1830 con 0x7f7440031fc0 2024-02-09T08:03:14.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.814+0000 7f74477fe640 10 monclient(hunting): _negotiate 2024-02-09T08:03:14.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.814+0000 7f74477fe640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:14.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.814+0000 7f74477fe640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:14.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.814+0000 7f74477fe640 10 monclient(hunting): my global_id is 4339 2024-02-09T08:03:14.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.814+0000 7f74477fe640 1 -- 172.21.15.62:0/4129897387 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7438003520 con 0x7f7440031fc0 2024-02-09T08:03:14.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.813+0000 7fea733be640 1 -- 172.21.15.62:0/2954043784 shutdown_connections 2024-02-09T08:03:14.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.814+0000 7fea733be640 1 -- 172.21.15.62:0/2954043784 wait complete. 2024-02-09T08:03:14.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.814+0000 7fea733be640 1 librados: shutdown 2024-02-09T08:03:14.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.818+0000 7f74477fe640 1 -- 172.21.15.62:0/4129897387 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2433833745 0 0) 0x7f7438003520 con 0x7f7440031fc0 2024-02-09T08:03:14.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.818+0000 7f74477fe640 1 -- 172.21.15.62:0/4129897387 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7440006a00 msgr2=0x7f74400349b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:14.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.818+0000 7f74477fe640 1 --2- 172.21.15.62:0/4129897387 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7440006a00 0x7f74400349b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.818+0000 7f74477fe640 1 -- 172.21.15.62:0/4129897387 >> v1:172.21.15.62:6789/0 conn(0x7f74400c3c50 legacy=0x7f74400c40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.818+0000 7f74477fe640 10 monclient: _finish_hunting 0 2024-02-09T08:03:14.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.818+0000 7f74477fe640 1 monclient: found mon.noname-c-legacy 2024-02-09T08:03:14.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.818+0000 7f74477fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:14.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.818+0000 7f74477fe640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:172.21.15.103:6789/0 2024-02-09T08:03:14.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.818+0000 7f74477fe640 1 -- 172.21.15.62:0/4129897387 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74400291f0 con 0x7f7440031fc0 2024-02-09T08:03:14.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.818+0000 7f74477fe640 10 monclient: _finish_auth 0 2024-02-09T08:03:14.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.818+0000 7f74477fe640 10 monclient: _check_auth_tickets 2024-02-09T08:03:14.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.818+0000 7f74477fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:14.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.818+0000 7f74477fe640 1 -- 172.21.15.62:0/4129897387 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1140318843 0 0) 0x7f744804f7e0 con 0x7f7440031fc0 2024-02-09T08:03:14.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.818+0000 7f74477fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:14.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.818+0000 7f74477fe640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2024-02-09T08:03:14.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.818+0000 7f74477fe640 10 monclient: dump: 2024-02-09T08:03:14.823 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:14.823 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.823 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.823 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.823 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:14.823 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.823 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:14.823 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:14.823 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:14.823 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.818+0000 7f74477fe640 1 monclient: mon.b has (v2) addrs [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] but i'm connected to v1:172.21.15.103:6789/0, reconnecting 2024-02-09T08:03:14.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.818+0000 7f74477fe640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:14.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.818+0000 7f74477fe640 1 -- 172.21.15.62:0/4129897387 >> v1:172.21.15.103:6789/0 conn(0x7f7440031fc0 legacy=0x7f74400c1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.818+0000 7f74477fe640 10 monclient: _add_conns ranks=[1,0,2] 2024-02-09T08:03:14.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.818+0000 7f74477fe640 1 --2- 172.21.15.62:0/4129897387 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7438003970 0x7f7438003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.818+0000 7f74477fe640 10 monclient(hunting): picked mon.b con 0x7f7438003970 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:03:14.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.818+0000 7f74477fe640 1 --2- 172.21.15.62:0/4129897387 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f74380047c0 0x7f7438004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.818+0000 7f74477fe640 10 monclient(hunting): picked mon.a con 0x7f74380047c0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:03:14.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.818+0000 7f74477fe640 1 --2- 172.21.15.62:0/4129897387 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7438005260 0x7f743800b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.818+0000 7f74477fe640 10 monclient(hunting): picked mon.c con 0x7f7438005260 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:14.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.818+0000 7f74477fe640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.818+0000 7f74477fe640 1 -- 172.21.15.62:0/4129897387 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7440031aa0 con 0x7f74380047c0 2024-02-09T08:03:14.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.818+0000 7f74477fe640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.818+0000 7f74477fe640 1 -- 172.21.15.62:0/4129897387 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743800c080 con 0x7f7438003970 2024-02-09T08:03:14.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.819+0000 7f74477fe640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.819+0000 7f74477fe640 1 -- 172.21.15.62:0/4129897387 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f743800c240 con 0x7f7438005260 2024-02-09T08:03:14.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.819+0000 7f74477fe640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:14.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.819+0000 7f74477fe640 10 monclient(hunting): _finish_auth 0 2024-02-09T08:03:14.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.821+0000 7f744ce24640 1 --2- 172.21.15.62:0/4129897387 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7438003970 0x7f7438003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.821+0000 7f744ce24640 10 monclient(hunting): get_auth_request con 0x7f7438003970 auth_method 0 2024-02-09T08:03:14.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.821+0000 7f744ce24640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:14.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.821+0000 7f744ce24640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:14.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.821+0000 7f744ce24640 10 monclient(hunting): _init_auth already have auth, reseting 2024-02-09T08:03:14.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.822+0000 7f744ce24640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:14.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.822+0000 7f744ce24640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:14.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.822+0000 7f744ce24640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-02-09T08:03:14.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.822+0000 7f7447fff640 1 --2- 172.21.15.62:0/4129897387 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f74380047c0 0x7f7438004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.822+0000 7f7447fff640 10 monclient(hunting): get_auth_request con 0x7f74380047c0 auth_method 0 2024-02-09T08:03:14.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.822+0000 7f7447fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:14.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.822+0000 7f7447fff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:14.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.822+0000 7f7447fff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-02-09T08:03:14.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.823+0000 7f744ce24640 10 monclient(hunting): handle_auth_done global_id 4339 payload 293 2024-02-09T08:03:14.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.823+0000 7f744ce24640 1 -- 172.21.15.62:0/4129897387 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7438005260 msgr2=0x7f743800b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:14.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.823+0000 7f744ce24640 1 --2- 172.21.15.62:0/4129897387 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7438005260 0x7f743800b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.823+0000 7f744ce24640 1 -- 172.21.15.62:0/4129897387 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f74380047c0 msgr2=0x7f7438004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:14.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.823+0000 7f744ce24640 1 --2- 172.21.15.62:0/4129897387 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f74380047c0 0x7f7438004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.823+0000 7f744ce24640 10 monclient: _finish_hunting 0 2024-02-09T08:03:14.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.823+0000 7f744ce24640 1 monclient: found mon.b 2024-02-09T08:03:14.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.823+0000 7f744ce24640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:14.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.823+0000 7f744ce24640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:14.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.823+0000 7f744ce24640 1 -- 172.21.15.62:0/4129897387 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7438003520 con 0x7f7438003970 2024-02-09T08:03:14.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.823+0000 7f744ce24640 10 monclient: _finish_auth 0 2024-02-09T08:03:14.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.823+0000 7f744ce24640 10 monclient: _check_auth_tickets 2024-02-09T08:03:14.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.823+0000 7f744ce24640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:14.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.824+0000 7f744de26640 5 monclient: authenticate success, global_id 4339 2024-02-09T08:03:14.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.824+0000 7f744de26640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-02-09T08:03:14.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.829+0000 7fdfc9432640 1 --2- 172.21.15.62:0/2636228579 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdfc413fdf0 0x7fdfc4146320 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdfb80097a0 tx=0x7fdfb802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ba4e52b7ef03124 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:14.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.830+0000 7f744ce24640 1 --2- 172.21.15.62:0/4129897387 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7438003970 0x7f7438003d90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f74400355b0 tx=0x7f74380057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98e32fa0730f5b8 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:14.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.834+0000 7f74477fe640 1 -- 172.21.15.62:0/4129897387 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7434032600 con 0x7f7438003970 2024-02-09T08:03:14.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.834+0000 7f74477fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:14.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.834+0000 7f74477fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:03:14.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.834+0000 7f74477fe640 10 monclient: dump: 2024-02-09T08:03:14.837 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:14.837 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.837 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.837 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.837 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:14.838 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.838 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:14.838 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:14.838 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:14.838 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.834+0000 7f744de26640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-02-09T08:03:14.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.834+0000 7f74477fe640 1 -- 172.21.15.62:0/4129897387 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7434032760 con 0x7f7438003970 2024-02-09T08:03:14.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.834+0000 7f74477fe640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:14.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.834+0000 7f744de26640 10 monclient: get_monmap_and_config success 2024-02-09T08:03:14.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.834+0000 7f744de26640 4 set_mon_vals no callback set 2024-02-09T08:03:14.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.835+0000 7f744de26640 10 monclient: shutdown 2024-02-09T08:03:14.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.835+0000 7f744de26640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:14.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.835+0000 7f744de26640 1 -- 172.21.15.62:0/4129897387 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7438003970 msgr2=0x7f7438003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.835+0000 7f744de26640 1 --2- 172.21.15.62:0/4129897387 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7438003970 0x7f7438003d90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f74400355b0 tx=0x7f74380057f0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.839 INFO:teuthology.orchestra.run.smithi062.stdout:90194313222 2024-02-09T08:03:14.840 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-02-09T08:03:14.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.838+0000 7f744d625640 1 -- 172.21.15.62:0/4129897387 reap_dead start 2024-02-09T08:03:14.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.840+0000 7f744de26640 1 -- 172.21.15.62:0/4129897387 shutdown_connections 2024-02-09T08:03:14.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.840+0000 7f744de26640 1 -- 172.21.15.62:0/4129897387 >> 172.21.15.62:0/4129897387 conn(0x7f7440005ee0 msgr2=0x7f74400062f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:14.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.841+0000 7f744de26640 1 -- 172.21.15.62:0/4129897387 shutdown_connections 2024-02-09T08:03:14.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.840+0000 7fdfc37fe640 1 -- 172.21.15.62:0/2636228579 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb80317c0 con 0x7fdfc413fdf0 2024-02-09T08:03:14.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.840+0000 7fdfc37fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:14.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.840+0000 7fdfc37fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-09T08:03:14.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.840+0000 7fdfc37fe640 10 monclient: dump: 2024-02-09T08:03:14.845 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:14.846 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.846 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.846 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.846 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:14.846 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.846 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:14.846 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:14.846 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:14.846 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.840+0000 7fdfc37fe640 10 monclient: _finish_auth 0 2024-02-09T08:03:14.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.840+0000 7fdfc37fe640 10 monclient: _check_auth_tickets 2024-02-09T08:03:14.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.840+0000 7fdfc37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:14.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.840+0000 7fdfc37fe640 1 -- 172.21.15.62:0/2636228579 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb8031920 con 0x7fdfc413fdf0 2024-02-09T08:03:14.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.840+0000 7fdfc37fe640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:14.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.840+0000 7fdfc37fe640 1 -- 172.21.15.62:0/2636228579 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb8031cf0 con 0x7fdfc413fdf0 2024-02-09T08:03:14.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.840+0000 7fdfc37fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:14.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.841+0000 7fdfc37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-09T08:03:14.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.841+0000 7fdfc37fe640 10 monclient: dump: 2024-02-09T08:03:14.847 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:14.847 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.847 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.847 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.848 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:14.848 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.848 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:14.848 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:14.848 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:14.848 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.841+0000 7f744de26640 1 -- 172.21.15.62:0/4129897387 wait complete. 2024-02-09T08:03:14.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.842+0000 7f744de26640 10 monclient: build_initial_monmap 2024-02-09T08:03:14.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.842+0000 7f744de26640 10 monclient: monmap: 2024-02-09T08:03:14.849 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:14.849 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:03:14.849 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:03:14.849 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:03:14.849 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:14.849 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.849 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:03:14.849 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:03:14.849 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:03:14.849 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.842+0000 7f744de26640 1 librados: starting msgr at 2024-02-09T08:03:14.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.842+0000 7f744de26640 1 librados: starting objecter 2024-02-09T08:03:14.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.842+0000 7f744de26640 1 Processor -- start 2024-02-09T08:03:14.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.843+0000 7f744de26640 1 -- start start 2024-02-09T08:03:14.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.843+0000 7fdfcae95640 5 monclient: authenticate success, global_id 4317 2024-02-09T08:03:14.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.843+0000 7fdfcae95640 10 monclient: get_monmap_and_config success 2024-02-09T08:03:14.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.843+0000 7fdfcae95640 4 set_mon_vals no callback set 2024-02-09T08:03:14.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.844+0000 7fdfcae95640 10 monclient: shutdown 2024-02-09T08:03:14.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.844+0000 7fdfcae95640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:14.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.844+0000 7fdfcae95640 1 -- 172.21.15.62:0/2636228579 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdfc413fdf0 msgr2=0x7fdfc4146320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.844+0000 7fdfcae95640 1 --2- 172.21.15.62:0/2636228579 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdfc413fdf0 0x7fdfc4146320 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdfb80097a0 tx=0x7fdfb802b860 comp rx=0 tx=0).stop 2024-02-09T08:03:14.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.843+0000 7f744de26640 1 librados: setting wanted keys 2024-02-09T08:03:14.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.843+0000 7f744de26640 1 librados: calling monclient init 2024-02-09T08:03:14.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.843+0000 7f744de26640 10 monclient: init 2024-02-09T08:03:14.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.844+0000 7f744de26640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:14.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.844+0000 7f744de26640 10 monclient: _add_conns ranks=[1,2,0] 2024-02-09T08:03:14.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.844+0000 7f744de26640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74400bb200 0x7f74400d4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.844+0000 7f744de26640 10 monclient(hunting): picked mon.noname-b con 0x7f74400bb200 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:03:14.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.844+0000 7f744de26640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f74400bb5e0 0x7f74400d4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.844+0000 7f744de26640 10 monclient(hunting): picked mon.noname-c con 0x7f74400bb5e0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:14.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.844+0000 7f744de26640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f744016a0d0 0x7f744016a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.844+0000 7f744de26640 10 monclient(hunting): picked mon.noname-a con 0x7f744016a0d0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:03:14.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.844+0000 7f744de26640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.844+0000 7f744de26640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74400bd130 con 0x7f744016a0d0 2024-02-09T08:03:14.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.844+0000 7f744de26640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.844+0000 7f744de26640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f744002cea0 con 0x7f74400bb200 2024-02-09T08:03:14.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.844+0000 7f744de26640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.844+0000 7f744de26640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74400bbef0 con 0x7f74400bb5e0 2024-02-09T08:03:14.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.844+0000 7f744de26640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:14.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.844+0000 7f744de26640 10 monclient(hunting): authenticate will time out at 1438.204351s 2024-02-09T08:03:14.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.847+0000 7f7447fff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f74400bb5e0 0x7f74400d4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.847+0000 7f7447fff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f74400bb5e0 0x7f74400d4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:32856/0 (socket says 172.21.15.62:32856) 2024-02-09T08:03:14.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.847+0000 7f7447fff640 1 -- 172.21.15.62:0/1008769425 learned_addr learned my addr 172.21.15.62:0/1008769425 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:14.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.847+0000 7f7447fff640 10 monclient(hunting): get_auth_request con 0x7f74400bb5e0 auth_method 0 2024-02-09T08:03:14.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.847+0000 7f7447fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:14.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.847+0000 7f7447fff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:14.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.847+0000 7f7447fff640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:14.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.848+0000 7fdfcae95640 1 -- 172.21.15.62:0/2636228579 shutdown_connections 2024-02-09T08:03:14.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.848+0000 7fdfcae95640 1 --2- 172.21.15.62:0/2636228579 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdfc413fdf0 0x7fdfc4146320 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.848+0000 7fdfcae95640 1 --2- 172.21.15.62:0/2636228579 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdfc40a9e30 0x7fdfc4145de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.848+0000 7fdfcae95640 1 -- 172.21.15.62:0/2636228579 >> 172.21.15.62:0/2636228579 conn(0x7fdfc4066bb0 msgr2=0x7fdfc4066fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:14.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.848+0000 7f744ce24640 1 --2- 172.21.15.62:0/1008769425 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74400bb200 0x7f74400d4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.849+0000 7f744d625640 1 --2- 172.21.15.62:0/1008769425 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f744016a0d0 0x7f744016a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.849+0000 7f744d625640 10 monclient(hunting): get_auth_request con 0x7f744016a0d0 auth_method 0 2024-02-09T08:03:14.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.849+0000 7f744d625640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:14.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.849+0000 7f744d625640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:14.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.849+0000 7f744d625640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:14.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.849+0000 7f7447fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:14.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.849+0000 7f7447fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:14.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.849+0000 7f7447fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:14.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.850+0000 7f744d625640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:14.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.850+0000 7f744d625640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:14.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.850+0000 7f744d625640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:14.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.850+0000 7f744ce24640 10 monclient(hunting): get_auth_request con 0x7f74400bb200 auth_method 0 2024-02-09T08:03:14.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.850+0000 7f744ce24640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:14.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.850+0000 7f744ce24640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:14.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.850+0000 7f744ce24640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:14.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.850+0000 7fdfcae95640 1 -- 172.21.15.62:0/2636228579 shutdown_connections 2024-02-09T08:03:14.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.851+0000 7f744ce24640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:14.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.851+0000 7f744ce24640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:14.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.851+0000 7f744ce24640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:14.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.853+0000 7f744ce24640 10 monclient(hunting): handle_auth_done global_id 4342 payload 824 2024-02-09T08:03:14.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.853+0000 7f744ce24640 1 -- 172.21.15.62:0/1008769425 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f74400bb5e0 msgr2=0x7f74400d4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.853+0000 7f744ce24640 1 --2- 172.21.15.62:0/1008769425 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f74400bb5e0 0x7f74400d4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.853+0000 7f744ce24640 1 -- 172.21.15.62:0/1008769425 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f744016a0d0 msgr2=0x7f744016a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.853+0000 7f744ce24640 1 --2- 172.21.15.62:0/1008769425 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f744016a0d0 0x7f744016a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.853+0000 7f744ce24640 10 monclient: _finish_hunting 0 2024-02-09T08:03:14.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.853+0000 7f744ce24640 1 monclient: found mon.noname-b 2024-02-09T08:03:14.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.853+0000 7f744ce24640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:14.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.853+0000 7f744ce24640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.103:3300/0 2024-02-09T08:03:14.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.853+0000 7f744ce24640 1 -- 172.21.15.62:0/1008769425 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74400328c0 con 0x7f74400bb200 2024-02-09T08:03:14.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.857+0000 7f744ce24640 1 --2- 172.21.15.62:0/1008769425 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74400bb200 0x7f74400d4690 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7434033000 tx=0x7f7434004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:14.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.857+0000 7f74457fa640 10 client.?.objecter ms_handle_connect 0x7f74400bb200 2024-02-09T08:03:14.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.857+0000 7f74457fa640 10 client.?.objecter resend_mon_ops 2024-02-09T08:03:14.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.856+0000 7fdfcae95640 1 -- 172.21.15.62:0/2636228579 wait complete. 2024-02-09T08:03:14.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.857+0000 7fdfcae95640 10 monclient: build_initial_monmap 2024-02-09T08:03:14.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.857+0000 7fdfcae95640 10 monclient: monmap: 2024-02-09T08:03:14.860 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:14.860 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:03:14.861 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:03:14.861 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:03:14.861 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:14.861 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.861 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:03:14.861 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:03:14.861 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:03:14.861 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.857+0000 7fdfcae95640 1 librados: starting msgr at 2024-02-09T08:03:14.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.857+0000 7fdfcae95640 1 librados: starting objecter 2024-02-09T08:03:14.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.857+0000 7fdfcae95640 1 Processor -- start 2024-02-09T08:03:14.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.861+0000 7f74457fa640 1 -- 172.21.15.62:0/1008769425 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7434032ea0 con 0x7f74400bb200 2024-02-09T08:03:14.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.861+0000 7f74457fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:14.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.861+0000 7f74457fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:03:14.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.861+0000 7f74457fa640 10 monclient: dump: 2024-02-09T08:03:14.863 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:14.863 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.864 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.864 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.864 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:14.864 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.864 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:14.864 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:14.864 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:14.864 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.861+0000 7f74457fa640 10 monclient: _finish_auth 0 2024-02-09T08:03:14.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.861+0000 7f74457fa640 10 monclient: _check_auth_tickets 2024-02-09T08:03:14.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.861+0000 7f74457fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:14.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.860+0000 7fdfcae95640 1 -- start start 2024-02-09T08:03:14.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.860+0000 7fdfcae95640 1 librados: setting wanted keys 2024-02-09T08:03:14.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.860+0000 7fdfcae95640 1 librados: calling monclient init 2024-02-09T08:03:14.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.860+0000 7fdfcae95640 10 monclient: init 2024-02-09T08:03:14.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.861+0000 7fdfcae95640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:14.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.861+0000 7fdfcae95640 10 monclient: _add_conns ranks=[1,0,2] 2024-02-09T08:03:14.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.861+0000 7fdfcae95640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdfc40a9e30 0x7fdfc413a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.861+0000 7fdfcae95640 10 monclient(hunting): picked mon.noname-b con 0x7fdfc40a9e30 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:03:14.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.861+0000 7fdfcae95640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdfc40b5000 0x7fdfc413af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.861+0000 7fdfcae95640 10 monclient(hunting): picked mon.noname-a con 0x7fdfc40b5000 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:03:14.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.861+0000 7fdfcae95640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdfc413fdf0 0x7fdfc41e46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.861+0000 7fdfcae95640 10 monclient(hunting): picked mon.noname-c con 0x7fdfc413fdf0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:14.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.861+0000 7fdfcae95640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.861+0000 7fdfcae95640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc41e41f0 con 0x7fdfc40b5000 2024-02-09T08:03:14.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.861+0000 7fdfcae95640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.861+0000 7fdfcae95640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc413c860 con 0x7fdfc40a9e30 2024-02-09T08:03:14.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.861+0000 7fdfcae95640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.861+0000 7fdfcae95640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc41437e0 con 0x7fdfc413fdf0 2024-02-09T08:03:14.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.861+0000 7fdfcae95640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:14.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.861+0000 7fdfcae95640 10 monclient(hunting): authenticate will time out at 1438.221412s 2024-02-09T08:03:14.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.861+0000 7f744de26640 5 monclient: authenticate success, global_id 4342 2024-02-09T08:03:14.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.861+0000 7f744de26640 10 monclient: _renew_subs 2024-02-09T08:03:14.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.861+0000 7f744de26640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:14.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.861+0000 7f744de26640 1 -- 172.21.15.62:0/1008769425 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74400bd380 con 0x7f74400bb200 2024-02-09T08:03:14.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.861+0000 7f744de26640 10 client.4342.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:03:14.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.861+0000 7f744de26640 10 monclient: _renew_subs 2024-02-09T08:03:14.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.861+0000 7f744de26640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:14.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.861+0000 7f744de26640 1 -- 172.21.15.62:0/1008769425 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74400bbb30 con 0x7f74400bb200 2024-02-09T08:03:14.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.861+0000 7f744de26640 1 librados: init done 2024-02-09T08:03:14.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.862+0000 7f74457fa640 1 -- 172.21.15.62:0/1008769425 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743403cbc0 con 0x7f74400bb200 2024-02-09T08:03:14.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.862+0000 7f74457fa640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:14.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.863+0000 7f74457fa640 1 -- 172.21.15.62:0/1008769425 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74340463f0 con 0x7f74400bb200 2024-02-09T08:03:14.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.863+0000 7f74457fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:14.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.863+0000 7f74457fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:03:14.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.863+0000 7f74457fa640 10 monclient: dump: 2024-02-09T08:03:14.867 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:14.867 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.867 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.867 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.868 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:14.868 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.868 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:14.868 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:14.868 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:14.868 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.864+0000 7fdfc3fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdfc40b5000 0x7fdfc413af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.865+0000 7f744de26640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:14.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.865+0000 7f744de26640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:14.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.865+0000 7f744de26640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:14.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.865+0000 7f744de26640 1 -- 172.21.15.62:0/1008769425 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74400052c0 con 0x7f74400bb200 2024-02-09T08:03:14.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.865+0000 7fdfc3fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdfc40b5000 0x7fdfc413af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:34918/0 (socket says 172.21.15.62:34918) 2024-02-09T08:03:14.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.865+0000 7fdfc3fff640 1 -- 172.21.15.62:0/1129173437 learned_addr learned my addr 172.21.15.62:0/1129173437 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:14.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.865+0000 7fdfc3fff640 10 monclient(hunting): get_auth_request con 0x7fdfc40b5000 auth_method 0 2024-02-09T08:03:14.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.865+0000 7fdfc3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:14.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.865+0000 7fdfc3fff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:14.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.865+0000 7fdfc3fff640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:14.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.866+0000 7fdfc9432640 1 --2- 172.21.15.62:0/1129173437 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdfc413fdf0 0x7fdfc41e46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.866+0000 7fdfc9432640 10 monclient(hunting): get_auth_request con 0x7fdfc413fdf0 auth_method 0 2024-02-09T08:03:14.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.866+0000 7fdfc9432640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:14.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.866+0000 7fdfc9432640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:14.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.866+0000 7fdfc9432640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:14.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.868+0000 7f7446ffd640 4 set_mon_vals no callback set 2024-02-09T08:03:14.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.870+0000 7fdfc9432640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:14.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.870+0000 7fdfc9432640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:14.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.870+0000 7fdfc9432640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:14.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.870+0000 7fdfc3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:14.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.870+0000 7fdfc3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:14.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.870+0000 7fdfc3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:14.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.876+0000 7fdfc9432640 10 monclient(hunting): handle_auth_done global_id 4313 payload 824 2024-02-09T08:03:14.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.876+0000 7fdfc9432640 1 -- 172.21.15.62:0/1129173437 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdfc40a9e30 msgr2=0x7fdfc413a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.876+0000 7fdfc9432640 1 --2- 172.21.15.62:0/1129173437 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdfc40a9e30 0x7fdfc413a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.876+0000 7fdfc9432640 1 -- 172.21.15.62:0/1129173437 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdfc40b5000 msgr2=0x7fdfc413af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.876+0000 7fdfc9432640 1 --2- 172.21.15.62:0/1129173437 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdfc40b5000 0x7fdfc413af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.876+0000 7fdfc9432640 10 monclient: _finish_hunting 0 2024-02-09T08:03:14.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.876+0000 7fdfc9432640 1 monclient: found mon.noname-c 2024-02-09T08:03:14.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.876+0000 7fdfc9432640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:14.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.876+0000 7fdfc9432640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-02-09T08:03:14.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.876+0000 7fdfc9432640 1 -- 172.21.15.62:0/1129173437 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb8009400 con 0x7fdfc413fdf0 2024-02-09T08:03:14.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.879+0000 7fdfc9432640 1 --2- 172.21.15.62:0/1129173437 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdfc413fdf0 0x7fdfc41e46d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8033000 tx=0x7fdfb80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:14.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.879+0000 7fdfc17fa640 10 client.?.objecter ms_handle_connect 0x7fdfc413fdf0 2024-02-09T08:03:14.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.879+0000 7fdfc17fa640 10 client.?.objecter resend_mon_ops 2024-02-09T08:03:14.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.883+0000 7f74457fa640 1 -- 172.21.15.62:0/1008769425 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f743404f450 con 0x7f74400bb200 2024-02-09T08:03:14.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.882+0000 7fd71959a640 1 -- 172.21.15.62:0/92905204 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7100317c0 con 0x7fd714031fc0 2024-02-09T08:03:14.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.883+0000 7fd71959a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:14.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.883+0000 7fd71959a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:03:14.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.883+0000 7fd71959a640 10 monclient: dump: 2024-02-09T08:03:14.886 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:14.887 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.887 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.887 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.887 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:14.887 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.887 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:14.887 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:14.887 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:14.887 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.883+0000 7fd71959a640 10 monclient: _finish_auth 0 2024-02-09T08:03:14.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.883+0000 7fd71959a640 10 monclient: _check_auth_tickets 2024-02-09T08:03:14.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.883+0000 7fd71959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:14.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.883+0000 7fd71b59e640 5 monclient: authenticate success, global_id 4304 2024-02-09T08:03:14.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.883+0000 7fd71b59e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-02-09T08:03:14.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.883+0000 7fd71959a640 1 -- 172.21.15.62:0/92905204 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd710031920 con 0x7fd714031fc0 2024-02-09T08:03:14.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.883+0000 7fd71959a640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:14.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.884+0000 7f74457fa640 1 --2- 172.21.15.62:0/1008769425 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f742c06d1f0 0x7f742c06f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.883+0000 7fd71b59e640 10 monclient: get_monmap_and_config success 2024-02-09T08:03:14.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.883+0000 7fd71b59e640 4 set_mon_vals no callback set 2024-02-09T08:03:14.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.884+0000 7fd71b59e640 10 monclient: shutdown 2024-02-09T08:03:14.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.884+0000 7fd71b59e640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:14.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.884+0000 7fd71b59e640 1 -- 172.21.15.62:0/92905204 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd714031fc0 msgr2=0x7fd7140c4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.884+0000 7fd71b59e640 1 --2- 172.21.15.62:0/92905204 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd714031fc0 0x7fd7140c4190 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd7100097a0 tx=0x7fd71002b860 comp rx=0 tx=0).stop 2024-02-09T08:03:14.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.884+0000 7fd71b59e640 1 -- 172.21.15.62:0/92905204 shutdown_connections 2024-02-09T08:03:14.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.884+0000 7fd71b59e640 1 --2- 172.21.15.62:0/92905204 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd714031fc0 0x7fd7140c4190 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.884+0000 7fd71b59e640 1 --2- 172.21.15.62:0/92905204 >> v2:172.21.15.103:3300/0 conn(0x7fd714034d90 0x7fd7140c3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.884+0000 7fd71b59e640 1 -- 172.21.15.62:0/92905204 >> 172.21.15.62:0/92905204 conn(0x7fd714005ee0 msgr2=0x7fd7140062f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:14.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.884+0000 7fd71b59e640 1 -- 172.21.15.62:0/92905204 shutdown_connections 2024-02-09T08:03:14.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.884+0000 7f7447fff640 1 --2- 172.21.15.62:0/1008769425 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f742c06d1f0 0x7f742c06f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.884+0000 7f7447fff640 10 monclient: get_auth_request con 0x7f742c06d1f0 auth_method 0 2024-02-09T08:03:14.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.884+0000 7fd71b59e640 1 -- 172.21.15.62:0/92905204 wait complete. 2024-02-09T08:03:14.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.885+0000 7f74457fa640 1 -- 172.21.15.62:0/1008769425 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f743407a7e0 con 0x7f74400bb200 2024-02-09T08:03:14.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.886+0000 7f74457fa640 10 client.4342.objecter ms_dispatch 0x7f7448000b90 osd_map(26..26 src has 1..26) v4 2024-02-09T08:03:14.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.886+0000 7f74457fa640 3 client.4342.objecter handle_osd_map got epochs [26,26] > 0 2024-02-09T08:03:14.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.886+0000 7f74457fa640 3 client.4342.objecter handle_osd_map decoding full epoch 26 2024-02-09T08:03:14.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.886+0000 7f74457fa640 20 client.4342.objecter dump_active .. 0 homeless 2024-02-09T08:03:14.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.886+0000 7fd71b59e640 10 monclient: build_initial_monmap 2024-02-09T08:03:14.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.886+0000 7fd71b59e640 10 monclient: monmap: 2024-02-09T08:03:14.893 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:14.893 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:03:14.893 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:03:14.893 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:03:14.893 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:14.893 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.893 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:03:14.893 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:03:14.893 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:03:14.893 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.886+0000 7fd71b59e640 1 librados: starting msgr at 2024-02-09T08:03:14.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.886+0000 7fd71b59e640 1 librados: starting objecter 2024-02-09T08:03:14.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.886+0000 7fd71b59e640 1 Processor -- start 2024-02-09T08:03:14.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.886+0000 7fd71b59e640 1 -- start start 2024-02-09T08:03:14.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.886+0000 7fd71b59e640 1 librados: setting wanted keys 2024-02-09T08:03:14.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.886+0000 7fd71b59e640 1 librados: calling monclient init 2024-02-09T08:03:14.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.886+0000 7fd71b59e640 10 monclient: init 2024-02-09T08:03:14.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.887+0000 7fd71b59e640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:14.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.887+0000 7fd71b59e640 10 monclient: _add_conns ranks=[1,2,0] 2024-02-09T08:03:14.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.887+0000 7fd71b59e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd714031fc0 0x7fd71402c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.887+0000 7fd71b59e640 10 monclient(hunting): picked mon.noname-b con 0x7fd714031fc0 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:03:14.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.887+0000 7fd71b59e640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd7140349b0 0x7fd71402e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.887+0000 7fd71b59e640 10 monclient(hunting): picked mon.noname-c con 0x7fd7140349b0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:14.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.888+0000 7fd71b59e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd714169b00 0x7fd714169fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.888+0000 7fd71b59e640 10 monclient(hunting): picked mon.noname-a con 0x7fd714169b00 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:03:14.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.888+0000 7fd71b59e640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.888+0000 7fd71b59e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71402e8e0 con 0x7fd714169b00 2024-02-09T08:03:14.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.888+0000 7fd71b59e640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.888+0000 7fd71b59e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71402ce40 con 0x7fd714031fc0 2024-02-09T08:03:14.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.888+0000 7fd71b59e640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.888+0000 7fd71b59e640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd71402d9c0 con 0x7fd7140349b0 2024-02-09T08:03:14.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.888+0000 7fd71b59e640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:14.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.888+0000 7fd71b59e640 10 monclient(hunting): authenticate will time out at 1438.248440s 2024-02-09T08:03:14.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.892+0000 7fdfc17fa640 1 -- 172.21.15.62:0/1129173437 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb8032860 con 0x7fdfc413fdf0 2024-02-09T08:03:14.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.892+0000 7fdfc17fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:14.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.892+0000 7fdfc17fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-09T08:03:14.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.892+0000 7fdfc17fa640 10 monclient: dump: 2024-02-09T08:03:14.896 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:14.896 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.896 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.896 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.896 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:14.896 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.896 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:14.896 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:14.897 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:14.897 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.892+0000 7fdfc17fa640 10 monclient: _finish_auth 0 2024-02-09T08:03:14.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.892+0000 7fdfc17fa640 10 monclient: _check_auth_tickets 2024-02-09T08:03:14.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.892+0000 7fdfc17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:14.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.892+0000 7fdfc17fa640 1 -- 172.21.15.62:0/1129173437 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb80329e0 con 0x7fdfc413fdf0 2024-02-09T08:03:14.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.892+0000 7fdfc17fa640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:14.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.892+0000 7fdfc17fa640 1 -- 172.21.15.62:0/1129173437 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb8032d90 con 0x7fdfc413fdf0 2024-02-09T08:03:14.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.892+0000 7fdfc17fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:14.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.892+0000 7fdfc17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-09T08:03:14.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.892+0000 7fdfc17fa640 10 monclient: dump: 2024-02-09T08:03:14.897 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:14.897 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.897 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.897 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.898 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:14.898 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.898 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:14.898 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:14.898 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:14.898 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.892+0000 7fdfc2ffd640 4 set_mon_vals no callback set 2024-02-09T08:03:14.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.893+0000 7fdfcae95640 5 monclient: authenticate success, global_id 4313 2024-02-09T08:03:14.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.893+0000 7fdfcae95640 10 monclient: _renew_subs 2024-02-09T08:03:14.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.893+0000 7fdfcae95640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:03:14.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.893+0000 7fdfcae95640 1 -- 172.21.15.62:0/1129173437 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc40b4870 con 0x7fdfc413fdf0 2024-02-09T08:03:14.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.893+0000 7fdfcae95640 10 client.4313.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:03:14.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.893+0000 7fdfcae95640 10 monclient: _renew_subs 2024-02-09T08:03:14.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.893+0000 7fdfcae95640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:03:14.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.893+0000 7fdfcae95640 1 -- 172.21.15.62:0/1129173437 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfc413b630 con 0x7fdfc413fdf0 2024-02-09T08:03:14.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.893+0000 7fdfcae95640 1 librados: init done 2024-02-09T08:03:14.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.895+0000 7fdfcae95640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:14.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.895+0000 7fdfcae95640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:14.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.895+0000 7fdfcae95640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:03:14.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.895+0000 7fdfcae95640 1 -- 172.21.15.62:0/1129173437 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfc413c6d0 con 0x7fdfc413fdf0 2024-02-09T08:03:14.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.903+0000 7fd719d9b640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd7140349b0 0x7fd71402e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.903+0000 7fd719d9b640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd7140349b0 0x7fd71402e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:32874/0 (socket says 172.21.15.62:32874) 2024-02-09T08:03:14.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.903+0000 7fd719d9b640 1 -- 172.21.15.62:0/50553452 learned_addr learned my addr 172.21.15.62:0/50553452 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:14.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.903+0000 7fd719d9b640 10 monclient(hunting): get_auth_request con 0x7fd7140349b0 auth_method 0 2024-02-09T08:03:14.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.903+0000 7fd719d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:14.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.900+0000 7f8122cdf640 10 monclient: get_monmap_and_config 2024-02-09T08:03:14.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.900+0000 7f8122cdf640 10 monclient: build_initial_monmap 2024-02-09T08:03:14.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.900+0000 7f8122cdf640 10 monclient: monmap: 2024-02-09T08:03:14.907 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:14.907 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.907 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:03:14.901382+0000 2024-02-09T08:03:14.907 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:03:14.901382+0000 2024-02-09T08:03:14.907 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:14.907 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.907 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:03:14.908 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:03:14.908 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:03:14.908 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:03:14.908 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:03:14.908 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.901+0000 7f8122cdf640 1 Processor -- start 2024-02-09T08:03:14.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.902+0000 7f8122cdf640 1 -- start start 2024-02-09T08:03:14.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.902+0000 7f8122cdf640 10 monclient: init 2024-02-09T08:03:14.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.902+0000 7f8122cdf640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:14.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.903+0000 7f8122cdf640 10 monclient: _add_conns ranks=[1,0,4,3,2] 2024-02-09T08:03:14.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.903+0000 7f8122cdf640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f811c0a9a10 addr v1:172.21.15.103:6789/0 2024-02-09T08:03:14.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.903+0000 7f8122cdf640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f811c0ab0e0 addr v1:172.21.15.62:6789/0 2024-02-09T08:03:14.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.903+0000 7f8122cdf640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f811c072540 0x7f811c0aca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.903+0000 7f8122cdf640 10 monclient(hunting): picked mon.noname-c con 0x7f811c072540 addr v2:172.21.15.103:3300/0 2024-02-09T08:03:14.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.903+0000 7f8122cdf640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f811c0ab630 con 0x7f811c0ab0e0 2024-02-09T08:03:14.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.903+0000 7f8122cdf640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f811c0ab910 con 0x7f811c0a9a10 2024-02-09T08:03:14.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.903+0000 7f8122cdf640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.903+0000 7f8122cdf640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f811c0aa1b0 con 0x7f811c072540 2024-02-09T08:03:14.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.903+0000 7f8122cdf640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:14.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.903+0000 7f8122cdf640 10 monclient(hunting): authenticate will time out at 1438.263328s 2024-02-09T08:03:14.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.903+0000 7fd719d9b640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:14.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.903+0000 7fd719d9b640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:14.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.903+0000 7f7447fff640 1 --2- 172.21.15.62:0/1008769425 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f742c06d1f0 0x7f742c06f6b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f744807ab20 tx=0x7f744808d040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:14.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.903+0000 7f74457fa640 10 client.4342.objecter ms_handle_connect 0x7f742c06d1f0 2024-02-09T08:03:14.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.908+0000 7f81214dc640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f811c0ab0e0 0x7f811c0ac2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34492/0 (socket says 172.21.15.62:34492) 2024-02-09T08:03:14.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.908+0000 7f81214dc640 1 -- 172.21.15.62:0/593585608 learned_addr learned my addr 172.21.15.62:0/593585608 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-09T08:03:14.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.911+0000 7f8120cdb640 1 -- 172.21.15.62:0/593585608 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2484015421 0 0) 0x7f811c0ab630 con 0x7f811c0ab0e0 2024-02-09T08:03:14.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.911+0000 7f8120cdb640 10 monclient(hunting): _negotiate 2024-02-09T08:03:14.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.911+0000 7f8120cdb640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:14.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.911+0000 7f8120cdb640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:14.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.911+0000 7f8120cdb640 10 monclient(hunting): my global_id is 4329 2024-02-09T08:03:14.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.911+0000 7f8120cdb640 1 -- 172.21.15.62:0/593585608 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8108003520 con 0x7f811c0ab0e0 2024-02-09T08:03:14.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.912+0000 7fd71ad9d640 1 --2- 172.21.15.62:0/50553452 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd714169b00 0x7fd714169fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.914+0000 7fd719d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:14.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.914+0000 7fd719d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:14.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.914+0000 7fd719d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:14.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.915+0000 7feab2b8c640 10 monclient: get_monmap_and_config 2024-02-09T08:03:14.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.915+0000 7feab2b8c640 10 monclient: build_initial_monmap 2024-02-09T08:03:14.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.915+0000 7feab2b8c640 10 monclient: monmap: 2024-02-09T08:03:14.917 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:14.918 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.918 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:03:14.916401+0000 2024-02-09T08:03:14.918 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:03:14.916401+0000 2024-02-09T08:03:14.918 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:14.918 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.918 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:03:14.918 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:03:14.918 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:03:14.918 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:03:14.918 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:03:14.918 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.916+0000 7feab2b8c640 1 Processor -- start 2024-02-09T08:03:14.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.916+0000 7feab2b8c640 1 -- start start 2024-02-09T08:03:14.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.916+0000 7feab2b8c640 10 monclient: init 2024-02-09T08:03:14.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.917+0000 7f8120cdb640 1 -- 172.21.15.62:0/593585608 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4180265039 0 0) 0x7f8108003520 con 0x7f811c0ab0e0 2024-02-09T08:03:14.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.917+0000 7f8120cdb640 1 -- 172.21.15.62:0/593585608 >> v2:172.21.15.103:3300/0 conn(0x7f811c072540 msgr2=0x7f811c0aca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:14.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.917+0000 7f8120cdb640 1 --2- 172.21.15.62:0/593585608 >> v2:172.21.15.103:3300/0 conn(0x7f811c072540 0x7f811c0aca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.917+0000 7f8120cdb640 1 -- 172.21.15.62:0/593585608 >> v1:172.21.15.103:6789/0 conn(0x7f811c0a9a10 legacy=0x7f811c071e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:14.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.917+0000 7f8120cdb640 10 monclient: _finish_hunting 0 2024-02-09T08:03:14.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.917+0000 7f8120cdb640 1 monclient: found mon.noname-a-legacy 2024-02-09T08:03:14.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.917+0000 7f8120cdb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:14.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.917+0000 7f8120cdb640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:172.21.15.62:6789/0 2024-02-09T08:03:14.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.917+0000 7f8120cdb640 1 -- 172.21.15.62:0/593585608 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f811c0abbf0 con 0x7f811c0ab0e0 2024-02-09T08:03:14.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.917+0000 7feab2b8c640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:14.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.917+0000 7feab2b8c640 10 monclient: _add_conns ranks=[3,2,4,0,1] 2024-02-09T08:03:14.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.917+0000 7feab2b8c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7feaac0b5000 0x7feaac13f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.917+0000 7feab2b8c640 10 monclient(hunting): picked mon.noname-a con 0x7feaac0b5000 addr v2:172.21.15.62:3300/0 2024-02-09T08:03:14.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.917+0000 7feab2b8c640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feaac0a9e30 0x7feaac13fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.917+0000 7feab2b8c640 10 monclient(hunting): picked mon.noname-b con 0x7feaac0a9e30 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:14.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.917+0000 7feab2b8c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7feaac145de0 0x7feaac1461f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.917+0000 7feab2b8c640 10 monclient(hunting): picked mon.noname-c con 0x7feaac145de0 addr v2:172.21.15.103:3300/0 2024-02-09T08:03:14.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.917+0000 7feab2b8c640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.917+0000 7feab2b8c640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaac140160 con 0x7feaac0b5000 2024-02-09T08:03:14.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.917+0000 7feab2b8c640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.917+0000 7feab2b8c640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaac0b53e0 con 0x7feaac145de0 2024-02-09T08:03:14.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.917+0000 7feab2b8c640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.917+0000 7feab2b8c640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaac0aa4a0 con 0x7feaac0a9e30 2024-02-09T08:03:14.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.917+0000 7feab2b8c640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:14.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.917+0000 7feab2b8c640 10 monclient(hunting): authenticate will time out at 1438.277435s 2024-02-09T08:03:14.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.917+0000 7f8120cdb640 10 monclient: _finish_auth 0 2024-02-09T08:03:14.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.917+0000 7f8120cdb640 10 monclient: _check_auth_tickets 2024-02-09T08:03:14.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.917+0000 7f8120cdb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:14.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.917+0000 7f8122cdf640 5 monclient: authenticate success, global_id 4329 2024-02-09T08:03:14.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.917+0000 7f8122cdf640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-02-09T08:03:14.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.917+0000 7f8120cdb640 1 -- 172.21.15.62:0/593585608 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1140318843 0 0) 0x7f8114001690 con 0x7f811c0ab0e0 2024-02-09T08:03:14.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.917+0000 7f8120cdb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:14.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.917+0000 7f8120cdb640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2024-02-09T08:03:14.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.917+0000 7f8120cdb640 10 monclient: dump: 2024-02-09T08:03:14.923 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:14.923 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.923 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.923 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.924 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:14.924 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.924 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:14.924 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:14.924 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:14.924 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.917+0000 7f8120cdb640 1 monclient: mon.a has (v2) addrs [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] but i'm connected to v1:172.21.15.62:6789/0, reconnecting 2024-02-09T08:03:14.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.917+0000 7f8120cdb640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:14.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.917+0000 7f8120cdb640 1 -- 172.21.15.62:0/593585608 >> v1:172.21.15.62:6789/0 conn(0x7f811c0ab0e0 legacy=0x7f811c0ac2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.917+0000 7f8120cdb640 10 monclient: _add_conns ranks=[0,1,2] 2024-02-09T08:03:14.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.917+0000 7f8120cdb640 1 --2- 172.21.15.62:0/593585608 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81080039c0 0x7f8108003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.917+0000 7f8120cdb640 10 monclient(hunting): picked mon.a con 0x7f81080039c0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:03:14.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.917+0000 7f8120cdb640 1 --2- 172.21.15.62:0/593585608 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81080047c0 0x7f8108004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.917+0000 7f8120cdb640 10 monclient(hunting): picked mon.b con 0x7f81080047c0 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:03:14.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.917+0000 7f8120cdb640 1 --2- 172.21.15.62:0/593585608 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8108005330 0x7f8108005970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.917+0000 7f8120cdb640 10 monclient(hunting): picked mon.c con 0x7f8108005330 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:14.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.917+0000 7f8120cdb640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.917+0000 7f8120cdb640 1 -- 172.21.15.62:0/593585608 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8108006220 con 0x7f81080039c0 2024-02-09T08:03:14.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.917+0000 7f8120cdb640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.917+0000 7f8120cdb640 1 -- 172.21.15.62:0/593585608 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8108006390 con 0x7f81080047c0 2024-02-09T08:03:14.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.917+0000 7f8120cdb640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.917+0000 7f8120cdb640 1 -- 172.21.15.62:0/593585608 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8108006550 con 0x7f8108005330 2024-02-09T08:03:14.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.917+0000 7f8120cdb640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:14.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.917+0000 7f8120cdb640 10 monclient(hunting): _finish_auth 0 2024-02-09T08:03:14.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.917+0000 7f8122cdf640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2024-02-09T08:03:14.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.918+0000 7fd71ad9d640 10 monclient(hunting): get_auth_request con 0x7fd714169b00 auth_method 0 2024-02-09T08:03:14.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.918+0000 7fd71ad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:14.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.918+0000 7fd71ad9d640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:14.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.918+0000 7fd71ad9d640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:14.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.918+0000 7fd71ad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:14.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.918+0000 7fd71ad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:14.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.918+0000 7fd71ad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:14.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.924+0000 7f89bf5b0640 10 monclient: get_monmap_and_config 2024-02-09T08:03:14.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.924+0000 7f89bf5b0640 10 monclient: build_initial_monmap 2024-02-09T08:03:14.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.924+0000 7f89bf5b0640 10 monclient: monmap: 2024-02-09T08:03:14.927 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:14.927 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.927 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:03:14.925379+0000 2024-02-09T08:03:14.927 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:03:14.925379+0000 2024-02-09T08:03:14.927 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:14.927 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.927 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:03:14.927 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:03:14.927 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:03:14.927 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:03:14.927 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:03:14.928 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.924+0000 7f89bf5b0640 1 Processor -- start 2024-02-09T08:03:14.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.925+0000 7f89bf5b0640 1 -- start start 2024-02-09T08:03:14.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.925+0000 7fd71ad9d640 10 monclient(hunting): handle_auth_done global_id 4332 payload 824 2024-02-09T08:03:14.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.925+0000 7f89bf5b0640 10 monclient: init 2024-02-09T08:03:14.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.925+0000 7fd71ad9d640 1 -- 172.21.15.62:0/50553452 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd7140349b0 msgr2=0x7fd71402e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.925+0000 7fd71ad9d640 1 --2- 172.21.15.62:0/50553452 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd7140349b0 0x7fd71402e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.925+0000 7fd71ad9d640 1 -- 172.21.15.62:0/50553452 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd714031fc0 msgr2=0x7fd71402c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.925+0000 7fd71ad9d640 1 --2- 172.21.15.62:0/50553452 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd714031fc0 0x7fd71402c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.925+0000 7fd71ad9d640 10 monclient: _finish_hunting 0 2024-02-09T08:03:14.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.925+0000 7fd71ad9d640 1 monclient: found mon.noname-a 2024-02-09T08:03:14.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.925+0000 7fd71ad9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:14.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.925+0000 7fd71ad9d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-02-09T08:03:14.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.925+0000 7fd71ad9d640 1 -- 172.21.15.62:0/50553452 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd710009400 con 0x7fd714169b00 2024-02-09T08:03:14.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.926+0000 7f89bf5b0640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:14.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.926+0000 7f89bf5b0640 10 monclient: _add_conns ranks=[3,0,1,4,2] 2024-02-09T08:03:14.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.926+0000 7f89bf5b0640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f89b80b5000 0x7f89b813f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.926+0000 7f89bf5b0640 10 monclient(hunting): picked mon.noname-a con 0x7f89b80b5000 addr v2:172.21.15.62:3300/0 2024-02-09T08:03:14.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.926+0000 7f89bf5b0640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f89b80a9e30 addr v1:172.21.15.62:6789/0 2024-02-09T08:03:14.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.926+0000 7f89bf5b0640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f89b81464f0 addr v1:172.21.15.103:6789/0 2024-02-09T08:03:14.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.926+0000 7f89bf5b0640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89b80aa4a0 con 0x7f89b80a9e30 2024-02-09T08:03:14.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.926+0000 7f89bf5b0640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89b80b2900 con 0x7f89b81464f0 2024-02-09T08:03:14.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.926+0000 7f89bf5b0640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.926+0000 7f89bf5b0640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89b80b53e0 con 0x7f89b80b5000 2024-02-09T08:03:14.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.926+0000 7f89bf5b0640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:14.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.926+0000 7f89bf5b0640 10 monclient(hunting): authenticate will time out at 1438.287185s 2024-02-09T08:03:14.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.930+0000 7fee4962d640 10 monclient: get_monmap_and_config 2024-02-09T08:03:14.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.930+0000 7fee4962d640 10 monclient: build_initial_monmap 2024-02-09T08:03:14.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.930+0000 7fee4962d640 10 monclient: monmap: 2024-02-09T08:03:14.933 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:14.933 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.933 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:03:14.931102+0000 2024-02-09T08:03:14.933 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:03:14.931102+0000 2024-02-09T08:03:14.933 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:14.934 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.934 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:03:14.934 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:03:14.934 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:03:14.934 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:03:14.934 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:03:14.934 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.930+0000 7fee4962d640 1 Processor -- start 2024-02-09T08:03:14.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.930+0000 7fd71ad9d640 1 --2- 172.21.15.62:0/50553452 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd714169b00 0x7fd714169fb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd710033000 tx=0x7fd7100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:14.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.930+0000 7fd70affd640 10 client.?.objecter ms_handle_connect 0x7fd714169b00 2024-02-09T08:03:14.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.930+0000 7fd70affd640 10 client.?.objecter resend_mon_ops 2024-02-09T08:03:14.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.930+0000 7fee4962d640 1 -- start start 2024-02-09T08:03:14.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.930+0000 7fee4962d640 10 monclient: init 2024-02-09T08:03:14.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.931+0000 7fee4962d640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:14.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.931+0000 7fee4962d640 10 monclient: _add_conns ranks=[4,3,2,0,1] 2024-02-09T08:03:14.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.931+0000 7fee4962d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fee440b5000 0x7fee4413f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.931+0000 7fee4962d640 10 monclient(hunting): picked mon.noname-c con 0x7fee440b5000 addr v2:172.21.15.103:3300/0 2024-02-09T08:03:14.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.931+0000 7fee4962d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fee440a9e30 0x7fee4413fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.931+0000 7fee4962d640 10 monclient(hunting): picked mon.noname-a con 0x7fee440a9e30 addr v2:172.21.15.62:3300/0 2024-02-09T08:03:14.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.931+0000 7fee4962d640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fee44145de0 0x7fee44146250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.931+0000 7fee4962d640 10 monclient(hunting): picked mon.noname-b con 0x7fee44145de0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:14.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.931+0000 7fee4962d640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.931+0000 7fee4962d640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee44140160 con 0x7fee440a9e30 2024-02-09T08:03:14.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.931+0000 7fee4962d640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.931+0000 7fee4962d640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee440b53e0 con 0x7fee440b5000 2024-02-09T08:03:14.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.931+0000 7fee4962d640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.931+0000 7fee4962d640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee440aa4a0 con 0x7fee44145de0 2024-02-09T08:03:14.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.931+0000 7fee4962d640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:14.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.931+0000 7fee4962d640 10 monclient(hunting): authenticate will time out at 1438.291848s 2024-02-09T08:03:14.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.933+0000 7fdfc17fa640 1 -- 172.21.15.62:0/1129173437 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fdfb8045400 con 0x7fdfc413fdf0 2024-02-09T08:03:14.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.933+0000 7fdfc17fa640 1 --2- 172.21.15.62:0/1129173437 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fdfb006d220 0x7fdfb006f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.933+0000 7fdfc8c31640 1 --2- 172.21.15.62:0/1129173437 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fdfb006d220 0x7fdfb006f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.933+0000 7fdfc8c31640 10 monclient: get_auth_request con 0x7fdfb006d220 auth_method 0 2024-02-09T08:03:14.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.934+0000 7fdfc8c31640 1 --2- 172.21.15.62:0/1129173437 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fdfb006d220 0x7fdfb006f6e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdfb40015f0 tx=0x7fdfb4007a40 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:14.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.934+0000 7fdfc17fa640 10 client.4313.objecter ms_handle_connect 0x7fdfb006d220 2024-02-09T08:03:14.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.935+0000 7feab0928640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7feaac0b5000 0x7feaac13f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.935+0000 7feab0928640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7feaac0b5000 0x7feaac13f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:34936/0 (socket says 172.21.15.62:34936) 2024-02-09T08:03:14.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.935+0000 7feab0928640 1 -- 172.21.15.62:0/1640482395 learned_addr learned my addr 172.21.15.62:0/1640482395 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:14.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.935+0000 7feab0928640 10 monclient(hunting): get_auth_request con 0x7feaac0b5000 auth_method 0 2024-02-09T08:03:14.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.935+0000 7feab0928640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:14.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.935+0000 7feab0928640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:14.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.935+0000 7feab0928640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:14.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.936+0000 7feab0928640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:14.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.936+0000 7feab0928640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:14.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.936+0000 7feab0928640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:14.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.938+0000 7feab0928640 10 monclient(hunting): handle_auth_done global_id 4335 payload 274 2024-02-09T08:03:14.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.938+0000 7feab0928640 1 -- 172.21.15.62:0/1640482395 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feaac0a9e30 msgr2=0x7feaac13fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:14.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.938+0000 7feab0928640 1 --2- 172.21.15.62:0/1640482395 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feaac0a9e30 0x7feaac13fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.938+0000 7feab0928640 1 -- 172.21.15.62:0/1640482395 >> v2:172.21.15.103:3300/0 conn(0x7feaac145de0 msgr2=0x7feaac1461f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:14.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.938+0000 7feab0928640 1 --2- 172.21.15.62:0/1640482395 >> v2:172.21.15.103:3300/0 conn(0x7feaac145de0 0x7feaac1461f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.938+0000 7feab0928640 10 monclient: _finish_hunting 0 2024-02-09T08:03:14.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.938+0000 7feab0928640 1 monclient: found mon.noname-a 2024-02-09T08:03:14.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.938+0000 7feab0928640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:14.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.938+0000 7feab0928640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-02-09T08:03:14.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.938+0000 7feab0928640 1 -- 172.21.15.62:0/1640482395 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaac0b2900 con 0x7feaac0b5000 2024-02-09T08:03:14.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.940+0000 7feab0928640 1 --2- 172.21.15.62:0/1640482395 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feaac0b5000 0x7feaac13f6e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7feaac0b27b0 tx=0x7feaa002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed18d1debc954b27 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:14.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.944+0000 7feaab7fe640 1 -- 172.21.15.62:0/1640482395 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa00317c0 con 0x7feaac0b5000 2024-02-09T08:03:14.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.944+0000 7feaab7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:14.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.944+0000 7feaab7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-09T08:03:14.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.944+0000 7feaab7fe640 10 monclient: dump: 2024-02-09T08:03:14.947 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:14.947 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.947 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.947 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.947 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:14.947 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.947 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:14.947 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:14.947 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:14.948 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.944+0000 7feaab7fe640 10 monclient: _finish_auth 0 2024-02-09T08:03:14.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.944+0000 7feaab7fe640 10 monclient: _check_auth_tickets 2024-02-09T08:03:14.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.944+0000 7feaab7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:14.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.944+0000 7feaab7fe640 1 -- 172.21.15.62:0/1640482395 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa0031920 con 0x7feaac0b5000 2024-02-09T08:03:14.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.944+0000 7feaab7fe640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:14.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.944+0000 7feaab7fe640 1 -- 172.21.15.62:0/1640482395 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa0031cb0 con 0x7feaac0b5000 2024-02-09T08:03:14.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.944+0000 7feaab7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:14.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.944+0000 7feaab7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-09T08:03:14.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.944+0000 7f89bd34c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f89b80b5000 0x7f89b813f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.944+0000 7feaab7fe640 10 monclient: dump: 2024-02-09T08:03:14.950 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:14.950 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.950 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.950 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.950 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:14.950 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.950 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:14.950 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:14.950 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:14.950 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.944+0000 7feab2b8c640 5 monclient: authenticate success, global_id 4335 2024-02-09T08:03:14.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.944+0000 7feab2b8c640 10 monclient: get_monmap_and_config success 2024-02-09T08:03:14.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.944+0000 7feab2b8c640 4 set_mon_vals no callback set 2024-02-09T08:03:14.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.945+0000 7f89bd34c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f89b80b5000 0x7f89b813f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:34952/0 (socket says 172.21.15.62:34952) 2024-02-09T08:03:14.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.945+0000 7f89bd34c640 1 -- 172.21.15.62:0/1410406586 learned_addr learned my addr 172.21.15.62:0/1410406586 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:14.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.945+0000 7f89bd34c640 10 monclient(hunting): get_auth_request con 0x7f89b80b5000 auth_method 0 2024-02-09T08:03:14.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.945+0000 7f89bd34c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:14.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.945+0000 7f89bd34c640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:14.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.945+0000 7f89bd34c640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:14.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.945+0000 7feab2b8c640 10 monclient: shutdown 2024-02-09T08:03:14.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.945+0000 7feab2b8c640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:14.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.945+0000 7feab2b8c640 1 -- 172.21.15.62:0/1640482395 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feaac0b5000 msgr2=0x7feaac13f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.945+0000 7feab2b8c640 1 --2- 172.21.15.62:0/1640482395 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feaac0b5000 0x7feaac13f6e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7feaac0b27b0 tx=0x7feaa002b860 comp rx=0 tx=0).stop 2024-02-09T08:03:14.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.945+0000 7feab2b8c640 1 -- 172.21.15.62:0/1640482395 shutdown_connections 2024-02-09T08:03:14.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.945+0000 7feab2b8c640 1 --2- 172.21.15.62:0/1640482395 >> v2:172.21.15.103:3300/0 conn(0x7feaac145de0 0x7feaac1461f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.945+0000 7feab2b8c640 1 --2- 172.21.15.62:0/1640482395 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feaac0a9e30 0x7feaac13fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.945+0000 7feab2b8c640 1 --2- 172.21.15.62:0/1640482395 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feaac0b5000 0x7feaac13f6e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.945+0000 7feab2b8c640 1 -- 172.21.15.62:0/1640482395 >> 172.21.15.62:0/1640482395 conn(0x7feaac066bb0 msgr2=0x7feaac066fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:14.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.945+0000 7f89bd34c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:14.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.945+0000 7f89bd34c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:14.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.945+0000 7f89bd34c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:14.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.945+0000 7feab2b8c640 1 -- 172.21.15.62:0/1640482395 shutdown_connections 2024-02-09T08:03:14.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.945+0000 7feab2b8c640 1 -- 172.21.15.62:0/1640482395 wait complete. 2024-02-09T08:03:14.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.946+0000 7feab2b8c640 10 monclient: build_initial_monmap 2024-02-09T08:03:14.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.946+0000 7feab2b8c640 10 monclient: monmap: 2024-02-09T08:03:14.955 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:14.955 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:03:14.955 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:03:14.955 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:03:14.955 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:14.955 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.955 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:03:14.955 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:03:14.955 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:03:14.955 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.947+0000 7feab2b8c640 1 librados: starting msgr at 2024-02-09T08:03:14.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.947+0000 7feab2b8c640 1 librados: starting objecter 2024-02-09T08:03:14.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.947+0000 7feab2b8c640 1 Processor -- start 2024-02-09T08:03:14.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.947+0000 7feab2b8c640 1 -- start start 2024-02-09T08:03:14.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.947+0000 7feab2b8c640 1 librados: setting wanted keys 2024-02-09T08:03:14.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.947+0000 7feab2b8c640 1 librados: calling monclient init 2024-02-09T08:03:14.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.947+0000 7feab2b8c640 10 monclient: init 2024-02-09T08:03:14.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.948+0000 7feab2b8c640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:14.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.948+0000 7feab2b8c640 10 monclient: _add_conns ranks=[1,2,0] 2024-02-09T08:03:14.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.948+0000 7feab2b8c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feaac0a9e30 0x7feaac06d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.948+0000 7feab2b8c640 10 monclient(hunting): picked mon.noname-b con 0x7feaac0a9e30 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:03:14.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.948+0000 7feab2b8c640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feaac0b5000 0x7feaac0706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.948+0000 7feab2b8c640 10 monclient(hunting): picked mon.noname-c con 0x7feaac0b5000 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:14.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.948+0000 7feab2b8c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feaac145de0 0x7feaac06f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.948+0000 7feab2b8c640 10 monclient(hunting): picked mon.noname-a con 0x7feaac145de0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:03:14.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.948+0000 7feab2b8c640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.948+0000 7feab2b8c640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaac06d720 con 0x7feaac145de0 2024-02-09T08:03:14.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.948+0000 7feab2b8c640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.948+0000 7feab2b8c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaac070c30 con 0x7feaac0a9e30 2024-02-09T08:03:14.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.948+0000 7feab2b8c640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.948+0000 7feab2b8c640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaac06ebd0 con 0x7feaac0b5000 2024-02-09T08:03:14.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.948+0000 7feab2b8c640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:14.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.948+0000 7feab2b8c640 10 monclient(hunting): authenticate will time out at 1438.308684s 2024-02-09T08:03:14.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.949+0000 7f89bd34c640 10 monclient(hunting): handle_auth_done global_id 4338 payload 274 2024-02-09T08:03:14.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.949+0000 7f89bd34c640 1 -- 172.21.15.62:0/1410406586 >> v1:172.21.15.103:6789/0 conn(0x7f89b81464f0 legacy=0x7f89b814cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:14.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.949+0000 7f89bd34c640 1 -- 172.21.15.62:0/1410406586 >> v1:172.21.15.62:6789/0 conn(0x7f89b80a9e30 legacy=0x7f89b8145de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:14.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.949+0000 7f89bd34c640 10 monclient: _finish_hunting 0 2024-02-09T08:03:14.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.949+0000 7f89bd34c640 1 monclient: found mon.noname-a 2024-02-09T08:03:14.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.949+0000 7f89bd34c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:14.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.949+0000 7f89bd34c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-02-09T08:03:14.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.949+0000 7f89bd34c640 1 -- 172.21.15.62:0/1410406586 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b80ab5f0 con 0x7f89b80b5000 2024-02-09T08:03:14.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.950+0000 7fee427fc640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fee440a9e30 0x7fee4413fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.950+0000 7fd70affd640 1 -- 172.21.15.62:0/50553452 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd710032bd0 con 0x7fd714169b00 2024-02-09T08:03:14.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.950+0000 7fd70affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:14.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.950+0000 7fd70affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-09T08:03:14.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.950+0000 7fd70affd640 10 monclient: dump: 2024-02-09T08:03:14.959 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:14.959 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.960 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.960 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.960 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:14.960 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.960 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:14.960 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:14.960 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:14.960 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.950+0000 7fd70affd640 10 monclient: _finish_auth 0 2024-02-09T08:03:14.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.950+0000 7fd70affd640 10 monclient: _check_auth_tickets 2024-02-09T08:03:14.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.950+0000 7fd70affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:14.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.950+0000 7fd71b59e640 5 monclient: authenticate success, global_id 4332 2024-02-09T08:03:14.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.950+0000 7fd71b59e640 10 monclient: _renew_subs 2024-02-09T08:03:14.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.950+0000 7fd71b59e640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:03:14.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.950+0000 7fd71b59e640 1 -- 172.21.15.62:0/50553452 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7140328c0 con 0x7fd714169b00 2024-02-09T08:03:14.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.950+0000 7fd71b59e640 10 client.4332.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:03:14.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.950+0000 7fd71b59e640 10 monclient: _renew_subs 2024-02-09T08:03:14.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.950+0000 7fd71b59e640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:03:14.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.950+0000 7fd71b59e640 1 -- 172.21.15.62:0/50553452 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd71402dd50 con 0x7fd714169b00 2024-02-09T08:03:14.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.950+0000 7fd71b59e640 1 librados: init done 2024-02-09T08:03:14.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.950+0000 7fd70affd640 1 -- 172.21.15.62:0/50553452 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd710032d50 con 0x7fd714169b00 2024-02-09T08:03:14.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.950+0000 7fd70affd640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:14.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.950+0000 7fd70affd640 1 -- 172.21.15.62:0/50553452 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd710045640 con 0x7fd714169b00 2024-02-09T08:03:14.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.950+0000 7fd70affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:14.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.950+0000 7fd70affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-09T08:03:14.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.950+0000 7fd70affd640 10 monclient: dump: 2024-02-09T08:03:14.961 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:14.961 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.961 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.961 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.962 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:14.962 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.962 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:14.962 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:14.962 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:14.962 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.950+0000 7fd718d99640 4 set_mon_vals no callback set 2024-02-09T08:03:14.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.951+0000 7f8121cdd640 1 --2- 172.21.15.62:0/593585608 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81080039c0 0x7f8108003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:14.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.951+0000 7fee427fc640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fee440a9e30 0x7fee4413fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:34962/0 (socket says 172.21.15.62:34962) 2024-02-09T08:03:14.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.951+0000 7fee427fc640 1 -- 172.21.15.62:0/2352036977 learned_addr learned my addr 172.21.15.62:0/2352036977 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:14.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.951+0000 7fee427fc640 10 monclient(hunting): get_auth_request con 0x7fee440a9e30 auth_method 0 2024-02-09T08:03:14.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.951+0000 7fee427fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:14.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.951+0000 7fee427fc640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:14.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.951+0000 7fd71b59e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:14.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.951+0000 7fd71b59e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:14.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.951+0000 7fd71b59e640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:03:14.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.951+0000 7fee427fc640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:14.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.951+0000 7fd71b59e640 1 -- 172.21.15.62:0/50553452 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd700005080 con 0x7fd714169b00 2024-02-09T08:03:14.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.952+0000 7fee427fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:14.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.952+0000 7fee427fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:14.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.952+0000 7fee427fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:14.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.954+0000 7f8121cdd640 10 monclient(hunting): get_auth_request con 0x7f81080039c0 auth_method 0 2024-02-09T08:03:14.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.954+0000 7f8121cdd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:14.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.954+0000 7f8121cdd640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:14.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.954+0000 7f8121cdd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-02-09T08:03:14.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.956+0000 7f89bd34c640 1 --2- 172.21.15.62:0/1410406586 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89b80b5000 0x7f89b813f6e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f89b4009870 tx=0x7f89b402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22edcc7e48623d8c server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:14.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.958+0000 7fee427fc640 10 monclient(hunting): handle_auth_done global_id 4341 payload 274 2024-02-09T08:03:14.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.958+0000 7fee427fc640 1 -- 172.21.15.62:0/2352036977 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fee44145de0 msgr2=0x7fee44146250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:14.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.958+0000 7fee427fc640 1 --2- 172.21.15.62:0/2352036977 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fee44145de0 0x7fee44146250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.958+0000 7fee427fc640 1 -- 172.21.15.62:0/2352036977 >> v2:172.21.15.103:3300/0 conn(0x7fee440b5000 msgr2=0x7fee4413f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:14.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.958+0000 7fee427fc640 1 --2- 172.21.15.62:0/2352036977 >> v2:172.21.15.103:3300/0 conn(0x7fee440b5000 0x7fee4413f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.958+0000 7fee427fc640 10 monclient: _finish_hunting 0 2024-02-09T08:03:14.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.958+0000 7fee427fc640 1 monclient: found mon.noname-a 2024-02-09T08:03:14.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.958+0000 7fee427fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:14.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.958+0000 7fee427fc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-02-09T08:03:14.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.958+0000 7fee427fc640 1 -- 172.21.15.62:0/2352036977 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee440b2900 con 0x7fee440a9e30 2024-02-09T08:03:14.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.961+0000 7f8121cdd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:14.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.961+0000 7f8121cdd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:14.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.962+0000 7f8121cdd640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-02-09T08:03:14.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.963+0000 7fdfc17fa640 1 -- 172.21.15.62:0/1129173437 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fdfb807b7c0 con 0x7fdfc413fdf0 2024-02-09T08:03:14.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.963+0000 7fdfc17fa640 10 client.4313.objecter ms_dispatch 0x7fdfc4000b90 osd_map(26..26 src has 1..26) v4 2024-02-09T08:03:14.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.963+0000 7fdfc17fa640 3 client.4313.objecter handle_osd_map got epochs [26,26] > 0 2024-02-09T08:03:14.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.963+0000 7fdfc17fa640 3 client.4313.objecter handle_osd_map decoding full epoch 26 2024-02-09T08:03:14.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.963+0000 7fdfc17fa640 20 client.4313.objecter dump_active .. 0 homeless 2024-02-09T08:03:14.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.964+0000 7fee427fc640 1 --2- 172.21.15.62:0/2352036977 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee440a9e30 0x7fee4413fc20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fee440b56c0 tx=0x7fee3802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaf61325d6f1be22 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:14.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.964+0000 7f89affff640 1 -- 172.21.15.62:0/1410406586 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b40317e0 con 0x7f89b80b5000 2024-02-09T08:03:14.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.964+0000 7f89affff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:14.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.964+0000 7f89affff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-09T08:03:14.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.964+0000 7f89affff640 10 monclient: dump: 2024-02-09T08:03:14.973 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:14.973 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.973 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.973 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.973 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:14.973 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.973 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:14.973 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:14.974 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:14.974 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.964+0000 7f89affff640 10 monclient: _finish_auth 0 2024-02-09T08:03:14.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.964+0000 7f89affff640 10 monclient: _check_auth_tickets 2024-02-09T08:03:14.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.964+0000 7f89affff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:14.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.964+0000 7f89affff640 1 -- 172.21.15.62:0/1410406586 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89b4031940 con 0x7f89b80b5000 2024-02-09T08:03:14.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.964+0000 7f89bf5b0640 5 monclient: authenticate success, global_id 4338 2024-02-09T08:03:14.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.964+0000 7f89bf5b0640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-02-09T08:03:14.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.964+0000 7f89affff640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:14.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.964+0000 7f89affff640 1 -- 172.21.15.62:0/1410406586 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b4031cd0 con 0x7f89b80b5000 2024-02-09T08:03:14.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.964+0000 7f89bf5b0640 10 monclient: get_monmap_and_config success 2024-02-09T08:03:14.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.964+0000 7f89bf5b0640 4 set_mon_vals no callback set 2024-02-09T08:03:14.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.965+0000 7f89bf5b0640 10 monclient: shutdown 2024-02-09T08:03:14.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.965+0000 7f89affff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:14.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.965+0000 7f89affff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-09T08:03:14.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.965+0000 7f89affff640 10 monclient: dump: 2024-02-09T08:03:14.975 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:14.975 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.975 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.975 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.975 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:14.975 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.975 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:14.975 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:14.976 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:14.976 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.965+0000 7f89bf5b0640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:14.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.965+0000 7f89bf5b0640 1 -- 172.21.15.62:0/1410406586 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89b80b5000 msgr2=0x7f89b813f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.965+0000 7f89bf5b0640 1 --2- 172.21.15.62:0/1410406586 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89b80b5000 0x7f89b813f6e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f89b4009870 tx=0x7f89b402b880 comp rx=0 tx=0).stop 2024-02-09T08:03:14.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.965+0000 7f89bf5b0640 1 -- 172.21.15.62:0/1410406586 shutdown_connections 2024-02-09T08:03:14.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.965+0000 7f89bf5b0640 1 --2- 172.21.15.62:0/1410406586 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89b80b5000 0x7f89b813f6e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.966+0000 7f89bf5b0640 1 -- 172.21.15.62:0/1410406586 >> 172.21.15.62:0/1410406586 conn(0x7f89b8066bb0 msgr2=0x7f89b8066fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:14.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.966+0000 7f89bf5b0640 1 -- 172.21.15.62:0/1410406586 shutdown_connections 2024-02-09T08:03:14.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.966+0000 7f89bf5b0640 1 -- 172.21.15.62:0/1410406586 wait complete. 2024-02-09T08:03:14.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.967+0000 7f89bf5b0640 10 monclient: build_initial_monmap 2024-02-09T08:03:14.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.967+0000 7f89bf5b0640 10 monclient: monmap: 2024-02-09T08:03:14.977 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:14.977 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:03:14.977 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:03:14.977 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:03:14.977 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:14.977 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.977 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:03:14.977 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:03:14.977 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:03:14.977 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.967+0000 7f8121cdd640 10 monclient(hunting): handle_auth_done global_id 4329 payload 293 2024-02-09T08:03:14.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.967+0000 7f8121cdd640 1 -- 172.21.15.62:0/593585608 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8108005330 msgr2=0x7f8108005970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:14.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.967+0000 7f8121cdd640 1 --2- 172.21.15.62:0/593585608 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8108005330 0x7f8108005970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.967+0000 7f8121cdd640 1 -- 172.21.15.62:0/593585608 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81080047c0 msgr2=0x7f8108004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:14.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.967+0000 7f8121cdd640 1 --2- 172.21.15.62:0/593585608 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81080047c0 0x7f8108004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.967+0000 7f8121cdd640 10 monclient: _finish_hunting 0 2024-02-09T08:03:14.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.967+0000 7f8121cdd640 1 monclient: found mon.a 2024-02-09T08:03:14.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.967+0000 7f8121cdd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:14.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.967+0000 7f8121cdd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:03:14.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.967+0000 7f8121cdd640 1 -- 172.21.15.62:0/593585608 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8108003520 con 0x7f81080039c0 2024-02-09T08:03:14.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.967+0000 7f8121cdd640 10 monclient: _finish_auth 0 2024-02-09T08:03:14.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.967+0000 7f8121cdd640 10 monclient: _check_auth_tickets 2024-02-09T08:03:14.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.967+0000 7f8121cdd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:14.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.967+0000 7f81224de640 1 -- 172.21.15.62:0/593585608 reap_dead start 2024-02-09T08:03:14.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.968+0000 7f89bf5b0640 1 librados: starting msgr at 2024-02-09T08:03:14.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.968+0000 7f89bf5b0640 1 librados: starting objecter 2024-02-09T08:03:14.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.968+0000 7f89bf5b0640 1 Processor -- start 2024-02-09T08:03:14.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.968+0000 7f89bf5b0640 1 -- start start 2024-02-09T08:03:14.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.968+0000 7f89bf5b0640 1 librados: setting wanted keys 2024-02-09T08:03:14.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.968+0000 7f89bf5b0640 1 librados: calling monclient init 2024-02-09T08:03:14.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.968+0000 7f89bf5b0640 10 monclient: init 2024-02-09T08:03:14.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.969+0000 7f89bf5b0640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:14.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.969+0000 7f89bf5b0640 10 monclient: _add_conns ranks=[2,0,1] 2024-02-09T08:03:14.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.969+0000 7f89bf5b0640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f89b80a9e30 0x7f89b81453a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.969+0000 7f89bf5b0640 10 monclient(hunting): picked mon.noname-c con 0x7f89b80a9e30 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:14.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.970+0000 7f89bf5b0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89b80b5000 0x7f89b8140530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.970+0000 7f89bf5b0640 10 monclient(hunting): picked mon.noname-a con 0x7f89b80b5000 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:03:14.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.970+0000 7f89bf5b0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89b81464f0 0x7f89b81dad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.970+0000 7f89bf5b0640 10 monclient(hunting): picked mon.noname-b con 0x7f89b81464f0 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:03:14.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.970+0000 7f89bf5b0640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.970+0000 7f89bf5b0640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b8134d50 con 0x7f89b80b5000 2024-02-09T08:03:14.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.970+0000 7f89bf5b0640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.970+0000 7f89bf5b0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b8141460 con 0x7f89b81464f0 2024-02-09T08:03:14.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.970+0000 7f89bf5b0640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.970+0000 7f89bf5b0640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89b8141740 con 0x7f89b80a9e30 2024-02-09T08:03:14.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.970+0000 7f89bf5b0640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:14.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.971+0000 7f89bf5b0640 10 monclient(hunting): authenticate will time out at 1438.331267s 2024-02-09T08:03:14.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.974+0000 7fee41ffb640 1 -- 172.21.15.62:0/2352036977 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee380317c0 con 0x7fee440a9e30 2024-02-09T08:03:14.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.974+0000 7fee41ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:14.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.974+0000 7fee41ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-09T08:03:14.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.974+0000 7fee41ffb640 10 monclient: dump: 2024-02-09T08:03:14.985 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:14.986 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.986 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.986 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.986 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:14.986 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.986 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:14.986 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:14.986 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:14.986 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.974+0000 7fee41ffb640 10 monclient: _finish_auth 0 2024-02-09T08:03:14.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.974+0000 7fee41ffb640 10 monclient: _check_auth_tickets 2024-02-09T08:03:14.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.974+0000 7fee41ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:14.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.974+0000 7fee41ffb640 1 -- 172.21.15.62:0/2352036977 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee38031920 con 0x7fee440a9e30 2024-02-09T08:03:14.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.974+0000 7fee41ffb640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:14.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.974+0000 7fee41ffb640 1 -- 172.21.15.62:0/2352036977 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee38031cb0 con 0x7fee440a9e30 2024-02-09T08:03:14.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.974+0000 7fee41ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:14.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.974+0000 7fee41ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-09T08:03:14.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.974+0000 7fee41ffb640 10 monclient: dump: 2024-02-09T08:03:14.987 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:14.987 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.987 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.987 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:14.988 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:14.988 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.988 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:14.988 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:14.988 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:14.988 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.974+0000 7fee4962d640 5 monclient: authenticate success, global_id 4341 2024-02-09T08:03:14.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.974+0000 7fee4962d640 10 monclient: get_monmap_and_config success 2024-02-09T08:03:14.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.974+0000 7fee4962d640 4 set_mon_vals no callback set 2024-02-09T08:03:14.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.974+0000 7f8121cdd640 1 --2- 172.21.15.62:0/593585608 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81080039c0 0x7f8108003dc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8118001650 tx=0x7f81080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16791f3dfa001aa0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:14.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.975+0000 7fee4962d640 10 monclient: shutdown 2024-02-09T08:03:14.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.975+0000 7fee4962d640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:14.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.975+0000 7fee4962d640 1 -- 172.21.15.62:0/2352036977 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee440a9e30 msgr2=0x7fee4413fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:14.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.975+0000 7fee4962d640 1 --2- 172.21.15.62:0/2352036977 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee440a9e30 0x7fee4413fc20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fee440b56c0 tx=0x7fee3802b860 comp rx=0 tx=0).stop 2024-02-09T08:03:14.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.975+0000 7fee4962d640 1 -- 172.21.15.62:0/2352036977 shutdown_connections 2024-02-09T08:03:14.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.975+0000 7fee4962d640 1 --2- 172.21.15.62:0/2352036977 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fee44145de0 0x7fee44146250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.975+0000 7fee4962d640 1 --2- 172.21.15.62:0/2352036977 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee440a9e30 0x7fee4413fc20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.975+0000 7fee4962d640 1 --2- 172.21.15.62:0/2352036977 >> v2:172.21.15.103:3300/0 conn(0x7fee440b5000 0x7fee4413f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:14.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.975+0000 7fee4962d640 1 -- 172.21.15.62:0/2352036977 >> 172.21.15.62:0/2352036977 conn(0x7fee44066bb0 msgr2=0x7fee44066fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:14.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.975+0000 7fee4962d640 1 -- 172.21.15.62:0/2352036977 shutdown_connections 2024-02-09T08:03:14.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.975+0000 7fee4962d640 1 -- 172.21.15.62:0/2352036977 wait complete. 2024-02-09T08:03:14.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.976+0000 7fee4962d640 10 monclient: build_initial_monmap 2024-02-09T08:03:14.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.976+0000 7fee4962d640 10 monclient: monmap: 2024-02-09T08:03:14.991 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:14.991 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:03:14.991 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:03:14.991 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:03:14.991 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:14.991 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.991 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:03:14.991 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:03:14.991 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:03:14.991 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.976+0000 7fee4962d640 1 librados: starting msgr at 2024-02-09T08:03:14.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.976+0000 7fee4962d640 1 librados: starting objecter 2024-02-09T08:03:14.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.976+0000 7fee4962d640 1 Processor -- start 2024-02-09T08:03:14.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.976+0000 7fee4962d640 1 -- start start 2024-02-09T08:03:14.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.976+0000 7fee4962d640 1 librados: setting wanted keys 2024-02-09T08:03:14.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.976+0000 7fee4962d640 1 librados: calling monclient init 2024-02-09T08:03:14.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.976+0000 7fee4962d640 10 monclient: init 2024-02-09T08:03:14.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.977+0000 7fee4962d640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:14.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.977+0000 7fee4962d640 10 monclient: _add_conns ranks=[0,2,1] 2024-02-09T08:03:14.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.977+0000 7fee4962d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee440a9e30 0x7fee44145230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.977+0000 7fee4962d640 10 monclient(hunting): picked mon.noname-a con 0x7fee440a9e30 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:03:14.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.977+0000 7fee4962d640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fee440b5000 0x7fee441402c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.977+0000 7fee4962d640 10 monclient(hunting): picked mon.noname-c con 0x7fee440b5000 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:14.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.977+0000 7fee4962d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee44145de0 0x7fee441daf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.978+0000 7fee4962d640 10 monclient(hunting): picked mon.noname-b con 0x7fee44145de0 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:03:14.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.978+0000 7fee4962d640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.978+0000 7fee4962d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4413c690 con 0x7fee440a9e30 2024-02-09T08:03:14.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.978+0000 7fee4962d640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.978+0000 7fee4962d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee44140800 con 0x7fee44145de0 2024-02-09T08:03:14.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.978+0000 7fee4962d640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.978+0000 7fee4962d640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee4413cb70 con 0x7fee440b5000 2024-02-09T08:03:14.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.978+0000 7fee4962d640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:14.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.978+0000 7fee4962d640 10 monclient(hunting): authenticate will time out at 1438.338279s 2024-02-09T08:03:14.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.991+0000 7fcd950de640 10 monclient: get_monmap_and_config 2024-02-09T08:03:14.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.991+0000 7fcd950de640 10 monclient: build_initial_monmap 2024-02-09T08:03:14.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.991+0000 7fcd950de640 10 monclient: monmap: 2024-02-09T08:03:14.994 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:14.994 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:14.994 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:03:14.992808+0000 2024-02-09T08:03:14.994 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:03:14.992808+0000 2024-02-09T08:03:14.994 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:14.994 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:14.994 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:03:14.994 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:03:14.994 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:03:14.994 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:03:14.994 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:03:14.994 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:14.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.992+0000 7fcd950de640 1 Processor -- start 2024-02-09T08:03:14.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.992+0000 7fcd950de640 1 -- start start 2024-02-09T08:03:14.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.992+0000 7fcd950de640 10 monclient: init 2024-02-09T08:03:14.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.993+0000 7fcd950de640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:14.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.993+0000 7fcd950de640 10 monclient: _add_conns ranks=[3,2,4,0,1] 2024-02-09T08:03:14.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.993+0000 7fcd950de640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fcd90067110 0x7fcd900a9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.993+0000 7fcd950de640 10 monclient(hunting): picked mon.noname-a con 0x7fcd90067110 addr v2:172.21.15.62:3300/0 2024-02-09T08:03:14.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.993+0000 7fcd950de640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcd9013f830 0x7fcd9013fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.993+0000 7fcd950de640 10 monclient(hunting): picked mon.noname-b con 0x7fcd9013f830 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:14.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.993+0000 7fcd950de640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fcd901424c0 0x7fcd90142930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:14.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.993+0000 7fcd950de640 10 monclient(hunting): picked mon.noname-c con 0x7fcd901424c0 addr v2:172.21.15.103:3300/0 2024-02-09T08:03:14.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.993+0000 7fcd950de640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.993+0000 7fcd950de640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd900674f0 con 0x7fcd90067110 2024-02-09T08:03:14.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.993+0000 7fcd950de640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.993+0000 7fcd950de640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd900aa090 con 0x7fcd901424c0 2024-02-09T08:03:14.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.993+0000 7fcd950de640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:14.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.993+0000 7fcd950de640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd900ab5b0 con 0x7fcd9013f830 2024-02-09T08:03:14.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.993+0000 7fcd950de640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:14.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:14.993+0000 7fcd950de640 10 monclient(hunting): authenticate will time out at 1438.353427s 2024-02-09T08:03:15.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.120+0000 7f74457fa640 1 -- 172.21.15.62:0/1008769425 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7434076a80 con 0x7f74400bb200 2024-02-09T08:03:15.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.120+0000 7f74457fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:15.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.120+0000 7f74457fa640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:03:15.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.125+0000 7feab0928640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feaac0a9e30 0x7feaac06d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:15.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.125+0000 7feab0928640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feaac0a9e30 0x7feaac06d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.62:40140/0 (socket says 172.21.15.62:40140) 2024-02-09T08:03:15.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.125+0000 7feab0928640 1 -- 172.21.15.62:0/3470205607 learned_addr learned my addr 172.21.15.62:0/3470205607 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:15.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.125+0000 7feab0928640 10 monclient(hunting): get_auth_request con 0x7feaac0a9e30 auth_method 0 2024-02-09T08:03:15.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.125+0000 7feab0928640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:15.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.125+0000 7feab0928640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:15.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.125+0000 7feab0928640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:15.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.126+0000 7feab0928640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:15.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.126+0000 7feab0928640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:15.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.126+0000 7feab0928640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:15.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.129+0000 7feab0928640 10 monclient(hunting): handle_auth_done global_id 4345 payload 824 2024-02-09T08:03:15.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.129+0000 7feab0928640 1 -- 172.21.15.62:0/3470205607 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feaac0b5000 msgr2=0x7feaac0706f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:15.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.129+0000 7feab0928640 1 --2- 172.21.15.62:0/3470205607 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feaac0b5000 0x7feaac0706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:15.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.129+0000 7feab0928640 1 -- 172.21.15.62:0/3470205607 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feaac145de0 msgr2=0x7feaac06f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:15.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.129+0000 7feab0928640 1 --2- 172.21.15.62:0/3470205607 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feaac145de0 0x7feaac06f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:15.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.130+0000 7feab0928640 10 monclient: _finish_hunting 0 2024-02-09T08:03:15.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.130+0000 7feab0928640 1 monclient: found mon.noname-b 2024-02-09T08:03:15.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.130+0000 7feab0928640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:15.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.130+0000 7feab0928640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.103:3300/0 2024-02-09T08:03:15.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.130+0000 7feab0928640 1 -- 172.21.15.62:0/3470205607 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa00094d0 con 0x7feaac0a9e30 2024-02-09T08:03:15.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.133+0000 7feab0928640 1 --2- 172.21.15.62:0/3470205607 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feaac0a9e30 0x7feaac06d0d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7feaa0000c00 tx=0x7feaa00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:15.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.133+0000 7feaa97fa640 10 client.?.objecter ms_handle_connect 0x7feaac0a9e30 2024-02-09T08:03:15.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.133+0000 7feaa97fa640 10 client.?.objecter resend_mon_ops 2024-02-09T08:03:15.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.133+0000 7fee437fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee44145de0 0x7fee441daf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:15.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.137+0000 7fee437fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee44145de0 0x7fee441daf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.62:40166/0 (socket says 172.21.15.62:40166) 2024-02-09T08:03:15.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.137+0000 7fee437fe640 1 -- 172.21.15.62:0/2667695348 learned_addr learned my addr 172.21.15.62:0/2667695348 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:15.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.137+0000 7fee437fe640 10 monclient(hunting): get_auth_request con 0x7fee44145de0 auth_method 0 2024-02-09T08:03:15.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.137+0000 7fee437fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:15.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.137+0000 7fee437fe640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:15.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.137+0000 7fee437fe640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:15.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.137+0000 7fcd8f59e640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fcd901424c0 0x7fcd90142930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:15.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.138+0000 7fcd8f59e640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fcd901424c0 0x7fcd90142930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.62:40174/0 (socket says 172.21.15.62:40174) 2024-02-09T08:03:15.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.138+0000 7fcd8f59e640 1 -- 172.21.15.62:0/1106891483 learned_addr learned my addr 172.21.15.62:0/1106891483 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:15.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.138+0000 7fcd8f59e640 10 monclient(hunting): get_auth_request con 0x7fcd901424c0 auth_method 0 2024-02-09T08:03:15.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.138+0000 7fcd8f59e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:15.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.138+0000 7fcd8f59e640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:15.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.138+0000 7fcd8f59e640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:15.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.138+0000 7fee437fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:15.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.138+0000 7fee437fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:15.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.138+0000 7fee437fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:15.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.139+0000 7f89bdb4d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89b81464f0 0x7f89b81dad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:15.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.139+0000 7f89bdb4d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89b81464f0 0x7f89b81dad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.62:40154/0 (socket says 172.21.15.62:40154) 2024-02-09T08:03:15.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.139+0000 7f89bdb4d640 1 -- 172.21.15.62:0/2185403171 learned_addr learned my addr 172.21.15.62:0/2185403171 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:15.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.139+0000 7f89bdb4d640 10 monclient(hunting): get_auth_request con 0x7f89b81464f0 auth_method 0 2024-02-09T08:03:15.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.139+0000 7f89bdb4d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:15.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.139+0000 7f89bdb4d640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:15.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.139+0000 7f89bdb4d640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:15.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.140+0000 7fcd8f59e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:15.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.140+0000 7fcd8f59e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:15.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.140+0000 7fcd8f59e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:15.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.142+0000 7fee437fe640 10 monclient(hunting): handle_auth_done global_id 4348 payload 824 2024-02-09T08:03:15.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.142+0000 7fee437fe640 1 -- 172.21.15.62:0/2667695348 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fee440b5000 msgr2=0x7fee441402c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:15.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.142+0000 7fee437fe640 1 --2- 172.21.15.62:0/2667695348 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fee440b5000 0x7fee441402c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:15.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.142+0000 7fee437fe640 1 -- 172.21.15.62:0/2667695348 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee440a9e30 msgr2=0x7fee44145230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:15.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.142+0000 7fee437fe640 1 --2- 172.21.15.62:0/2667695348 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee440a9e30 0x7fee44145230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:15.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.142+0000 7fee437fe640 10 monclient: _finish_hunting 0 2024-02-09T08:03:15.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.142+0000 7fee437fe640 1 monclient: found mon.noname-b 2024-02-09T08:03:15.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.142+0000 7fee437fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:15.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.142+0000 7fee437fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.103:3300/0 2024-02-09T08:03:15.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.142+0000 7fee437fe640 1 -- 172.21.15.62:0/2667695348 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee380094d0 con 0x7fee44145de0 2024-02-09T08:03:15.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.145+0000 7f89bdb4d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:15.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.145+0000 7f89bdb4d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:15.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.145+0000 7f89bdb4d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:15.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.146+0000 7fee437fe640 1 --2- 172.21.15.62:0/2667695348 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee44145de0 0x7fee441daf70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fee3c00b970 tx=0x7fee3c00be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:15.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.146+0000 7fee2b7fe640 10 client.?.objecter ms_handle_connect 0x7fee44145de0 2024-02-09T08:03:15.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.146+0000 7fee2b7fe640 10 client.?.objecter resend_mon_ops 2024-02-09T08:03:15.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.149+0000 7fcd8f59e640 10 monclient(hunting): handle_auth_done global_id 4351 payload 274 2024-02-09T08:03:15.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.149+0000 7fcd8f59e640 1 -- 172.21.15.62:0/1106891483 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcd9013f830 msgr2=0x7fcd9013fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:15.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.149+0000 7fcd8f59e640 1 --2- 172.21.15.62:0/1106891483 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcd9013f830 0x7fcd9013fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:15.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.149+0000 7fcd8f59e640 1 -- 172.21.15.62:0/1106891483 >> v2:172.21.15.62:3300/0 conn(0x7fcd90067110 msgr2=0x7fcd900a9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:15.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.149+0000 7fcd8f59e640 1 --2- 172.21.15.62:0/1106891483 >> v2:172.21.15.62:3300/0 conn(0x7fcd90067110 0x7fcd900a9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:15.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.149+0000 7fcd8f59e640 10 monclient: _finish_hunting 0 2024-02-09T08:03:15.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.149+0000 7fcd8f59e640 1 monclient: found mon.noname-c 2024-02-09T08:03:15.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.149+0000 7fcd8f59e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:15.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.149+0000 7fcd8f59e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.103:3300/0 2024-02-09T08:03:15.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.149+0000 7fcd8f59e640 1 -- 172.21.15.62:0/1106891483 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd900b4720 con 0x7fcd901424c0 2024-02-09T08:03:15.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.153+0000 7feaa97fa640 1 -- 172.21.15.62:0/3470205607 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa0032860 con 0x7feaac0a9e30 2024-02-09T08:03:15.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.153+0000 7feaa97fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:15.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.153+0000 7feaa97fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:03:15.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.153+0000 7feaa97fa640 10 monclient: dump: 2024-02-09T08:03:15.156 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:15.156 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:15.156 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:15.156 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:15.156 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:15.157 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:15.157 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:15.157 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:15.157 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:15.157 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:15.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.153+0000 7feaa97fa640 10 monclient: _finish_auth 0 2024-02-09T08:03:15.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.153+0000 7feaa97fa640 10 monclient: _check_auth_tickets 2024-02-09T08:03:15.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.153+0000 7feaa97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:15.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.153+0000 7feaa97fa640 1 -- 172.21.15.62:0/3470205607 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa00329e0 con 0x7feaac0a9e30 2024-02-09T08:03:15.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.153+0000 7feab2b8c640 5 monclient: authenticate success, global_id 4345 2024-02-09T08:03:15.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.153+0000 7feaa97fa640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:15.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.153+0000 7feaa97fa640 1 -- 172.21.15.62:0/3470205607 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa0032d90 con 0x7feaac0a9e30 2024-02-09T08:03:15.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.153+0000 7feaa97fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:15.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.153+0000 7feaa97fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:03:15.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.153+0000 7feaaaffd640 4 set_mon_vals no callback set 2024-02-09T08:03:15.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.153+0000 7feaa97fa640 10 monclient: dump: 2024-02-09T08:03:15.158 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:15.158 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:15.158 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:15.158 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:15.158 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:15.158 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:15.158 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:15.158 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:15.158 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:15.158 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:15.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.153+0000 7feab2b8c640 10 monclient: _renew_subs 2024-02-09T08:03:15.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.153+0000 7feab2b8c640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:15.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.153+0000 7feab2b8c640 1 -- 172.21.15.62:0/3470205607 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaac0b4870 con 0x7feaac0a9e30 2024-02-09T08:03:15.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.153+0000 7feab2b8c640 10 client.4345.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:03:15.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.153+0000 7feab2b8c640 10 monclient: _renew_subs 2024-02-09T08:03:15.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.153+0000 7feab2b8c640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:15.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.153+0000 7feab2b8c640 1 -- 172.21.15.62:0/3470205607 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaac06f880 con 0x7feaac0a9e30 2024-02-09T08:03:15.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.153+0000 7feab2b8c640 1 librados: init done 2024-02-09T08:03:15.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.154+0000 7fcd8f59e640 1 --2- 172.21.15.62:0/1106891483 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd901424c0 0x7fcd90142930 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcd900b3bb0 tx=0x7fcd8802be40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=489a350de5bad11e server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:15.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.154+0000 7feab2b8c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:15.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.155+0000 7feab2b8c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:15.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.155+0000 7feab2b8c640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:15.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.155+0000 7feab2b8c640 1 -- 172.21.15.62:0/3470205607 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaac0b4670 con 0x7feaac0a9e30 2024-02-09T08:03:15.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.155+0000 7fee2b7fe640 1 -- 172.21.15.62:0/2667695348 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3c00cb40 con 0x7fee44145de0 2024-02-09T08:03:15.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.155+0000 7fee2b7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:15.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.155+0000 7fee2b7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:03:15.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.155+0000 7fee2b7fe640 10 monclient: dump: 2024-02-09T08:03:15.162 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:15.162 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:15.162 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:15.162 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:15.162 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:15.162 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:15.162 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:15.162 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:15.162 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:15.162 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:15.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.155+0000 7fee2b7fe640 10 monclient: _finish_auth 0 2024-02-09T08:03:15.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.155+0000 7fee2b7fe640 10 monclient: _check_auth_tickets 2024-02-09T08:03:15.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.155+0000 7fee2b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:15.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.155+0000 7fee2b7fe640 1 -- 172.21.15.62:0/2667695348 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee3c00ccc0 con 0x7fee44145de0 2024-02-09T08:03:15.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.155+0000 7fee4962d640 5 monclient: authenticate success, global_id 4348 2024-02-09T08:03:15.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.155+0000 7fee2b7fe640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:15.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.155+0000 7fee2b7fe640 1 -- 172.21.15.62:0/2667695348 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3c014680 con 0x7fee44145de0 2024-02-09T08:03:15.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.155+0000 7fee4962d640 10 monclient: _renew_subs 2024-02-09T08:03:15.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.155+0000 7fee4962d640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:15.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.155+0000 7fee4962d640 1 -- 172.21.15.62:0/2667695348 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee440b4870 con 0x7fee44145de0 2024-02-09T08:03:15.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.155+0000 7fee417fa640 4 set_mon_vals no callback set 2024-02-09T08:03:15.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.155+0000 7fee4962d640 10 client.4348.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:03:15.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.155+0000 7fee2b7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:15.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.155+0000 7fee2b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:03:15.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.155+0000 7fee2b7fe640 10 monclient: dump: 2024-02-09T08:03:15.163 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:15.164 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:15.164 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:15.164 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:15.164 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:15.164 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:15.164 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:15.164 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:15.164 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:15.164 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:15.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.155+0000 7fee4962d640 10 monclient: _renew_subs 2024-02-09T08:03:15.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.155+0000 7fee4962d640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:15.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.155+0000 7fee4962d640 1 -- 172.21.15.62:0/2667695348 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee4413b370 con 0x7fee44145de0 2024-02-09T08:03:15.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.155+0000 7fee4962d640 1 librados: init done 2024-02-09T08:03:15.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.156+0000 7fee4962d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:15.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.156+0000 7fee4962d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:15.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.156+0000 7fee4962d640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:15.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.156+0000 7fee4962d640 1 -- 172.21.15.62:0/2667695348 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee4413c860 con 0x7fee44145de0 2024-02-09T08:03:15.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.158+0000 7f89bdb4d640 10 monclient(hunting): handle_auth_done global_id 4354 payload 824 2024-02-09T08:03:15.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.158+0000 7f89bdb4d640 1 -- 172.21.15.62:0/2185403171 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f89b80a9e30 msgr2=0x7f89b81453a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:15.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.158+0000 7f89bdb4d640 1 --2- 172.21.15.62:0/2185403171 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f89b80a9e30 0x7f89b81453a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:15.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.158+0000 7f89bdb4d640 1 -- 172.21.15.62:0/2185403171 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89b80b5000 msgr2=0x7f89b8140530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:15.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.158+0000 7f89bdb4d640 1 --2- 172.21.15.62:0/2185403171 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89b80b5000 0x7f89b8140530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:15.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.158+0000 7f89bdb4d640 10 monclient: _finish_hunting 0 2024-02-09T08:03:15.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.158+0000 7f89bdb4d640 1 monclient: found mon.noname-b 2024-02-09T08:03:15.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.158+0000 7f89bdb4d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:15.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.158+0000 7f89bdb4d640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.103:3300/0 2024-02-09T08:03:15.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.158+0000 7f89bdb4d640 1 -- 172.21.15.62:0/2185403171 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b40094d0 con 0x7f89b81464f0 2024-02-09T08:03:15.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.164+0000 7f89bdb4d640 1 --2- 172.21.15.62:0/2185403171 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89b81464f0 0x7f89b81dad90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f89b000b990 tx=0x7f89b000be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:15.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.164+0000 7f89adffb640 10 client.?.objecter ms_handle_connect 0x7f89b81464f0 2024-02-09T08:03:15.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.164+0000 7f89adffb640 10 client.?.objecter resend_mon_ops 2024-02-09T08:03:15.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.226+0000 7fdfc17fa640 1 -- 172.21.15.62:0/1129173437 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdfb8077360 con 0x7fdfc413fdf0 2024-02-09T08:03:15.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.226+0000 7fdfc17fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:15.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.226+0000 7fdfc17fa640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:03:15.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.264+0000 7f8120cdb640 1 -- 172.21.15.62:0/593585608 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8118005270 con 0x7f81080039c0 2024-02-09T08:03:15.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.264+0000 7f8120cdb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:15.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.264+0000 7f8120cdb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-09T08:03:15.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.264+0000 7f8120cdb640 10 monclient: dump: 2024-02-09T08:03:15.267 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:15.267 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:15.267 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:15.267 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:15.267 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:15.267 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:15.268 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:15.268 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:15.268 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:15.268 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:15.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.264+0000 7f8120cdb640 1 -- 172.21.15.62:0/593585608 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811802e070 con 0x7f81080039c0 2024-02-09T08:03:15.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.264+0000 7f8122cdf640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-02-09T08:03:15.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.264+0000 7f8120cdb640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:15.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.264+0000 7f8122cdf640 10 monclient: get_monmap_and_config success 2024-02-09T08:03:15.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.264+0000 7f8122cdf640 4 set_mon_vals no callback set 2024-02-09T08:03:15.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.264+0000 7f8120cdb640 1 -- 172.21.15.62:0/593585608 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8118003610 con 0x7f81080039c0 2024-02-09T08:03:15.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.264+0000 7f8120cdb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:15.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.264+0000 7f8120cdb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-09T08:03:15.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.264+0000 7f8120cdb640 10 monclient: dump: 2024-02-09T08:03:15.268 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:15.269 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:15.269 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:15.269 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:15.269 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:15.269 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:15.269 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:15.269 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:15.269 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:15.269 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:15.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.265+0000 7f8122cdf640 10 monclient: shutdown 2024-02-09T08:03:15.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.265+0000 7f8122cdf640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:15.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.265+0000 7f8122cdf640 1 -- 172.21.15.62:0/593585608 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81080039c0 msgr2=0x7f8108003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:15.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.265+0000 7f8122cdf640 1 --2- 172.21.15.62:0/593585608 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81080039c0 0x7f8108003dc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8118001650 tx=0x7f81080057f0 comp rx=0 tx=0).stop 2024-02-09T08:03:15.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.265+0000 7f8122cdf640 1 -- 172.21.15.62:0/593585608 shutdown_connections 2024-02-09T08:03:15.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.265+0000 7f8122cdf640 1 --2- 172.21.15.62:0/593585608 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81080039c0 0x7f8108003dc0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:15.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.265+0000 7f8122cdf640 1 -- 172.21.15.62:0/593585608 >> 172.21.15.62:0/593585608 conn(0x7f811c0b0410 msgr2=0x7f811c0b0820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:15.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.266+0000 7f8122cdf640 1 -- 172.21.15.62:0/593585608 shutdown_connections 2024-02-09T08:03:15.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.266+0000 7f8122cdf640 1 -- 172.21.15.62:0/593585608 wait complete. 2024-02-09T08:03:15.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.266+0000 7f8122cdf640 10 monclient: build_initial_monmap 2024-02-09T08:03:15.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.266+0000 7f8122cdf640 10 monclient: monmap: 2024-02-09T08:03:15.272 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:15.272 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:03:15.273 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:03:15.273 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:03:15.273 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:15.273 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:15.273 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:03:15.273 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:03:15.273 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:03:15.273 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:15.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.267+0000 7f8122cdf640 1 librados: starting msgr at 2024-02-09T08:03:15.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.267+0000 7f8122cdf640 1 librados: starting objecter 2024-02-09T08:03:15.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.267+0000 7f8122cdf640 1 Processor -- start 2024-02-09T08:03:15.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.267+0000 7f8122cdf640 1 -- start start 2024-02-09T08:03:15.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.267+0000 7f8122cdf640 1 librados: setting wanted keys 2024-02-09T08:03:15.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.267+0000 7f8122cdf640 1 librados: calling monclient init 2024-02-09T08:03:15.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.267+0000 7f8122cdf640 10 monclient: init 2024-02-09T08:03:15.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.267+0000 7f8122cdf640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:15.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.267+0000 7f8122cdf640 10 monclient: _add_conns ranks=[2,1,0] 2024-02-09T08:03:15.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.267+0000 7f8122cdf640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f81080039c0 0x7f811c08a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:15.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.267+0000 7f8122cdf640 10 monclient(hunting): picked mon.noname-c con 0x7f81080039c0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:15.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.267+0000 7f8122cdf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f811c1eb720 0x7f811c070140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:15.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.267+0000 7f8122cdf640 10 monclient(hunting): picked mon.noname-b con 0x7f811c1eb720 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:03:15.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.267+0000 7f8122cdf640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f811c1ec1f0 0x7f811c1e8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:15.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.267+0000 7f8122cdf640 10 monclient(hunting): picked mon.noname-a con 0x7f811c1ec1f0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:03:15.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.267+0000 7f8122cdf640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:15.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.267+0000 7f8122cdf640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811c1ebd60 con 0x7f811c1ec1f0 2024-02-09T08:03:15.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.267+0000 7f8122cdf640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:15.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.267+0000 7f8122cdf640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811c1ec670 con 0x7f811c1eb720 2024-02-09T08:03:15.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.267+0000 7f8122cdf640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:15.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.267+0000 7f8122cdf640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f811c083220 con 0x7f81080039c0 2024-02-09T08:03:15.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.267+0000 7f8122cdf640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:15.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.267+0000 7f8122cdf640 10 monclient(hunting): authenticate will time out at 1438.627989s 2024-02-09T08:03:15.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.268+0000 7f8121cdd640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f81080039c0 0x7f811c08a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:15.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.268+0000 7f8121cdd640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f81080039c0 0x7f811c08a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:32962/0 (socket says 172.21.15.62:32962) 2024-02-09T08:03:15.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.268+0000 7f8121cdd640 1 -- 172.21.15.62:0/178330242 learned_addr learned my addr 172.21.15.62:0/178330242 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:15.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.268+0000 7f8121cdd640 10 monclient(hunting): get_auth_request con 0x7f81080039c0 auth_method 0 2024-02-09T08:03:15.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.268+0000 7f8121cdd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:15.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.268+0000 7f8121cdd640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:15.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.268+0000 7f8121cdd640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:15.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.269+0000 7f8121cdd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:15.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.269+0000 7f8121cdd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:15.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.269+0000 7f8121cdd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:15.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.272+0000 7f8121cdd640 10 monclient(hunting): handle_auth_done global_id 4319 payload 824 2024-02-09T08:03:15.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.272+0000 7f8121cdd640 1 -- 172.21.15.62:0/178330242 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f811c1eb720 msgr2=0x7f811c070140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:15.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.272+0000 7f8121cdd640 1 --2- 172.21.15.62:0/178330242 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f811c1eb720 0x7f811c070140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:15.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.272+0000 7f8121cdd640 1 -- 172.21.15.62:0/178330242 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f811c1ec1f0 msgr2=0x7f811c1e8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:15.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.272+0000 7f8121cdd640 1 --2- 172.21.15.62:0/178330242 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f811c1ec1f0 0x7f811c1e8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:15.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.272+0000 7f8121cdd640 10 monclient: _finish_hunting 0 2024-02-09T08:03:15.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.272+0000 7f8121cdd640 1 monclient: found mon.noname-c 2024-02-09T08:03:15.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.272+0000 7f8121cdd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:15.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.272+0000 7f8121cdd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-02-09T08:03:15.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.272+0000 7f8121cdd640 1 -- 172.21.15.62:0/178330242 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f811c1e8760 con 0x7f81080039c0 2024-02-09T08:03:15.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.274+0000 7f8121cdd640 1 --2- 172.21.15.62:0/178330242 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f81080039c0 0x7f811c08a800 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8118001770 tx=0x7f8118000fb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:15.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.274+0000 7f81127fc640 10 client.?.objecter ms_handle_connect 0x7f81080039c0 2024-02-09T08:03:15.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.274+0000 7f81127fc640 10 client.?.objecter resend_mon_ops 2024-02-09T08:03:15.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.279+0000 7f81127fc640 1 -- 172.21.15.62:0/178330242 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8118007240 con 0x7f81080039c0 2024-02-09T08:03:15.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.279+0000 7f81127fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:15.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.279+0000 7f81127fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-09T08:03:15.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.279+0000 7f81127fc640 10 monclient: dump: 2024-02-09T08:03:15.281 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:15.281 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:15.281 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:15.282 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:15.282 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:15.282 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:15.282 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:15.282 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:15.282 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:15.282 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:15.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.279+0000 7f81127fc640 10 monclient: _finish_auth 0 2024-02-09T08:03:15.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.279+0000 7f81127fc640 10 monclient: _check_auth_tickets 2024-02-09T08:03:15.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.279+0000 7f81127fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:15.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.279+0000 7f8122cdf640 5 monclient: authenticate success, global_id 4319 2024-02-09T08:03:15.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.279+0000 7f8122cdf640 10 monclient: _renew_subs 2024-02-09T08:03:15.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.279+0000 7f8122cdf640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:03:15.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.279+0000 7f8122cdf640 1 -- 172.21.15.62:0/178330242 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f811c1e88f0 con 0x7f81080039c0 2024-02-09T08:03:15.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.279+0000 7fd70affd640 1 -- 172.21.15.62:0/50553452 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fd71004e440 con 0x7fd714169b00 2024-02-09T08:03:15.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.279+0000 7f8122cdf640 10 client.4319.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:03:15.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.279+0000 7f8122cdf640 10 monclient: _renew_subs 2024-02-09T08:03:15.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.279+0000 7f8122cdf640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:03:15.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.279+0000 7f8122cdf640 1 -- 172.21.15.62:0/178330242 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f811c07f5c0 con 0x7f81080039c0 2024-02-09T08:03:15.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.279+0000 7f8122cdf640 1 librados: init done 2024-02-09T08:03:15.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.279+0000 7fd70affd640 1 --2- 172.21.15.62:0/50553452 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fd6fc06d1a0 0x7fd6fc06f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:15.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.279+0000 7f81127fc640 1 -- 172.21.15.62:0/178330242 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81180073a0 con 0x7f81080039c0 2024-02-09T08:03:15.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.279+0000 7f81127fc640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:15.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.280+0000 7f81127fc640 1 -- 172.21.15.62:0/178330242 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8118007240 con 0x7f81080039c0 2024-02-09T08:03:15.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.280+0000 7f81127fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:15.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.280+0000 7f81127fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-09T08:03:15.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.280+0000 7f81127fc640 10 monclient: dump: 2024-02-09T08:03:15.284 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:15.285 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:15.285 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:15.285 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:15.285 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:15.285 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:15.285 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:15.285 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:15.285 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:15.285 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:15.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.280+0000 7f8113fff640 4 set_mon_vals no callback set 2024-02-09T08:03:15.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.281+0000 7fd71a59c640 1 --2- 172.21.15.62:0/50553452 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fd6fc06d1a0 0x7fd6fc06f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:15.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.281+0000 7fd71a59c640 10 monclient: get_auth_request con 0x7fd6fc06d1a0 auth_method 0 2024-02-09T08:03:15.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.281+0000 7fd71a59c640 1 --2- 172.21.15.62:0/50553452 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fd6fc06d1a0 0x7fd6fc06f660 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd70c0014e0 tx=0x7fd70c005a60 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:15.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.281+0000 7fd70affd640 10 client.4332.objecter ms_handle_connect 0x7fd6fc06d1a0 2024-02-09T08:03:15.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.281+0000 7f8122cdf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:15.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.281+0000 7f8122cdf640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:15.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.281+0000 7f8122cdf640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:03:15.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.281+0000 7f8122cdf640 1 -- 172.21.15.62:0/178330242 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8104005080 con 0x7f81080039c0 2024-02-09T08:03:15.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.297+0000 7fd70affd640 1 -- 172.21.15.62:0/50553452 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd71007b750 con 0x7fd714169b00 2024-02-09T08:03:15.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.297+0000 7fd70affd640 10 client.4332.objecter ms_dispatch 0x7fd71c000b90 osd_map(26..26 src has 1..26) v4 2024-02-09T08:03:15.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.297+0000 7fd70affd640 3 client.4332.objecter handle_osd_map got epochs [26,26] > 0 2024-02-09T08:03:15.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.297+0000 7fd70affd640 3 client.4332.objecter handle_osd_map decoding full epoch 26 2024-02-09T08:03:15.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.298+0000 7fd70affd640 20 client.4332.objecter dump_active .. 0 homeless 2024-02-09T08:03:15.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.298+0000 7fd70affd640 1 -- 172.21.15.62:0/50553452 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd7100772f0 con 0x7fd714169b00 2024-02-09T08:03:15.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.298+0000 7fd70affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:15.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.298+0000 7fd70affd640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:03:15.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.335+0000 7f744de26640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2024-02-09T08:03:15.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.335+0000 7f744de26640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2024-02-09T08:03:15.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.335+0000 7f744de26640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:15.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.335+0000 7f744de26640 1 -- 172.21.15.62:0/1008769425 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7440038870 con 0x7f74400bb200 2024-02-09T08:03:15.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.365+0000 7fcd8e59c640 1 -- 172.21.15.62:0/1106891483 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8802c9e0 con 0x7fcd901424c0 2024-02-09T08:03:15.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.365+0000 7fcd8e59c640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:15.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.365+0000 7fcd8e59c640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-09T08:03:15.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.365+0000 7fcd8e59c640 10 monclient: dump: 2024-02-09T08:03:15.368 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:15.368 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:15.368 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:15.368 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:15.368 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:15.368 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:15.368 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:15.368 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:15.369 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:15.369 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:15.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.365+0000 7fcd8e59c640 10 monclient: _finish_auth 0 2024-02-09T08:03:15.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.365+0000 7fcd8e59c640 10 monclient: _check_auth_tickets 2024-02-09T08:03:15.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.365+0000 7fcd8e59c640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:15.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.365+0000 7fcd950de640 5 monclient: authenticate success, global_id 4351 2024-02-09T08:03:15.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.365+0000 7fcd950de640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-02-09T08:03:15.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.404+0000 7fcd8e59c640 1 -- 172.21.15.62:0/1106891483 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd8802cb40 con 0x7fcd901424c0 2024-02-09T08:03:15.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.404+0000 7fcd8e59c640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:15.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.404+0000 7fcd8e59c640 1 -- 172.21.15.62:0/1106891483 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd880343f0 con 0x7fcd901424c0 2024-02-09T08:03:15.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.404+0000 7fcd8e59c640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:15.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.404+0000 7fcd8e59c640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:03:15.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.404+0000 7fcd8e59c640 10 monclient: dump: 2024-02-09T08:03:15.407 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:15.407 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:15.407 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:15.407 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:15.407 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:15.407 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:15.407 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:15.407 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:15.407 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:15.407 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:15.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.404+0000 7fcd950de640 10 monclient: get_monmap_and_config success 2024-02-09T08:03:15.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.404+0000 7fcd950de640 4 set_mon_vals no callback set 2024-02-09T08:03:15.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.405+0000 7fcd950de640 10 monclient: shutdown 2024-02-09T08:03:15.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.405+0000 7fcd950de640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:15.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.405+0000 7fcd950de640 1 -- 172.21.15.62:0/1106891483 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd901424c0 msgr2=0x7fcd90142930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:15.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.405+0000 7fcd950de640 1 --2- 172.21.15.62:0/1106891483 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd901424c0 0x7fcd90142930 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcd900b3bb0 tx=0x7fcd8802be40 comp rx=0 tx=0).stop 2024-02-09T08:03:15.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.405+0000 7fcd950de640 1 -- 172.21.15.62:0/1106891483 shutdown_connections 2024-02-09T08:03:15.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.405+0000 7fcd950de640 1 --2- 172.21.15.62:0/1106891483 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd901424c0 0x7fcd90142930 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:15.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.405+0000 7fcd950de640 1 --2- 172.21.15.62:0/1106891483 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcd9013f830 0x7fcd9013fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:15.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.405+0000 7fcd950de640 1 --2- 172.21.15.62:0/1106891483 >> v2:172.21.15.62:3300/0 conn(0x7fcd90067110 0x7fcd900a9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:15.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.405+0000 7fcd950de640 1 -- 172.21.15.62:0/1106891483 >> 172.21.15.62:0/1106891483 conn(0x7fcd900b4e20 msgr2=0x7fcd900b5230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:15.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.405+0000 7fcd950de640 1 -- 172.21.15.62:0/1106891483 shutdown_connections 2024-02-09T08:03:15.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.405+0000 7fcd950de640 1 -- 172.21.15.62:0/1106891483 wait complete. 2024-02-09T08:03:15.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.406+0000 7fcd950de640 10 monclient: build_initial_monmap 2024-02-09T08:03:15.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.406+0000 7fcd950de640 10 monclient: monmap: 2024-02-09T08:03:15.413 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:15.413 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:03:15.413 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:03:15.413 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:03:15.413 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:15.413 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:15.413 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:03:15.413 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:03:15.414 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:03:15.414 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:15.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.406+0000 7fcd950de640 1 librados: starting msgr at 2024-02-09T08:03:15.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.406+0000 7fcd950de640 1 librados: starting objecter 2024-02-09T08:03:15.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.407+0000 7fcd950de640 1 Processor -- start 2024-02-09T08:03:15.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.407+0000 7fcd950de640 1 -- start start 2024-02-09T08:03:15.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.407+0000 7fcd950de640 1 librados: setting wanted keys 2024-02-09T08:03:15.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.407+0000 7fcd950de640 1 librados: calling monclient init 2024-02-09T08:03:15.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.407+0000 7fcd950de640 10 monclient: init 2024-02-09T08:03:15.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.408+0000 7fcd950de640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:15.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.408+0000 7fcd950de640 10 monclient: _add_conns ranks=[1,0,2] 2024-02-09T08:03:15.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.408+0000 7fcd950de640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd90067110 0x7fcd90146160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:15.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.408+0000 7fcd950de640 10 monclient(hunting): picked mon.noname-b con 0x7fcd90067110 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:03:15.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.408+0000 7fcd950de640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcd9013f830 0x7fcd901d7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:15.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.408+0000 7fcd950de640 10 monclient(hunting): picked mon.noname-a con 0x7fcd9013f830 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:03:15.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.408+0000 7fcd950de640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcd901424c0 0x7fcd901db6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:15.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.408+0000 7fcd950de640 10 monclient(hunting): picked mon.noname-c con 0x7fcd901424c0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:15.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.408+0000 7fcd950de640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:15.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.408+0000 7fcd950de640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd900ac460 con 0x7fcd9013f830 2024-02-09T08:03:15.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.408+0000 7fcd950de640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:15.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.408+0000 7fcd950de640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd900ac690 con 0x7fcd90067110 2024-02-09T08:03:15.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.408+0000 7fcd950de640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:15.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.408+0000 7fcd950de640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd901db1a0 con 0x7fcd901424c0 2024-02-09T08:03:15.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.408+0000 7fcd950de640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:15.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.408+0000 7fcd950de640 10 monclient(hunting): authenticate will time out at 1438.768363s 2024-02-09T08:03:15.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.408+0000 7fcd87fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcd9013f830 0x7fcd901d7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:15.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.409+0000 7fcd87fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcd9013f830 0x7fcd901d7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:35018/0 (socket says 172.21.15.62:35018) 2024-02-09T08:03:15.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.409+0000 7fcd87fff640 1 -- 172.21.15.62:0/2294969903 learned_addr learned my addr 172.21.15.62:0/2294969903 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:15.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.409+0000 7fcd87fff640 10 monclient(hunting): get_auth_request con 0x7fcd9013f830 auth_method 0 2024-02-09T08:03:15.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.409+0000 7fcd87fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:15.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.409+0000 7fcd87fff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:15.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.409+0000 7fcd87fff640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:15.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.409+0000 7fcd87fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:15.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.409+0000 7fcd87fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:15.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.409+0000 7fcd87fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:15.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.412+0000 7fcd87fff640 10 monclient(hunting): handle_auth_done global_id 4344 payload 824 2024-02-09T08:03:15.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.412+0000 7fcd87fff640 1 -- 172.21.15.62:0/2294969903 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcd901424c0 msgr2=0x7fcd901db6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:15.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.412+0000 7fcd87fff640 1 --2- 172.21.15.62:0/2294969903 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcd901424c0 0x7fcd901db6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:15.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.412+0000 7fcd87fff640 1 -- 172.21.15.62:0/2294969903 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd90067110 msgr2=0x7fcd90146160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:15.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.412+0000 7fcd87fff640 1 --2- 172.21.15.62:0/2294969903 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd90067110 0x7fcd90146160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:15.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.412+0000 7fcd87fff640 10 monclient: _finish_hunting 0 2024-02-09T08:03:15.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.412+0000 7fcd87fff640 1 monclient: found mon.noname-a 2024-02-09T08:03:15.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.412+0000 7fcd87fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:15.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.412+0000 7fcd87fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-02-09T08:03:15.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.412+0000 7fcd87fff640 1 -- 172.21.15.62:0/2294969903 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd88009b30 con 0x7fcd9013f830 2024-02-09T08:03:15.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.415+0000 7fcd87fff640 1 --2- 172.21.15.62:0/2294969903 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcd9013f830 0x7fcd901d7900 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcd7800b4a0 tx=0x7fcd7800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:15.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.415+0000 7fcd877fe640 10 client.?.objecter ms_handle_connect 0x7fcd9013f830 2024-02-09T08:03:15.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.415+0000 7fcd877fe640 10 client.?.objecter resend_mon_ops 2024-02-09T08:03:15.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.417+0000 7fee2b7fe640 1 -- 172.21.15.62:0/2667695348 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fee3c01d3b0 con 0x7fee44145de0 2024-02-09T08:03:15.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.417+0000 7fee2b7fe640 1 --2- 172.21.15.62:0/2667695348 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fee3006d1f0 0x7fee3006f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:15.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.417+0000 7fee42ffd640 1 --2- 172.21.15.62:0/2667695348 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fee3006d1f0 0x7fee3006f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:15.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.417+0000 7fee42ffd640 10 monclient: get_auth_request con 0x7fee3006d1f0 auth_method 0 2024-02-09T08:03:15.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.418+0000 7fee2b7fe640 10 client.4348.objecter ms_handle_connect 0x7fee3006d1f0 2024-02-09T08:03:15.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.418+0000 7fee42ffd640 1 --2- 172.21.15.62:0/2667695348 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fee3006d1f0 0x7fee3006f6b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fee34009710 tx=0x7fee34006c90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:15.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.419+0000 7fcd877fe640 1 -- 172.21.15.62:0/2294969903 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd78010610 con 0x7fcd9013f830 2024-02-09T08:03:15.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.419+0000 7fcd877fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:15.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.419+0000 7fcd877fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-09T08:03:15.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.419+0000 7fcd877fe640 10 monclient: dump: 2024-02-09T08:03:15.422 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:15.422 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:15.422 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:15.422 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:15.423 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:15.423 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:15.423 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:15.423 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:15.423 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:15.423 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:15.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.419+0000 7fcd877fe640 10 monclient: _finish_auth 0 2024-02-09T08:03:15.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.419+0000 7fcd877fe640 10 monclient: _check_auth_tickets 2024-02-09T08:03:15.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.419+0000 7fcd877fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:15.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.419+0000 7fcd877fe640 1 -- 172.21.15.62:0/2294969903 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd78010770 con 0x7fcd9013f830 2024-02-09T08:03:15.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.419+0000 7fcd877fe640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:15.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.419+0000 7fcd877fe640 1 -- 172.21.15.62:0/2294969903 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd78010b20 con 0x7fcd9013f830 2024-02-09T08:03:15.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.419+0000 7fcd877fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:15.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.419+0000 7fcd877fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-09T08:03:15.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.419+0000 7fcd877fe640 10 monclient: dump: 2024-02-09T08:03:15.424 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:15.424 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:15.424 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:15.424 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:15.424 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:15.424 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:15.424 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:15.424 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:15.424 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:15.424 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:15.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.419+0000 7fcd8dd9b640 4 set_mon_vals no callback set 2024-02-09T08:03:15.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.420+0000 7fcd950de640 5 monclient: authenticate success, global_id 4344 2024-02-09T08:03:15.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.420+0000 7fcd950de640 10 monclient: _renew_subs 2024-02-09T08:03:15.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.420+0000 7fcd950de640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:03:15.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.420+0000 7fcd950de640 1 -- 172.21.15.62:0/2294969903 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd901dbc00 con 0x7fcd9013f830 2024-02-09T08:03:15.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.420+0000 7fee2b7fe640 1 -- 172.21.15.62:0/2667695348 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fee3c00ce30 con 0x7fee44145de0 2024-02-09T08:03:15.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.420+0000 7fee2b7fe640 10 client.4348.objecter ms_dispatch 0x7fee44000b90 osd_map(26..26 src has 1..26) v4 2024-02-09T08:03:15.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.420+0000 7fee2b7fe640 3 client.4348.objecter handle_osd_map got epochs [26,26] > 0 2024-02-09T08:03:15.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.420+0000 7fee2b7fe640 3 client.4348.objecter handle_osd_map decoding full epoch 26 2024-02-09T08:03:15.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.420+0000 7fee2b7fe640 20 client.4348.objecter dump_active .. 0 homeless 2024-02-09T08:03:15.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.420+0000 7fcd950de640 10 client.4344.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:03:15.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.420+0000 7fcd950de640 10 monclient: _renew_subs 2024-02-09T08:03:15.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.420+0000 7fcd950de640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:03:15.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.420+0000 7fcd950de640 1 -- 172.21.15.62:0/2294969903 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd900b0f20 con 0x7fcd9013f830 2024-02-09T08:03:15.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.420+0000 7fcd950de640 1 librados: init done 2024-02-09T08:03:15.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.421+0000 7fcd950de640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:15.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.421+0000 7fcd950de640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:15.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.421+0000 7fcd950de640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:03:15.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.421+0000 7fcd950de640 1 -- 172.21.15.62:0/2294969903 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd901dafe0 con 0x7fcd9013f830 2024-02-09T08:03:15.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.430+0000 7fee2b7fe640 1 -- 172.21.15.62:0/2667695348 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fee3c055010 con 0x7fee44145de0 2024-02-09T08:03:15.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.430+0000 7fee2b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:15.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.430+0000 7fee2b7fe640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:03:15.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.433+0000 7f89adffb640 1 -- 172.21.15.62:0/2185403171 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b000cba0 con 0x7f89b81464f0 2024-02-09T08:03:15.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.433+0000 7f89adffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:15.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.433+0000 7f89adffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:03:15.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.433+0000 7f89adffb640 10 monclient: dump: 2024-02-09T08:03:15.437 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:15.437 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:15.437 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:15.437 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:15.437 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:15.437 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:15.437 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:15.437 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:15.438 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:15.438 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:15.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.434+0000 7f89adffb640 10 monclient: _finish_auth 0 2024-02-09T08:03:15.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.434+0000 7f89adffb640 10 monclient: _check_auth_tickets 2024-02-09T08:03:15.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.434+0000 7f89adffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:15.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.434+0000 7f89bf5b0640 5 monclient: authenticate success, global_id 4354 2024-02-09T08:03:15.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.434+0000 7f89bf5b0640 10 monclient: _renew_subs 2024-02-09T08:03:15.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.434+0000 7f89bf5b0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:15.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.434+0000 7f89bf5b0640 1 -- 172.21.15.62:0/2185403171 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89b813cc30 con 0x7f89b81464f0 2024-02-09T08:03:15.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.434+0000 7f89bf5b0640 10 client.4354.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:03:15.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.434+0000 7f89bf5b0640 10 monclient: _renew_subs 2024-02-09T08:03:15.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.434+0000 7f89bf5b0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:15.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.434+0000 7f89bf5b0640 1 -- 172.21.15.62:0/2185403171 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89b81db2d0 con 0x7f89b81464f0 2024-02-09T08:03:15.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.434+0000 7f89bf5b0640 1 librados: init done 2024-02-09T08:03:15.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.435+0000 7f89a37fe640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:15.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.435+0000 7f89a37fe640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:15.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.435+0000 7f89a37fe640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:15.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.435+0000 7f89a37fe640 1 -- 172.21.15.62:0/2185403171 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8998005080 con 0x7f89b81464f0 2024-02-09T08:03:15.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.463+0000 7fdfcae95640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2024-02-09T08:03:15.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.463+0000 7fdfcae95640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2024-02-09T08:03:15.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.463+0000 7fdfcae95640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:03:15.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.463+0000 7fdfcae95640 1 -- 172.21.15.62:0/1129173437 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdfc41e43c0 con 0x7fdfc413fdf0 2024-02-09T08:03:15.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.523+0000 7fd71b59e640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 6}] 2024-02-09T08:03:15.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.523+0000 7fd71b59e640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2024-02-09T08:03:15.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.523+0000 7fd71b59e640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:03:15.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.523+0000 7fd71b59e640 1 -- 172.21.15.62:0/50553452 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fd700005600 con 0x7fd714169b00 2024-02-09T08:03:15.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.618+0000 7f81127fc640 1 -- 172.21.15.62:0/178330242 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f8118030030 con 0x7f81080039c0 2024-02-09T08:03:15.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.618+0000 7f81127fc640 1 --2- 172.21.15.62:0/178330242 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f810006d200 0x7f810006f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:15.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.618+0000 7f81214dc640 1 --2- 172.21.15.62:0/178330242 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f810006d200 0x7f810006f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:15.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.618+0000 7f81214dc640 10 monclient: get_auth_request con 0x7f810006d200 auth_method 0 2024-02-09T08:03:15.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.619+0000 7f81127fc640 10 client.4319.objecter ms_handle_connect 0x7f810006d200 2024-02-09T08:03:15.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.619+0000 7f81214dc640 1 --2- 172.21.15.62:0/178330242 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f810006d200 0x7f810006f6c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8114004b60 tx=0x7f81140015e0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:15.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.636+0000 7fee4962d640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2024-02-09T08:03:15.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.636+0000 7fee4962d640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2024-02-09T08:03:15.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.636+0000 7fee4962d640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:15.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.636+0000 7fee4962d640 1 -- 172.21.15.62:0/2667695348 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fee4404ef90 con 0x7fee44145de0 2024-02-09T08:03:15.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.638+0000 7f81127fc640 1 -- 172.21.15.62:0/178330242 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f811803c370 con 0x7f81080039c0 2024-02-09T08:03:15.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.638+0000 7f81127fc640 10 client.4319.objecter ms_dispatch 0x7f811c000b90 osd_map(26..26 src has 1..26) v4 2024-02-09T08:03:15.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.638+0000 7f81127fc640 3 client.4319.objecter handle_osd_map got epochs [26,26] > 0 2024-02-09T08:03:15.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.638+0000 7f81127fc640 3 client.4319.objecter handle_osd_map decoding full epoch 26 2024-02-09T08:03:15.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.638+0000 7f81127fc640 20 client.4319.objecter dump_active .. 0 homeless 2024-02-09T08:03:15.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.638+0000 7f81127fc640 1 -- 172.21.15.62:0/178330242 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f81180754d0 con 0x7f81080039c0 2024-02-09T08:03:15.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.638+0000 7f81127fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:15.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.638+0000 7f81127fc640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:03:15.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.649+0000 7fdfc17fa640 1 -- 172.21.15.62:0/1129173437 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdfb807aa20 con 0x7fdfc413fdf0 2024-02-09T08:03:15.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.649+0000 7fdfc17fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2024-02-09T08:03:15.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.649+0000 7fdfc17fa640 10 monclient: _finish_command 2 = system:0 2024-02-09T08:03:15.651 INFO:teuthology.orchestra.run.smithi062.stdout:64424509445 2024-02-09T08:03:15.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.651+0000 7fdfcae95640 10 librados: watch_flush enter 2024-02-09T08:03:15.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.651+0000 7fdfcae95640 10 librados: watch_flush exit 2024-02-09T08:03:15.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.651+0000 7fdfcae95640 20 client.4313.objecter shutdown clearing up homeless session... 2024-02-09T08:03:15.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.651+0000 7fdfcae95640 10 client.4313.objecter successfully canceled tick 2024-02-09T08:03:15.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.651+0000 7fdfcae95640 1 -- 172.21.15.62:0/1129173437 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fdfb006d220 msgr2=0x7fdfb006f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:15.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.651+0000 7fdfcae95640 1 --2- 172.21.15.62:0/1129173437 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fdfb006d220 0x7fdfb006f6e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdfb40015f0 tx=0x7fdfb4007a40 comp rx=0 tx=0).stop 2024-02-09T08:03:15.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.651+0000 7fdfcae95640 10 monclient: shutdown 2024-02-09T08:03:15.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.651+0000 7fdfcae95640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:15.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.651+0000 7fdfcae95640 1 -- 172.21.15.62:0/1129173437 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdfc413fdf0 msgr2=0x7fdfc41e46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:15.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.651+0000 7fdfcae95640 1 --2- 172.21.15.62:0/1129173437 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdfc413fdf0 0x7fdfc41e46d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8033000 tx=0x7fdfb80046c0 comp rx=0 tx=0).stop 2024-02-09T08:03:15.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.651+0000 7fdfcae95640 1 -- 172.21.15.62:0/1129173437 shutdown_connections 2024-02-09T08:03:15.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.651+0000 7fdfcae95640 1 --2- 172.21.15.62:0/1129173437 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fdfb006d220 0x7fdfb006f6e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:15.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.651+0000 7fdfcae95640 1 --2- 172.21.15.62:0/1129173437 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdfc413fdf0 0x7fdfc41e46d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:15.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.651+0000 7fdfcae95640 1 --2- 172.21.15.62:0/1129173437 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdfc40b5000 0x7fdfc413af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:15.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.651+0000 7fdfcae95640 1 --2- 172.21.15.62:0/1129173437 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdfc40a9e30 0x7fdfc413a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:15.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.651+0000 7fdfcae95640 1 -- 172.21.15.62:0/1129173437 >> 172.21.15.62:0/1129173437 conn(0x7fdfc4066bb0 msgr2=0x7fdfc40b67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:15.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.651+0000 7fdfcae95640 1 -- 172.21.15.62:0/1129173437 shutdown_connections 2024-02-09T08:03:15.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.651+0000 7fdfcae95640 1 -- 172.21.15.62:0/1129173437 wait complete. 2024-02-09T08:03:15.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.651+0000 7fdfcae95640 1 librados: shutdown 2024-02-09T08:03:15.665 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.2 2024-02-09T08:03:15.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.671+0000 7f89adffb640 1 -- 172.21.15.62:0/2185403171 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89b00098d0 con 0x7f89b81464f0 2024-02-09T08:03:15.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.671+0000 7f89adffb640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:15.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.671+0000 7f89adffb640 1 -- 172.21.15.62:0/2185403171 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b001e440 con 0x7f89b81464f0 2024-02-09T08:03:15.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.671+0000 7f89adffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:15.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.671+0000 7f89adffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:03:15.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.671+0000 7f89adffb640 10 monclient: dump: 2024-02-09T08:03:15.674 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:15.674 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:15.674 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:15.674 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:15.674 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:15.674 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:15.674 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:15.674 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:15.674 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:15.675 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:15.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.671+0000 7f89af7fe640 4 set_mon_vals no callback set 2024-02-09T08:03:15.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.678+0000 7fee2b7fe640 1 -- 172.21.15.62:0/2667695348 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fee3c019090 con 0x7fee44145de0 2024-02-09T08:03:15.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.678+0000 7fee2b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2024-02-09T08:03:15.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.678+0000 7fee2b7fe640 10 monclient: _finish_command 2 = system:0 2024-02-09T08:03:15.682 INFO:teuthology.orchestra.run.smithi062.stdout:68719476742 2024-02-09T08:03:15.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.680+0000 7fee4962d640 10 librados: watch_flush enter 2024-02-09T08:03:15.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.680+0000 7fee4962d640 10 librados: watch_flush exit 2024-02-09T08:03:15.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.681+0000 7fee4962d640 20 client.4348.objecter shutdown clearing up homeless session... 2024-02-09T08:03:15.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.681+0000 7fee4962d640 10 client.4348.objecter successfully canceled tick 2024-02-09T08:03:15.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.681+0000 7fee4962d640 1 -- 172.21.15.62:0/2667695348 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fee3006d1f0 msgr2=0x7fee3006f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:15.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.681+0000 7fee4962d640 1 --2- 172.21.15.62:0/2667695348 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fee3006d1f0 0x7fee3006f6b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fee34009710 tx=0x7fee34006c90 comp rx=0 tx=0).stop 2024-02-09T08:03:15.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.681+0000 7fee4962d640 10 monclient: shutdown 2024-02-09T08:03:15.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.681+0000 7fee4962d640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:15.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.681+0000 7fee4962d640 1 -- 172.21.15.62:0/2667695348 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee44145de0 msgr2=0x7fee441daf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:15.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.681+0000 7fee4962d640 1 --2- 172.21.15.62:0/2667695348 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee44145de0 0x7fee441daf70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fee3c00b970 tx=0x7fee3c00be30 comp rx=0 tx=0).stop 2024-02-09T08:03:15.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.681+0000 7fee4962d640 1 -- 172.21.15.62:0/2667695348 shutdown_connections 2024-02-09T08:03:15.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.681+0000 7fee4962d640 1 --2- 172.21.15.62:0/2667695348 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fee3006d1f0 0x7fee3006f6b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:15.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.681+0000 7fee4962d640 1 --2- 172.21.15.62:0/2667695348 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee44145de0 0x7fee441daf70 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:15.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.681+0000 7fee4962d640 1 --2- 172.21.15.62:0/2667695348 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fee440b5000 0x7fee441402c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:15.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.681+0000 7fee4962d640 1 --2- 172.21.15.62:0/2667695348 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee440a9e30 0x7fee44145230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:15.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.681+0000 7fee4962d640 1 -- 172.21.15.62:0/2667695348 >> 172.21.15.62:0/2667695348 conn(0x7fee44066bb0 msgr2=0x7fee440b8700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:15.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.681+0000 7fee4962d640 1 -- 172.21.15.62:0/2667695348 shutdown_connections 2024-02-09T08:03:15.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.681+0000 7fee4962d640 1 -- 172.21.15.62:0/2667695348 wait complete. 2024-02-09T08:03:15.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.681+0000 7fee4962d640 1 librados: shutdown 2024-02-09T08:03:15.695 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476743 got 68719476742 for osd.1 2024-02-09T08:03:15.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.698+0000 7feaa97fa640 1 -- 172.21.15.62:0/3470205607 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7feaa004e450 con 0x7feaac0a9e30 2024-02-09T08:03:15.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.698+0000 7feaa97fa640 1 --2- 172.21.15.62:0/3470205607 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fea9006d1a0 0x7fea9006f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:15.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.698+0000 7feaabfff640 1 --2- 172.21.15.62:0/3470205607 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fea9006d1a0 0x7fea9006f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:15.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.699+0000 7feaabfff640 10 monclient: get_auth_request con 0x7fea9006d1a0 auth_method 0 2024-02-09T08:03:15.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.699+0000 7feaa97fa640 10 client.4345.objecter ms_handle_connect 0x7fea9006d1a0 2024-02-09T08:03:15.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.699+0000 7feaabfff640 1 --2- 172.21.15.62:0/3470205607 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fea9006d1a0 0x7fea9006f660 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7feaac141fa0 tx=0x7fea98006c90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:15.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.702+0000 7feaa97fa640 1 -- 172.21.15.62:0/3470205607 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5210+0+0 (secure 0 0 0) 0x7feaa007b560 con 0x7feaac0a9e30 2024-02-09T08:03:15.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.702+0000 7feaa97fa640 10 client.4345.objecter ms_dispatch 0x7feaac000b90 osd_map(26..26 src has 1..26) v4 2024-02-09T08:03:15.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.702+0000 7feaa97fa640 3 client.4345.objecter handle_osd_map got epochs [26,26] > 0 2024-02-09T08:03:15.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.702+0000 7feaa97fa640 3 client.4345.objecter handle_osd_map decoding full epoch 26 2024-02-09T08:03:15.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.702+0000 7feaa97fa640 20 client.4345.objecter dump_active .. 0 homeless 2024-02-09T08:03:15.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.735+0000 7fcd877fe640 1 -- 172.21.15.62:0/2294969903 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fcd78010c80 con 0x7fcd9013f830 2024-02-09T08:03:15.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.735+0000 7fcd877fe640 1 --2- 172.21.15.62:0/2294969903 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fcd7006d1f0 0x7fcd7006f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:15.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.735+0000 7fcd8ed9d640 1 --2- 172.21.15.62:0/2294969903 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fcd7006d1f0 0x7fcd7006f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:15.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.735+0000 7fcd8ed9d640 10 monclient: get_auth_request con 0x7fcd7006d1f0 auth_method 0 2024-02-09T08:03:15.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.736+0000 7fcd8ed9d640 1 --2- 172.21.15.62:0/2294969903 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fcd7006d1f0 0x7fcd7006f6b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcd80009710 tx=0x7fcd80006c90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:15.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.736+0000 7fcd877fe640 10 client.4344.objecter ms_handle_connect 0x7fcd7006d1f0 2024-02-09T08:03:15.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.750+0000 7fcd877fe640 1 -- 172.21.15.62:0/2294969903 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fcd78059170 con 0x7fcd9013f830 2024-02-09T08:03:15.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.750+0000 7fcd877fe640 10 client.4344.objecter ms_dispatch 0x7fcd90000b90 osd_map(26..26 src has 1..26) v4 2024-02-09T08:03:15.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.750+0000 7fcd877fe640 3 client.4344.objecter handle_osd_map got epochs [26,26] > 0 2024-02-09T08:03:15.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.750+0000 7fcd877fe640 3 client.4344.objecter handle_osd_map decoding full epoch 26 2024-02-09T08:03:15.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.750+0000 7fcd877fe640 20 client.4344.objecter dump_active .. 0 homeless 2024-02-09T08:03:15.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.750+0000 7fcd877fe640 1 -- 172.21.15.62:0/2294969903 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcd78054d10 con 0x7fcd9013f830 2024-02-09T08:03:15.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.750+0000 7fcd877fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:15.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.750+0000 7fcd877fe640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:03:15.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.757+0000 7fd70affd640 1 -- 172.21.15.62:0/50553452 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd71007a9b0 con 0x7fd714169b00 2024-02-09T08:03:15.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.757+0000 7fd70affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2024-02-09T08:03:15.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.757+0000 7fd70affd640 10 monclient: _finish_command 2 = system:0 2024-02-09T08:03:15.760 INFO:teuthology.orchestra.run.smithi062.stdout:64424509446 2024-02-09T08:03:15.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.760+0000 7fd71b59e640 10 librados: watch_flush enter 2024-02-09T08:03:15.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.760+0000 7fd71b59e640 10 librados: watch_flush exit 2024-02-09T08:03:15.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.760+0000 7fd71b59e640 20 client.4332.objecter shutdown clearing up homeless session... 2024-02-09T08:03:15.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.760+0000 7fd71b59e640 10 client.4332.objecter successfully canceled tick 2024-02-09T08:03:15.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.760+0000 7fd71b59e640 1 -- 172.21.15.62:0/50553452 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fd6fc06d1a0 msgr2=0x7fd6fc06f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:15.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.760+0000 7fd71b59e640 1 --2- 172.21.15.62:0/50553452 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fd6fc06d1a0 0x7fd6fc06f660 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd70c0014e0 tx=0x7fd70c005a60 comp rx=0 tx=0).stop 2024-02-09T08:03:15.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.760+0000 7fd71b59e640 10 monclient: shutdown 2024-02-09T08:03:15.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.760+0000 7fd71b59e640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:15.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.760+0000 7fd71b59e640 1 -- 172.21.15.62:0/50553452 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd714169b00 msgr2=0x7fd714169fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:15.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.760+0000 7fd71b59e640 1 --2- 172.21.15.62:0/50553452 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd714169b00 0x7fd714169fb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd710033000 tx=0x7fd7100046c0 comp rx=0 tx=0).stop 2024-02-09T08:03:15.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.760+0000 7fd71b59e640 1 -- 172.21.15.62:0/50553452 shutdown_connections 2024-02-09T08:03:15.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.760+0000 7fd71b59e640 1 --2- 172.21.15.62:0/50553452 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fd6fc06d1a0 0x7fd6fc06f660 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:15.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.760+0000 7fd71b59e640 1 --2- 172.21.15.62:0/50553452 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd714169b00 0x7fd714169fb0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:15.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.760+0000 7fd71b59e640 1 --2- 172.21.15.62:0/50553452 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd7140349b0 0x7fd71402e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:15.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.760+0000 7fd71b59e640 1 --2- 172.21.15.62:0/50553452 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd714031fc0 0x7fd71402c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:15.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.760+0000 7fd71b59e640 1 -- 172.21.15.62:0/50553452 >> 172.21.15.62:0/50553452 conn(0x7fd714005ee0 msgr2=0x7fd714036e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:15.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.760+0000 7fd71b59e640 1 -- 172.21.15.62:0/50553452 shutdown_connections 2024-02-09T08:03:15.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.760+0000 7fd71b59e640 1 -- 172.21.15.62:0/50553452 wait complete. 2024-02-09T08:03:15.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.760+0000 7fd71b59e640 1 librados: shutdown 2024-02-09T08:03:15.779 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.6 2024-02-09T08:03:15.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.843+0000 7f8122cdf640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 7}] 2024-02-09T08:03:15.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.843+0000 7f8122cdf640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2024-02-09T08:03:15.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.843+0000 7f8122cdf640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:03:15.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.843+0000 7f8122cdf640 1 -- 172.21.15.62:0/178330242 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f8104005600 con 0x7f81080039c0 2024-02-09T08:03:15.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.847+0000 7f81127fc640 1 -- 172.21.15.62:0/178330242 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8118007510 con 0x7f81080039c0 2024-02-09T08:03:15.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.847+0000 7f81127fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2024-02-09T08:03:15.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.847+0000 7f81127fc640 10 monclient: _finish_command 2 = system:0 2024-02-09T08:03:15.850 INFO:teuthology.orchestra.run.smithi062.stdout:64424509446 2024-02-09T08:03:15.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.849+0000 7f8122cdf640 10 librados: watch_flush enter 2024-02-09T08:03:15.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.849+0000 7f8122cdf640 10 librados: watch_flush exit 2024-02-09T08:03:15.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.849+0000 7f8122cdf640 20 client.4319.objecter shutdown clearing up homeless session... 2024-02-09T08:03:15.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.849+0000 7f8122cdf640 10 client.4319.objecter successfully canceled tick 2024-02-09T08:03:15.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.849+0000 7f8122cdf640 1 -- 172.21.15.62:0/178330242 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f810006d200 msgr2=0x7f810006f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:15.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.849+0000 7f8122cdf640 1 --2- 172.21.15.62:0/178330242 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f810006d200 0x7f810006f6c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8114004b60 tx=0x7f81140015e0 comp rx=0 tx=0).stop 2024-02-09T08:03:15.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.849+0000 7f8122cdf640 10 monclient: shutdown 2024-02-09T08:03:15.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.849+0000 7f8122cdf640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:15.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.849+0000 7f8122cdf640 1 -- 172.21.15.62:0/178330242 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f81080039c0 msgr2=0x7f811c08a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:15.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.849+0000 7f8122cdf640 1 --2- 172.21.15.62:0/178330242 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f81080039c0 0x7f811c08a800 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8118001770 tx=0x7f8118000fb0 comp rx=0 tx=0).stop 2024-02-09T08:03:15.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.849+0000 7f8122cdf640 1 -- 172.21.15.62:0/178330242 shutdown_connections 2024-02-09T08:03:15.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.849+0000 7f8122cdf640 1 --2- 172.21.15.62:0/178330242 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f810006d200 0x7f810006f6c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:15.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.849+0000 7f8122cdf640 1 --2- 172.21.15.62:0/178330242 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f811c1ec1f0 0x7f811c1e8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:15.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.849+0000 7f8122cdf640 1 --2- 172.21.15.62:0/178330242 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f811c1eb720 0x7f811c070140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:15.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.849+0000 7f8122cdf640 1 --2- 172.21.15.62:0/178330242 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f81080039c0 0x7f811c08a800 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:15.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.849+0000 7f8122cdf640 1 -- 172.21.15.62:0/178330242 >> 172.21.15.62:0/178330242 conn(0x7f811c0b0410 msgr2=0x7f811c0b14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:15.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.849+0000 7f8122cdf640 1 -- 172.21.15.62:0/178330242 shutdown_connections 2024-02-09T08:03:15.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.849+0000 7f8122cdf640 1 -- 172.21.15.62:0/178330242 wait complete. 2024-02-09T08:03:15.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.849+0000 7f8122cdf640 1 librados: shutdown 2024-02-09T08:03:15.862 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.7 2024-02-09T08:03:15.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.937+0000 7fcd950de640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2024-02-09T08:03:15.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.937+0000 7fcd950de640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2024-02-09T08:03:15.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.937+0000 7fcd950de640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:03:15.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.937+0000 7fcd950de640 1 -- 172.21.15.62:0/2294969903 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcd9004ef90 con 0x7fcd9013f830 2024-02-09T08:03:15.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.942+0000 7fcd877fe640 1 -- 172.21.15.62:0/2294969903 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcd7801e070 con 0x7fcd9013f830 2024-02-09T08:03:15.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.942+0000 7fcd877fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2024-02-09T08:03:15.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.942+0000 7fcd877fe640 10 monclient: _finish_command 2 = system:0 2024-02-09T08:03:15.945 INFO:teuthology.orchestra.run.smithi062.stdout:90194313221 2024-02-09T08:03:15.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.944+0000 7fcd950de640 10 librados: watch_flush enter 2024-02-09T08:03:15.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.944+0000 7fcd950de640 10 librados: watch_flush exit 2024-02-09T08:03:15.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.944+0000 7fcd950de640 20 client.4344.objecter shutdown clearing up homeless session... 2024-02-09T08:03:15.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.944+0000 7fcd950de640 10 client.4344.objecter successfully canceled tick 2024-02-09T08:03:15.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.944+0000 7fcd950de640 1 -- 172.21.15.62:0/2294969903 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fcd7006d1f0 msgr2=0x7fcd7006f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:15.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.944+0000 7fcd950de640 1 --2- 172.21.15.62:0/2294969903 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fcd7006d1f0 0x7fcd7006f6b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcd80009710 tx=0x7fcd80006c90 comp rx=0 tx=0).stop 2024-02-09T08:03:15.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.944+0000 7fcd950de640 10 monclient: shutdown 2024-02-09T08:03:15.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.944+0000 7fcd950de640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:15.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.944+0000 7fcd950de640 1 -- 172.21.15.62:0/2294969903 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcd9013f830 msgr2=0x7fcd901d7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:15.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.944+0000 7fcd950de640 1 --2- 172.21.15.62:0/2294969903 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcd9013f830 0x7fcd901d7900 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcd7800b4a0 tx=0x7fcd7800b960 comp rx=0 tx=0).stop 2024-02-09T08:03:15.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.944+0000 7fcd950de640 1 -- 172.21.15.62:0/2294969903 shutdown_connections 2024-02-09T08:03:15.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.944+0000 7fcd950de640 1 --2- 172.21.15.62:0/2294969903 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fcd7006d1f0 0x7fcd7006f6b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:15.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.944+0000 7fcd950de640 1 --2- 172.21.15.62:0/2294969903 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcd901424c0 0x7fcd901db6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:15.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.944+0000 7fcd950de640 1 --2- 172.21.15.62:0/2294969903 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcd9013f830 0x7fcd901d7900 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:15.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.944+0000 7fcd950de640 1 --2- 172.21.15.62:0/2294969903 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd90067110 0x7fcd90146160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:15.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.944+0000 7fcd950de640 1 -- 172.21.15.62:0/2294969903 >> 172.21.15.62:0/2294969903 conn(0x7fcd900b4e20 msgr2=0x7fcd90069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:15.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.944+0000 7fcd950de640 1 -- 172.21.15.62:0/2294969903 shutdown_connections 2024-02-09T08:03:15.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.944+0000 7fcd950de640 1 -- 172.21.15.62:0/2294969903 wait complete. 2024-02-09T08:03:15.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.944+0000 7fcd950de640 1 librados: shutdown 2024-02-09T08:03:15.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.945+0000 7feaa97fa640 1 -- 172.21.15.62:0/3470205607 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7feaa0077100 con 0x7feaac0a9e30 2024-02-09T08:03:15.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.945+0000 7feaa97fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:15.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.945+0000 7feaa97fa640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:03:15.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.946+0000 7f74457fa640 1 -- 172.21.15.62:0/1008769425 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f743407a140 con 0x7f74400bb200 2024-02-09T08:03:15.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.946+0000 7f74457fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2024-02-09T08:03:15.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.946+0000 7f74457fa640 10 monclient: _finish_command 2 = system:0 2024-02-09T08:03:15.949 INFO:teuthology.orchestra.run.smithi062.stdout:64424509445 2024-02-09T08:03:15.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.948+0000 7f744de26640 10 librados: watch_flush enter 2024-02-09T08:03:15.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.948+0000 7f744de26640 10 librados: watch_flush exit 2024-02-09T08:03:15.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.948+0000 7f744de26640 20 client.4342.objecter shutdown clearing up homeless session... 2024-02-09T08:03:15.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.948+0000 7f744de26640 10 client.4342.objecter successfully canceled tick 2024-02-09T08:03:15.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.948+0000 7f744de26640 1 -- 172.21.15.62:0/1008769425 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f742c06d1f0 msgr2=0x7f742c06f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:15.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.948+0000 7f744de26640 1 --2- 172.21.15.62:0/1008769425 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f742c06d1f0 0x7f742c06f6b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f744807ab20 tx=0x7f744808d040 comp rx=0 tx=0).stop 2024-02-09T08:03:15.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.948+0000 7f744de26640 10 monclient: shutdown 2024-02-09T08:03:15.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.948+0000 7f744de26640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:15.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.948+0000 7f744de26640 1 -- 172.21.15.62:0/1008769425 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74400bb200 msgr2=0x7f74400d4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:15.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.948+0000 7f744de26640 1 --2- 172.21.15.62:0/1008769425 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74400bb200 0x7f74400d4690 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7434033000 tx=0x7f7434004730 comp rx=0 tx=0).stop 2024-02-09T08:03:15.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.948+0000 7f744de26640 1 -- 172.21.15.62:0/1008769425 shutdown_connections 2024-02-09T08:03:15.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.948+0000 7f744de26640 1 --2- 172.21.15.62:0/1008769425 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f742c06d1f0 0x7f742c06f6b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:15.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.948+0000 7f744de26640 1 --2- 172.21.15.62:0/1008769425 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f744016a0d0 0x7f744016a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:15.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.948+0000 7f744de26640 1 --2- 172.21.15.62:0/1008769425 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f74400bb5e0 0x7f74400d4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:15.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.948+0000 7f744de26640 1 --2- 172.21.15.62:0/1008769425 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74400bb200 0x7f74400d4690 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:15.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.948+0000 7f744de26640 1 -- 172.21.15.62:0/1008769425 >> 172.21.15.62:0/1008769425 conn(0x7f7440005ee0 msgr2=0x7f74400c1120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:15.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.948+0000 7f744de26640 1 -- 172.21.15.62:0/1008769425 shutdown_connections 2024-02-09T08:03:15.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.948+0000 7f744de26640 1 -- 172.21.15.62:0/1008769425 wait complete. 2024-02-09T08:03:15.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.948+0000 7f744de26640 1 librados: shutdown 2024-02-09T08:03:15.963 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.0 2024-02-09T08:03:15.964 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313222 got 90194313221 for osd.3 2024-02-09T08:03:15.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.967+0000 7f89adffb640 1 -- 172.21.15.62:0/2185403171 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f89b0014440 con 0x7f89b81464f0 2024-02-09T08:03:15.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.968+0000 7f89adffb640 1 --2- 172.21.15.62:0/2185403171 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f899c06d1a0 0x7f899c06f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:15.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.968+0000 7f89bd34c640 1 --2- 172.21.15.62:0/2185403171 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f899c06d1a0 0x7f899c06f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:15.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.968+0000 7f89bd34c640 10 monclient: get_auth_request con 0x7f899c06d1a0 auth_method 0 2024-02-09T08:03:15.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.968+0000 7f89bd34c640 1 --2- 172.21.15.62:0/2185403171 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f899c06d1a0 0x7f899c06f660 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f89b4036000 tx=0x7f89b4030000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:15.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.968+0000 7f89adffb640 10 client.4354.objecter ms_handle_connect 0x7f899c06d1a0 2024-02-09T08:03:15.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.970+0000 7f89adffb640 1 -- 172.21.15.62:0/2185403171 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f89b00590f0 con 0x7f89b81464f0 2024-02-09T08:03:15.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.971+0000 7f89adffb640 10 client.4354.objecter ms_dispatch 0x7f89b8000b90 osd_map(26..26 src has 1..26) v4 2024-02-09T08:03:15.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.971+0000 7f89adffb640 3 client.4354.objecter handle_osd_map got epochs [26,26] > 0 2024-02-09T08:03:15.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.971+0000 7f89adffb640 3 client.4354.objecter handle_osd_map decoding full epoch 26 2024-02-09T08:03:15.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.971+0000 7f89adffb640 20 client.4354.objecter dump_active .. 0 homeless 2024-02-09T08:03:15.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.993+0000 7f89adffb640 1 -- 172.21.15.62:0/2185403171 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f89b0055390 con 0x7f89b81464f0 2024-02-09T08:03:15.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.993+0000 7f89adffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:15.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:15.993+0000 7f89adffb640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:03:16.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.160+0000 7feab2b8c640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2024-02-09T08:03:16.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.160+0000 7feab2b8c640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2024-02-09T08:03:16.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.160+0000 7feab2b8c640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:16.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.160+0000 7feab2b8c640 1 -- 172.21.15.62:0/3470205607 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7feaac04ef90 con 0x7feaac0a9e30 2024-02-09T08:03:16.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.163+0000 7feaa97fa640 1 -- 172.21.15.62:0/3470205607 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7feaa007a7c0 con 0x7feaac0a9e30 2024-02-09T08:03:16.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.163+0000 7feaa97fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2024-02-09T08:03:16.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.163+0000 7feaa97fa640 10 monclient: _finish_command 2 = system:0 2024-02-09T08:03:16.166 INFO:teuthology.orchestra.run.smithi062.stdout:85899345928 2024-02-09T08:03:16.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.165+0000 7feab2b8c640 10 librados: watch_flush enter 2024-02-09T08:03:16.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.165+0000 7feab2b8c640 10 librados: watch_flush exit 2024-02-09T08:03:16.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.166+0000 7feab2b8c640 20 client.4345.objecter shutdown clearing up homeless session... 2024-02-09T08:03:16.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.166+0000 7feab2b8c640 10 client.4345.objecter successfully canceled tick 2024-02-09T08:03:16.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.166+0000 7feab2b8c640 1 -- 172.21.15.62:0/3470205607 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fea9006d1a0 msgr2=0x7fea9006f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:16.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.166+0000 7feab2b8c640 1 --2- 172.21.15.62:0/3470205607 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fea9006d1a0 0x7fea9006f660 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7feaac141fa0 tx=0x7fea98006c90 comp rx=0 tx=0).stop 2024-02-09T08:03:16.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.166+0000 7feab2b8c640 10 monclient: shutdown 2024-02-09T08:03:16.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.166+0000 7feab2b8c640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:16.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.166+0000 7feab2b8c640 1 -- 172.21.15.62:0/3470205607 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feaac0a9e30 msgr2=0x7feaac06d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:16.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.166+0000 7feab2b8c640 1 --2- 172.21.15.62:0/3470205607 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feaac0a9e30 0x7feaac06d0d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7feaa0000c00 tx=0x7feaa00046c0 comp rx=0 tx=0).stop 2024-02-09T08:03:16.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.166+0000 7feab2b8c640 1 -- 172.21.15.62:0/3470205607 shutdown_connections 2024-02-09T08:03:16.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.166+0000 7feab2b8c640 1 --2- 172.21.15.62:0/3470205607 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fea9006d1a0 0x7fea9006f660 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:16.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.166+0000 7feab2b8c640 1 --2- 172.21.15.62:0/3470205607 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feaac145de0 0x7feaac06f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:16.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.166+0000 7feab2b8c640 1 --2- 172.21.15.62:0/3470205607 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feaac0b5000 0x7feaac0706f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:16.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.166+0000 7feab2b8c640 1 --2- 172.21.15.62:0/3470205607 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feaac0a9e30 0x7feaac06d0d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:16.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.166+0000 7feab2b8c640 1 -- 172.21.15.62:0/3470205607 >> 172.21.15.62:0/3470205607 conn(0x7feaac066bb0 msgr2=0x7feaac1394d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:16.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.166+0000 7feab2b8c640 1 -- 172.21.15.62:0/3470205607 shutdown_connections 2024-02-09T08:03:16.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.166+0000 7feab2b8c640 1 -- 172.21.15.62:0/3470205607 wait complete. 2024-02-09T08:03:16.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.166+0000 7feab2b8c640 1 librados: shutdown 2024-02-09T08:03:16.180 INFO:tasks.ceph.ceph_manager.ceph:need seq 85899345930 got 85899345928 for osd.4 2024-02-09T08:03:16.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.188+0000 7f89a37fe640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2024-02-09T08:03:16.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.188+0000 7f89a37fe640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2024-02-09T08:03:16.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.188+0000 7f89a37fe640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:16.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.188+0000 7f89a37fe640 1 -- 172.21.15.62:0/2185403171 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f8998005600 con 0x7f89b81464f0 2024-02-09T08:03:16.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.191+0000 7f89adffb640 1 -- 172.21.15.62:0/2185403171 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f89b0023090 con 0x7f89b81464f0 2024-02-09T08:03:16.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.191+0000 7f89adffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2024-02-09T08:03:16.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.191+0000 7f89adffb640 10 monclient: _finish_command 2 = system:0 2024-02-09T08:03:16.194 INFO:teuthology.orchestra.run.smithi062.stdout:55834574854 2024-02-09T08:03:16.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.193+0000 7f89a37fe640 10 librados: watch_flush enter 2024-02-09T08:03:16.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.193+0000 7f89a37fe640 10 librados: watch_flush exit 2024-02-09T08:03:16.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.193+0000 7f89a37fe640 20 client.4354.objecter shutdown clearing up homeless session... 2024-02-09T08:03:16.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.193+0000 7f89a37fe640 10 client.4354.objecter successfully canceled tick 2024-02-09T08:03:16.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.193+0000 7f89a37fe640 1 -- 172.21.15.62:0/2185403171 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f899c06d1a0 msgr2=0x7f899c06f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:16.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.193+0000 7f89a37fe640 1 --2- 172.21.15.62:0/2185403171 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f899c06d1a0 0x7f899c06f660 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f89b4036000 tx=0x7f89b4030000 comp rx=0 tx=0).stop 2024-02-09T08:03:16.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.193+0000 7f89a37fe640 10 monclient: shutdown 2024-02-09T08:03:16.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.193+0000 7f89a37fe640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:16.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.193+0000 7f89a37fe640 1 -- 172.21.15.62:0/2185403171 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89b81464f0 msgr2=0x7f89b81dad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:16.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.193+0000 7f89a37fe640 1 --2- 172.21.15.62:0/2185403171 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89b81464f0 0x7f89b81dad90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f89b000b990 tx=0x7f89b000be50 comp rx=0 tx=0).stop 2024-02-09T08:03:16.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.193+0000 7f89a37fe640 1 -- 172.21.15.62:0/2185403171 shutdown_connections 2024-02-09T08:03:16.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.193+0000 7f89a37fe640 1 --2- 172.21.15.62:0/2185403171 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f899c06d1a0 0x7f899c06f660 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:16.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.193+0000 7f89a37fe640 1 --2- 172.21.15.62:0/2185403171 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89b81464f0 0x7f89b81dad90 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:16.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.193+0000 7f89a37fe640 1 --2- 172.21.15.62:0/2185403171 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89b80b5000 0x7f89b8140530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:16.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.193+0000 7f89a37fe640 1 --2- 172.21.15.62:0/2185403171 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f89b80a9e30 0x7f89b81453a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:16.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.193+0000 7f89a37fe640 1 -- 172.21.15.62:0/2185403171 >> 172.21.15.62:0/2185403171 conn(0x7f89b8066bb0 msgr2=0x7f89b8137f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:16.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.193+0000 7f89a37fe640 1 -- 172.21.15.62:0/2185403171 shutdown_connections 2024-02-09T08:03:16.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.193+0000 7f89a37fe640 1 -- 172.21.15.62:0/2185403171 wait complete. 2024-02-09T08:03:16.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.193+0000 7f89a37fe640 1 librados: shutdown 2024-02-09T08:03:16.207 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.5 2024-02-09T08:03:16.666 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-02-09T08:03:16.696 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-02-09T08:03:16.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.769+0000 7f62cae62640 10 monclient: get_monmap_and_config 2024-02-09T08:03:16.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.769+0000 7f62cae62640 10 monclient: build_initial_monmap 2024-02-09T08:03:16.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.769+0000 7f62cae62640 10 monclient: monmap: 2024-02-09T08:03:16.772 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:16.772 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:16.772 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:03:16.770637+0000 2024-02-09T08:03:16.772 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:03:16.770637+0000 2024-02-09T08:03:16.772 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:16.772 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:16.772 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:03:16.772 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:03:16.772 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:03:16.772 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:03:16.772 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:03:16.773 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:16.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.770+0000 7f62cae62640 1 Processor -- start 2024-02-09T08:03:16.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.770+0000 7f62cae62640 1 -- start start 2024-02-09T08:03:16.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.770+0000 7f62cae62640 10 monclient: init 2024-02-09T08:03:16.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.771+0000 7f62cae62640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:16.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.771+0000 7f62cae62640 10 monclient: _add_conns ranks=[4,0,1,2,3] 2024-02-09T08:03:16.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.771+0000 7f62cae62640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f62c40abf80 0x7f62c40ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:16.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.771+0000 7f62cae62640 10 monclient(hunting): picked mon.noname-c con 0x7f62c40abf80 addr v2:172.21.15.103:3300/0 2024-02-09T08:03:16.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.771+0000 7f62cae62640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f62c4144160 addr v1:172.21.15.62:6789/0 2024-02-09T08:03:16.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.771+0000 7f62cae62640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f62c41445a0 addr v1:172.21.15.103:6789/0 2024-02-09T08:03:16.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.771+0000 7f62cae62640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62c40adc80 con 0x7f62c4144160 2024-02-09T08:03:16.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.771+0000 7f62cae62640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62c40adef0 con 0x7f62c41445a0 2024-02-09T08:03:16.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.771+0000 7f62cae62640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:16.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.771+0000 7f62cae62640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62c406df40 con 0x7f62c40abf80 2024-02-09T08:03:16.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.771+0000 7f62cae62640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:16.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.771+0000 7f62cae62640 10 monclient(hunting): authenticate will time out at 1440.131383s 2024-02-09T08:03:16.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.771+0000 7f62c3fff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f62c4144160 0x7f62c413d520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34502/0 (socket says 172.21.15.62:34502) 2024-02-09T08:03:16.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.771+0000 7f62c3fff640 1 -- 172.21.15.62:0/1772856044 learned_addr learned my addr 172.21.15.62:0/1772856044 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-09T08:03:16.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.772+0000 7f62c8bfe640 1 --2- 172.21.15.62:0/1772856044 >> v2:172.21.15.103:3300/0 conn(0x7f62c40abf80 0x7f62c40ae9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:16.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.772+0000 7f62c8bfe640 10 monclient(hunting): get_auth_request con 0x7f62c40abf80 auth_method 0 2024-02-09T08:03:16.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.772+0000 7f62c8bfe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:16.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.772+0000 7f62c8bfe640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:16.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.772+0000 7f62c8bfe640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:16.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.773+0000 7f62c8bfe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:16.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.773+0000 7f62c8bfe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:16.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.773+0000 7f62c8bfe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:16.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.774+0000 7f62c37fe640 1 -- 172.21.15.62:0/1772856044 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1701702428 0 0) 0x7f62c40adc80 con 0x7f62c4144160 2024-02-09T08:03:16.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.774+0000 7f62c37fe640 10 monclient(hunting): _negotiate 2024-02-09T08:03:16.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.774+0000 7f62c37fe640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:16.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.774+0000 7f62c37fe640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:16.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.774+0000 7f62c37fe640 10 monclient(hunting): my global_id is 4347 2024-02-09T08:03:16.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.774+0000 7f62c37fe640 1 -- 172.21.15.62:0/1772856044 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62b4003520 con 0x7f62c4144160 2024-02-09T08:03:16.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.776+0000 7f62c8bfe640 10 monclient(hunting): handle_auth_done global_id 4357 payload 274 2024-02-09T08:03:16.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.776+0000 7f62c8bfe640 1 -- 172.21.15.62:0/1772856044 >> v1:172.21.15.103:6789/0 conn(0x7f62c41445a0 legacy=0x7f62c414ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:16.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.776+0000 7f62c8bfe640 1 -- 172.21.15.62:0/1772856044 >> v1:172.21.15.62:6789/0 conn(0x7f62c4144160 legacy=0x7f62c413d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:16.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.776+0000 7f62c8bfe640 10 monclient: _finish_hunting 0 2024-02-09T08:03:16.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.776+0000 7f62c8bfe640 1 monclient: found mon.noname-c 2024-02-09T08:03:16.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.776+0000 7f62c8bfe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:16.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.776+0000 7f62c8bfe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.103:3300/0 2024-02-09T08:03:16.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.776+0000 7f62c8bfe640 1 -- 172.21.15.62:0/1772856044 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c4072b80 con 0x7f62c40abf80 2024-02-09T08:03:16.779 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-02-09T08:03:16.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.779+0000 7f62c8bfe640 1 --2- 172.21.15.62:0/1772856044 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62c40abf80 0x7f62c40ae9c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f62b80097a0 tx=0x7f62b802b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cac7edb1ec702bf2 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:16.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.783+0000 7f62c37fe640 1 -- 172.21.15.62:0/1772856044 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b802e070 con 0x7f62c40abf80 2024-02-09T08:03:16.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.783+0000 7f62c37fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:16.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.783+0000 7f62c37fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-09T08:03:16.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.783+0000 7f62c37fe640 10 monclient: dump: 2024-02-09T08:03:16.786 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:16.786 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:16.786 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:16.786 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:16.786 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:16.786 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:16.786 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:16.786 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:16.786 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:16.786 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:16.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.783+0000 7f62c37fe640 10 monclient: _finish_auth 0 2024-02-09T08:03:16.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.783+0000 7f62c37fe640 10 monclient: _check_auth_tickets 2024-02-09T08:03:16.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.783+0000 7f62c37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:16.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.783+0000 7f62c37fe640 1 -- 172.21.15.62:0/1772856044 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b80315a0 con 0x7f62c40abf80 2024-02-09T08:03:16.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.783+0000 7f62cae62640 5 monclient: authenticate success, global_id 4357 2024-02-09T08:03:16.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.783+0000 7f62cae62640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-02-09T08:03:16.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.783+0000 7f62c37fe640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:16.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.783+0000 7f62cae62640 10 monclient: get_monmap_and_config success 2024-02-09T08:03:16.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.783+0000 7f62cae62640 4 set_mon_vals no callback set 2024-02-09T08:03:16.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.783+0000 7f62c37fe640 1 -- 172.21.15.62:0/1772856044 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b8031930 con 0x7f62c40abf80 2024-02-09T08:03:16.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.783+0000 7f62c37fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:16.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.783+0000 7f62c37fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:03:16.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.783+0000 7f62c37fe640 10 monclient: dump: 2024-02-09T08:03:16.787 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:16.787 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:16.787 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:16.787 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:16.787 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:16.788 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:16.788 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:16.788 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:16.788 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:16.788 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:16.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.784+0000 7f62cae62640 10 monclient: shutdown 2024-02-09T08:03:16.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.784+0000 7f62cae62640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:16.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.784+0000 7f62cae62640 1 -- 172.21.15.62:0/1772856044 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62c40abf80 msgr2=0x7f62c40ae9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:16.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.784+0000 7f62cae62640 1 --2- 172.21.15.62:0/1772856044 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62c40abf80 0x7f62c40ae9c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f62b80097a0 tx=0x7f62b802b840 comp rx=0 tx=0).stop 2024-02-09T08:03:16.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.784+0000 7f62cae62640 1 -- 172.21.15.62:0/1772856044 shutdown_connections 2024-02-09T08:03:16.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.784+0000 7f62cae62640 1 --2- 172.21.15.62:0/1772856044 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62c40abf80 0x7f62c40ae9c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:16.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.784+0000 7f62cae62640 1 -- 172.21.15.62:0/1772856044 >> 172.21.15.62:0/1772856044 conn(0x7f62c40b3ef0 msgr2=0x7f62c40b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:16.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.784+0000 7f62cae62640 1 -- 172.21.15.62:0/1772856044 shutdown_connections 2024-02-09T08:03:16.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.784+0000 7f62cae62640 1 -- 172.21.15.62:0/1772856044 wait complete. 2024-02-09T08:03:16.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.784+0000 7f62cae62640 10 monclient: build_initial_monmap 2024-02-09T08:03:16.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.784+0000 7f62cae62640 10 monclient: monmap: 2024-02-09T08:03:16.793 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:16.793 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:03:16.793 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:03:16.793 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:03:16.793 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:16.793 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:16.794 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:03:16.794 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:03:16.794 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:03:16.794 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:16.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.785+0000 7f62cae62640 1 librados: starting msgr at 2024-02-09T08:03:16.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.785+0000 7f62cae62640 1 librados: starting objecter 2024-02-09T08:03:16.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.785+0000 7f62cae62640 1 Processor -- start 2024-02-09T08:03:16.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.785+0000 7f62cae62640 1 -- start start 2024-02-09T08:03:16.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.785+0000 7f62cae62640 1 librados: setting wanted keys 2024-02-09T08:03:16.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.785+0000 7f62cae62640 1 librados: calling monclient init 2024-02-09T08:03:16.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.785+0000 7f62cae62640 10 monclient: init 2024-02-09T08:03:16.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.786+0000 7f62cae62640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:16.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.786+0000 7f62cae62640 10 monclient: _add_conns ranks=[2,1,0] 2024-02-09T08:03:16.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.786+0000 7f62cae62640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f62c40abf80 0x7f62c413e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:16.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.786+0000 7f62cae62640 10 monclient(hunting): picked mon.noname-c con 0x7f62c40abf80 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:16.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.786+0000 7f62cae62640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62c4144160 0x7f62c406f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:16.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.786+0000 7f62cae62640 10 monclient(hunting): picked mon.noname-b con 0x7f62c4144160 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:03:16.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.786+0000 7f62cae62640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62c41445a0 0x7f62c406fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:16.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.786+0000 7f62cae62640 10 monclient(hunting): picked mon.noname-a con 0x7f62c41445a0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:03:16.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.786+0000 7f62cae62640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:16.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.786+0000 7f62cae62640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c413e9b0 con 0x7f62c41445a0 2024-02-09T08:03:16.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.786+0000 7f62cae62640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:16.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.786+0000 7f62cae62640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c41401c0 con 0x7f62c4144160 2024-02-09T08:03:16.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.786+0000 7f62cae62640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:16.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.786+0000 7f62cae62640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c41404a0 con 0x7f62c40abf80 2024-02-09T08:03:16.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.786+0000 7f62cae62640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:16.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.786+0000 7f62cae62640 10 monclient(hunting): authenticate will time out at 1440.146425s 2024-02-09T08:03:16.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.786+0000 7f62c93ff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62c41445a0 0x7f62c406fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:16.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.786+0000 7f62c3fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62c4144160 0x7f62c406f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:16.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.787+0000 7f62c8bfe640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f62c40abf80 0x7f62c413e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:16.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.787+0000 7f62c3fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62c4144160 0x7f62c406f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.62:40202/0 (socket says 172.21.15.62:40202) 2024-02-09T08:03:16.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.787+0000 7f62c93ff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62c41445a0 0x7f62c406fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:35026/0 (socket says 172.21.15.62:35026) 2024-02-09T08:03:16.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.787+0000 7f62c3fff640 1 -- 172.21.15.62:0/1714551101 learned_addr learned my addr 172.21.15.62:0/1714551101 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:16.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.787+0000 7f62c3fff640 10 monclient(hunting): get_auth_request con 0x7f62c4144160 auth_method 0 2024-02-09T08:03:16.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.787+0000 7f62c3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:16.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.787+0000 7f62c3fff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:16.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.787+0000 7f62c3fff640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:16.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.787+0000 7f62c93ff640 10 monclient(hunting): get_auth_request con 0x7f62c41445a0 auth_method 0 2024-02-09T08:03:16.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.787+0000 7f62c93ff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:16.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.787+0000 7f62c93ff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:16.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.787+0000 7f62c93ff640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:16.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.787+0000 7f62c8bfe640 10 monclient(hunting): get_auth_request con 0x7f62c40abf80 auth_method 0 2024-02-09T08:03:16.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.787+0000 7f62c8bfe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:16.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.787+0000 7f62c8bfe640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:16.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.787+0000 7f62c8bfe640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:16.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.787+0000 7f62c3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:16.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.787+0000 7f62c3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:16.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.787+0000 7f62c3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:16.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.787+0000 7f62c93ff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:16.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.787+0000 7f62c93ff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:16.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.787+0000 7f62c93ff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:16.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.788+0000 7f62c8bfe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:16.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.788+0000 7f62c8bfe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:16.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.788+0000 7f62c8bfe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:16.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.790+0000 7f62c3fff640 10 monclient(hunting): handle_auth_done global_id 4363 payload 824 2024-02-09T08:03:16.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.790+0000 7f62c3fff640 1 -- 172.21.15.62:0/1714551101 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f62c40abf80 msgr2=0x7f62c413e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:16.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.790+0000 7f62c3fff640 1 --2- 172.21.15.62:0/1714551101 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f62c40abf80 0x7f62c413e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:16.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.790+0000 7f62c3fff640 1 -- 172.21.15.62:0/1714551101 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62c41445a0 msgr2=0x7f62c406fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:16.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.790+0000 7f62c3fff640 1 --2- 172.21.15.62:0/1714551101 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62c41445a0 0x7f62c406fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:16.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.790+0000 7f62c3fff640 10 monclient: _finish_hunting 0 2024-02-09T08:03:16.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.790+0000 7f62c3fff640 1 monclient: found mon.noname-b 2024-02-09T08:03:16.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.790+0000 7f62c3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:16.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.790+0000 7f62c3fff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.103:3300/0 2024-02-09T08:03:16.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.790+0000 7f62c3fff640 1 -- 172.21.15.62:0/1714551101 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b8009400 con 0x7f62c4144160 2024-02-09T08:03:16.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.792+0000 7f62c3fff640 1 --2- 172.21.15.62:0/1714551101 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62c4144160 0x7f62c406f880 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f62b000c430 tx=0x7f62b000c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:16.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.792+0000 7f62c17fa640 10 client.?.objecter ms_handle_connect 0x7f62c4144160 2024-02-09T08:03:16.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.792+0000 7f62c17fa640 10 client.?.objecter resend_mon_ops 2024-02-09T08:03:16.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.795+0000 7f62c17fa640 1 -- 172.21.15.62:0/1714551101 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b0005ce0 con 0x7f62c4144160 2024-02-09T08:03:16.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.795+0000 7f62c17fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:16.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.795+0000 7f62c17fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:03:16.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.795+0000 7f62c17fa640 10 monclient: dump: 2024-02-09T08:03:16.800 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:16.800 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:16.801 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:16.801 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:16.801 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:16.801 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:16.801 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:16.801 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:16.801 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:16.801 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:16.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.795+0000 7f62c17fa640 10 monclient: _finish_auth 0 2024-02-09T08:03:16.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.795+0000 7f62c17fa640 10 monclient: _check_auth_tickets 2024-02-09T08:03:16.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.796+0000 7f62c17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:16.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.796+0000 7f62c17fa640 1 -- 172.21.15.62:0/1714551101 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b0005e40 con 0x7f62c4144160 2024-02-09T08:03:16.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.796+0000 7f62cae62640 5 monclient: authenticate success, global_id 4363 2024-02-09T08:03:16.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.796+0000 7f62c17fa640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:16.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.796+0000 7f62cae62640 10 monclient: _renew_subs 2024-02-09T08:03:16.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.796+0000 7f62c17fa640 1 -- 172.21.15.62:0/1714551101 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b00072f0 con 0x7f62c4144160 2024-02-09T08:03:16.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.796+0000 7f62cae62640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:16.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.796+0000 7f62cae62640 1 -- 172.21.15.62:0/1714551101 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62c413edd0 con 0x7f62c4144160 2024-02-09T08:03:16.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.796+0000 7f62c2ffd640 4 set_mon_vals no callback set 2024-02-09T08:03:16.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.796+0000 7f62c17fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:16.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.796+0000 7f62cae62640 10 client.4363.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:03:16.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.796+0000 7f62c17fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:03:16.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.796+0000 7f62c17fa640 10 monclient: dump: 2024-02-09T08:03:16.802 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:16.802 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:16.802 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:16.802 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:16.802 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:16.803 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:16.803 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:16.803 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:16.803 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:16.803 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:16.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.796+0000 7f62cae62640 10 monclient: _renew_subs 2024-02-09T08:03:16.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.796+0000 7f62cae62640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:16.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.796+0000 7f62cae62640 1 -- 172.21.15.62:0/1714551101 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62c413f180 con 0x7f62c4144160 2024-02-09T08:03:16.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.796+0000 7f62cae62640 1 librados: init done 2024-02-09T08:03:16.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.797+0000 7f62cae62640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:16.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.797+0000 7f62cae62640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:16.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.797+0000 7f62cae62640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:16.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.797+0000 7f62cae62640 1 -- 172.21.15.62:0/1714551101 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62c413eaf0 con 0x7f62c4144160 2024-02-09T08:03:16.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.814+0000 7f701b436640 10 monclient: get_monmap_and_config 2024-02-09T08:03:16.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.814+0000 7f701b436640 10 monclient: build_initial_monmap 2024-02-09T08:03:16.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.814+0000 7f701b436640 10 monclient: monmap: 2024-02-09T08:03:16.817 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:16.817 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:16.817 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:03:16.815749+0000 2024-02-09T08:03:16.817 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:03:16.815749+0000 2024-02-09T08:03:16.817 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:16.817 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:16.817 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:03:16.817 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:03:16.817 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:03:16.817 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:03:16.817 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:03:16.817 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:16.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.815+0000 7f701b436640 1 Processor -- start 2024-02-09T08:03:16.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.815+0000 7f701b436640 1 -- start start 2024-02-09T08:03:16.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.815+0000 7f701b436640 10 monclient: init 2024-02-09T08:03:16.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.816+0000 7f701b436640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:16.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.816+0000 7f701b436640 10 monclient: _add_conns ranks=[4,0,3,1,2] 2024-02-09T08:03:16.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.816+0000 7f701b436640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f70140b5000 0x7f701413f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:16.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.816+0000 7f701b436640 10 monclient(hunting): picked mon.noname-c con 0x7f70140b5000 addr v2:172.21.15.103:3300/0 2024-02-09T08:03:16.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.816+0000 7f701b436640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f70140a9e30 addr v1:172.21.15.62:6789/0 2024-02-09T08:03:16.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.816+0000 7f701b436640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f70141464f0 0x7f701413fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:16.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.816+0000 7f701b436640 10 monclient(hunting): picked mon.noname-a con 0x7f70141464f0 addr v2:172.21.15.62:3300/0 2024-02-09T08:03:16.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.816+0000 7f701b436640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70140aa4a0 con 0x7f70140a9e30 2024-02-09T08:03:16.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.816+0000 7f701b436640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:16.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.816+0000 7f701b436640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7014140160 con 0x7f70141464f0 2024-02-09T08:03:16.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.816+0000 7f701b436640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:16.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.816+0000 7f701b436640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70140b53e0 con 0x7f70140b5000 2024-02-09T08:03:16.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.816+0000 7f701b436640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:16.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.816+0000 7f701b436640 10 monclient(hunting): authenticate will time out at 1440.176400s 2024-02-09T08:03:16.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.817+0000 7f70199d3640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f70141464f0 0x7f701413fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:16.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.817+0000 7f70189d1640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f70140a9e30 0x7f7014145de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34504/0 (socket says 172.21.15.62:34504) 2024-02-09T08:03:16.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.817+0000 7f70189d1640 1 -- 172.21.15.62:0/1558417848 learned_addr learned my addr 172.21.15.62:0/1558417848 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-09T08:03:16.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.817+0000 7f70199d3640 10 monclient(hunting): get_auth_request con 0x7f70141464f0 auth_method 0 2024-02-09T08:03:16.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.817+0000 7f70199d3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:16.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.817+0000 7f70199d3640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:16.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.817+0000 7f70199d3640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:16.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.818+0000 7f70199d3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:16.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.818+0000 7f70199d3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:16.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.818+0000 7f70199d3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:16.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.820+0000 7f70199d3640 10 monclient(hunting): handle_auth_done global_id 4353 payload 274 2024-02-09T08:03:16.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.820+0000 7f70199d3640 1 -- 172.21.15.62:0/1558417848 >> v2:172.21.15.103:3300/0 conn(0x7f70140b5000 msgr2=0x7f701413f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:16.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.820+0000 7f70199d3640 1 --2- 172.21.15.62:0/1558417848 >> v2:172.21.15.103:3300/0 conn(0x7f70140b5000 0x7f701413f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:16.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.820+0000 7f70199d3640 1 -- 172.21.15.62:0/1558417848 >> v1:172.21.15.62:6789/0 conn(0x7f70140a9e30 legacy=0x7f7014145de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:16.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.820+0000 7f70199d3640 10 monclient: _finish_hunting 0 2024-02-09T08:03:16.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.820+0000 7f70199d3640 1 monclient: found mon.noname-a 2024-02-09T08:03:16.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.820+0000 7f70199d3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:16.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.820+0000 7f70199d3640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-02-09T08:03:16.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.820+0000 7f70199d3640 1 -- 172.21.15.62:0/1558417848 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70140b2900 con 0x7f70141464f0 2024-02-09T08:03:16.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.823+0000 7f70199d3640 1 --2- 172.21.15.62:0/1558417848 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70141464f0 0x7f701413fc20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f70140b56c0 tx=0x7f700c02be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49dffdaff991b740 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:16.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.828+0000 7f700bfff640 1 -- 172.21.15.62:0/1558417848 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c02cbd0 con 0x7f70141464f0 2024-02-09T08:03:16.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.828+0000 7f700bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:16.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.828+0000 7f700bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-09T08:03:16.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.828+0000 7f700bfff640 10 monclient: dump: 2024-02-09T08:03:16.831 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:16.831 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:16.831 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:16.831 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:16.831 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:16.831 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:16.831 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:16.832 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:16.832 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:16.832 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:16.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.828+0000 7f700bfff640 10 monclient: _finish_auth 0 2024-02-09T08:03:16.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.828+0000 7f700bfff640 10 monclient: _check_auth_tickets 2024-02-09T08:03:16.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.828+0000 7f700bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:16.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.828+0000 7f700bfff640 1 -- 172.21.15.62:0/1558417848 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f700c02cd30 con 0x7f70141464f0 2024-02-09T08:03:16.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.828+0000 7f700bfff640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:16.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.828+0000 7f700bfff640 1 -- 172.21.15.62:0/1558417848 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c02cea0 con 0x7f70141464f0 2024-02-09T08:03:16.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.828+0000 7f700bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:16.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.828+0000 7f700bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-09T08:03:16.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.828+0000 7f700bfff640 10 monclient: dump: 2024-02-09T08:03:16.832 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:16.832 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:16.833 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:16.833 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:16.833 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:16.833 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:16.833 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:16.833 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:16.833 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:16.833 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:16.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.828+0000 7f701b436640 5 monclient: authenticate success, global_id 4353 2024-02-09T08:03:16.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.828+0000 7f701b436640 10 monclient: get_monmap_and_config success 2024-02-09T08:03:16.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.828+0000 7f701b436640 4 set_mon_vals no callback set 2024-02-09T08:03:16.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.829+0000 7f701b436640 10 monclient: shutdown 2024-02-09T08:03:16.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.829+0000 7f701b436640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:16.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.829+0000 7f701b436640 1 -- 172.21.15.62:0/1558417848 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70141464f0 msgr2=0x7f701413fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:16.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.829+0000 7f701b436640 1 --2- 172.21.15.62:0/1558417848 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70141464f0 0x7f701413fc20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f70140b56c0 tx=0x7f700c02be20 comp rx=0 tx=0).stop 2024-02-09T08:03:16.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.829+0000 7f701b436640 1 -- 172.21.15.62:0/1558417848 shutdown_connections 2024-02-09T08:03:16.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.829+0000 7f701b436640 1 --2- 172.21.15.62:0/1558417848 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70141464f0 0x7f701413fc20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:16.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.829+0000 7f701b436640 1 --2- 172.21.15.62:0/1558417848 >> v2:172.21.15.103:3300/0 conn(0x7f70140b5000 0x7f701413f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:16.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.829+0000 7f701b436640 1 -- 172.21.15.62:0/1558417848 >> 172.21.15.62:0/1558417848 conn(0x7f7014066bb0 msgr2=0x7f7014066fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:16.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.829+0000 7f701b436640 1 -- 172.21.15.62:0/1558417848 shutdown_connections 2024-02-09T08:03:16.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.829+0000 7f701b436640 1 -- 172.21.15.62:0/1558417848 wait complete. 2024-02-09T08:03:16.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.830+0000 7f701b436640 10 monclient: build_initial_monmap 2024-02-09T08:03:16.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.830+0000 7f701b436640 10 monclient: monmap: 2024-02-09T08:03:16.837 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:16.837 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:03:16.837 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:03:16.837 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:03:16.837 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:16.837 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:16.838 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:03:16.838 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:03:16.838 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:03:16.838 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:16.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.830+0000 7f701b436640 1 librados: starting msgr at 2024-02-09T08:03:16.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.830+0000 7f701b436640 1 librados: starting objecter 2024-02-09T08:03:16.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.831+0000 7f701b436640 1 Processor -- start 2024-02-09T08:03:16.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.831+0000 7f701b436640 1 -- start start 2024-02-09T08:03:16.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.831+0000 7f701b436640 1 librados: setting wanted keys 2024-02-09T08:03:16.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.831+0000 7f701b436640 1 librados: calling monclient init 2024-02-09T08:03:16.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.831+0000 7f701b436640 10 monclient: init 2024-02-09T08:03:16.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.831+0000 7f701b436640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:16.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.831+0000 7f701b436640 10 monclient: _add_conns ranks=[1,2,0] 2024-02-09T08:03:16.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.831+0000 7f701b436640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70140a9e30 0x7f7014133f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:16.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.831+0000 7f701b436640 10 monclient(hunting): picked mon.noname-b con 0x7f70140a9e30 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:03:16.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.831+0000 7f701b436640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f70140b5000 0x7f7014132050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:16.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.831+0000 7f701b436640 10 monclient(hunting): picked mon.noname-c con 0x7f70140b5000 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:16.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.831+0000 7f701b436640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70141464f0 0x7f7014132590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:16.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.831+0000 7f701b436640 10 monclient(hunting): picked mon.noname-a con 0x7f70141464f0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:03:16.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.831+0000 7f701b436640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:16.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.831+0000 7f701b436640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7014140c20 con 0x7f70141464f0 2024-02-09T08:03:16.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.831+0000 7f701b436640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:16.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.831+0000 7f701b436640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7014135570 con 0x7f70140a9e30 2024-02-09T08:03:16.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.831+0000 7f701b436640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:16.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.831+0000 7f701b436640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7014135850 con 0x7f70140b5000 2024-02-09T08:03:16.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.831+0000 7f701b436640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:16.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.831+0000 7f701b436640 10 monclient(hunting): authenticate will time out at 1440.192007s 2024-02-09T08:03:16.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.832+0000 7f70199d3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70141464f0 0x7f7014132590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:16.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.832+0000 7f70189d1640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f70140b5000 0x7f7014132050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:16.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.832+0000 7f70199d3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70141464f0 0x7f7014132590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:35042/0 (socket says 172.21.15.62:35042) 2024-02-09T08:03:16.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.832+0000 7f70199d3640 1 -- 172.21.15.62:0/2951724241 learned_addr learned my addr 172.21.15.62:0/2951724241 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:16.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.832+0000 7f70199d3640 10 monclient(hunting): get_auth_request con 0x7f70141464f0 auth_method 0 2024-02-09T08:03:16.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.832+0000 7f70199d3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:16.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.832+0000 7f70199d3640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:16.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.832+0000 7f70199d3640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:16.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.833+0000 7f70199d3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:16.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.833+0000 7f70199d3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:16.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.833+0000 7f70199d3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:16.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.833+0000 7f70189d1640 10 monclient(hunting): get_auth_request con 0x7f70140b5000 auth_method 0 2024-02-09T08:03:16.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.833+0000 7f70189d1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:16.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.833+0000 7f70189d1640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:16.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.833+0000 7f70189d1640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:16.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.835+0000 7f70189d1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:16.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.835+0000 7f70189d1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:16.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.835+0000 7f70189d1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:16.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.836+0000 7f70199d3640 10 monclient(hunting): handle_auth_done global_id 4359 payload 824 2024-02-09T08:03:16.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.836+0000 7f70199d3640 1 -- 172.21.15.62:0/2951724241 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f70140b5000 msgr2=0x7f7014132050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:16.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.836+0000 7f70199d3640 1 --2- 172.21.15.62:0/2951724241 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f70140b5000 0x7f7014132050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:16.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.836+0000 7f70199d3640 1 -- 172.21.15.62:0/2951724241 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70140a9e30 msgr2=0x7f7014133f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:16.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.836+0000 7f70199d3640 1 --2- 172.21.15.62:0/2951724241 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70140a9e30 0x7f7014133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:16.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.836+0000 7f70199d3640 10 monclient: _finish_hunting 0 2024-02-09T08:03:16.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.836+0000 7f70199d3640 1 monclient: found mon.noname-a 2024-02-09T08:03:16.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.836+0000 7f70199d3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:16.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.836+0000 7f70199d3640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-02-09T08:03:16.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.836+0000 7f70199d3640 1 -- 172.21.15.62:0/2951724241 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f700c009a70 con 0x7f70141464f0 2024-02-09T08:03:16.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.841+0000 7f70199d3640 1 --2- 172.21.15.62:0/2951724241 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70141464f0 0x7f7014132590 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f700c009d90 tx=0x7f700c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:16.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.841+0000 7f7009ffb640 10 client.?.objecter ms_handle_connect 0x7f70141464f0 2024-02-09T08:03:16.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.841+0000 7f7009ffb640 10 client.?.objecter resend_mon_ops 2024-02-09T08:03:16.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.846+0000 7f7009ffb640 1 -- 172.21.15.62:0/2951724241 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c02cea0 con 0x7f70141464f0 2024-02-09T08:03:16.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.846+0000 7f7009ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:16.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.846+0000 7f7009ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-09T08:03:16.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.846+0000 7f7009ffb640 10 monclient: dump: 2024-02-09T08:03:16.849 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:16.849 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:16.849 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:16.850 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:16.850 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:16.850 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:16.850 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:16.850 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:16.850 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:16.850 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:16.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.846+0000 7f7009ffb640 10 monclient: _finish_auth 0 2024-02-09T08:03:16.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.846+0000 7f7009ffb640 10 monclient: _check_auth_tickets 2024-02-09T08:03:16.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.846+0000 7f7009ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:16.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.846+0000 7f7009ffb640 1 -- 172.21.15.62:0/2951724241 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f700c03e610 con 0x7f70141464f0 2024-02-09T08:03:16.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.846+0000 7f7009ffb640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:16.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.846+0000 7f7009ffb640 1 -- 172.21.15.62:0/2951724241 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c03e9a0 con 0x7f70141464f0 2024-02-09T08:03:16.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.846+0000 7f7009ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:16.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.846+0000 7f7009ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-09T08:03:16.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.846+0000 7f7009ffb640 10 monclient: dump: 2024-02-09T08:03:16.851 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:16.851 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:16.851 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:16.851 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:16.851 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:16.851 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:16.851 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:16.851 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:16.851 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:16.851 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:16.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.846+0000 7f701b436640 5 monclient: authenticate success, global_id 4359 2024-02-09T08:03:16.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.846+0000 7f701b436640 10 monclient: _renew_subs 2024-02-09T08:03:16.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.846+0000 7f701b436640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:03:16.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.846+0000 7f701b436640 1 -- 172.21.15.62:0/2951724241 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70140b4870 con 0x7f70141464f0 2024-02-09T08:03:16.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.846+0000 7f700affd640 4 set_mon_vals no callback set 2024-02-09T08:03:16.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.847+0000 7f701b436640 10 client.4359.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:03:16.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.847+0000 7f701b436640 10 monclient: _renew_subs 2024-02-09T08:03:16.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.847+0000 7f701b436640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:03:16.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.847+0000 7f701b436640 1 -- 172.21.15.62:0/2951724241 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70141345a0 con 0x7f70141464f0 2024-02-09T08:03:16.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.847+0000 7f701b436640 1 librados: init done 2024-02-09T08:03:16.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.848+0000 7f701b436640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:16.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.848+0000 7f701b436640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:16.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.848+0000 7f701b436640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:03:16.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.848+0000 7f701b436640 1 -- 172.21.15.62:0/2951724241 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7014140e50 con 0x7f70141464f0 2024-02-09T08:03:16.863 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-02-09T08:03:16.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.883+0000 7f0b832d1640 10 monclient: get_monmap_and_config 2024-02-09T08:03:16.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.883+0000 7f0b832d1640 10 monclient: build_initial_monmap 2024-02-09T08:03:16.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.883+0000 7f0b832d1640 10 monclient: monmap: 2024-02-09T08:03:16.886 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:16.886 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:16.886 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:03:16.884974+0000 2024-02-09T08:03:16.886 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:03:16.884974+0000 2024-02-09T08:03:16.886 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:16.886 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:16.886 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:03:16.886 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:03:16.887 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:03:16.887 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:03:16.887 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:03:16.887 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:16.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.884+0000 7f0b832d1640 1 Processor -- start 2024-02-09T08:03:16.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.884+0000 7f0b832d1640 1 -- start start 2024-02-09T08:03:16.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.884+0000 7f0b832d1640 10 monclient: init 2024-02-09T08:03:16.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.885+0000 7f0b832d1640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:16.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.885+0000 7f0b832d1640 10 monclient: _add_conns ranks=[0,2,4,1,3] 2024-02-09T08:03:16.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.885+0000 7f0b832d1640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f0b7c067110 addr v1:172.21.15.62:6789/0 2024-02-09T08:03:16.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.885+0000 7f0b832d1640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0b7c0a9930 0x7f0b7c1424c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:16.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.885+0000 7f0b832d1640 10 monclient(hunting): picked mon.noname-b con 0x7f0b7c0a9930 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:16.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.885+0000 7f0b832d1640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0b7c142a00 0x7f0b7c14cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:16.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.885+0000 7f0b832d1640 10 monclient(hunting): picked mon.noname-c con 0x7f0b7c142a00 addr v2:172.21.15.103:3300/0 2024-02-09T08:03:16.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.885+0000 7f0b832d1640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b7c0aa090 con 0x7f0b7c067110 2024-02-09T08:03:16.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.885+0000 7f0b832d1640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:16.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.885+0000 7f0b832d1640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b7c0674f0 con 0x7f0b7c142a00 2024-02-09T08:03:16.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.885+0000 7f0b832d1640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:16.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.885+0000 7f0b832d1640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7c0a9d70 con 0x7f0b7c0a9930 2024-02-09T08:03:16.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.885+0000 7f0b832d1640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:16.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.885+0000 7f0b832d1640 10 monclient(hunting): authenticate will time out at 1440.245662s 2024-02-09T08:03:16.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.886+0000 7f0b8086c640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0b7c0a9930 0x7f0b7c1424c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:16.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.886+0000 7f0b8086c640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0b7c0a9930 0x7f0b7c1424c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:32978/0 (socket says 172.21.15.62:32978) 2024-02-09T08:03:16.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.886+0000 7f0b8086c640 1 -- 172.21.15.62:0/4279117403 learned_addr learned my addr 172.21.15.62:0/4279117403 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:16.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.886+0000 7f0b8086c640 10 monclient(hunting): get_auth_request con 0x7f0b7c0a9930 auth_method 0 2024-02-09T08:03:16.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.886+0000 7f0b8086c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:16.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.886+0000 7f0b8086c640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:16.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.886+0000 7f0b8086c640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:16.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.887+0000 7f0b8086c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:16.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.887+0000 7f0b8086c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:16.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.887+0000 7f0b8086c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:16.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.889+0000 7f0b8086c640 10 monclient(hunting): handle_auth_done global_id 4328 payload 274 2024-02-09T08:03:16.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.889+0000 7f0b8086c640 1 -- 172.21.15.62:0/4279117403 >> v2:172.21.15.103:3300/0 conn(0x7f0b7c142a00 msgr2=0x7f0b7c14cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:16.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.889+0000 7f0b8086c640 1 --2- 172.21.15.62:0/4279117403 >> v2:172.21.15.103:3300/0 conn(0x7f0b7c142a00 0x7f0b7c14cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:16.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.889+0000 7f0b8086c640 1 -- 172.21.15.62:0/4279117403 >> v1:172.21.15.62:6789/0 conn(0x7f0b7c067110 legacy=0x7f0b7c13f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:16.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.889+0000 7f0b8086c640 10 monclient: _finish_hunting 0 2024-02-09T08:03:16.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.889+0000 7f0b8086c640 1 monclient: found mon.noname-b 2024-02-09T08:03:16.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.889+0000 7f0b8086c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:16.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.889+0000 7f0b8086c640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.62:3301/0 2024-02-09T08:03:16.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.889+0000 7f0b8086c640 1 -- 172.21.15.62:0/4279117403 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b7c0ab5b0 con 0x7f0b7c0a9930 2024-02-09T08:03:16.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.891+0000 7f0b8086c640 1 --2- 172.21.15.62:0/4279117403 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0b7c0a9930 0x7f0b7c1424c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c009870 tx=0x7f0b6c02b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9727bb9c067f75af server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:16.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.894+0000 7f0b73fff640 1 -- 172.21.15.62:0/4279117403 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c0317c0 con 0x7f0b7c0a9930 2024-02-09T08:03:16.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.894+0000 7f0b73fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:16.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.894+0000 7f0b73fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:03:16.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.894+0000 7f0b73fff640 10 monclient: dump: 2024-02-09T08:03:16.898 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:16.898 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:16.898 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:16.898 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:16.898 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:16.898 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:16.898 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:16.898 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:16.899 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:16.899 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:16.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.894+0000 7f0b73fff640 10 monclient: _finish_auth 0 2024-02-09T08:03:16.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.894+0000 7f0b73fff640 10 monclient: _check_auth_tickets 2024-02-09T08:03:16.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.894+0000 7f0b73fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:16.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.894+0000 7f0b73fff640 1 -- 172.21.15.62:0/4279117403 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b6c031920 con 0x7f0b7c0a9930 2024-02-09T08:03:16.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.894+0000 7f0b73fff640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:16.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.895+0000 7f0b832d1640 5 monclient: authenticate success, global_id 4328 2024-02-09T08:03:16.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.895+0000 7f0b832d1640 10 monclient: get_monmap_and_config success 2024-02-09T08:03:16.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.895+0000 7f0b832d1640 4 set_mon_vals no callback set 2024-02-09T08:03:16.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.894+0000 7f0b73fff640 1 -- 172.21.15.62:0/4279117403 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c031cb0 con 0x7f0b7c0a9930 2024-02-09T08:03:16.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.895+0000 7f0b73fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:16.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.895+0000 7f0b73fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-09T08:03:16.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.895+0000 7f0b73fff640 10 monclient: dump: 2024-02-09T08:03:16.899 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:16.900 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:16.900 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:16.900 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:16.900 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:16.900 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:16.900 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:16.900 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:16.900 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:16.900 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:16.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.895+0000 7f0b832d1640 10 monclient: shutdown 2024-02-09T08:03:16.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.895+0000 7f0b832d1640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:16.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.895+0000 7f0b832d1640 1 -- 172.21.15.62:0/4279117403 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0b7c0a9930 msgr2=0x7f0b7c1424c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:16.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.895+0000 7f0b832d1640 1 --2- 172.21.15.62:0/4279117403 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0b7c0a9930 0x7f0b7c1424c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c009870 tx=0x7f0b6c02b860 comp rx=0 tx=0).stop 2024-02-09T08:03:16.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.895+0000 7f0b832d1640 1 -- 172.21.15.62:0/4279117403 shutdown_connections 2024-02-09T08:03:16.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.895+0000 7f0b832d1640 1 --2- 172.21.15.62:0/4279117403 >> v2:172.21.15.103:3300/0 conn(0x7f0b7c142a00 0x7f0b7c14cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:16.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.895+0000 7f0b832d1640 1 --2- 172.21.15.62:0/4279117403 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0b7c0a9930 0x7f0b7c1424c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:16.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.895+0000 7f0b832d1640 1 -- 172.21.15.62:0/4279117403 >> 172.21.15.62:0/4279117403 conn(0x7f0b7c0b4e20 msgr2=0x7f0b7c0b5230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:16.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.895+0000 7f0b832d1640 1 -- 172.21.15.62:0/4279117403 shutdown_connections 2024-02-09T08:03:16.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.895+0000 7f0b832d1640 1 -- 172.21.15.62:0/4279117403 wait complete. 2024-02-09T08:03:16.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.896+0000 7f0b832d1640 10 monclient: build_initial_monmap 2024-02-09T08:03:16.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.896+0000 7f0b832d1640 10 monclient: monmap: 2024-02-09T08:03:16.903 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:16.903 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:03:16.903 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:03:16.903 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:03:16.903 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:16.903 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:16.903 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:03:16.903 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:03:16.904 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:03:16.904 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:16.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.896+0000 7f0b832d1640 1 librados: starting msgr at 2024-02-09T08:03:16.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.896+0000 7f0b832d1640 1 librados: starting objecter 2024-02-09T08:03:16.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.896+0000 7f0b832d1640 1 Processor -- start 2024-02-09T08:03:16.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.896+0000 7f0b832d1640 1 -- start start 2024-02-09T08:03:16.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.896+0000 7f0b832d1640 1 librados: setting wanted keys 2024-02-09T08:03:16.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.896+0000 7f0b832d1640 1 librados: calling monclient init 2024-02-09T08:03:16.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.896+0000 7f0b832d1640 10 monclient: init 2024-02-09T08:03:16.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.897+0000 7f0b832d1640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:16.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.897+0000 7f0b832d1640 10 monclient: _add_conns ranks=[1,2,0] 2024-02-09T08:03:16.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.897+0000 7f0b832d1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b7c067110 0x7f0b7c1cc570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:16.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.897+0000 7f0b832d1640 10 monclient(hunting): picked mon.noname-b con 0x7f0b7c067110 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:03:16.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.897+0000 7f0b832d1640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0b7c0a9930 0x7f0b7c1ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:16.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.897+0000 7f0b832d1640 10 monclient(hunting): picked mon.noname-c con 0x7f0b7c0a9930 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:16.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.897+0000 7f0b832d1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b7c142a00 0x7f0b7c1ce570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:16.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.897+0000 7f0b832d1640 10 monclient(hunting): picked mon.noname-a con 0x7f0b7c142a00 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:03:16.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.897+0000 7f0b832d1640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:16.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.897+0000 7f0b832d1640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7c1cba40 con 0x7f0b7c142a00 2024-02-09T08:03:16.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.897+0000 7f0b832d1640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:16.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.897+0000 7f0b832d1640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7c1cda00 con 0x7f0b7c067110 2024-02-09T08:03:16.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.897+0000 7f0b832d1640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:16.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.897+0000 7f0b832d1640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7c1cdc70 con 0x7f0b7c0a9930 2024-02-09T08:03:16.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.897+0000 7f0b832d1640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:16.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.897+0000 7f0b832d1640 10 monclient(hunting): authenticate will time out at 1440.257869s 2024-02-09T08:03:16.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.898+0000 7f0b8086c640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0b7c0a9930 0x7f0b7c1ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:16.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.898+0000 7f0b8086c640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0b7c0a9930 0x7f0b7c1ccab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:32988/0 (socket says 172.21.15.62:32988) 2024-02-09T08:03:16.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.898+0000 7f0b8086c640 1 -- 172.21.15.62:0/1439048145 learned_addr learned my addr 172.21.15.62:0/1439048145 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:16.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.898+0000 7f0b8086c640 10 monclient(hunting): get_auth_request con 0x7f0b7c0a9930 auth_method 0 2024-02-09T08:03:16.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.898+0000 7f0b8086c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:16.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.898+0000 7f0b8086c640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:16.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.898+0000 7f0b8086c640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:16.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.899+0000 7f0b8086c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:16.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.899+0000 7f0b8086c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:16.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.899+0000 7f0b8086c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:16.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.903+0000 7f0b8086c640 10 monclient(hunting): handle_auth_done global_id 4331 payload 824 2024-02-09T08:03:16.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.903+0000 7f0b8086c640 1 -- 172.21.15.62:0/1439048145 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b7c067110 msgr2=0x7f0b7c1cc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:16.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.903+0000 7f0b8086c640 1 --2- 172.21.15.62:0/1439048145 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b7c067110 0x7f0b7c1cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:16.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.903+0000 7f0b8086c640 1 -- 172.21.15.62:0/1439048145 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b7c142a00 msgr2=0x7f0b7c1ce570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:16.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.903+0000 7f0b8086c640 1 --2- 172.21.15.62:0/1439048145 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b7c142a00 0x7f0b7c1ce570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:16.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.903+0000 7f0b8086c640 10 monclient: _finish_hunting 0 2024-02-09T08:03:16.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.903+0000 7f0b8086c640 1 monclient: found mon.noname-c 2024-02-09T08:03:16.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.903+0000 7f0b8086c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:16.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.903+0000 7f0b8086c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-02-09T08:03:16.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.903+0000 7f0b8086c640 1 -- 172.21.15.62:0/1439048145 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b6c0094d0 con 0x7f0b7c0a9930 2024-02-09T08:03:16.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.907+0000 7f0b8086c640 1 --2- 172.21.15.62:0/1439048145 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0b7c0a9930 0x7f0b7c1ccab0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c000c00 tx=0x7f0b6c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:16.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.907+0000 7f0b71ffb640 10 client.?.objecter ms_handle_connect 0x7f0b7c0a9930 2024-02-09T08:03:16.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.907+0000 7f0b71ffb640 10 client.?.objecter resend_mon_ops 2024-02-09T08:03:16.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.911+0000 7f0b71ffb640 1 -- 172.21.15.62:0/1439048145 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c032860 con 0x7f0b7c0a9930 2024-02-09T08:03:16.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.911+0000 7f0b71ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:16.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.911+0000 7f0b71ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-09T08:03:16.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.911+0000 7f0b71ffb640 10 monclient: dump: 2024-02-09T08:03:16.915 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:16.915 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:16.915 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:16.915 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:16.915 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:16.915 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:16.915 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:16.915 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:16.915 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:16.915 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:16.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.911+0000 7f0b71ffb640 10 monclient: _finish_auth 0 2024-02-09T08:03:16.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.911+0000 7f0b71ffb640 10 monclient: _check_auth_tickets 2024-02-09T08:03:16.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.911+0000 7f0b71ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:16.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.911+0000 7f0b71ffb640 1 -- 172.21.15.62:0/1439048145 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b6c0329e0 con 0x7f0b7c0a9930 2024-02-09T08:03:16.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.911+0000 7f0b71ffb640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:16.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.911+0000 7f0b71ffb640 1 -- 172.21.15.62:0/1439048145 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c032d90 con 0x7f0b7c0a9930 2024-02-09T08:03:16.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.911+0000 7f0b71ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:16.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.911+0000 7f0b71ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-09T08:03:16.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.911+0000 7f0b737fe640 4 set_mon_vals no callback set 2024-02-09T08:03:16.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.911+0000 7f0b71ffb640 10 monclient: dump: 2024-02-09T08:03:16.916 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:16.916 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:16.916 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:16.916 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:16.916 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:16.916 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:16.917 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:16.917 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:16.917 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:16.917 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:16.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.912+0000 7f0b832d1640 5 monclient: authenticate success, global_id 4331 2024-02-09T08:03:16.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.912+0000 7f0b832d1640 10 monclient: _renew_subs 2024-02-09T08:03:16.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.912+0000 7f0b832d1640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:03:16.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.912+0000 7f0b832d1640 1 -- 172.21.15.62:0/1439048145 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b7c1cdf50 con 0x7f0b7c0a9930 2024-02-09T08:03:16.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.912+0000 7f0b832d1640 10 client.4331.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:03:16.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.912+0000 7f0b832d1640 10 monclient: _renew_subs 2024-02-09T08:03:16.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.912+0000 7f0b832d1640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:03:16.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.912+0000 7f0b832d1640 1 -- 172.21.15.62:0/1439048145 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b7c1cec90 con 0x7f0b7c0a9930 2024-02-09T08:03:16.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.912+0000 7f0b832d1640 1 librados: init done 2024-02-09T08:03:16.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.913+0000 7f0b832d1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:16.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.913+0000 7f0b832d1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:16.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.913+0000 7f0b832d1640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:03:16.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.913+0000 7f0b832d1640 1 -- 172.21.15.62:0/1439048145 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b7c0b4140 con 0x7f0b7c0a9930 2024-02-09T08:03:16.964 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-02-09T08:03:16.964 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-02-09T08:03:16.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.970+0000 7f03724de640 10 monclient: get_monmap_and_config 2024-02-09T08:03:16.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.970+0000 7f03724de640 10 monclient: build_initial_monmap 2024-02-09T08:03:16.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.971+0000 7f03724de640 10 monclient: monmap: 2024-02-09T08:03:16.973 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:16.973 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:16.973 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:03:16.972076+0000 2024-02-09T08:03:16.973 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:03:16.972076+0000 2024-02-09T08:03:16.973 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:16.973 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:16.973 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:03:16.973 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:03:16.974 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:03:16.974 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:03:16.974 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:03:16.974 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:16.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.971+0000 7f03724de640 1 Processor -- start 2024-02-09T08:03:16.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.971+0000 7f03724de640 1 -- start start 2024-02-09T08:03:16.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.971+0000 7f03724de640 10 monclient: init 2024-02-09T08:03:16.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.972+0000 7f03724de640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:16.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.972+0000 7f03724de640 10 monclient: _add_conns ranks=[2,3,0,1,4] 2024-02-09T08:03:16.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.972+0000 7f03724de640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f036c0b5000 0x7f036c13f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:16.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.972+0000 7f03724de640 10 monclient(hunting): picked mon.noname-b con 0x7f036c0b5000 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:16.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.972+0000 7f03724de640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f036c0a9e30 0x7f036c13fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:16.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.972+0000 7f03724de640 10 monclient(hunting): picked mon.noname-a con 0x7f036c0a9e30 addr v2:172.21.15.62:3300/0 2024-02-09T08:03:16.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.972+0000 7f03724de640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f036c145de0 addr v1:172.21.15.62:6789/0 2024-02-09T08:03:16.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.972+0000 7f03724de640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f036c0aa4a0 con 0x7f036c145de0 2024-02-09T08:03:16.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.972+0000 7f03724de640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:16.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.972+0000 7f03724de640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f036c140160 con 0x7f036c0a9e30 2024-02-09T08:03:16.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.972+0000 7f03724de640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:16.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.972+0000 7f03724de640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f036c146900 con 0x7f036c0b5000 2024-02-09T08:03:16.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.972+0000 7f03724de640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:16.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:16.972+0000 7f03724de640 10 monclient(hunting): authenticate will time out at 1440.333104s 2024-02-09T08:03:17.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.044+0000 7f62c17fa640 1 -- 172.21.15.62:0/1714551101 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f62b0007450 con 0x7f62c4144160 2024-02-09T08:03:17.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.045+0000 7f62c17fa640 1 --2- 172.21.15.62:0/1714551101 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f62a806d1f0 0x7f62a806f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:17.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.045+0000 7f62c8bfe640 1 --2- 172.21.15.62:0/1714551101 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f62a806d1f0 0x7f62a806f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:17.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.045+0000 7f62c8bfe640 10 monclient: get_auth_request con 0x7f62a806d1f0 auth_method 0 2024-02-09T08:03:17.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.046+0000 7f62c17fa640 10 client.4363.objecter ms_handle_connect 0x7f62a806d1f0 2024-02-09T08:03:17.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.046+0000 7f62c8bfe640 1 --2- 172.21.15.62:0/1714551101 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f62a806d1f0 0x7f62a806f6b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f62b8036000 tx=0x7f62b803d040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:17.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.048+0000 7f62c17fa640 1 -- 172.21.15.62:0/1714551101 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f62b0058300 con 0x7f62c4144160 2024-02-09T08:03:17.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.048+0000 7f62c17fa640 10 client.4363.objecter ms_dispatch 0x7f62c4000b90 osd_map(26..26 src has 1..26) v4 2024-02-09T08:03:17.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.048+0000 7f62c17fa640 3 client.4363.objecter handle_osd_map got epochs [26,26] > 0 2024-02-09T08:03:17.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.048+0000 7f62c17fa640 3 client.4363.objecter handle_osd_map decoding full epoch 26 2024-02-09T08:03:17.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.048+0000 7f62c17fa640 20 client.4363.objecter dump_active .. 0 homeless 2024-02-09T08:03:17.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.057+0000 7f62c17fa640 1 -- 172.21.15.62:0/1714551101 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f62b00545a0 con 0x7f62c4144160 2024-02-09T08:03:17.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.058+0000 7f62c17fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:17.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.058+0000 7f62c17fa640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:03:17.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.069+0000 7f54e42de640 10 monclient: get_monmap_and_config 2024-02-09T08:03:17.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.069+0000 7f54e42de640 10 monclient: build_initial_monmap 2024-02-09T08:03:17.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.069+0000 7f54e42de640 10 monclient: monmap: 2024-02-09T08:03:17.072 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:17.072 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:17.072 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:03:17.070393+0000 2024-02-09T08:03:17.072 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:03:17.070393+0000 2024-02-09T08:03:17.072 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:17.072 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:17.072 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:03:17.072 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:03:17.072 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:03:17.073 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:03:17.073 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:03:17.073 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:17.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.071+0000 7f5091dfa640 10 monclient: get_monmap_and_config 2024-02-09T08:03:17.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.071+0000 7f5091dfa640 10 monclient: build_initial_monmap 2024-02-09T08:03:17.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.071+0000 7f5091dfa640 10 monclient: monmap: 2024-02-09T08:03:17.076 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:17.076 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:17.077 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:03:17.072408+0000 2024-02-09T08:03:17.077 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:03:17.072408+0000 2024-02-09T08:03:17.077 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:17.077 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:17.077 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:03:17.077 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:03:17.077 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:03:17.078 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:03:17.078 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:03:17.078 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:17.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.072+0000 7f54e42de640 1 Processor -- start 2024-02-09T08:03:17.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.072+0000 7f5091dfa640 1 Processor -- start 2024-02-09T08:03:17.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.072+0000 7f54e42de640 1 -- start start 2024-02-09T08:03:17.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.072+0000 7f5091dfa640 1 -- start start 2024-02-09T08:03:17.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.072+0000 7f54e42de640 10 monclient: init 2024-02-09T08:03:17.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.072+0000 7f5091dfa640 10 monclient: init 2024-02-09T08:03:17.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.073+0000 7f5091dfa640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:17.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.073+0000 7f5091dfa640 10 monclient: _add_conns ranks=[0,3,1,4,2] 2024-02-09T08:03:17.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.073+0000 7f5091dfa640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f508c072490 addr v1:172.21.15.62:6789/0 2024-02-09T08:03:17.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.073+0000 7f5091dfa640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f508c1431d0 0x7f508c13f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:17.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.073+0000 7f5091dfa640 10 monclient(hunting): picked mon.noname-a con 0x7f508c1431d0 addr v2:172.21.15.62:3300/0 2024-02-09T08:03:17.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.073+0000 7f5091dfa640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f508c0a9e50 addr v1:172.21.15.103:6789/0 2024-02-09T08:03:17.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.073+0000 7f5091dfa640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f508c0ab310 con 0x7f508c072490 2024-02-09T08:03:17.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.073+0000 7f5091dfa640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f508c0ab5f0 con 0x7f508c0a9e50 2024-02-09T08:03:17.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.073+0000 7f5091dfa640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:17.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.073+0000 7f5091dfa640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f508c072870 con 0x7f508c1431d0 2024-02-09T08:03:17.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.073+0000 7f5091dfa640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:17.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.073+0000 7f5091dfa640 10 monclient(hunting): authenticate will time out at 1440.433698s 2024-02-09T08:03:17.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.073+0000 7f54e42de640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:17.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.073+0000 7f54e42de640 10 monclient: _add_conns ranks=[1,3,2,0,4] 2024-02-09T08:03:17.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.073+0000 7f54e42de640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f54dc0b5000 addr v1:172.21.15.103:6789/0 2024-02-09T08:03:17.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.073+0000 7f54e42de640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f54dc0a9e30 0x7f54dc145de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:17.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.073+0000 7f54e42de640 10 monclient(hunting): picked mon.noname-a con 0x7f54dc0a9e30 addr v2:172.21.15.62:3300/0 2024-02-09T08:03:17.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.073+0000 7f54e42de640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f54dc13fdf0 0x7f54dc146320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:17.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.073+0000 7f54e42de640 10 monclient(hunting): picked mon.noname-b con 0x7f54dc13fdf0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:17.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.073+0000 7f54e42de640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54dc0aa4a0 con 0x7f54dc0b5000 2024-02-09T08:03:17.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.074+0000 7f54e42de640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:17.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.074+0000 7f508bfff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f508c0a9e50 0x7f508c14ceb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.62:50534/0 (socket says 172.21.15.62:50534) 2024-02-09T08:03:17.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.074+0000 7f508bfff640 1 -- 172.21.15.62:0/3093602433 learned_addr learned my addr 172.21.15.62:0/3093602433 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-09T08:03:17.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.074+0000 7f54e42de640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54dc0b53e0 con 0x7f54dc0a9e30 2024-02-09T08:03:17.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.074+0000 7f54e42de640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:17.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.074+0000 7f54e42de640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54dc146860 con 0x7f54dc13fdf0 2024-02-09T08:03:17.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.074+0000 7f54e42de640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:17.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.074+0000 7f54e42de640 10 monclient(hunting): authenticate will time out at 1440.434247s 2024-02-09T08:03:17.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.074+0000 7f54e207a640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f54dc0b5000 0x7f54dc13f6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.62:50538/0 (socket says 172.21.15.62:50538) 2024-02-09T08:03:17.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.075+0000 7f54e207a640 1 -- 172.21.15.62:0/3517092315 learned_addr learned my addr 172.21.15.62:0/3517092315 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-09T08:03:17.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.077+0000 7f508a7fc640 1 -- 172.21.15.62:0/3093602433 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3959660606 0 0) 0x7f508c0ab5f0 con 0x7f508c0a9e50 2024-02-09T08:03:17.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.077+0000 7f508a7fc640 10 monclient(hunting): _negotiate 2024-02-09T08:03:17.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.077+0000 7f508a7fc640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:17.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.077+0000 7f508a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:17.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.077+0000 7f508a7fc640 10 monclient(hunting): my global_id is 4366 2024-02-09T08:03:17.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.077+0000 7f508a7fc640 1 -- 172.21.15.62:0/3093602433 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5074003520 con 0x7f508c0a9e50 2024-02-09T08:03:17.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.081+0000 7f54e1078640 1 -- 172.21.15.62:0/3517092315 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 143977275 0 0) 0x7f54dc0aa4a0 con 0x7f54dc0b5000 2024-02-09T08:03:17.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.082+0000 7f54e1078640 10 monclient(hunting): _negotiate 2024-02-09T08:03:17.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.082+0000 7f54e1078640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:17.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.082+0000 7f54e1078640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:17.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.082+0000 7f54e1078640 10 monclient(hunting): my global_id is 4369 2024-02-09T08:03:17.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.082+0000 7f54e1078640 1 -- 172.21.15.62:0/3517092315 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54c8003520 con 0x7f54dc0b5000 2024-02-09T08:03:17.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.083+0000 7f508a7fc640 1 -- 172.21.15.62:0/3093602433 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 113582339 0 0) 0x7f5074003520 con 0x7f508c0a9e50 2024-02-09T08:03:17.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.083+0000 7f508a7fc640 1 -- 172.21.15.62:0/3093602433 >> v2:172.21.15.62:3300/0 conn(0x7f508c1431d0 msgr2=0x7f508c13f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:17.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.083+0000 7f508a7fc640 1 --2- 172.21.15.62:0/3093602433 >> v2:172.21.15.62:3300/0 conn(0x7f508c1431d0 0x7f508c13f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.083+0000 7f508a7fc640 1 -- 172.21.15.62:0/3093602433 >> v1:172.21.15.62:6789/0 conn(0x7f508c072490 legacy=0x7f508c142ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:17.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.083+0000 7f508a7fc640 10 monclient: _finish_hunting 0 2024-02-09T08:03:17.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.083+0000 7f508a7fc640 1 monclient: found mon.noname-c-legacy 2024-02-09T08:03:17.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.083+0000 7f508a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:17.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.083+0000 7f508a7fc640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:172.21.15.103:6789/0 2024-02-09T08:03:17.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.083+0000 7f508a7fc640 1 -- 172.21.15.62:0/3093602433 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f508c1425a0 con 0x7f508c0a9e50 2024-02-09T08:03:17.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.083+0000 7f508a7fc640 10 monclient: _finish_auth 0 2024-02-09T08:03:17.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.083+0000 7f508a7fc640 10 monclient: _check_auth_tickets 2024-02-09T08:03:17.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.083+0000 7f508a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:17.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.083+0000 7f5091dfa640 5 monclient: authenticate success, global_id 4366 2024-02-09T08:03:17.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.083+0000 7f5091dfa640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-02-09T08:03:17.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.085+0000 7f508a7fc640 1 -- 172.21.15.62:0/3093602433 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1140318843 0 0) 0x7f50840019f0 con 0x7f508c0a9e50 2024-02-09T08:03:17.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.085+0000 7f508a7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:17.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.085+0000 7f508a7fc640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2024-02-09T08:03:17.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.085+0000 7f508a7fc640 10 monclient: dump: 2024-02-09T08:03:17.102 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:17.102 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:17.102 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:17.102 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:17.102 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:17.102 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:17.102 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:17.102 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:17.103 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:17.103 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:17.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.085+0000 7f508a7fc640 1 monclient: mon.b has (v2) addrs [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] but i'm connected to v1:172.21.15.103:6789/0, reconnecting 2024-02-09T08:03:17.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.085+0000 7f508a7fc640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:17.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.085+0000 7f508a7fc640 1 -- 172.21.15.62:0/3093602433 >> v1:172.21.15.103:6789/0 conn(0x7f508c0a9e50 legacy=0x7f508c14ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:17.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.085+0000 7f508a7fc640 10 monclient: _add_conns ranks=[2,1,0] 2024-02-09T08:03:17.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.085+0000 7f508a7fc640 1 --2- 172.21.15.62:0/3093602433 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f50740039e0 0x7f5074003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:17.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.086+0000 7f508a7fc640 10 monclient(hunting): picked mon.c con 0x7f50740039e0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:17.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.086+0000 7f508a7fc640 1 --2- 172.21.15.62:0/3093602433 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50740047c0 0x7f5074004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:17.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.086+0000 7f508a7fc640 10 monclient(hunting): picked mon.b con 0x7f50740047c0 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:03:17.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.086+0000 7f508a7fc640 1 --2- 172.21.15.62:0/3093602433 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5074005380 0x7f507400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:17.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.086+0000 7f508a7fc640 10 monclient(hunting): picked mon.a con 0x7f5074005380 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:03:17.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.086+0000 7f508a7fc640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:17.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.086+0000 7f508a7fc640 1 -- 172.21.15.62:0/3093602433 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508c072870 con 0x7f5074005380 2024-02-09T08:03:17.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.086+0000 7f508a7fc640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:17.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.086+0000 7f508a7fc640 1 -- 172.21.15.62:0/3093602433 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f507400c1f0 con 0x7f50740047c0 2024-02-09T08:03:17.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.086+0000 7f508a7fc640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:17.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.086+0000 7f508a7fc640 1 -- 172.21.15.62:0/3093602433 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f507400c3b0 con 0x7f50740039e0 2024-02-09T08:03:17.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.086+0000 7f508a7fc640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:17.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.086+0000 7f508a7fc640 10 monclient(hunting): _finish_auth 0 2024-02-09T08:03:17.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.086+0000 7f5091dfa640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2024-02-09T08:03:17.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.089+0000 7f54e1078640 1 -- 172.21.15.62:0/3517092315 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1112426819 0 0) 0x7f54c8003520 con 0x7f54dc0b5000 2024-02-09T08:03:17.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.089+0000 7f54e1078640 1 -- 172.21.15.62:0/3517092315 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f54dc13fdf0 msgr2=0x7f54dc146320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:17.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.089+0000 7f54e1078640 1 --2- 172.21.15.62:0/3517092315 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f54dc13fdf0 0x7f54dc146320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.089+0000 7f54e1078640 1 -- 172.21.15.62:0/3517092315 >> v2:172.21.15.62:3300/0 conn(0x7f54dc0a9e30 msgr2=0x7f54dc145de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:17.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.089+0000 7f54e1078640 1 --2- 172.21.15.62:0/3517092315 >> v2:172.21.15.62:3300/0 conn(0x7f54dc0a9e30 0x7f54dc145de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.089+0000 7f54e1078640 10 monclient: _finish_hunting 0 2024-02-09T08:03:17.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.089+0000 7f54e1078640 1 monclient: found mon.noname-c-legacy 2024-02-09T08:03:17.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.089+0000 7f54e1078640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:17.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.089+0000 7f54e1078640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:172.21.15.103:6789/0 2024-02-09T08:03:17.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.089+0000 7f54e1078640 1 -- 172.21.15.62:0/3517092315 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54dc0b2900 con 0x7f54dc0b5000 2024-02-09T08:03:17.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.089+0000 7f54e1078640 10 monclient: _finish_auth 0 2024-02-09T08:03:17.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.089+0000 7f54e1078640 10 monclient: _check_auth_tickets 2024-02-09T08:03:17.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.089+0000 7f54e1078640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:17.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.089+0000 7f54e1078640 1 -- 172.21.15.62:0/3517092315 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1140318843 0 0) 0x7f54d40019f0 con 0x7f54dc0b5000 2024-02-09T08:03:17.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.089+0000 7f54e1078640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:17.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.089+0000 7f54e1078640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2024-02-09T08:03:17.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.089+0000 7f54e1078640 10 monclient: dump: 2024-02-09T08:03:17.107 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:17.107 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:17.108 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:17.108 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:17.108 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:17.108 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:17.108 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:17.108 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:17.108 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:17.108 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:17.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.089+0000 7f54e1078640 1 monclient: mon.b has (v2) addrs [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] but i'm connected to v1:172.21.15.103:6789/0, reconnecting 2024-02-09T08:03:17.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.089+0000 7f54e1078640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:17.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.089+0000 7f54e1078640 1 -- 172.21.15.62:0/3517092315 >> v1:172.21.15.103:6789/0 conn(0x7f54dc0b5000 legacy=0x7f54dc13f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:17.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.089+0000 7f508affd640 1 --2- 172.21.15.62:0/3093602433 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50740047c0 0x7f5074004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:17.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.089+0000 7f54e1078640 10 monclient: _add_conns ranks=[1,0,2] 2024-02-09T08:03:17.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.089+0000 7f54e1078640 1 --2- 172.21.15.62:0/3517092315 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54c80039e0 0x7f54c8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:17.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.089+0000 7f54e1078640 10 monclient(hunting): picked mon.b con 0x7f54c80039e0 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:03:17.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.089+0000 7f54e1078640 1 --2- 172.21.15.62:0/3517092315 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54c80047c0 0x7f54c8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:17.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.089+0000 7f54e1078640 10 monclient(hunting): picked mon.a con 0x7f54c80047c0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:03:17.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.089+0000 7f54e1078640 1 --2- 172.21.15.62:0/3517092315 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f54c8005380 0x7f54c8014190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:17.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.089+0000 7f54e1078640 10 monclient(hunting): picked mon.c con 0x7f54c8005380 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:17.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.089+0000 7f54e1078640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:17.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.089+0000 7f54e1078640 1 -- 172.21.15.62:0/3517092315 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54dc0b53e0 con 0x7f54c80047c0 2024-02-09T08:03:17.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.089+0000 7f54e1078640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:17.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.089+0000 7f54e1078640 1 -- 172.21.15.62:0/3517092315 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54dc146860 con 0x7f54c80039e0 2024-02-09T08:03:17.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.089+0000 7f54e1078640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:17.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.089+0000 7f54e1078640 1 -- 172.21.15.62:0/3517092315 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c8014a80 con 0x7f54c8005380 2024-02-09T08:03:17.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.089+0000 7f54e1078640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:17.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.089+0000 7f54e1078640 10 monclient(hunting): _finish_auth 0 2024-02-09T08:03:17.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.090+0000 7f508affd640 10 monclient(hunting): get_auth_request con 0x7f50740047c0 auth_method 0 2024-02-09T08:03:17.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.090+0000 7f508affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:17.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.090+0000 7f508affd640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:17.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.090+0000 7f508affd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-02-09T08:03:17.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.091+0000 7f508affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:17.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.091+0000 7f508affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:17.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.091+0000 7f508affd640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-02-09T08:03:17.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.093+0000 7f508affd640 10 monclient(hunting): handle_auth_done global_id 4366 payload 293 2024-02-09T08:03:17.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.093+0000 7f508affd640 1 -- 172.21.15.62:0/3093602433 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f50740039e0 msgr2=0x7f5074003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:17.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.093+0000 7f508affd640 1 --2- 172.21.15.62:0/3093602433 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f50740039e0 0x7f5074003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.093+0000 7f508affd640 1 -- 172.21.15.62:0/3093602433 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5074005380 msgr2=0x7f507400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:17.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.093+0000 7f508affd640 1 --2- 172.21.15.62:0/3093602433 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5074005380 0x7f507400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.093+0000 7f508affd640 10 monclient: _finish_hunting 0 2024-02-09T08:03:17.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.093+0000 7f508affd640 1 monclient: found mon.b 2024-02-09T08:03:17.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.093+0000 7f508affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:17.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.093+0000 7f508affd640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:17.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.093+0000 7f508bfff640 1 -- 172.21.15.62:0/3093602433 reap_dead start 2024-02-09T08:03:17.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.093+0000 7f508affd640 1 -- 172.21.15.62:0/3093602433 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5074003520 con 0x7f50740047c0 2024-02-09T08:03:17.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.093+0000 7f508affd640 10 monclient: _finish_auth 0 2024-02-09T08:03:17.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.093+0000 7f508affd640 10 monclient: _check_auth_tickets 2024-02-09T08:03:17.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.093+0000 7f508affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:17.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.095+0000 7f54e207a640 1 --2- 172.21.15.62:0/3517092315 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54c80039e0 0x7f54c8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:17.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.096+0000 7f54e207a640 10 monclient(hunting): get_auth_request con 0x7f54c80039e0 auth_method 0 2024-02-09T08:03:17.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.096+0000 7f54e207a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:17.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.096+0000 7f54e207a640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:17.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.096+0000 7f54e207a640 10 monclient(hunting): _init_auth already have auth, reseting 2024-02-09T08:03:17.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.096+0000 7f508affd640 1 --2- 172.21.15.62:0/3093602433 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50740047c0 0x7f5074004c40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f508c143630 tx=0x7f50740057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc4cd787e084475d server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:17.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.098+0000 7f54e207a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:17.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.098+0000 7f54e207a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:17.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.098+0000 7f54e207a640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-02-09T08:03:17.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.101+0000 7f54e207a640 10 monclient(hunting): handle_auth_done global_id 4369 payload 293 2024-02-09T08:03:17.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.101+0000 7f54e207a640 1 -- 172.21.15.62:0/3517092315 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f54c8005380 msgr2=0x7f54c8014190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:17.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.101+0000 7f54e207a640 1 --2- 172.21.15.62:0/3517092315 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f54c8005380 0x7f54c8014190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.101+0000 7f54e207a640 1 -- 172.21.15.62:0/3517092315 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54c80047c0 msgr2=0x7f54c8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:17.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.101+0000 7f54e207a640 1 --2- 172.21.15.62:0/3517092315 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54c80047c0 0x7f54c8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.101+0000 7f54e207a640 10 monclient: _finish_hunting 0 2024-02-09T08:03:17.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.101+0000 7f54e207a640 1 monclient: found mon.b 2024-02-09T08:03:17.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.101+0000 7f54e207a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:17.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.101+0000 7f54e207a640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:17.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.101+0000 7f54e207a640 1 -- 172.21.15.62:0/3517092315 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54dc0b2900 con 0x7f54c80039e0 2024-02-09T08:03:17.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.101+0000 7f54e207a640 10 monclient: _finish_auth 0 2024-02-09T08:03:17.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.101+0000 7f54e207a640 10 monclient: _check_auth_tickets 2024-02-09T08:03:17.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.101+0000 7f54e207a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:17.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.101+0000 7f54e42de640 5 monclient: authenticate success, global_id 4369 2024-02-09T08:03:17.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.101+0000 7f54e42de640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-02-09T08:03:17.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.102+0000 7f508a7fc640 1 -- 172.21.15.62:0/3093602433 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5080032600 con 0x7f50740047c0 2024-02-09T08:03:17.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.102+0000 7f508a7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:17.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.102+0000 7f508a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:03:17.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.102+0000 7f508a7fc640 10 monclient: dump: 2024-02-09T08:03:17.118 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:17.118 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:17.118 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:17.118 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:17.118 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:17.119 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:17.119 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:17.119 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:17.119 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:17.119 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:17.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.102+0000 7f508a7fc640 1 -- 172.21.15.62:0/3093602433 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f508002e050 con 0x7f50740047c0 2024-02-09T08:03:17.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.102+0000 7f5091dfa640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-02-09T08:03:17.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.102+0000 7f508a7fc640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:17.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.102+0000 7f5091dfa640 10 monclient: get_monmap_and_config success 2024-02-09T08:03:17.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.102+0000 7f5091dfa640 4 set_mon_vals no callback set 2024-02-09T08:03:17.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.102+0000 7f508a7fc640 1 -- 172.21.15.62:0/3093602433 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50800329c0 con 0x7f50740047c0 2024-02-09T08:03:17.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.102+0000 7f508a7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:17.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.102+0000 7f508a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:03:17.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.102+0000 7f508a7fc640 10 monclient: dump: 2024-02-09T08:03:17.119 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:17.120 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:17.120 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:17.120 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:17.120 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:17.121 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:17.121 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:17.121 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:17.121 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:17.121 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:17.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.103+0000 7f5091dfa640 10 monclient: shutdown 2024-02-09T08:03:17.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.103+0000 7f5091dfa640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:17.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.103+0000 7f5091dfa640 1 -- 172.21.15.62:0/3093602433 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50740047c0 msgr2=0x7f5074004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:17.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.103+0000 7f5091dfa640 1 --2- 172.21.15.62:0/3093602433 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50740047c0 0x7f5074004c40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f508c143630 tx=0x7f50740057f0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.103+0000 7f5091dfa640 1 -- 172.21.15.62:0/3093602433 shutdown_connections 2024-02-09T08:03:17.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.103+0000 7f5091dfa640 1 --2- 172.21.15.62:0/3093602433 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50740047c0 0x7f5074004c40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.103+0000 7f5091dfa640 1 -- 172.21.15.62:0/3093602433 >> 172.21.15.62:0/3093602433 conn(0x7f508c0b3cb0 msgr2=0x7f508c0b40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:17.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.103+0000 7f5091dfa640 1 -- 172.21.15.62:0/3093602433 shutdown_connections 2024-02-09T08:03:17.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.103+0000 7f5091dfa640 1 -- 172.21.15.62:0/3093602433 wait complete. 2024-02-09T08:03:17.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.104+0000 7f5091dfa640 10 monclient: build_initial_monmap 2024-02-09T08:03:17.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.104+0000 7f5091dfa640 10 monclient: monmap: 2024-02-09T08:03:17.122 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:17.122 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:03:17.122 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:03:17.122 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:03:17.122 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:17.122 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:17.123 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:03:17.123 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:03:17.123 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:03:17.123 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:17.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.104+0000 7f7009ffb640 1 -- 172.21.15.62:0/2951724241 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f700c03b050 con 0x7f70141464f0 2024-02-09T08:03:17.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.104+0000 7f5091dfa640 1 librados: starting msgr at 2024-02-09T08:03:17.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.104+0000 7f5091dfa640 1 librados: starting objecter 2024-02-09T08:03:17.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.105+0000 7f5091dfa640 1 Processor -- start 2024-02-09T08:03:17.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.105+0000 7f7009ffb640 1 --2- 172.21.15.62:0/2951724241 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f6ff806d1a0 0x7f6ff806f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:17.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.105+0000 7f70191d2640 1 --2- 172.21.15.62:0/2951724241 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f6ff806d1a0 0x7f6ff806f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:17.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.105+0000 7f5091dfa640 1 -- start start 2024-02-09T08:03:17.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.105+0000 7f5091dfa640 1 librados: setting wanted keys 2024-02-09T08:03:17.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.105+0000 7f5091dfa640 1 librados: calling monclient init 2024-02-09T08:03:17.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.105+0000 7f5091dfa640 10 monclient: init 2024-02-09T08:03:17.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.105+0000 7f70191d2640 10 monclient: get_auth_request con 0x7f6ff806d1a0 auth_method 0 2024-02-09T08:03:17.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.105+0000 7f54e207a640 1 --2- 172.21.15.62:0/3517092315 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54c80039e0 0x7f54c8003e00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f54d400a8a0 tx=0x7f54c80057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30baced3add6b8eb server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:17.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.105+0000 7f70191d2640 1 --2- 172.21.15.62:0/2951724241 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f6ff806d1a0 0x7f6ff806f660 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7010009710 tx=0x7f7010006c90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:17.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.105+0000 7f7009ffb640 10 client.4359.objecter ms_handle_connect 0x7f6ff806d1a0 2024-02-09T08:03:17.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.106+0000 7f5091dfa640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:17.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.106+0000 7f5091dfa640 10 monclient: _add_conns ranks=[0,1,2] 2024-02-09T08:03:17.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.106+0000 7f5091dfa640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f50740047c0 0x7f508c0b28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:17.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.106+0000 7f5091dfa640 10 monclient(hunting): picked mon.noname-a con 0x7f50740047c0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:03:17.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.106+0000 7f5091dfa640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f508c11d140 0x7f508c11dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:17.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.106+0000 7f5091dfa640 10 monclient(hunting): picked mon.noname-b con 0x7f508c11d140 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:03:17.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.106+0000 7f5091dfa640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f508c1d76e0 0x7f508c138c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:17.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.106+0000 7f5091dfa640 10 monclient(hunting): picked mon.noname-c con 0x7f508c1d76e0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:17.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.106+0000 7f5091dfa640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:17.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.106+0000 7f5091dfa640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508c11d750 con 0x7f50740047c0 2024-02-09T08:03:17.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.106+0000 7f5091dfa640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:17.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.106+0000 7f5091dfa640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508c11f330 con 0x7f508c11d140 2024-02-09T08:03:17.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.106+0000 7f5091dfa640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:17.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.106+0000 7f5091dfa640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f508c11d560 con 0x7f508c1d76e0 2024-02-09T08:03:17.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.106+0000 7f5091dfa640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:17.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.106+0000 7f5091dfa640 10 monclient(hunting): authenticate will time out at 1440.466561s 2024-02-09T08:03:17.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.109+0000 7f54e1078640 1 -- 172.21.15.62:0/3517092315 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d4034630 con 0x7f54c80039e0 2024-02-09T08:03:17.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.109+0000 7f508affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f508c11d140 0x7f508c11dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:17.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.109+0000 7f54e1078640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:17.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.109+0000 7f54e1078640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:03:17.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.109+0000 7f54e1078640 10 monclient: dump: 2024-02-09T08:03:17.129 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:17.129 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:17.129 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:17.129 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:17.129 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:17.129 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:17.130 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:17.130 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:17.130 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:17.130 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:17.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.109+0000 7f54e1078640 1 -- 172.21.15.62:0/3517092315 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54d402f070 con 0x7f54c80039e0 2024-02-09T08:03:17.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.109+0000 7f54e1078640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:17.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.109+0000 7f54e1078640 1 -- 172.21.15.62:0/3517092315 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d40349f0 con 0x7f54c80039e0 2024-02-09T08:03:17.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.109+0000 7f54e1078640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:17.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.110+0000 7f508affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f508c11d140 0x7f508c11dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.62:40262/0 (socket says 172.21.15.62:40262) 2024-02-09T08:03:17.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.109+0000 7f54e1078640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:03:17.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.109+0000 7f54e1078640 10 monclient: dump: 2024-02-09T08:03:17.131 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:17.131 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:17.131 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:17.131 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:17.131 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:17.131 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:17.131 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:17.131 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:17.131 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:17.131 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:17.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.109+0000 7f54e42de640 10 monclient: get_monmap_and_config success 2024-02-09T08:03:17.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.109+0000 7f54e42de640 4 set_mon_vals no callback set 2024-02-09T08:03:17.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.110+0000 7f508affd640 1 -- 172.21.15.62:0/1806176421 learned_addr learned my addr 172.21.15.62:0/1806176421 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:17.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.110+0000 7f508affd640 10 monclient(hunting): get_auth_request con 0x7f508c11d140 auth_method 0 2024-02-09T08:03:17.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.110+0000 7f508affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:17.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.110+0000 7f508affd640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:17.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.110+0000 7f508affd640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:17.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.110+0000 7f54e42de640 10 monclient: shutdown 2024-02-09T08:03:17.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.110+0000 7f54e42de640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:17.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.110+0000 7f54e42de640 1 -- 172.21.15.62:0/3517092315 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54c80039e0 msgr2=0x7f54c8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:17.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.110+0000 7f54e42de640 1 --2- 172.21.15.62:0/3517092315 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54c80039e0 0x7f54c8003e00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f54d400a8a0 tx=0x7f54c80057f0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.110+0000 7f54e287b640 1 -- 172.21.15.62:0/3517092315 reap_dead start 2024-02-09T08:03:17.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.110+0000 7f508affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:17.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.110+0000 7f508affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:17.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.110+0000 7f508affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:17.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.110+0000 7f54e42de640 1 -- 172.21.15.62:0/3517092315 shutdown_connections 2024-02-09T08:03:17.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.110+0000 7f54e42de640 1 -- 172.21.15.62:0/3517092315 >> 172.21.15.62:0/3517092315 conn(0x7f54dc066bb0 msgr2=0x7f54dc066fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:17.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.110+0000 7f54e42de640 1 -- 172.21.15.62:0/3517092315 shutdown_connections 2024-02-09T08:03:17.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.110+0000 7f54e42de640 1 -- 172.21.15.62:0/3517092315 wait complete. 2024-02-09T08:03:17.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.111+0000 7f54e42de640 10 monclient: build_initial_monmap 2024-02-09T08:03:17.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.111+0000 7f54e42de640 10 monclient: monmap: 2024-02-09T08:03:17.135 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:17.135 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:03:17.135 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:03:17.136 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:03:17.136 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:17.136 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:17.136 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:03:17.136 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:03:17.136 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:03:17.136 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:17.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.111+0000 7f54e42de640 1 librados: starting msgr at 2024-02-09T08:03:17.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.111+0000 7f54e42de640 1 librados: starting objecter 2024-02-09T08:03:17.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.111+0000 7f54e42de640 1 Processor -- start 2024-02-09T08:03:17.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.111+0000 7f54e42de640 1 -- start start 2024-02-09T08:03:17.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.111+0000 7f54e42de640 1 librados: setting wanted keys 2024-02-09T08:03:17.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.111+0000 7f54e42de640 1 librados: calling monclient init 2024-02-09T08:03:17.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.111+0000 7f54e42de640 10 monclient: init 2024-02-09T08:03:17.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.112+0000 7f54e42de640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:17.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.112+0000 7f54e42de640 10 monclient: _add_conns ranks=[2,0,1] 2024-02-09T08:03:17.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.112+0000 7f54e42de640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f54c80039e0 0x7f54dc142c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:17.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.112+0000 7f54e42de640 10 monclient(hunting): picked mon.noname-c con 0x7f54c80039e0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:17.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.112+0000 7f54e42de640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54dc1d6ad0 0x7f54dc0b8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:17.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.112+0000 7f54e42de640 10 monclient(hunting): picked mon.noname-a con 0x7f54dc1d6ad0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:03:17.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.112+0000 7f54e42de640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54dc0b7790 0x7f54dc070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:17.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.112+0000 7f54e42de640 10 monclient(hunting): picked mon.noname-b con 0x7f54dc0b7790 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:03:17.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.112+0000 7f54e42de640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:17.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.112+0000 7f54e42de640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54dc06ddb0 con 0x7f54dc1d6ad0 2024-02-09T08:03:17.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.112+0000 7f54e42de640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:17.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.112+0000 7f54e42de640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54dc0b8240 con 0x7f54dc0b7790 2024-02-09T08:03:17.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.112+0000 7f54e42de640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:17.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.112+0000 7f54e42de640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54dc0b8ca0 con 0x7f54c80039e0 2024-02-09T08:03:17.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.112+0000 7f54e42de640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:17.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.112+0000 7f54e42de640 10 monclient(hunting): authenticate will time out at 1440.472669s 2024-02-09T08:03:17.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.114+0000 7f508affd640 10 monclient(hunting): handle_auth_done global_id 4372 payload 824 2024-02-09T08:03:17.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.114+0000 7f508affd640 1 -- 172.21.15.62:0/1806176421 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f508c1d76e0 msgr2=0x7f508c138c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:17.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.114+0000 7f508affd640 1 --2- 172.21.15.62:0/1806176421 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f508c1d76e0 0x7f508c138c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.114+0000 7f508affd640 1 -- 172.21.15.62:0/1806176421 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f50740047c0 msgr2=0x7f508c0b28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:17.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.114+0000 7f508affd640 1 --2- 172.21.15.62:0/1806176421 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f50740047c0 0x7f508c0b28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.114+0000 7f508affd640 10 monclient: _finish_hunting 0 2024-02-09T08:03:17.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.114+0000 7f508affd640 1 monclient: found mon.noname-b 2024-02-09T08:03:17.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.114+0000 7f508affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:17.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.114+0000 7f508affd640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.103:3300/0 2024-02-09T08:03:17.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.114+0000 7f508affd640 1 -- 172.21.15.62:0/1806176421 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f508c11d980 con 0x7f508c11d140 2024-02-09T08:03:17.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.116+0000 7f54e287b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54dc0b7790 0x7f54dc070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:17.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.117+0000 7f508affd640 1 --2- 172.21.15.62:0/1806176421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f508c11d140 0x7f508c11dea0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5080009950 tx=0x7f50800047d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:17.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.117+0000 7f5073fff640 10 client.?.objecter ms_handle_connect 0x7f508c11d140 2024-02-09T08:03:17.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.117+0000 7f5073fff640 10 client.?.objecter resend_mon_ops 2024-02-09T08:03:17.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.117+0000 7f54e287b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54dc0b7790 0x7f54dc070740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.62:40270/0 (socket says 172.21.15.62:40270) 2024-02-09T08:03:17.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.117+0000 7f54e287b640 1 -- 172.21.15.62:0/760294374 learned_addr learned my addr 172.21.15.62:0/760294374 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:17.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.117+0000 7f54e287b640 10 monclient(hunting): get_auth_request con 0x7f54dc0b7790 auth_method 0 2024-02-09T08:03:17.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.117+0000 7f54e287b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:17.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.117+0000 7f54e287b640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:17.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.117+0000 7f54e287b640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:17.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.118+0000 7f54e287b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:17.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.118+0000 7f54e287b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:17.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.118+0000 7f54e287b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:17.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.122+0000 7f54e287b640 10 monclient(hunting): handle_auth_done global_id 4375 payload 824 2024-02-09T08:03:17.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.122+0000 7f54e287b640 1 -- 172.21.15.62:0/760294374 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f54c80039e0 msgr2=0x7f54dc142c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:17.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.122+0000 7f54e287b640 1 --2- 172.21.15.62:0/760294374 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f54c80039e0 0x7f54dc142c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.122+0000 7f54e287b640 1 -- 172.21.15.62:0/760294374 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54dc1d6ad0 msgr2=0x7f54dc0b8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:17.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.123+0000 7f54e287b640 1 --2- 172.21.15.62:0/760294374 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54dc1d6ad0 0x7f54dc0b8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.123+0000 7f54e287b640 10 monclient: _finish_hunting 0 2024-02-09T08:03:17.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.123+0000 7f54e287b640 1 monclient: found mon.noname-b 2024-02-09T08:03:17.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.123+0000 7f54e287b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:17.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.123+0000 7f54e287b640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.103:3300/0 2024-02-09T08:03:17.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.123+0000 7f54e287b640 1 -- 172.21.15.62:0/760294374 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54dc0b4870 con 0x7f54dc0b7790 2024-02-09T08:03:17.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.124+0000 7f5073fff640 1 -- 172.21.15.62:0/1806176421 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508003c610 con 0x7f508c11d140 2024-02-09T08:03:17.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.124+0000 7f5073fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:17.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.124+0000 7f5073fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:03:17.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.124+0000 7f5073fff640 10 monclient: dump: 2024-02-09T08:03:17.143 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:17.143 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:17.143 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:17.143 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:17.143 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:17.144 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:17.144 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:17.144 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:17.144 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:17.144 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:17.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.124+0000 7f5073fff640 10 monclient: _finish_auth 0 2024-02-09T08:03:17.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.124+0000 7f5073fff640 10 monclient: _check_auth_tickets 2024-02-09T08:03:17.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.124+0000 7f5073fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:17.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.124+0000 7f5073fff640 1 -- 172.21.15.62:0/1806176421 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f508003c770 con 0x7f508c11d140 2024-02-09T08:03:17.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.124+0000 7f5091dfa640 5 monclient: authenticate success, global_id 4372 2024-02-09T08:03:17.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.124+0000 7f5091dfa640 10 monclient: _renew_subs 2024-02-09T08:03:17.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.124+0000 7f5091dfa640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:17.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.124+0000 7f5091dfa640 1 -- 172.21.15.62:0/1806176421 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f508c1d5220 con 0x7f508c11d140 2024-02-09T08:03:17.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.124+0000 7f5073fff640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:17.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.124+0000 7f5089ffb640 4 set_mon_vals no callback set 2024-02-09T08:03:17.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.124+0000 7f5091dfa640 10 client.4372.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:03:17.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.124+0000 7f5091dfa640 10 monclient: _renew_subs 2024-02-09T08:03:17.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.124+0000 7f5091dfa640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:17.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.124+0000 7f5091dfa640 1 -- 172.21.15.62:0/1806176421 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f508c1d7d40 con 0x7f508c11d140 2024-02-09T08:03:17.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.124+0000 7f5091dfa640 1 librados: init done 2024-02-09T08:03:17.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.125+0000 7f5073fff640 1 -- 172.21.15.62:0/1806176421 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508003cb20 con 0x7f508c11d140 2024-02-09T08:03:17.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.125+0000 7f5073fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:17.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.125+0000 7f5073fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:03:17.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.125+0000 7f5073fff640 10 monclient: dump: 2024-02-09T08:03:17.145 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:17.145 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:17.145 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:17.145 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:17.145 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:17.145 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:17.146 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:17.146 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:17.146 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:17.146 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:17.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.125+0000 7f5091dfa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:17.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.125+0000 7f5091dfa640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:17.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.125+0000 7f5091dfa640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:17.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.125+0000 7f5091dfa640 1 -- 172.21.15.62:0/1806176421 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f508c11db10 con 0x7f508c11d140 2024-02-09T08:03:17.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.151+0000 7f7009ffb640 1 -- 172.21.15.62:0/2951724241 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f700c07aee0 con 0x7f70141464f0 2024-02-09T08:03:17.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.151+0000 7f7009ffb640 10 client.4359.objecter ms_dispatch 0x7f7014000b90 osd_map(26..26 src has 1..26) v4 2024-02-09T08:03:17.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.151+0000 7f7009ffb640 3 client.4359.objecter handle_osd_map got epochs [26,26] > 0 2024-02-09T08:03:17.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.151+0000 7f7009ffb640 3 client.4359.objecter handle_osd_map decoding full epoch 26 2024-02-09T08:03:17.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.152+0000 7f7009ffb640 20 client.4359.objecter dump_active .. 0 homeless 2024-02-09T08:03:17.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.152+0000 7f7009ffb640 1 -- 172.21.15.62:0/2951724241 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f700c077180 con 0x7f70141464f0 2024-02-09T08:03:17.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.152+0000 7f7009ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:17.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.152+0000 7f7009ffb640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:03:17.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.174+0000 7f036b7fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f036c0a9e30 0x7f036c13fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:17.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.175+0000 7f0370a7b640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f036c145de0 0x7f036c1461f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34522/0 (socket says 172.21.15.62:34522) 2024-02-09T08:03:17.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.175+0000 7f0370a7b640 1 -- 172.21.15.62:0/2369885523 learned_addr learned my addr 172.21.15.62:0/2369885523 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-09T08:03:17.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.176+0000 7f036b7fe640 10 monclient(hunting): get_auth_request con 0x7f036c0a9e30 auth_method 0 2024-02-09T08:03:17.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.176+0000 7f036b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:17.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.176+0000 7f036b7fe640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:17.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.176+0000 7f036b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:17.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.177+0000 7f036b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:17.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.177+0000 7f036b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:17.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.177+0000 7f036b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:17.181 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-02-09T08:03:17.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.180+0000 7f036b7fe640 10 monclient(hunting): handle_auth_done global_id 4362 payload 274 2024-02-09T08:03:17.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.180+0000 7f036b7fe640 1 -- 172.21.15.62:0/2369885523 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f036c0b5000 msgr2=0x7f036c13f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:17.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.180+0000 7f036b7fe640 1 --2- 172.21.15.62:0/2369885523 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f036c0b5000 0x7f036c13f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.180+0000 7f036b7fe640 1 -- 172.21.15.62:0/2369885523 >> v1:172.21.15.62:6789/0 conn(0x7f036c145de0 legacy=0x7f036c1461f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:17.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.180+0000 7f036b7fe640 10 monclient: _finish_hunting 0 2024-02-09T08:03:17.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.180+0000 7f036b7fe640 1 monclient: found mon.noname-a 2024-02-09T08:03:17.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.180+0000 7f036b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:17.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.180+0000 7f036b7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-02-09T08:03:17.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.180+0000 7f036b7fe640 1 -- 172.21.15.62:0/2369885523 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f036c0b2900 con 0x7f036c0a9e30 2024-02-09T08:03:17.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.187+0000 7f036b7fe640 1 --2- 172.21.15.62:0/2369885523 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f036c0a9e30 0x7f036c13fc20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f03600097a0 tx=0x7f036002b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4f5e4f8e34305e9 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:17.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.199+0000 7f036affd640 1 -- 172.21.15.62:0/2369885523 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0360031780 con 0x7f036c0a9e30 2024-02-09T08:03:17.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.199+0000 7f036affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:17.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.199+0000 7f036affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-09T08:03:17.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.199+0000 7f036affd640 10 monclient: dump: 2024-02-09T08:03:17.201 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:17.201 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:17.202 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:17.202 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:17.202 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:17.202 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:17.202 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:17.202 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:17.202 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:17.202 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:17.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.199+0000 7f036affd640 10 monclient: _finish_auth 0 2024-02-09T08:03:17.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.199+0000 7f036affd640 10 monclient: _check_auth_tickets 2024-02-09T08:03:17.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.199+0000 7f036affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:17.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.199+0000 7f036affd640 1 -- 172.21.15.62:0/2369885523 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03600318e0 con 0x7f036c0a9e30 2024-02-09T08:03:17.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.199+0000 7f03724de640 5 monclient: authenticate success, global_id 4362 2024-02-09T08:03:17.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.199+0000 7f03724de640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-02-09T08:03:17.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.199+0000 7f036affd640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:17.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.199+0000 7f036affd640 1 -- 172.21.15.62:0/2369885523 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0360031c70 con 0x7f036c0a9e30 2024-02-09T08:03:17.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.199+0000 7f036affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:17.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.199+0000 7f036affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-09T08:03:17.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.199+0000 7f036affd640 10 monclient: dump: 2024-02-09T08:03:17.203 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:17.203 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:17.203 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:17.203 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:17.203 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:17.203 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:17.203 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:17.203 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:17.203 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:17.203 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:17.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.199+0000 7f03724de640 10 monclient: get_monmap_and_config success 2024-02-09T08:03:17.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.199+0000 7f03724de640 4 set_mon_vals no callback set 2024-02-09T08:03:17.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.199+0000 7f03724de640 10 monclient: shutdown 2024-02-09T08:03:17.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.200+0000 7f03724de640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:17.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.200+0000 7f03724de640 1 -- 172.21.15.62:0/2369885523 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f036c0a9e30 msgr2=0x7f036c13fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:17.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.200+0000 7f03724de640 1 --2- 172.21.15.62:0/2369885523 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f036c0a9e30 0x7f036c13fc20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f03600097a0 tx=0x7f036002b820 comp rx=0 tx=0).stop 2024-02-09T08:03:17.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.200+0000 7f03724de640 1 -- 172.21.15.62:0/2369885523 shutdown_connections 2024-02-09T08:03:17.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.200+0000 7f03724de640 1 --2- 172.21.15.62:0/2369885523 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f036c0a9e30 0x7f036c13fc20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.200+0000 7f03724de640 1 --2- 172.21.15.62:0/2369885523 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f036c0b5000 0x7f036c13f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.200+0000 7f03724de640 1 -- 172.21.15.62:0/2369885523 >> 172.21.15.62:0/2369885523 conn(0x7f036c066bb0 msgr2=0x7f036c066fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:17.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.200+0000 7f03724de640 1 -- 172.21.15.62:0/2369885523 shutdown_connections 2024-02-09T08:03:17.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.200+0000 7f03724de640 1 -- 172.21.15.62:0/2369885523 wait complete. 2024-02-09T08:03:17.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.201+0000 7f03724de640 10 monclient: build_initial_monmap 2024-02-09T08:03:17.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.201+0000 7f03724de640 10 monclient: monmap: 2024-02-09T08:03:17.208 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:17.208 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:03:17.208 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:03:17.208 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:03:17.208 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:17.208 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:17.208 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:03:17.208 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:03:17.208 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:03:17.208 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:17.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.201+0000 7f03724de640 1 librados: starting msgr at 2024-02-09T08:03:17.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.201+0000 7f03724de640 1 librados: starting objecter 2024-02-09T08:03:17.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.202+0000 7f03724de640 1 Processor -- start 2024-02-09T08:03:17.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.202+0000 7f03724de640 1 -- start start 2024-02-09T08:03:17.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.202+0000 7f03724de640 1 librados: setting wanted keys 2024-02-09T08:03:17.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.202+0000 7f03724de640 1 librados: calling monclient init 2024-02-09T08:03:17.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.202+0000 7f03724de640 10 monclient: init 2024-02-09T08:03:17.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.203+0000 7f03724de640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:17.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.203+0000 7f03724de640 10 monclient: _add_conns ranks=[1,0,2] 2024-02-09T08:03:17.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.203+0000 7f03724de640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f036c0a9e30 0x7f036c1357a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:17.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.203+0000 7f03724de640 10 monclient(hunting): picked mon.noname-b con 0x7f036c0a9e30 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:03:17.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.203+0000 7f03724de640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f036c0b5000 0x7f036c142c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:17.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.203+0000 7f03724de640 10 monclient(hunting): picked mon.noname-a con 0x7f036c0b5000 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:03:17.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.203+0000 7f03724de640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f036c145de0 0x7f036c1d7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:17.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.203+0000 7f03724de640 10 monclient(hunting): picked mon.noname-c con 0x7f036c145de0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:17.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.204+0000 7f03724de640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:17.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.204+0000 7f03724de640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f036c135090 con 0x7f036c0b5000 2024-02-09T08:03:17.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.204+0000 7f03724de640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:17.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.204+0000 7f03724de640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f036c1352c0 con 0x7f036c0a9e30 2024-02-09T08:03:17.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.204+0000 7f03724de640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:17.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.204+0000 7f03724de640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f036c141990 con 0x7f036c145de0 2024-02-09T08:03:17.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.204+0000 7f03724de640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:17.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.204+0000 7f03724de640 10 monclient(hunting): authenticate will time out at 1440.564309s 2024-02-09T08:03:17.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.205+0000 7f036b7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f036c0b5000 0x7f036c142c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:17.210 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-02-09T08:03:17.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.205+0000 7f036b7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f036c0b5000 0x7f036c142c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:35140/0 (socket says 172.21.15.62:35140) 2024-02-09T08:03:17.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.205+0000 7f036b7fe640 1 -- 172.21.15.62:0/2882853261 learned_addr learned my addr 172.21.15.62:0/2882853261 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:17.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.205+0000 7f036b7fe640 10 monclient(hunting): get_auth_request con 0x7f036c0b5000 auth_method 0 2024-02-09T08:03:17.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.205+0000 7f036b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:17.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.205+0000 7f036b7fe640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:17.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.205+0000 7f036b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:17.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.206+0000 7f036b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:17.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.206+0000 7f036b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:17.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.206+0000 7f036b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:17.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.210+0000 7f036b7fe640 10 monclient(hunting): handle_auth_done global_id 4368 payload 824 2024-02-09T08:03:17.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.210+0000 7f036b7fe640 1 -- 172.21.15.62:0/2882853261 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f036c145de0 msgr2=0x7f036c1d7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:17.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.210+0000 7f036b7fe640 1 --2- 172.21.15.62:0/2882853261 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f036c145de0 0x7f036c1d7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.210+0000 7f036b7fe640 1 -- 172.21.15.62:0/2882853261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f036c0a9e30 msgr2=0x7f036c1357a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:17.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.210+0000 7f036b7fe640 1 --2- 172.21.15.62:0/2882853261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f036c0a9e30 0x7f036c1357a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.210+0000 7f036b7fe640 10 monclient: _finish_hunting 0 2024-02-09T08:03:17.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.210+0000 7f036b7fe640 1 monclient: found mon.noname-a 2024-02-09T08:03:17.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.210+0000 7f036b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:17.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.211+0000 7f036b7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-02-09T08:03:17.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.211+0000 7f036b7fe640 1 -- 172.21.15.62:0/2882853261 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0360009400 con 0x7f036c0b5000 2024-02-09T08:03:17.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.215+0000 7f036b7fe640 1 --2- 172.21.15.62:0/2882853261 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f036c0b5000 0x7f036c142c20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0360000c00 tx=0x7f03600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:17.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.215+0000 7f0368ff9640 10 client.?.objecter ms_handle_connect 0x7f036c0b5000 2024-02-09T08:03:17.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.215+0000 7f0368ff9640 10 client.?.objecter resend_mon_ops 2024-02-09T08:03:17.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.218+0000 7f0368ff9640 1 -- 172.21.15.62:0/2882853261 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0360032960 con 0x7f036c0b5000 2024-02-09T08:03:17.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.218+0000 7f0368ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:17.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.218+0000 7f0368ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-09T08:03:17.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.218+0000 7f0368ff9640 10 monclient: dump: 2024-02-09T08:03:17.224 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:17.224 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:17.224 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:17.224 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:17.224 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:17.224 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:17.224 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:17.224 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:17.225 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:17.225 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:17.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.218+0000 7f0368ff9640 10 monclient: _finish_auth 0 2024-02-09T08:03:17.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.219+0000 7f0368ff9640 10 monclient: _check_auth_tickets 2024-02-09T08:03:17.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.219+0000 7f0368ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:17.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.219+0000 7f03724de640 5 monclient: authenticate success, global_id 4368 2024-02-09T08:03:17.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.219+0000 7f03724de640 10 monclient: _renew_subs 2024-02-09T08:03:17.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.219+0000 7f03724de640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:03:17.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.219+0000 7f03724de640 1 -- 172.21.15.62:0/2882853261 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f036c0b4870 con 0x7f036c0b5000 2024-02-09T08:03:17.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.219+0000 7f03724de640 10 client.4368.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:03:17.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.219+0000 7f03724de640 10 monclient: _renew_subs 2024-02-09T08:03:17.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.219+0000 7f03724de640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:03:17.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.219+0000 7f03724de640 1 -- 172.21.15.62:0/2882853261 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f036c143160 con 0x7f036c0b5000 2024-02-09T08:03:17.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.219+0000 7f03724de640 1 librados: init done 2024-02-09T08:03:17.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.220+0000 7f03724de640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:17.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.220+0000 7f03724de640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:17.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.220+0000 7f03724de640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:03:17.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.220+0000 7f03724de640 1 -- 172.21.15.62:0/2882853261 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f036c135480 con 0x7f036c0b5000 2024-02-09T08:03:17.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.221+0000 7f0368ff9640 1 -- 172.21.15.62:0/2882853261 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0360032ac0 con 0x7f036c0b5000 2024-02-09T08:03:17.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.221+0000 7f0368ff9640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:17.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.221+0000 7f0368ff9640 1 -- 172.21.15.62:0/2882853261 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0360032e70 con 0x7f036c0b5000 2024-02-09T08:03:17.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.221+0000 7f0368ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:17.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.221+0000 7f0368ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-09T08:03:17.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.221+0000 7f0368ff9640 10 monclient: dump: 2024-02-09T08:03:17.226 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:17.226 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:17.227 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:17.227 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:17.227 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:17.227 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:17.227 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:17.227 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:17.227 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:17.227 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:17.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.221+0000 7f036a7fc640 4 set_mon_vals no callback set 2024-02-09T08:03:17.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.223+0000 7f0b71ffb640 1 -- 172.21.15.62:0/1439048145 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f0b6c04d3f0 con 0x7f0b7c0a9930 2024-02-09T08:03:17.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.224+0000 7f0b71ffb640 1 --2- 172.21.15.62:0/1439048145 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f0b6006d1d0 0x7f0b6006f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:17.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.224+0000 7f0b8106d640 1 --2- 172.21.15.62:0/1439048145 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f0b6006d1d0 0x7f0b6006f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:17.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.224+0000 7f0b8106d640 10 monclient: get_auth_request con 0x7f0b6006d1d0 auth_method 0 2024-02-09T08:03:17.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.225+0000 7f0b8106d640 1 --2- 172.21.15.62:0/1439048145 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f0b6006d1d0 0x7f0b6006f690 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0b78001560 tx=0x7f0b78007990 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:17.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.225+0000 7f0b71ffb640 10 client.4331.objecter ms_handle_connect 0x7f0b6006d1d0 2024-02-09T08:03:17.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.241+0000 7f0b71ffb640 1 -- 172.21.15.62:0/1439048145 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0b6c07b220 con 0x7f0b7c0a9930 2024-02-09T08:03:17.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.241+0000 7f0b71ffb640 10 client.4331.objecter ms_dispatch 0x7f0b7c000b90 osd_map(26..26 src has 1..26) v4 2024-02-09T08:03:17.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.241+0000 7f0b71ffb640 3 client.4331.objecter handle_osd_map got epochs [26,26] > 0 2024-02-09T08:03:17.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.241+0000 7f0b71ffb640 3 client.4331.objecter handle_osd_map decoding full epoch 26 2024-02-09T08:03:17.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.241+0000 7f0b71ffb640 20 client.4331.objecter dump_active .. 0 homeless 2024-02-09T08:03:17.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.242+0000 7f0b71ffb640 1 -- 172.21.15.62:0/1439048145 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0b6c076dc0 con 0x7f0b7c0a9930 2024-02-09T08:03:17.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.242+0000 7f0b71ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:17.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.242+0000 7f0b71ffb640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:03:17.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.281+0000 7f0368ff9640 1 -- 172.21.15.62:0/2882853261 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f036004e450 con 0x7f036c0b5000 2024-02-09T08:03:17.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.281+0000 7f0368ff9640 1 --2- 172.21.15.62:0/2882853261 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f035806d1a0 0x7f035806f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:17.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.282+0000 7f036bfff640 1 --2- 172.21.15.62:0/2882853261 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f035806d1a0 0x7f035806f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:17.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.282+0000 7f036bfff640 10 monclient: get_auth_request con 0x7f035806d1a0 auth_method 0 2024-02-09T08:03:17.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.282+0000 7f0368ff9640 10 client.4368.objecter ms_handle_connect 0x7f035806d1a0 2024-02-09T08:03:17.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.282+0000 7f036bfff640 1 --2- 172.21.15.62:0/2882853261 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f035806d1a0 0x7f035806f660 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f035c009710 tx=0x7f035c006c90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:17.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.313+0000 7f62cae62640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2024-02-09T08:03:17.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.313+0000 7f62cae62640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2024-02-09T08:03:17.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.313+0000 7f62cae62640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:17.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.313+0000 7f62cae62640 1 -- 172.21.15.62:0/1714551101 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f62c413eaf0 con 0x7f62c4144160 2024-02-09T08:03:17.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.316+0000 7f0368ff9640 1 -- 172.21.15.62:0/2882853261 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f036007b550 con 0x7f036c0b5000 2024-02-09T08:03:17.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.316+0000 7f0368ff9640 10 client.4368.objecter ms_dispatch 0x7f036c000b90 osd_map(26..26 src has 1..26) v4 2024-02-09T08:03:17.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.316+0000 7f0368ff9640 3 client.4368.objecter handle_osd_map got epochs [26,26] > 0 2024-02-09T08:03:17.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.316+0000 7f0368ff9640 3 client.4368.objecter handle_osd_map decoding full epoch 26 2024-02-09T08:03:17.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.316+0000 7f0368ff9640 20 client.4368.objecter dump_active .. 0 homeless 2024-02-09T08:03:17.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.323+0000 7fa75b208640 10 monclient: get_monmap_and_config 2024-02-09T08:03:17.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.323+0000 7fa75b208640 10 monclient: build_initial_monmap 2024-02-09T08:03:17.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.323+0000 7fa75b208640 10 monclient: monmap: 2024-02-09T08:03:17.327 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:17.327 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:17.327 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:03:17.324942+0000 2024-02-09T08:03:17.328 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:03:17.324942+0000 2024-02-09T08:03:17.328 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:17.328 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:17.328 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:03:17.328 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:03:17.328 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:03:17.329 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:03:17.329 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:03:17.329 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:17.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.324+0000 7fa75b208640 1 Processor -- start 2024-02-09T08:03:17.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.324+0000 7fa75b208640 1 -- start start 2024-02-09T08:03:17.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.324+0000 7fa75b208640 10 monclient: init 2024-02-09T08:03:17.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.325+0000 7fa75b208640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:17.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.325+0000 7fa75b208640 10 monclient: _add_conns ranks=[4,2,3,1,0] 2024-02-09T08:03:17.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.325+0000 7fa75b208640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa7540b5000 0x7fa75413f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:17.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.325+0000 7fa75b208640 10 monclient(hunting): picked mon.noname-c con 0x7fa7540b5000 addr v2:172.21.15.103:3300/0 2024-02-09T08:03:17.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.325+0000 7fa75b208640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa7540a9e30 0x7fa75413fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:17.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.325+0000 7fa75b208640 10 monclient(hunting): picked mon.noname-b con 0x7fa7540a9e30 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:17.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.325+0000 7fa75b208640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa754145de0 0x7fa7541461f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:17.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.325+0000 7fa75b208640 10 monclient(hunting): picked mon.noname-a con 0x7fa754145de0 addr v2:172.21.15.62:3300/0 2024-02-09T08:03:17.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.325+0000 7fa75b208640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:17.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.325+0000 7fa75b208640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa754140160 con 0x7fa754145de0 2024-02-09T08:03:17.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.325+0000 7fa75b208640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:17.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.325+0000 7fa75b208640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7540b53e0 con 0x7fa7540b5000 2024-02-09T08:03:17.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.325+0000 7fa75b208640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:17.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.325+0000 7fa75b208640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7540aa4a0 con 0x7fa7540a9e30 2024-02-09T08:03:17.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.325+0000 7fa75b208640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:17.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.325+0000 7fa75b208640 10 monclient(hunting): authenticate will time out at 1440.685964s 2024-02-09T08:03:17.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.326+0000 7fa753fff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa7540a9e30 0x7fa75413fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:17.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.326+0000 7fa753fff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa7540a9e30 0x7fa75413fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:33054/0 (socket says 172.21.15.62:33054) 2024-02-09T08:03:17.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.326+0000 7fa753fff640 1 -- 172.21.15.62:0/1877614635 learned_addr learned my addr 172.21.15.62:0/1877614635 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:17.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.326+0000 7fa753fff640 10 monclient(hunting): get_auth_request con 0x7fa7540a9e30 auth_method 0 2024-02-09T08:03:17.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.326+0000 7fa753fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:17.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.326+0000 7fa753fff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:17.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.326+0000 7fa753fff640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:17.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.327+0000 7fa753fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:17.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.327+0000 7fa753fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:17.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.327+0000 7fa753fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:17.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.330+0000 7fa753fff640 10 monclient(hunting): handle_auth_done global_id 4334 payload 274 2024-02-09T08:03:17.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.330+0000 7fa753fff640 1 -- 172.21.15.62:0/1877614635 >> v2:172.21.15.103:3300/0 conn(0x7fa7540b5000 msgr2=0x7fa75413f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:17.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.330+0000 7fa753fff640 1 --2- 172.21.15.62:0/1877614635 >> v2:172.21.15.103:3300/0 conn(0x7fa7540b5000 0x7fa75413f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.330+0000 7fa753fff640 1 -- 172.21.15.62:0/1877614635 >> v2:172.21.15.62:3300/0 conn(0x7fa754145de0 msgr2=0x7fa7541461f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:17.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.330+0000 7fa753fff640 1 --2- 172.21.15.62:0/1877614635 >> v2:172.21.15.62:3300/0 conn(0x7fa754145de0 0x7fa7541461f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.330+0000 7fa753fff640 10 monclient: _finish_hunting 0 2024-02-09T08:03:17.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.330+0000 7fa753fff640 1 monclient: found mon.noname-b 2024-02-09T08:03:17.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.330+0000 7fa753fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:17.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.330+0000 7fa753fff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.62:3301/0 2024-02-09T08:03:17.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.330+0000 7fa753fff640 1 -- 172.21.15.62:0/1877614635 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7540b2900 con 0x7fa7540a9e30 2024-02-09T08:03:17.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.333+0000 7fa753fff640 1 --2- 172.21.15.62:0/1877614635 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa7540a9e30 0x7fa75413fc20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa7540b56c0 tx=0x7fa74002b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b698a8a766713f68 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:17.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.339+0000 7fa7537fe640 1 -- 172.21.15.62:0/1877614635 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7400317c0 con 0x7fa7540a9e30 2024-02-09T08:03:17.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.339+0000 7fa7537fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:17.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.339+0000 7fa7537fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:03:17.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.339+0000 7fa7537fe640 10 monclient: dump: 2024-02-09T08:03:17.345 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:17.345 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:17.345 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:17.345 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:17.345 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:17.345 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:17.346 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:17.346 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:17.346 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:17.346 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:17.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.339+0000 7fa7537fe640 10 monclient: _finish_auth 0 2024-02-09T08:03:17.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.339+0000 7fa7537fe640 10 monclient: _check_auth_tickets 2024-02-09T08:03:17.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.339+0000 7fa7537fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:17.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.339+0000 7fa7537fe640 1 -- 172.21.15.62:0/1877614635 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa740031920 con 0x7fa7540a9e30 2024-02-09T08:03:17.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.339+0000 7fa7537fe640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:17.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.339+0000 7fa7537fe640 1 -- 172.21.15.62:0/1877614635 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa740031cb0 con 0x7fa7540a9e30 2024-02-09T08:03:17.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.339+0000 7fa7537fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:17.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.339+0000 7fa7537fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-09T08:03:17.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.339+0000 7fa7537fe640 10 monclient: dump: 2024-02-09T08:03:17.346 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:17.347 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:17.347 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:17.347 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:17.347 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:17.347 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:17.347 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:17.347 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:17.347 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:17.347 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:17.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.339+0000 7fa75b208640 5 monclient: authenticate success, global_id 4334 2024-02-09T08:03:17.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.339+0000 7fa75b208640 10 monclient: get_monmap_and_config success 2024-02-09T08:03:17.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.339+0000 7fa75b208640 4 set_mon_vals no callback set 2024-02-09T08:03:17.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.340+0000 7fa75b208640 10 monclient: shutdown 2024-02-09T08:03:17.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.340+0000 7fa75b208640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:17.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.340+0000 7fa75b208640 1 -- 172.21.15.62:0/1877614635 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa7540a9e30 msgr2=0x7fa75413fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:17.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.340+0000 7fa75b208640 1 --2- 172.21.15.62:0/1877614635 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa7540a9e30 0x7fa75413fc20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa7540b56c0 tx=0x7fa74002b860 comp rx=0 tx=0).stop 2024-02-09T08:03:17.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.340+0000 7fa75b208640 1 -- 172.21.15.62:0/1877614635 shutdown_connections 2024-02-09T08:03:17.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.340+0000 7fa75b208640 1 --2- 172.21.15.62:0/1877614635 >> v2:172.21.15.62:3300/0 conn(0x7fa754145de0 0x7fa7541461f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.340+0000 7fa75b208640 1 --2- 172.21.15.62:0/1877614635 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa7540a9e30 0x7fa75413fc20 secure :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa7540b56c0 tx=0x7fa74002b860 comp rx=0 tx=0).stop 2024-02-09T08:03:17.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.340+0000 7fa75b208640 1 --2- 172.21.15.62:0/1877614635 >> v2:172.21.15.103:3300/0 conn(0x7fa7540b5000 0x7fa75413f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.340+0000 7fa75b208640 1 -- 172.21.15.62:0/1877614635 >> 172.21.15.62:0/1877614635 conn(0x7fa754066bb0 msgr2=0x7fa754066fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:17.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.340+0000 7fa75b208640 1 -- 172.21.15.62:0/1877614635 shutdown_connections 2024-02-09T08:03:17.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.340+0000 7fa75b208640 1 -- 172.21.15.62:0/1877614635 wait complete. 2024-02-09T08:03:17.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.341+0000 7fa75b208640 10 monclient: build_initial_monmap 2024-02-09T08:03:17.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.341+0000 7fa75b208640 10 monclient: monmap: 2024-02-09T08:03:17.348 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:17.348 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:03:17.349 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:03:17.349 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:03:17.349 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:17.349 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:17.349 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:03:17.349 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:03:17.349 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:03:17.349 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:17.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.341+0000 7fa75b208640 1 librados: starting msgr at 2024-02-09T08:03:17.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.341+0000 7fa75b208640 1 librados: starting objecter 2024-02-09T08:03:17.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.341+0000 7fa75b208640 1 Processor -- start 2024-02-09T08:03:17.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.341+0000 7fa75b208640 1 -- start start 2024-02-09T08:03:17.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.341+0000 7fa75b208640 1 librados: setting wanted keys 2024-02-09T08:03:17.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.341+0000 7fa75b208640 1 librados: calling monclient init 2024-02-09T08:03:17.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.341+0000 7fa75b208640 10 monclient: init 2024-02-09T08:03:17.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.342+0000 7fa75b208640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:17.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.342+0000 7fa75b208640 10 monclient: _add_conns ranks=[1,2,0] 2024-02-09T08:03:17.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.342+0000 7fa75b208640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7540b5000 0x7fa75413c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:17.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.342+0000 7fa75b208640 10 monclient(hunting): picked mon.noname-b con 0x7fa7540b5000 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:03:17.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.342+0000 7fa75b208640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa754145de0 0x7fa7541db000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:17.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.342+0000 7fa75b208640 10 monclient(hunting): picked mon.noname-c con 0x7fa754145de0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:17.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.342+0000 7fa75b208640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa75413b080 0x7fa754132530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:17.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.342+0000 7fa75b208640 10 monclient(hunting): picked mon.noname-a con 0x7fa75413b080 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:03:17.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.342+0000 7fa75b208640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:17.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.342+0000 7fa75b208640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa75413aef0 con 0x7fa75413b080 2024-02-09T08:03:17.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.342+0000 7fa75b208640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:17.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.342+0000 7fa75b208640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa75413a9d0 con 0x7fa7540b5000 2024-02-09T08:03:17.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.342+0000 7fa75b208640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:17.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.342+0000 7fa75b208640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa754145700 con 0x7fa754145de0 2024-02-09T08:03:17.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.342+0000 7fa75b208640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:17.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.342+0000 7fa75b208640 10 monclient(hunting): authenticate will time out at 1440.702808s 2024-02-09T08:03:17.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.343+0000 7fa753fff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa754145de0 0x7fa7541db000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:17.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.344+0000 7fa753fff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa754145de0 0x7fa7541db000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:33062/0 (socket says 172.21.15.62:33062) 2024-02-09T08:03:17.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.344+0000 7fa753fff640 1 -- 172.21.15.62:0/1511082850 learned_addr learned my addr 172.21.15.62:0/1511082850 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:17.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.344+0000 7fa753fff640 10 monclient(hunting): get_auth_request con 0x7fa754145de0 auth_method 0 2024-02-09T08:03:17.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.344+0000 7fa753fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:17.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.344+0000 7fa753fff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:17.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.344+0000 7fa753fff640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:17.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.345+0000 7fa753fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:17.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.345+0000 7fa753fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:17.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.345+0000 7fa753fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:17.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.350+0000 7fa753fff640 10 monclient(hunting): handle_auth_done global_id 4337 payload 824 2024-02-09T08:03:17.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.350+0000 7fa753fff640 1 -- 172.21.15.62:0/1511082850 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7540b5000 msgr2=0x7fa75413c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:17.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.350+0000 7fa753fff640 1 --2- 172.21.15.62:0/1511082850 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7540b5000 0x7fa75413c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.350+0000 7fa753fff640 1 -- 172.21.15.62:0/1511082850 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa75413b080 msgr2=0x7fa754132530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:17.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.350+0000 7fa753fff640 1 --2- 172.21.15.62:0/1511082850 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa75413b080 0x7fa754132530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.350+0000 7fa753fff640 10 monclient: _finish_hunting 0 2024-02-09T08:03:17.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.350+0000 7fa753fff640 1 monclient: found mon.noname-c 2024-02-09T08:03:17.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.350+0000 7fa753fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:17.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.350+0000 7fa753fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-02-09T08:03:17.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.350+0000 7fa753fff640 1 -- 172.21.15.62:0/1511082850 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7400094d0 con 0x7fa754145de0 2024-02-09T08:03:17.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.351+0000 7fa753fff640 1 --2- 172.21.15.62:0/1511082850 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa754145de0 0x7fa7541db000 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa740034040 tx=0x7fa7400046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:17.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.352+0000 7fa7517fa640 10 client.?.objecter ms_handle_connect 0x7fa754145de0 2024-02-09T08:03:17.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.352+0000 7fa7517fa640 10 client.?.objecter resend_mon_ops 2024-02-09T08:03:17.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.356+0000 7fe74f8b0640 10 monclient: get_monmap_and_config 2024-02-09T08:03:17.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.356+0000 7fe74f8b0640 10 monclient: build_initial_monmap 2024-02-09T08:03:17.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.356+0000 7fe74f8b0640 10 monclient: monmap: 2024-02-09T08:03:17.360 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:17.360 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:17.360 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:03:17.357872+0000 2024-02-09T08:03:17.360 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:03:17.357872+0000 2024-02-09T08:03:17.360 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:17.360 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:17.360 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:03:17.361 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:03:17.361 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:03:17.361 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:03:17.361 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:03:17.361 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:17.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.357+0000 7fa7517fa640 1 -- 172.21.15.62:0/1511082850 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa740004220 con 0x7fa754145de0 2024-02-09T08:03:17.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.357+0000 7fa7517fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:17.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.357+0000 7fe74f8b0640 1 Processor -- start 2024-02-09T08:03:17.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.357+0000 7fa7517fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-09T08:03:17.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.357+0000 7fa7517fa640 10 monclient: dump: 2024-02-09T08:03:17.364 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:17.364 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:17.364 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:17.365 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:17.365 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:17.365 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:17.365 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:17.365 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:17.365 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:17.366 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:17.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.357+0000 7fa7517fa640 10 monclient: _finish_auth 0 2024-02-09T08:03:17.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.357+0000 7fa7517fa640 10 monclient: _check_auth_tickets 2024-02-09T08:03:17.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.357+0000 7fa7517fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:17.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.357+0000 7fe74f8b0640 1 -- start start 2024-02-09T08:03:17.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.357+0000 7fe74f8b0640 10 monclient: init 2024-02-09T08:03:17.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.357+0000 7fa7517fa640 1 -- 172.21.15.62:0/1511082850 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa740004380 con 0x7fa754145de0 2024-02-09T08:03:17.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.357+0000 7fa7517fa640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:17.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.357+0000 7fa752ffd640 4 set_mon_vals no callback set 2024-02-09T08:03:17.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.357+0000 7fa7517fa640 1 -- 172.21.15.62:0/1511082850 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa740003850 con 0x7fa754145de0 2024-02-09T08:03:17.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.358+0000 7fa7517fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:17.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.358+0000 7fa7517fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-09T08:03:17.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.358+0000 7fa7517fa640 10 monclient: dump: 2024-02-09T08:03:17.369 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:17.369 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:17.369 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:17.369 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:17.369 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:17.369 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:17.369 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:17.369 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:17.370 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:17.370 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:17.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.358+0000 7fa75b208640 5 monclient: authenticate success, global_id 4337 2024-02-09T08:03:17.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.358+0000 7fa75b208640 10 monclient: _renew_subs 2024-02-09T08:03:17.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.358+0000 7fa75b208640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:03:17.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.358+0000 7fa75b208640 1 -- 172.21.15.62:0/1511082850 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7540b4870 con 0x7fa754145de0 2024-02-09T08:03:17.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.358+0000 7fa75b208640 10 client.4337.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:03:17.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.358+0000 7fa75b208640 10 monclient: _renew_subs 2024-02-09T08:03:17.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.358+0000 7fa75b208640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:03:17.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.358+0000 7fa75b208640 1 -- 172.21.15.62:0/1511082850 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7541db720 con 0x7fa754145de0 2024-02-09T08:03:17.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.358+0000 7fa75b208640 1 librados: init done 2024-02-09T08:03:17.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.358+0000 7fe74f8b0640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:17.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.358+0000 7fe74f8b0640 10 monclient: _add_conns ranks=[1,3,0,4,2] 2024-02-09T08:03:17.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.358+0000 7fe74f8b0640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fe7480b5000 addr v1:172.21.15.103:6789/0 2024-02-09T08:03:17.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.358+0000 7fe74f8b0640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe7480a9e30 0x7fe748145de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:17.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.358+0000 7fe74f8b0640 10 monclient(hunting): picked mon.noname-a con 0x7fe7480a9e30 addr v2:172.21.15.62:3300/0 2024-02-09T08:03:17.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.358+0000 7fe74f8b0640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe74813fdf0 addr v1:172.21.15.62:6789/0 2024-02-09T08:03:17.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.358+0000 7fe74f8b0640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7480aa4a0 con 0x7fe74813fdf0 2024-02-09T08:03:17.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.358+0000 7fe74f8b0640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7480b2900 con 0x7fe7480b5000 2024-02-09T08:03:17.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.358+0000 7fe74f8b0640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:17.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.358+0000 7fe74f8b0640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7480b53e0 con 0x7fe7480a9e30 2024-02-09T08:03:17.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.358+0000 7fe74f8b0640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:17.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.358+0000 7fe74f8b0640 10 monclient(hunting): authenticate will time out at 1440.718901s 2024-02-09T08:03:17.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.359+0000 7fa75b208640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:17.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.359+0000 7fa75b208640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:17.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.359+0000 7fa75b208640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:03:17.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.359+0000 7fa75b208640 1 -- 172.21.15.62:0/1511082850 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7540b4670 con 0x7fa754145de0 2024-02-09T08:03:17.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.372+0000 7f5073fff640 1 -- 172.21.15.62:0/1806176421 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f5080039050 con 0x7f508c11d140 2024-02-09T08:03:17.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.372+0000 7f5073fff640 1 --2- 172.21.15.62:0/1806176421 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f507806d1a0 0x7f507806f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:17.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.372+0000 7f508b7fe640 1 --2- 172.21.15.62:0/1806176421 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f507806d1a0 0x7f507806f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:17.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.372+0000 7f508b7fe640 10 monclient: get_auth_request con 0x7f507806d1a0 auth_method 0 2024-02-09T08:03:17.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.373+0000 7f5073fff640 10 client.4372.objecter ms_handle_connect 0x7f507806d1a0 2024-02-09T08:03:17.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.373+0000 7f508b7fe640 1 --2- 172.21.15.62:0/1806176421 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f507806d1a0 0x7f507806f660 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f507c001550 tx=0x7f507c007990 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:17.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.376+0000 7f5073fff640 1 -- 172.21.15.62:0/1806176421 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f50800044c0 con 0x7f508c11d140 2024-02-09T08:03:17.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.376+0000 7f5073fff640 10 client.4372.objecter ms_dispatch 0x7f508c000b90 osd_map(26..26 src has 1..26) v4 2024-02-09T08:03:17.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.376+0000 7f5073fff640 3 client.4372.objecter handle_osd_map got epochs [26,26] > 0 2024-02-09T08:03:17.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.376+0000 7f5073fff640 3 client.4372.objecter handle_osd_map decoding full epoch 26 2024-02-09T08:03:17.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.376+0000 7f5073fff640 20 client.4372.objecter dump_active .. 0 homeless 2024-02-09T08:03:17.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.386+0000 7f5073fff640 1 -- 172.21.15.62:0/1806176421 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5080077290 con 0x7f508c11d140 2024-02-09T08:03:17.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.386+0000 7f5073fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:17.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.386+0000 7f5073fff640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:03:17.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.386+0000 7f54e287b640 1 --2- 172.21.15.62:0/760294374 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54dc0b7790 0x7f54dc070740 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f54c80057a0 tx=0x7f54d8001490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:17.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.386+0000 7f54d2ffd640 10 client.?.objecter ms_handle_connect 0x7f54dc0b7790 2024-02-09T08:03:17.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.386+0000 7f54d2ffd640 10 client.?.objecter resend_mon_ops 2024-02-09T08:03:17.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.392+0000 7f54d2ffd640 1 -- 172.21.15.62:0/760294374 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d8005b50 con 0x7f54dc0b7790 2024-02-09T08:03:17.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.392+0000 7f54d2ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:17.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.392+0000 7f54d2ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:03:17.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.392+0000 7f54d2ffd640 10 monclient: dump: 2024-02-09T08:03:17.395 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:17.395 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:17.395 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:17.395 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:17.395 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:17.395 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:17.395 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:17.395 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:17.395 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:17.395 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:17.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.392+0000 7f54d2ffd640 10 monclient: _finish_auth 0 2024-02-09T08:03:17.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.392+0000 7f54d2ffd640 10 monclient: _check_auth_tickets 2024-02-09T08:03:17.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.392+0000 7f54d2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:17.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.392+0000 7f54e42de640 5 monclient: authenticate success, global_id 4375 2024-02-09T08:03:17.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.392+0000 7f54e42de640 10 monclient: _renew_subs 2024-02-09T08:03:17.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.392+0000 7f54e42de640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:17.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.392+0000 7f54e42de640 1 -- 172.21.15.62:0/760294374 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54dc1d6f10 con 0x7f54dc0b7790 2024-02-09T08:03:17.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.392+0000 7fe74d64c640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe7480b5000 0x7fe74813f6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.62:50544/0 (socket says 172.21.15.62:50544) 2024-02-09T08:03:17.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.393+0000 7fe74d64c640 1 -- 172.21.15.62:0/2553009332 learned_addr learned my addr 172.21.15.62:0/2553009332 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-09T08:03:17.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.392+0000 7f54d2ffd640 1 -- 172.21.15.62:0/760294374 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54d8005cd0 con 0x7f54dc0b7790 2024-02-09T08:03:17.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.392+0000 7f54d2ffd640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:17.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.392+0000 7f54e0877640 4 set_mon_vals no callback set 2024-02-09T08:03:17.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.393+0000 7f54e42de640 10 client.4375.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:03:17.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.393+0000 7f54d2ffd640 1 -- 172.21.15.62:0/760294374 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d80072b0 con 0x7f54dc0b7790 2024-02-09T08:03:17.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.393+0000 7f54d2ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:17.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.393+0000 7f54d2ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:03:17.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.393+0000 7f54d2ffd640 10 monclient: dump: 2024-02-09T08:03:17.398 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:17.398 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:17.398 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:17.398 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:17.398 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:17.398 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:17.399 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:17.399 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:17.399 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:17.399 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:17.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.393+0000 7f54e42de640 10 monclient: _renew_subs 2024-02-09T08:03:17.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.393+0000 7f54e42de640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:17.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.393+0000 7f54e42de640 1 -- 172.21.15.62:0/760294374 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54dc0b7e20 con 0x7f54dc0b7790 2024-02-09T08:03:17.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.393+0000 7f54e42de640 1 librados: init done 2024-02-09T08:03:17.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.394+0000 7f54e42de640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:17.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.394+0000 7f54e42de640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:17.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.394+0000 7f54e42de640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:17.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.394+0000 7f54e42de640 1 -- 172.21.15.62:0/760294374 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54dc1462a0 con 0x7f54dc0b7790 2024-02-09T08:03:17.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.437+0000 7f701b436640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2024-02-09T08:03:17.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.437+0000 7f701b436640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2024-02-09T08:03:17.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.437+0000 7f701b436640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:03:17.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.437+0000 7f701b436640 1 -- 172.21.15.62:0/2951724241 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7014140e50 con 0x7f70141464f0 2024-02-09T08:03:17.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.498+0000 7f0b832d1640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 6}] 2024-02-09T08:03:17.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.498+0000 7f0b832d1640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2024-02-09T08:03:17.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.498+0000 7f0b832d1640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:03:17.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.498+0000 7f0b832d1640 1 -- 172.21.15.62:0/1439048145 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f0b7c04ef90 con 0x7f0b7c0a9930 2024-02-09T08:03:17.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.568+0000 7f5091dfa640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2024-02-09T08:03:17.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.568+0000 7f5091dfa640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2024-02-09T08:03:17.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.568+0000 7f5091dfa640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:17.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.568+0000 7f5091dfa640 1 -- 172.21.15.62:0/1806176421 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f508c04ef90 con 0x7f508c11d140 2024-02-09T08:03:17.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.636+0000 7f0368ff9640 1 -- 172.21.15.62:0/2882853261 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f03600770f0 con 0x7f036c0b5000 2024-02-09T08:03:17.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.636+0000 7f0368ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:17.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.636+0000 7f0368ff9640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:03:17.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.636+0000 7f62c17fa640 1 -- 172.21.15.62:0/1714551101 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f62c413eaf0 con 0x7f62c4144160 2024-02-09T08:03:17.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.636+0000 7f62c17fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2024-02-09T08:03:17.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.636+0000 7f62c17fa640 10 monclient: _finish_command 2 = system:0 2024-02-09T08:03:17.640 INFO:teuthology.orchestra.run.smithi062.stdout:64424509445 2024-02-09T08:03:17.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.639+0000 7f62cae62640 10 librados: watch_flush enter 2024-02-09T08:03:17.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.639+0000 7f62cae62640 10 librados: watch_flush exit 2024-02-09T08:03:17.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.639+0000 7f62cae62640 20 client.4363.objecter shutdown clearing up homeless session... 2024-02-09T08:03:17.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.639+0000 7f62cae62640 10 client.4363.objecter successfully canceled tick 2024-02-09T08:03:17.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.640+0000 7f62cae62640 1 -- 172.21.15.62:0/1714551101 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f62a806d1f0 msgr2=0x7f62a806f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:17.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.640+0000 7f62cae62640 1 --2- 172.21.15.62:0/1714551101 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f62a806d1f0 0x7f62a806f6b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f62b8036000 tx=0x7f62b803d040 comp rx=0 tx=0).stop 2024-02-09T08:03:17.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.640+0000 7f62cae62640 10 monclient: shutdown 2024-02-09T08:03:17.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.640+0000 7f62cae62640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:17.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.640+0000 7f62cae62640 1 -- 172.21.15.62:0/1714551101 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62c4144160 msgr2=0x7f62c406f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:17.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.640+0000 7f62cae62640 1 --2- 172.21.15.62:0/1714551101 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62c4144160 0x7f62c406f880 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f62b000c430 tx=0x7f62b000c8f0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.640+0000 7f62cae62640 1 -- 172.21.15.62:0/1714551101 shutdown_connections 2024-02-09T08:03:17.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.640+0000 7f62cae62640 1 --2- 172.21.15.62:0/1714551101 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f62a806d1f0 0x7f62a806f6b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.640+0000 7f62cae62640 1 --2- 172.21.15.62:0/1714551101 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62c41445a0 0x7f62c406fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.640+0000 7f62cae62640 1 --2- 172.21.15.62:0/1714551101 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62c4144160 0x7f62c406f880 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.640+0000 7f62cae62640 1 --2- 172.21.15.62:0/1714551101 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f62c40abf80 0x7f62c413e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.640+0000 7f62cae62640 1 -- 172.21.15.62:0/1714551101 >> 172.21.15.62:0/1714551101 conn(0x7f62c40b3ef0 msgr2=0x7f62c4137ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:17.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.640+0000 7f62cae62640 1 -- 172.21.15.62:0/1714551101 shutdown_connections 2024-02-09T08:03:17.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.640+0000 7f62cae62640 1 -- 172.21.15.62:0/1714551101 wait complete. 2024-02-09T08:03:17.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.640+0000 7f62cae62640 1 librados: shutdown 2024-02-09T08:03:17.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.642+0000 7fe74ce4b640 1 --2- 172.21.15.62:0/2553009332 >> v2:172.21.15.62:3300/0 conn(0x7fe7480a9e30 0x7fe748145de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:17.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.646+0000 7fa7517fa640 1 -- 172.21.15.62:0/1511082850 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fa740043070 con 0x7fa754145de0 2024-02-09T08:03:17.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.646+0000 7f0b71ffb640 1 -- 172.21.15.62:0/1439048145 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0b6c07a480 con 0x7f0b7c0a9930 2024-02-09T08:03:17.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.646+0000 7f0b71ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2024-02-09T08:03:17.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.646+0000 7f0b71ffb640 10 monclient: _finish_command 2 = system:0 2024-02-09T08:03:17.649 INFO:teuthology.orchestra.run.smithi062.stdout:64424509446 2024-02-09T08:03:17.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.646+0000 7fa7517fa640 1 --2- 172.21.15.62:0/1511082850 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fa73806d1f0 0x7fa73806f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:17.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.646+0000 7fa758fa4640 1 --2- 172.21.15.62:0/1511082850 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fa73806d1f0 0x7fa73806f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:17.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.646+0000 7fa758fa4640 10 monclient: get_auth_request con 0x7fa73806d1f0 auth_method 0 2024-02-09T08:03:17.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.647+0000 7fa7517fa640 10 client.4337.objecter ms_handle_connect 0x7fa73806d1f0 2024-02-09T08:03:17.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.647+0000 7fa758fa4640 1 --2- 172.21.15.62:0/1511082850 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fa73806d1f0 0x7fa73806f6b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa748009710 tx=0x7fa748006c90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:17.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.648+0000 7f0b832d1640 10 librados: watch_flush enter 2024-02-09T08:03:17.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.648+0000 7f0b832d1640 10 librados: watch_flush exit 2024-02-09T08:03:17.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.648+0000 7f0b832d1640 20 client.4331.objecter shutdown clearing up homeless session... 2024-02-09T08:03:17.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.648+0000 7f0b832d1640 10 client.4331.objecter successfully canceled tick 2024-02-09T08:03:17.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.648+0000 7f0b832d1640 1 -- 172.21.15.62:0/1439048145 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f0b6006d1d0 msgr2=0x7f0b6006f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:17.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.649+0000 7f0b832d1640 1 --2- 172.21.15.62:0/1439048145 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f0b6006d1d0 0x7f0b6006f690 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0b78001560 tx=0x7f0b78007990 comp rx=0 tx=0).stop 2024-02-09T08:03:17.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.649+0000 7f0b832d1640 10 monclient: shutdown 2024-02-09T08:03:17.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.649+0000 7f0b832d1640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:17.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.649+0000 7f0b832d1640 1 -- 172.21.15.62:0/1439048145 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0b7c0a9930 msgr2=0x7f0b7c1ccab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:17.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.649+0000 7f0b832d1640 1 --2- 172.21.15.62:0/1439048145 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0b7c0a9930 0x7f0b7c1ccab0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c000c00 tx=0x7f0b6c0046c0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.649+0000 7f0b832d1640 1 -- 172.21.15.62:0/1439048145 shutdown_connections 2024-02-09T08:03:17.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.649+0000 7f0b832d1640 1 --2- 172.21.15.62:0/1439048145 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f0b6006d1d0 0x7f0b6006f690 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.649+0000 7f0b832d1640 1 --2- 172.21.15.62:0/1439048145 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b7c142a00 0x7f0b7c1ce570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.649+0000 7f0b832d1640 1 --2- 172.21.15.62:0/1439048145 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0b7c0a9930 0x7f0b7c1ccab0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.649+0000 7f0b832d1640 1 --2- 172.21.15.62:0/1439048145 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b7c067110 0x7f0b7c1cc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.649+0000 7f0b832d1640 1 -- 172.21.15.62:0/1439048145 >> 172.21.15.62:0/1439048145 conn(0x7f0b7c0b4e20 msgr2=0x7f0b7c13d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:17.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.649+0000 7f0b832d1640 1 -- 172.21.15.62:0/1439048145 shutdown_connections 2024-02-09T08:03:17.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.649+0000 7f0b832d1640 1 -- 172.21.15.62:0/1439048145 wait complete. 2024-02-09T08:03:17.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.649+0000 7f0b832d1640 1 librados: shutdown 2024-02-09T08:03:17.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.649+0000 7fe74ce4b640 10 monclient(hunting): get_auth_request con 0x7fe7480a9e30 auth_method 0 2024-02-09T08:03:17.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.650+0000 7fe74ce4b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:17.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.650+0000 7fe74ce4b640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:17.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.650+0000 7fe74ce4b640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:17.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.652+0000 7fe74ce4b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:17.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.652+0000 7fe74ce4b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:17.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.652+0000 7fe74ce4b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:17.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.652+0000 7f54d2ffd640 1 -- 172.21.15.62:0/760294374 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f54d8007410 con 0x7f54dc0b7790 2024-02-09T08:03:17.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.653+0000 7f54d2ffd640 1 --2- 172.21.15.62:0/760294374 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f54c006d1d0 0x7f54c006f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:17.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.653+0000 7f54e207a640 1 --2- 172.21.15.62:0/760294374 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f54c006d1d0 0x7f54c006f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:17.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.653+0000 7f54e207a640 10 monclient: get_auth_request con 0x7f54c006d1d0 auth_method 0 2024-02-09T08:03:17.658 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.2 2024-02-09T08:03:17.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.653+0000 7f54d2ffd640 10 client.4375.objecter ms_handle_connect 0x7f54c006d1d0 2024-02-09T08:03:17.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.653+0000 7f54e207a640 1 --2- 172.21.15.62:0/760294374 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f54c006d1d0 0x7f54c006f690 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f54d4034000 tx=0x7f54d4007000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:17.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.654+0000 7f54d2ffd640 1 -- 172.21.15.62:0/760294374 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f54d8058860 con 0x7f54dc0b7790 2024-02-09T08:03:17.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.654+0000 7f54d2ffd640 10 client.4375.objecter ms_dispatch 0x7f54dc000b90 osd_map(26..26 src has 1..26) v4 2024-02-09T08:03:17.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.654+0000 7f54d2ffd640 3 client.4375.objecter handle_osd_map got epochs [26,26] > 0 2024-02-09T08:03:17.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.654+0000 7f54d2ffd640 3 client.4375.objecter handle_osd_map decoding full epoch 26 2024-02-09T08:03:17.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.654+0000 7f54d2ffd640 20 client.4375.objecter dump_active .. 0 homeless 2024-02-09T08:03:17.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.655+0000 7fe74ce4b640 10 monclient(hunting): handle_auth_done global_id 4371 payload 274 2024-02-09T08:03:17.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.655+0000 7fe74ce4b640 1 -- 172.21.15.62:0/2553009332 >> v1:172.21.15.103:6789/0 conn(0x7fe7480b5000 legacy=0x7fe74813f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:17.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.655+0000 7fe74ce4b640 1 -- 172.21.15.62:0/2553009332 >> v1:172.21.15.62:6789/0 conn(0x7fe74813fdf0 legacy=0x7fe748146320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:17.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.655+0000 7fe74ce4b640 10 monclient: _finish_hunting 0 2024-02-09T08:03:17.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.655+0000 7fe74ce4b640 1 monclient: found mon.noname-a 2024-02-09T08:03:17.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.655+0000 7fe74ce4b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:17.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.655+0000 7fe74ce4b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-02-09T08:03:17.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.655+0000 7fe74ce4b640 1 -- 172.21.15.62:0/2553009332 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7480ab5f0 con 0x7fe7480a9e30 2024-02-09T08:03:17.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.660+0000 7fe74ce4b640 1 --2- 172.21.15.62:0/2553009332 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7480a9e30 0x7fe748145de0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe7380097d0 tx=0x7fe73802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e6a26151c2d6a29 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:17.664 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.6 2024-02-09T08:03:17.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.665+0000 7f54d2ffd640 1 -- 172.21.15.62:0/760294374 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f54d8054400 con 0x7f54dc0b7790 2024-02-09T08:03:17.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.665+0000 7f54d2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:17.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.665+0000 7f54d2ffd640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:03:17.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.666+0000 7fa7517fa640 1 -- 172.21.15.62:0/1511082850 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa74007b130 con 0x7fa754145de0 2024-02-09T08:03:17.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.666+0000 7fa7517fa640 10 client.4337.objecter ms_dispatch 0x7fa754000b90 osd_map(26..26 src has 1..26) v4 2024-02-09T08:03:17.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.666+0000 7fa7517fa640 3 client.4337.objecter handle_osd_map got epochs [26,26] > 0 2024-02-09T08:03:17.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.666+0000 7fa7517fa640 3 client.4337.objecter handle_osd_map decoding full epoch 26 2024-02-09T08:03:17.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.666+0000 7fa7517fa640 20 client.4337.objecter dump_active .. 0 homeless 2024-02-09T08:03:17.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.666+0000 7fa7517fa640 1 -- 172.21.15.62:0/1511082850 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa740076cd0 con 0x7fa754145de0 2024-02-09T08:03:17.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.666+0000 7fa7517fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:17.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.666+0000 7fa7517fa640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:03:17.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.671+0000 7f5073fff640 1 -- 172.21.15.62:0/1806176421 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5080037070 con 0x7f508c11d140 2024-02-09T08:03:17.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.671+0000 7f5073fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2024-02-09T08:03:17.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.671+0000 7f5073fff640 10 monclient: _finish_command 2 = system:0 2024-02-09T08:03:17.673 INFO:teuthology.orchestra.run.smithi062.stdout:64424509445 2024-02-09T08:03:17.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.673+0000 7f5091dfa640 10 librados: watch_flush enter 2024-02-09T08:03:17.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.673+0000 7f5091dfa640 10 librados: watch_flush exit 2024-02-09T08:03:17.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.673+0000 7f5091dfa640 20 client.4372.objecter shutdown clearing up homeless session... 2024-02-09T08:03:17.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.673+0000 7f5091dfa640 10 client.4372.objecter successfully canceled tick 2024-02-09T08:03:17.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.673+0000 7f5091dfa640 1 -- 172.21.15.62:0/1806176421 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f507806d1a0 msgr2=0x7f507806f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:17.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.673+0000 7f5091dfa640 1 --2- 172.21.15.62:0/1806176421 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f507806d1a0 0x7f507806f660 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f507c001550 tx=0x7f507c007990 comp rx=0 tx=0).stop 2024-02-09T08:03:17.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.673+0000 7f5091dfa640 10 monclient: shutdown 2024-02-09T08:03:17.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.673+0000 7f5091dfa640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:17.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.673+0000 7f5091dfa640 1 -- 172.21.15.62:0/1806176421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f508c11d140 msgr2=0x7f508c11dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:17.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.673+0000 7f5091dfa640 1 --2- 172.21.15.62:0/1806176421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f508c11d140 0x7f508c11dea0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5080009950 tx=0x7f50800047d0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.673+0000 7f5091dfa640 1 -- 172.21.15.62:0/1806176421 shutdown_connections 2024-02-09T08:03:17.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.673+0000 7f5091dfa640 1 --2- 172.21.15.62:0/1806176421 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f507806d1a0 0x7f507806f660 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.673+0000 7f5091dfa640 1 --2- 172.21.15.62:0/1806176421 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f508c1d76e0 0x7f508c138c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.673+0000 7f5091dfa640 1 --2- 172.21.15.62:0/1806176421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f508c11d140 0x7f508c11dea0 secure :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5080009950 tx=0x7f50800047d0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.673+0000 7f5091dfa640 1 --2- 172.21.15.62:0/1806176421 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f50740047c0 0x7f508c0b28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.673+0000 7f5091dfa640 1 -- 172.21.15.62:0/1806176421 >> 172.21.15.62:0/1806176421 conn(0x7f508c0b3cb0 msgr2=0x7f508c13d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:17.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.674+0000 7f5091dfa640 1 -- 172.21.15.62:0/1806176421 shutdown_connections 2024-02-09T08:03:17.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.674+0000 7f5091dfa640 1 -- 172.21.15.62:0/1806176421 wait complete. 2024-02-09T08:03:17.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.674+0000 7f5091dfa640 1 librados: shutdown 2024-02-09T08:03:17.692 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.0 2024-02-09T08:03:17.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.760+0000 7f7009ffb640 1 -- 172.21.15.62:0/2951724241 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7014140e50 con 0x7f70141464f0 2024-02-09T08:03:17.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.760+0000 7f7009ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2024-02-09T08:03:17.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.760+0000 7f7009ffb640 10 monclient: _finish_command 2 = system:0 2024-02-09T08:03:17.763 INFO:teuthology.orchestra.run.smithi062.stdout:68719476742 2024-02-09T08:03:17.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.763+0000 7f701b436640 10 librados: watch_flush enter 2024-02-09T08:03:17.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.763+0000 7f701b436640 10 librados: watch_flush exit 2024-02-09T08:03:17.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.763+0000 7f701b436640 20 client.4359.objecter shutdown clearing up homeless session... 2024-02-09T08:03:17.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.763+0000 7f701b436640 10 client.4359.objecter successfully canceled tick 2024-02-09T08:03:17.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.764+0000 7f701b436640 1 -- 172.21.15.62:0/2951724241 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f6ff806d1a0 msgr2=0x7f6ff806f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:17.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.764+0000 7f701b436640 1 --2- 172.21.15.62:0/2951724241 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f6ff806d1a0 0x7f6ff806f660 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7010009710 tx=0x7f7010006c90 comp rx=0 tx=0).stop 2024-02-09T08:03:17.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.764+0000 7f701b436640 10 monclient: shutdown 2024-02-09T08:03:17.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.764+0000 7f701b436640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:17.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.764+0000 7f701b436640 1 -- 172.21.15.62:0/2951724241 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70141464f0 msgr2=0x7f7014132590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:17.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.764+0000 7f701b436640 1 --2- 172.21.15.62:0/2951724241 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70141464f0 0x7f7014132590 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f700c009d90 tx=0x7f700c004a40 comp rx=0 tx=0).stop 2024-02-09T08:03:17.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.764+0000 7f701b436640 1 -- 172.21.15.62:0/2951724241 shutdown_connections 2024-02-09T08:03:17.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.764+0000 7f701b436640 1 --2- 172.21.15.62:0/2951724241 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f6ff806d1a0 0x7f6ff806f660 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.764+0000 7f701b436640 1 --2- 172.21.15.62:0/2951724241 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70141464f0 0x7f7014132590 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.764+0000 7f701b436640 1 --2- 172.21.15.62:0/2951724241 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f70140b5000 0x7f7014132050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.764+0000 7f701b436640 1 --2- 172.21.15.62:0/2951724241 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70140a9e30 0x7f7014133f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.764+0000 7f701b436640 1 -- 172.21.15.62:0/2951724241 >> 172.21.15.62:0/2951724241 conn(0x7f7014066bb0 msgr2=0x7f70140b8700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:17.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.764+0000 7f701b436640 1 -- 172.21.15.62:0/2951724241 shutdown_connections 2024-02-09T08:03:17.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.764+0000 7f701b436640 1 -- 172.21.15.62:0/2951724241 wait complete. 2024-02-09T08:03:17.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.764+0000 7f701b436640 1 librados: shutdown 2024-02-09T08:03:17.779 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476743 got 68719476742 for osd.1 2024-02-09T08:03:17.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.783+0000 7fe73ffff640 1 -- 172.21.15.62:0/2553009332 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe738031830 con 0x7fe7480a9e30 2024-02-09T08:03:17.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.783+0000 7fe73ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:17.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.783+0000 7fe73ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-09T08:03:17.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.783+0000 7fe73ffff640 10 monclient: dump: 2024-02-09T08:03:17.786 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:17.786 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:17.786 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:17.786 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:17.786 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:17.786 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:17.786 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:17.786 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:17.787 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:17.787 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:17.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.783+0000 7fe73ffff640 10 monclient: _finish_auth 0 2024-02-09T08:03:17.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.783+0000 7fe73ffff640 10 monclient: _check_auth_tickets 2024-02-09T08:03:17.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.783+0000 7fe73ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:17.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.783+0000 7fe73ffff640 1 -- 172.21.15.62:0/2553009332 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe738031990 con 0x7fe7480a9e30 2024-02-09T08:03:17.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.783+0000 7fe74f8b0640 5 monclient: authenticate success, global_id 4371 2024-02-09T08:03:17.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.783+0000 7fe74f8b0640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-02-09T08:03:17.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.783+0000 7fe73ffff640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:17.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.783+0000 7fe74f8b0640 10 monclient: get_monmap_and_config success 2024-02-09T08:03:17.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.783+0000 7fe73ffff640 1 -- 172.21.15.62:0/2553009332 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe738031d20 con 0x7fe7480a9e30 2024-02-09T08:03:17.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.783+0000 7fe74f8b0640 4 set_mon_vals no callback set 2024-02-09T08:03:17.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.783+0000 7fe73ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:17.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.783+0000 7fe73ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-09T08:03:17.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.783+0000 7fe73ffff640 10 monclient: dump: 2024-02-09T08:03:17.788 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:17.788 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:17.788 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:17.788 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:17.788 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:17.788 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:17.788 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:17.788 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:17.788 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:17.788 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:17.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.784+0000 7fe74f8b0640 10 monclient: shutdown 2024-02-09T08:03:17.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.784+0000 7fe74f8b0640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:17.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.784+0000 7fe74f8b0640 1 -- 172.21.15.62:0/2553009332 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7480a9e30 msgr2=0x7fe748145de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:17.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.784+0000 7fe74f8b0640 1 --2- 172.21.15.62:0/2553009332 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7480a9e30 0x7fe748145de0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe7380097d0 tx=0x7fe73802b8d0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.784+0000 7fe74f8b0640 1 -- 172.21.15.62:0/2553009332 shutdown_connections 2024-02-09T08:03:17.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.784+0000 7fe74f8b0640 1 --2- 172.21.15.62:0/2553009332 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7480a9e30 0x7fe748145de0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.784+0000 7fe74f8b0640 1 -- 172.21.15.62:0/2553009332 >> 172.21.15.62:0/2553009332 conn(0x7fe748066bb0 msgr2=0x7fe748066fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:17.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.785+0000 7fe74f8b0640 1 -- 172.21.15.62:0/2553009332 shutdown_connections 2024-02-09T08:03:17.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.785+0000 7fe74f8b0640 1 -- 172.21.15.62:0/2553009332 wait complete. 2024-02-09T08:03:17.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.786+0000 7fe74f8b0640 10 monclient: build_initial_monmap 2024-02-09T08:03:17.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.786+0000 7fe74f8b0640 10 monclient: monmap: 2024-02-09T08:03:17.793 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:17.793 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:03:17.793 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:03:17.793 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:03:17.793 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:17.793 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:17.793 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:03:17.793 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:03:17.793 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:03:17.793 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:17.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.786+0000 7fe74f8b0640 1 librados: starting msgr at 2024-02-09T08:03:17.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.786+0000 7fe74f8b0640 1 librados: starting objecter 2024-02-09T08:03:17.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.786+0000 7fe74f8b0640 1 Processor -- start 2024-02-09T08:03:17.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.786+0000 7fe74f8b0640 1 -- start start 2024-02-09T08:03:17.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.786+0000 7fe74f8b0640 1 librados: setting wanted keys 2024-02-09T08:03:17.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.786+0000 7fe74f8b0640 1 librados: calling monclient init 2024-02-09T08:03:17.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.786+0000 7fe74f8b0640 10 monclient: init 2024-02-09T08:03:17.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.787+0000 7fe74f8b0640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:17.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.787+0000 7fe74f8b0640 10 monclient: _add_conns ranks=[0,2,1] 2024-02-09T08:03:17.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.787+0000 7fe74f8b0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7480a9e30 0x7fe748135240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:17.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.787+0000 7fe74f8b0640 10 monclient(hunting): picked mon.noname-a con 0x7fe7480a9e30 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:03:17.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.787+0000 7fe74f8b0640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe7480b5000 0x7fe748142e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:17.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.787+0000 7fe74f8b0640 10 monclient(hunting): picked mon.noname-c con 0x7fe7480b5000 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:17.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.787+0000 7fe74f8b0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe74813fdf0 0x7fe748132c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:17.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.787+0000 7fe74f8b0640 10 monclient(hunting): picked mon.noname-b con 0x7fe74813fdf0 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:03:17.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.787+0000 7fe74f8b0640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:17.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.787+0000 7fe74f8b0640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe748143350 con 0x7fe7480a9e30 2024-02-09T08:03:17.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.787+0000 7fe74f8b0640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:17.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.787+0000 7fe74f8b0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7481362e0 con 0x7fe74813fdf0 2024-02-09T08:03:17.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.787+0000 7fe74f8b0640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:17.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.787+0000 7fe74f8b0640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7481365c0 con 0x7fe7480b5000 2024-02-09T08:03:17.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.787+0000 7fe74f8b0640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:17.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.787+0000 7fe74f8b0640 10 monclient(hunting): authenticate will time out at 1441.147894s 2024-02-09T08:03:17.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.788+0000 7fe74ce4b640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe7480b5000 0x7fe748142e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:17.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.788+0000 7fe74ce4b640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe7480b5000 0x7fe748142e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:33076/0 (socket says 172.21.15.62:33076) 2024-02-09T08:03:17.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.788+0000 7fe74ce4b640 1 -- 172.21.15.62:0/2827663303 learned_addr learned my addr 172.21.15.62:0/2827663303 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:17.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.788+0000 7fe74ce4b640 10 monclient(hunting): get_auth_request con 0x7fe7480b5000 auth_method 0 2024-02-09T08:03:17.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.788+0000 7fe74ce4b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:17.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.788+0000 7fe74ce4b640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:17.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.788+0000 7fe74ce4b640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:17.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.788+0000 7fe74d64c640 1 --2- 172.21.15.62:0/2827663303 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7480a9e30 0x7fe748135240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:17.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.789+0000 7fe74d64c640 10 monclient(hunting): get_auth_request con 0x7fe7480a9e30 auth_method 0 2024-02-09T08:03:17.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.789+0000 7fe74d64c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:17.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.789+0000 7fe74d64c640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:17.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.789+0000 7fe74d64c640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:17.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.789+0000 7fe74ce4b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:17.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.789+0000 7fe74ce4b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:17.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.789+0000 7fe74ce4b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:17.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.790+0000 7fe74d64c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:17.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.790+0000 7fe74d64c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:17.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.790+0000 7fe74d64c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:17.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.792+0000 7fe74ce4b640 10 monclient(hunting): handle_auth_done global_id 4340 payload 824 2024-02-09T08:03:17.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.792+0000 7fe74ce4b640 1 -- 172.21.15.62:0/2827663303 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe74813fdf0 msgr2=0x7fe748132c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:17.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.792+0000 7fe74ce4b640 1 --2- 172.21.15.62:0/2827663303 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe74813fdf0 0x7fe748132c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.792+0000 7fe74ce4b640 1 -- 172.21.15.62:0/2827663303 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7480a9e30 msgr2=0x7fe748135240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:17.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.792+0000 7fe74ce4b640 1 --2- 172.21.15.62:0/2827663303 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7480a9e30 0x7fe748135240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.792+0000 7fe74ce4b640 10 monclient: _finish_hunting 0 2024-02-09T08:03:17.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.792+0000 7fe74ce4b640 1 monclient: found mon.noname-c 2024-02-09T08:03:17.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.792+0000 7fe74ce4b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:17.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.792+0000 7fe74ce4b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-02-09T08:03:17.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.792+0000 7fe74ce4b640 1 -- 172.21.15.62:0/2827663303 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe738009400 con 0x7fe7480b5000 2024-02-09T08:03:17.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.794+0000 7fe74ce4b640 1 --2- 172.21.15.62:0/2827663303 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe7480b5000 0x7fe748142e10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe73802bee0 tx=0x7fe7380046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:17.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.794+0000 7fe73dffb640 10 client.?.objecter ms_handle_connect 0x7fe7480b5000 2024-02-09T08:03:17.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.795+0000 7fe73dffb640 10 client.?.objecter resend_mon_ops 2024-02-09T08:03:17.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.799+0000 7fe73dffb640 1 -- 172.21.15.62:0/2827663303 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73803ba70 con 0x7fe7480b5000 2024-02-09T08:03:17.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.799+0000 7fe73dffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:17.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.799+0000 7fe73dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-09T08:03:17.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.799+0000 7fe73dffb640 10 monclient: dump: 2024-02-09T08:03:17.804 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:17.804 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:17.804 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:17.804 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:17.804 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:17.804 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:17.804 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:17.804 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:17.804 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:17.804 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:17.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.799+0000 7fe73dffb640 10 monclient: _finish_auth 0 2024-02-09T08:03:17.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.799+0000 7fe73dffb640 10 monclient: _check_auth_tickets 2024-02-09T08:03:17.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.799+0000 7fe73dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:17.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.799+0000 7fe73dffb640 1 -- 172.21.15.62:0/2827663303 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe73803bbf0 con 0x7fe7480b5000 2024-02-09T08:03:17.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.799+0000 7fe73dffb640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:17.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.799+0000 7fe73dffb640 1 -- 172.21.15.62:0/2827663303 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7380453f0 con 0x7fe7480b5000 2024-02-09T08:03:17.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.799+0000 7fe73dffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:17.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.799+0000 7fe73dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-09T08:03:17.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.799+0000 7fe73dffb640 10 monclient: dump: 2024-02-09T08:03:17.805 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:17.805 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:17.805 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:17.805 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:17.805 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:17.805 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:17.805 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:17.805 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:17.805 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:17.805 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:17.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.799+0000 7fe74f8b0640 5 monclient: authenticate success, global_id 4340 2024-02-09T08:03:17.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.799+0000 7fe74f8b0640 10 monclient: _renew_subs 2024-02-09T08:03:17.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.799+0000 7fe73f7fe640 4 set_mon_vals no callback set 2024-02-09T08:03:17.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.799+0000 7fe74f8b0640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:03:17.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.799+0000 7fe74f8b0640 1 -- 172.21.15.62:0/2827663303 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe748142740 con 0x7fe7480b5000 2024-02-09T08:03:17.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.800+0000 7fe74f8b0640 10 client.4340.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:03:17.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.800+0000 7fe74f8b0640 10 monclient: _renew_subs 2024-02-09T08:03:17.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.800+0000 7fe74f8b0640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:03:17.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.800+0000 7fe74f8b0640 1 -- 172.21.15.62:0/2827663303 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe748136ea0 con 0x7fe7480b5000 2024-02-09T08:03:17.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.800+0000 7fe74f8b0640 1 librados: init done 2024-02-09T08:03:17.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.801+0000 7fe74f8b0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:17.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.801+0000 7fe74f8b0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:17.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.801+0000 7fe74f8b0640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:03:17.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.801+0000 7fe74f8b0640 1 -- 172.21.15.62:0/2827663303 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe748142960 con 0x7fe7480b5000 2024-02-09T08:03:17.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.844+0000 7f03724de640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 7}] 2024-02-09T08:03:17.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.844+0000 7f03724de640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2024-02-09T08:03:17.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.844+0000 7f03724de640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:03:17.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.844+0000 7f03724de640 1 -- 172.21.15.62:0/2882853261 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f036c04ef90 con 0x7f036c0b5000 2024-02-09T08:03:17.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.907+0000 7fa75b208640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2024-02-09T08:03:17.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.907+0000 7fa75b208640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2024-02-09T08:03:17.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.907+0000 7fa75b208640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:03:17.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.907+0000 7fa75b208640 1 -- 172.21.15.62:0/1511082850 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fa75404ef90 con 0x7fa754145de0 2024-02-09T08:03:17.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.919+0000 7f54e42de640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2024-02-09T08:03:17.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.919+0000 7f54e42de640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2024-02-09T08:03:17.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.919+0000 7f54e42de640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:17.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.919+0000 7f54e42de640 1 -- 172.21.15.62:0/760294374 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f54dc04ef90 con 0x7f54dc0b7790 2024-02-09T08:03:17.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.922+0000 7f54d2ffd640 1 -- 172.21.15.62:0/760294374 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f54d8057ac0 con 0x7f54dc0b7790 2024-02-09T08:03:17.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.922+0000 7f54d2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2024-02-09T08:03:17.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.922+0000 7f54d2ffd640 10 monclient: _finish_command 2 = system:0 2024-02-09T08:03:17.924 INFO:teuthology.orchestra.run.smithi062.stdout:90194313221 2024-02-09T08:03:17.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.924+0000 7f54e42de640 10 librados: watch_flush enter 2024-02-09T08:03:17.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.924+0000 7f54e42de640 10 librados: watch_flush exit 2024-02-09T08:03:17.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.924+0000 7f54e42de640 20 client.4375.objecter shutdown clearing up homeless session... 2024-02-09T08:03:17.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.924+0000 7f54e42de640 10 client.4375.objecter successfully canceled tick 2024-02-09T08:03:17.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.924+0000 7f54e42de640 1 -- 172.21.15.62:0/760294374 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f54c006d1d0 msgr2=0x7f54c006f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:17.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.924+0000 7f54e42de640 1 --2- 172.21.15.62:0/760294374 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f54c006d1d0 0x7f54c006f690 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f54d4034000 tx=0x7f54d4007000 comp rx=0 tx=0).stop 2024-02-09T08:03:17.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.924+0000 7f54e42de640 10 monclient: shutdown 2024-02-09T08:03:17.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.924+0000 7f54e42de640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:17.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.924+0000 7f54e42de640 1 -- 172.21.15.62:0/760294374 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54dc0b7790 msgr2=0x7f54dc070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:17.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.924+0000 7f54e42de640 1 --2- 172.21.15.62:0/760294374 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54dc0b7790 0x7f54dc070740 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f54c80057a0 tx=0x7f54d8001490 comp rx=0 tx=0).stop 2024-02-09T08:03:17.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.924+0000 7f54e42de640 1 -- 172.21.15.62:0/760294374 shutdown_connections 2024-02-09T08:03:17.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.924+0000 7f54e42de640 1 --2- 172.21.15.62:0/760294374 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f54c006d1d0 0x7f54c006f690 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.924+0000 7f54e42de640 1 --2- 172.21.15.62:0/760294374 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54dc0b7790 0x7f54dc070740 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.924+0000 7f54e42de640 1 --2- 172.21.15.62:0/760294374 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54dc1d6ad0 0x7f54dc0b8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.924+0000 7f54e42de640 1 --2- 172.21.15.62:0/760294374 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f54c80039e0 0x7f54dc142c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.924+0000 7f54e42de640 1 -- 172.21.15.62:0/760294374 >> 172.21.15.62:0/760294374 conn(0x7f54dc066bb0 msgr2=0x7f54dc139d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:17.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.924+0000 7f54e42de640 1 -- 172.21.15.62:0/760294374 shutdown_connections 2024-02-09T08:03:17.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.924+0000 7f54e42de640 1 -- 172.21.15.62:0/760294374 wait complete. 2024-02-09T08:03:17.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.924+0000 7f54e42de640 1 librados: shutdown 2024-02-09T08:03:17.937 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313222 got 90194313221 for osd.3 2024-02-09T08:03:17.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.948+0000 7f0368ff9640 1 -- 172.21.15.62:0/2882853261 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f036007a7b0 con 0x7f036c0b5000 2024-02-09T08:03:17.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.948+0000 7f0368ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2024-02-09T08:03:17.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.948+0000 7f0368ff9640 10 monclient: _finish_command 2 = system:0 2024-02-09T08:03:17.950 INFO:teuthology.orchestra.run.smithi062.stdout:64424509447 2024-02-09T08:03:17.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.949+0000 7f03724de640 10 librados: watch_flush enter 2024-02-09T08:03:17.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.950+0000 7f03724de640 10 librados: watch_flush exit 2024-02-09T08:03:17.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.950+0000 7f03724de640 20 client.4368.objecter shutdown clearing up homeless session... 2024-02-09T08:03:17.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.950+0000 7f03724de640 10 client.4368.objecter successfully canceled tick 2024-02-09T08:03:17.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.950+0000 7f03724de640 1 -- 172.21.15.62:0/2882853261 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f035806d1a0 msgr2=0x7f035806f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:17.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.950+0000 7f03724de640 1 --2- 172.21.15.62:0/2882853261 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f035806d1a0 0x7f035806f660 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f035c009710 tx=0x7f035c006c90 comp rx=0 tx=0).stop 2024-02-09T08:03:17.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.950+0000 7f03724de640 10 monclient: shutdown 2024-02-09T08:03:17.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.950+0000 7f03724de640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:17.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.950+0000 7f03724de640 1 -- 172.21.15.62:0/2882853261 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f036c0b5000 msgr2=0x7f036c142c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:17.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.950+0000 7f03724de640 1 --2- 172.21.15.62:0/2882853261 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f036c0b5000 0x7f036c142c20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0360000c00 tx=0x7f03600046c0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.950+0000 7f03724de640 1 -- 172.21.15.62:0/2882853261 shutdown_connections 2024-02-09T08:03:17.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.950+0000 7f03724de640 1 --2- 172.21.15.62:0/2882853261 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f035806d1a0 0x7f035806f660 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.950+0000 7f03724de640 1 --2- 172.21.15.62:0/2882853261 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f036c145de0 0x7f036c1d7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.950+0000 7f03724de640 1 --2- 172.21.15.62:0/2882853261 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f036c0b5000 0x7f036c142c20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.950+0000 7f03724de640 1 --2- 172.21.15.62:0/2882853261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f036c0a9e30 0x7f036c1357a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:17.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.950+0000 7f03724de640 1 -- 172.21.15.62:0/2882853261 >> 172.21.15.62:0/2882853261 conn(0x7f036c066bb0 msgr2=0x7f036c13b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:17.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.950+0000 7f03724de640 1 -- 172.21.15.62:0/2882853261 shutdown_connections 2024-02-09T08:03:17.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.950+0000 7f03724de640 1 -- 172.21.15.62:0/2882853261 wait complete. 2024-02-09T08:03:17.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:17.950+0000 7f03724de640 1 librados: shutdown 2024-02-09T08:03:17.963 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.7 2024-02-09T08:03:17.964 DEBUG:teuthology.parallel:result is None 2024-02-09T08:03:18.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.122+0000 7fe73dffb640 1 -- 172.21.15.62:0/2827663303 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fe73804e450 con 0x7fe7480b5000 2024-02-09T08:03:18.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.122+0000 7fe73dffb640 1 --2- 172.21.15.62:0/2827663303 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fe72c06d1a0 0x7fe72c06f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:18.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.122+0000 7fe74d64c640 1 --2- 172.21.15.62:0/2827663303 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fe72c06d1a0 0x7fe72c06f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:18.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.122+0000 7fe74d64c640 10 monclient: get_auth_request con 0x7fe72c06d1a0 auth_method 0 2024-02-09T08:03:18.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.123+0000 7fe73dffb640 10 client.4340.objecter ms_handle_connect 0x7fe72c06d1a0 2024-02-09T08:03:18.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.123+0000 7fe74d64c640 1 --2- 172.21.15.62:0/2827663303 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fe72c06d1a0 0x7fe72c06f660 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe744005880 tx=0x7fe744009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:18.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.139+0000 7fe73dffb640 1 -- 172.21.15.62:0/2827663303 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe73807b6c0 con 0x7fe7480b5000 2024-02-09T08:03:18.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.139+0000 7fe73dffb640 10 client.4340.objecter ms_dispatch 0x7fe748000b90 osd_map(26..26 src has 1..26) v4 2024-02-09T08:03:18.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.139+0000 7fe73dffb640 3 client.4340.objecter handle_osd_map got epochs [26,26] > 0 2024-02-09T08:03:18.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.139+0000 7fe73dffb640 3 client.4340.objecter handle_osd_map decoding full epoch 26 2024-02-09T08:03:18.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.139+0000 7fe73dffb640 20 client.4340.objecter dump_active .. 0 homeless 2024-02-09T08:03:18.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.139+0000 7fe73dffb640 1 -- 172.21.15.62:0/2827663303 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe738077260 con 0x7fe7480b5000 2024-02-09T08:03:18.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.139+0000 7fe73dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:18.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.139+0000 7fe73dffb640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:03:18.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.142+0000 7fa7517fa640 1 -- 172.21.15.62:0/1511082850 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa74007a390 con 0x7fa754145de0 2024-02-09T08:03:18.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.142+0000 7fa7517fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2024-02-09T08:03:18.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.142+0000 7fa7517fa640 10 monclient: _finish_command 2 = system:0 2024-02-09T08:03:18.145 INFO:teuthology.orchestra.run.smithi062.stdout:85899345928 2024-02-09T08:03:18.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.144+0000 7fa75b208640 10 librados: watch_flush enter 2024-02-09T08:03:18.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.144+0000 7fa75b208640 10 librados: watch_flush exit 2024-02-09T08:03:18.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.144+0000 7fa75b208640 20 client.4337.objecter shutdown clearing up homeless session... 2024-02-09T08:03:18.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.144+0000 7fa75b208640 10 client.4337.objecter successfully canceled tick 2024-02-09T08:03:18.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.145+0000 7fa75b208640 1 -- 172.21.15.62:0/1511082850 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fa73806d1f0 msgr2=0x7fa73806f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:18.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.145+0000 7fa75b208640 1 --2- 172.21.15.62:0/1511082850 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fa73806d1f0 0x7fa73806f6b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa748009710 tx=0x7fa748006c90 comp rx=0 tx=0).stop 2024-02-09T08:03:18.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.145+0000 7fa75b208640 10 monclient: shutdown 2024-02-09T08:03:18.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.145+0000 7fa75b208640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:18.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.145+0000 7fa75b208640 1 -- 172.21.15.62:0/1511082850 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa754145de0 msgr2=0x7fa7541db000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:18.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.145+0000 7fa75b208640 1 --2- 172.21.15.62:0/1511082850 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa754145de0 0x7fa7541db000 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa740034040 tx=0x7fa7400046c0 comp rx=0 tx=0).stop 2024-02-09T08:03:18.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.145+0000 7fa75b208640 1 -- 172.21.15.62:0/1511082850 shutdown_connections 2024-02-09T08:03:18.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.145+0000 7fa75b208640 1 --2- 172.21.15.62:0/1511082850 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fa73806d1f0 0x7fa73806f6b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:18.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.145+0000 7fa75b208640 1 --2- 172.21.15.62:0/1511082850 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa75413b080 0x7fa754132530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:18.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.145+0000 7fa75b208640 1 --2- 172.21.15.62:0/1511082850 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa754145de0 0x7fa7541db000 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:18.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.145+0000 7fa75b208640 1 --2- 172.21.15.62:0/1511082850 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7540b5000 0x7fa75413c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:18.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.145+0000 7fa75b208640 1 -- 172.21.15.62:0/1511082850 >> 172.21.15.62:0/1511082850 conn(0x7fa754066bb0 msgr2=0x7fa7540b7550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:18.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.145+0000 7fa75b208640 1 -- 172.21.15.62:0/1511082850 shutdown_connections 2024-02-09T08:03:18.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.145+0000 7fa75b208640 1 -- 172.21.15.62:0/1511082850 wait complete. 2024-02-09T08:03:18.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.145+0000 7fa75b208640 1 librados: shutdown 2024-02-09T08:03:18.159 INFO:tasks.ceph.ceph_manager.ceph:need seq 85899345930 got 85899345928 for osd.4 2024-02-09T08:03:18.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.322+0000 7fe74f8b0640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2024-02-09T08:03:18.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.322+0000 7fe74f8b0640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2024-02-09T08:03:18.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.322+0000 7fe74f8b0640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:03:18.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.322+0000 7fe74f8b0640 1 -- 172.21.15.62:0/2827663303 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fe74804ef90 con 0x7fe7480b5000 2024-02-09T08:03:18.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.325+0000 7fe73dffb640 1 -- 172.21.15.62:0/2827663303 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe738035090 con 0x7fe7480b5000 2024-02-09T08:03:18.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.325+0000 7fe73dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2024-02-09T08:03:18.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.325+0000 7fe73dffb640 10 monclient: _finish_command 2 = system:0 2024-02-09T08:03:18.328 INFO:teuthology.orchestra.run.smithi062.stdout:55834574855 2024-02-09T08:03:18.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.327+0000 7fe74f8b0640 10 librados: watch_flush enter 2024-02-09T08:03:18.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.327+0000 7fe74f8b0640 10 librados: watch_flush exit 2024-02-09T08:03:18.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.327+0000 7fe74f8b0640 20 client.4340.objecter shutdown clearing up homeless session... 2024-02-09T08:03:18.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.327+0000 7fe74f8b0640 10 client.4340.objecter successfully canceled tick 2024-02-09T08:03:18.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.327+0000 7fe74f8b0640 1 -- 172.21.15.62:0/2827663303 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fe72c06d1a0 msgr2=0x7fe72c06f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:18.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.327+0000 7fe74f8b0640 1 --2- 172.21.15.62:0/2827663303 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fe72c06d1a0 0x7fe72c06f660 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe744005880 tx=0x7fe744009040 comp rx=0 tx=0).stop 2024-02-09T08:03:18.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.327+0000 7fe74f8b0640 10 monclient: shutdown 2024-02-09T08:03:18.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.327+0000 7fe74f8b0640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:18.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.327+0000 7fe74f8b0640 1 -- 172.21.15.62:0/2827663303 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe7480b5000 msgr2=0x7fe748142e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:18.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.327+0000 7fe74f8b0640 1 --2- 172.21.15.62:0/2827663303 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe7480b5000 0x7fe748142e10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe73802bee0 tx=0x7fe7380046c0 comp rx=0 tx=0).stop 2024-02-09T08:03:18.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.327+0000 7fe74f8b0640 1 -- 172.21.15.62:0/2827663303 shutdown_connections 2024-02-09T08:03:18.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.327+0000 7fe74f8b0640 1 --2- 172.21.15.62:0/2827663303 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fe72c06d1a0 0x7fe72c06f660 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:18.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.327+0000 7fe74f8b0640 1 --2- 172.21.15.62:0/2827663303 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe74813fdf0 0x7fe748132c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:18.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.327+0000 7fe74f8b0640 1 --2- 172.21.15.62:0/2827663303 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe7480b5000 0x7fe748142e10 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:18.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.327+0000 7fe74f8b0640 1 --2- 172.21.15.62:0/2827663303 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7480a9e30 0x7fe748135240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:18.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.327+0000 7fe74f8b0640 1 -- 172.21.15.62:0/2827663303 >> 172.21.15.62:0/2827663303 conn(0x7fe748066bb0 msgr2=0x7fe7481394b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:18.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.327+0000 7fe74f8b0640 1 -- 172.21.15.62:0/2827663303 shutdown_connections 2024-02-09T08:03:18.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.327+0000 7fe74f8b0640 1 -- 172.21.15.62:0/2827663303 wait complete. 2024-02-09T08:03:18.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.327+0000 7fe74f8b0640 1 librados: shutdown 2024-02-09T08:03:18.342 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2024-02-09T08:03:18.342 DEBUG:teuthology.parallel:result is None 2024-02-09T08:03:18.658 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-02-09T08:03:18.665 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-02-09T08:03:18.693 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-02-09T08:03:18.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.764+0000 7fa762941640 10 monclient: get_monmap_and_config 2024-02-09T08:03:18.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.764+0000 7fa762941640 10 monclient: build_initial_monmap 2024-02-09T08:03:18.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.764+0000 7fa762941640 10 monclient: monmap: 2024-02-09T08:03:18.767 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:18.768 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:18.768 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:03:18.765773+0000 2024-02-09T08:03:18.768 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:03:18.765773+0000 2024-02-09T08:03:18.768 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:18.768 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:18.768 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:03:18.768 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:03:18.768 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:03:18.768 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:03:18.768 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:03:18.768 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:18.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.765+0000 7fa762941640 1 Processor -- start 2024-02-09T08:03:18.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.765+0000 7fa762941640 1 -- start start 2024-02-09T08:03:18.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.765+0000 7fa762941640 10 monclient: init 2024-02-09T08:03:18.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.766+0000 7fa762941640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:18.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.766+0000 7fa762941640 10 monclient: _add_conns ranks=[1,0,3,4,2] 2024-02-09T08:03:18.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.766+0000 7fa762941640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fa75c0b5000 addr v1:172.21.15.103:6789/0 2024-02-09T08:03:18.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.766+0000 7fa762941640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa75c0a9e30 addr v1:172.21.15.62:6789/0 2024-02-09T08:03:18.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.766+0000 7fa762941640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa75c13fdf0 0x7fa75c1464f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:18.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.766+0000 7fa762941640 10 monclient(hunting): picked mon.noname-a con 0x7fa75c13fdf0 addr v2:172.21.15.62:3300/0 2024-02-09T08:03:18.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.766+0000 7fa762941640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa75c0aa4a0 con 0x7fa75c0a9e30 2024-02-09T08:03:18.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.766+0000 7fa762941640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa75c0b2900 con 0x7fa75c0b5000 2024-02-09T08:03:18.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.766+0000 7fa762941640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:18.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.766+0000 7fa762941640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa75c0b53e0 con 0x7fa75c13fdf0 2024-02-09T08:03:18.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.766+0000 7fa762941640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:18.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.766+0000 7fa762941640 10 monclient(hunting): authenticate will time out at 1442.126410s 2024-02-09T08:03:18.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.766+0000 7fa75bfff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa75c0b5000 0x7fa75c13f6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.62:50554/0 (socket says 172.21.15.62:50554) 2024-02-09T08:03:18.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.766+0000 7fa75bfff640 1 -- 172.21.15.62:0/88406144 learned_addr learned my addr 172.21.15.62:0/88406144 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-09T08:03:18.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.767+0000 7fa760ede640 1 --2- 172.21.15.62:0/88406144 >> v2:172.21.15.62:3300/0 conn(0x7fa75c13fdf0 0x7fa75c1464f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:18.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.767+0000 7fa760ede640 10 monclient(hunting): get_auth_request con 0x7fa75c13fdf0 auth_method 0 2024-02-09T08:03:18.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.767+0000 7fa760ede640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:18.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.767+0000 7fa760ede640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:18.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.767+0000 7fa760ede640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:18.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.768+0000 7fa760ede640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:18.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.768+0000 7fa760ede640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:18.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.768+0000 7fa760ede640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:18.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.769+0000 7fa75affd640 1 -- 172.21.15.62:0/88406144 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3299085730 0 0) 0x7fa75c0b2900 con 0x7fa75c0b5000 2024-02-09T08:03:18.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.769+0000 7fa75affd640 10 monclient(hunting): _negotiate 2024-02-09T08:03:18.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.769+0000 7fa75affd640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:18.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.769+0000 7fa75affd640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:18.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.769+0000 7fa75affd640 10 monclient(hunting): my global_id is 4378 2024-02-09T08:03:18.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.769+0000 7fa75affd640 1 -- 172.21.15.62:0/88406144 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa744003520 con 0x7fa75c0b5000 2024-02-09T08:03:18.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.771+0000 7fa760ede640 10 monclient(hunting): handle_auth_done global_id 4377 payload 274 2024-02-09T08:03:18.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.771+0000 7fa760ede640 1 -- 172.21.15.62:0/88406144 >> v1:172.21.15.103:6789/0 conn(0x7fa75c0b5000 legacy=0x7fa75c13f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:18.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.771+0000 7fa760ede640 1 -- 172.21.15.62:0/88406144 >> v1:172.21.15.62:6789/0 conn(0x7fa75c0a9e30 legacy=0x7fa75c145de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:18.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.771+0000 7fa760ede640 10 monclient: _finish_hunting 0 2024-02-09T08:03:18.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.771+0000 7fa760ede640 1 monclient: found mon.noname-a 2024-02-09T08:03:18.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.771+0000 7fa760ede640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:18.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.771+0000 7fa760ede640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-02-09T08:03:18.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.771+0000 7fa760ede640 1 -- 172.21.15.62:0/88406144 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa75c0ab5f0 con 0x7fa75c13fdf0 2024-02-09T08:03:18.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.776+0000 7fa760ede640 1 --2- 172.21.15.62:0/88406144 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa75c13fdf0 0x7fa75c1464f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa754009dc0 tx=0x7fa75402be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2318e1bae0b456b5 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:18.780 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-02-09T08:03:18.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.782+0000 7fa75affd640 1 -- 172.21.15.62:0/88406144 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75402cc40 con 0x7fa75c13fdf0 2024-02-09T08:03:18.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.782+0000 7fa75affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:18.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.782+0000 7fa75affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-09T08:03:18.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.782+0000 7fa75affd640 10 monclient: dump: 2024-02-09T08:03:18.784 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:18.785 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:18.785 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:18.785 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:18.785 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:18.785 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:18.785 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:18.785 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:18.785 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:18.785 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:18.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.782+0000 7fa75affd640 10 monclient: _finish_auth 0 2024-02-09T08:03:18.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.782+0000 7fa75affd640 10 monclient: _check_auth_tickets 2024-02-09T08:03:18.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.782+0000 7fa75affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:18.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.782+0000 7fa75affd640 1 -- 172.21.15.62:0/88406144 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75402cda0 con 0x7fa75c13fdf0 2024-02-09T08:03:18.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.782+0000 7fa762941640 5 monclient: authenticate success, global_id 4377 2024-02-09T08:03:18.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.782+0000 7fa762941640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-02-09T08:03:18.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.782+0000 7fa75affd640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:18.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.782+0000 7fa762941640 10 monclient: get_monmap_and_config success 2024-02-09T08:03:18.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.782+0000 7fa75affd640 1 -- 172.21.15.62:0/88406144 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa754034660 con 0x7fa75c13fdf0 2024-02-09T08:03:18.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.782+0000 7fa762941640 4 set_mon_vals no callback set 2024-02-09T08:03:18.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.782+0000 7fa75affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:18.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.782+0000 7fa75affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-09T08:03:18.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.782+0000 7fa75affd640 10 monclient: dump: 2024-02-09T08:03:18.787 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:18.787 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:18.787 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:18.787 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:18.787 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:18.787 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:18.787 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:18.787 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:18.787 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:18.787 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:18.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.782+0000 7fa762941640 10 monclient: shutdown 2024-02-09T08:03:18.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.782+0000 7fa762941640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:18.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.782+0000 7fa762941640 1 -- 172.21.15.62:0/88406144 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa75c13fdf0 msgr2=0x7fa75c1464f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:18.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.782+0000 7fa762941640 1 --2- 172.21.15.62:0/88406144 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa75c13fdf0 0x7fa75c1464f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa754009dc0 tx=0x7fa75402be90 comp rx=0 tx=0).stop 2024-02-09T08:03:18.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.783+0000 7fa762941640 1 -- 172.21.15.62:0/88406144 shutdown_connections 2024-02-09T08:03:18.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.783+0000 7fa762941640 1 --2- 172.21.15.62:0/88406144 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa75c13fdf0 0x7fa75c1464f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:18.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.783+0000 7fa762941640 1 -- 172.21.15.62:0/88406144 >> 172.21.15.62:0/88406144 conn(0x7fa75c066bb0 msgr2=0x7fa75c066fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:18.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.783+0000 7fa762941640 1 -- 172.21.15.62:0/88406144 shutdown_connections 2024-02-09T08:03:18.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.783+0000 7fa762941640 1 -- 172.21.15.62:0/88406144 wait complete. 2024-02-09T08:03:18.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.784+0000 7fa762941640 10 monclient: build_initial_monmap 2024-02-09T08:03:18.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.784+0000 7fa762941640 10 monclient: monmap: 2024-02-09T08:03:18.794 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:18.794 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:03:18.794 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:03:18.794 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:03:18.794 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:18.794 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:18.794 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:03:18.794 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:03:18.794 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:03:18.795 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:18.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.784+0000 7fa762941640 1 librados: starting msgr at 2024-02-09T08:03:18.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.784+0000 7fa762941640 1 librados: starting objecter 2024-02-09T08:03:18.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.784+0000 7fa762941640 1 Processor -- start 2024-02-09T08:03:18.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.784+0000 7fa762941640 1 -- start start 2024-02-09T08:03:18.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.784+0000 7fa762941640 1 librados: setting wanted keys 2024-02-09T08:03:18.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.784+0000 7fa762941640 1 librados: calling monclient init 2024-02-09T08:03:18.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.784+0000 7fa762941640 10 monclient: init 2024-02-09T08:03:18.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.785+0000 7fa762941640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:18.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.785+0000 7fa762941640 10 monclient: _add_conns ranks=[0,1,2] 2024-02-09T08:03:18.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.785+0000 7fa762941640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa75c0a9e30 0x7fa75c1350b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:18.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.785+0000 7fa762941640 10 monclient(hunting): picked mon.noname-a con 0x7fa75c0a9e30 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:03:18.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.785+0000 7fa762941640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa75c0b5000 0x7fa75c140940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:18.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.785+0000 7fa762941640 10 monclient(hunting): picked mon.noname-b con 0x7fa75c0b5000 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:03:18.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.785+0000 7fa762941640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa75c13fdf0 0x7fa75c140e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:18.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.785+0000 7fa762941640 10 monclient(hunting): picked mon.noname-c con 0x7fa75c13fdf0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:18.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.785+0000 7fa762941640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:18.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.785+0000 7fa762941640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa75c136680 con 0x7fa75c0a9e30 2024-02-09T08:03:18.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.785+0000 7fa762941640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:18.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.785+0000 7fa762941640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa75c143020 con 0x7fa75c0b5000 2024-02-09T08:03:18.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.785+0000 7fa762941640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:18.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.785+0000 7fa762941640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa75c1431e0 con 0x7fa75c13fdf0 2024-02-09T08:03:18.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.785+0000 7fa762941640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:18.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.785+0000 7fa762941640 10 monclient(hunting): authenticate will time out at 1442.145840s 2024-02-09T08:03:18.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.786+0000 7fa75b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa75c0b5000 0x7fa75c140940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:18.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.786+0000 7fa75bfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa75c0a9e30 0x7fa75c1350b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:18.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.786+0000 7fa760ede640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa75c13fdf0 0x7fa75c140e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:18.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.786+0000 7fa75b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa75c0b5000 0x7fa75c140940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.62:40296/0 (socket says 172.21.15.62:40296) 2024-02-09T08:03:18.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.786+0000 7fa75b7fe640 1 -- 172.21.15.62:0/3103771502 learned_addr learned my addr 172.21.15.62:0/3103771502 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:18.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.786+0000 7fa75b7fe640 10 monclient(hunting): get_auth_request con 0x7fa75c0b5000 auth_method 0 2024-02-09T08:03:18.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.786+0000 7fa75b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:18.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.786+0000 7fa75b7fe640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:18.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.786+0000 7fa75b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:18.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.786+0000 7fa75bfff640 10 monclient(hunting): get_auth_request con 0x7fa75c0a9e30 auth_method 0 2024-02-09T08:03:18.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.786+0000 7fa75bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:18.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.786+0000 7fa75bfff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:18.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.786+0000 7fa75bfff640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:18.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.786+0000 7fa760ede640 10 monclient(hunting): get_auth_request con 0x7fa75c13fdf0 auth_method 0 2024-02-09T08:03:18.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.786+0000 7fa760ede640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:18.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.786+0000 7fa760ede640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:18.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.786+0000 7fa760ede640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:18.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.787+0000 7fa75b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:18.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.787+0000 7fa75b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:18.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.787+0000 7fa75b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:18.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.787+0000 7fa75bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:18.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.787+0000 7fa75bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:18.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.787+0000 7fa75bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:18.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.787+0000 7fa760ede640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:18.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.787+0000 7fa760ede640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:18.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.787+0000 7fa760ede640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:18.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.789+0000 7fa75b7fe640 10 monclient(hunting): handle_auth_done global_id 4381 payload 824 2024-02-09T08:03:18.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.789+0000 7fa75b7fe640 1 -- 172.21.15.62:0/3103771502 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa75c13fdf0 msgr2=0x7fa75c140e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:18.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.789+0000 7fa75b7fe640 1 --2- 172.21.15.62:0/3103771502 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa75c13fdf0 0x7fa75c140e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:18.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.789+0000 7fa75b7fe640 1 -- 172.21.15.62:0/3103771502 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa75c0a9e30 msgr2=0x7fa75c1350b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:18.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.789+0000 7fa75b7fe640 1 --2- 172.21.15.62:0/3103771502 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa75c0a9e30 0x7fa75c1350b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:18.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.789+0000 7fa75b7fe640 10 monclient: _finish_hunting 0 2024-02-09T08:03:18.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.789+0000 7fa75b7fe640 1 monclient: found mon.noname-b 2024-02-09T08:03:18.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.789+0000 7fa75b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:18.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.789+0000 7fa75b7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.103:3300/0 2024-02-09T08:03:18.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.789+0000 7fa75b7fe640 1 -- 172.21.15.62:0/3103771502 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa754009a70 con 0x7fa75c0b5000 2024-02-09T08:03:18.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.791+0000 7fa75b7fe640 1 --2- 172.21.15.62:0/3103771502 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa75c0b5000 0x7fa75c140940 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa75000c400 tx=0x7fa75000c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:18.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.791+0000 7fa758ff9640 10 client.?.objecter ms_handle_connect 0x7fa75c0b5000 2024-02-09T08:03:18.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.791+0000 7fa758ff9640 10 client.?.objecter resend_mon_ops 2024-02-09T08:03:18.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.795+0000 7fa758ff9640 1 -- 172.21.15.62:0/3103771502 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7500052d0 con 0x7fa75c0b5000 2024-02-09T08:03:18.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.795+0000 7fa758ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:18.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.795+0000 7fa758ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:03:18.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.795+0000 7fa758ff9640 10 monclient: dump: 2024-02-09T08:03:18.804 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:18.804 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:18.804 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:18.804 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:18.804 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:18.804 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:18.804 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:18.804 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:18.804 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:18.804 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:18.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.795+0000 7fa758ff9640 10 monclient: _finish_auth 0 2024-02-09T08:03:18.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.795+0000 7fa758ff9640 10 monclient: _check_auth_tickets 2024-02-09T08:03:18.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.795+0000 7fa758ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:18.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.795+0000 7fa758ff9640 1 -- 172.21.15.62:0/3103771502 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa750005450 con 0x7fa75c0b5000 2024-02-09T08:03:18.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.795+0000 7fa762941640 5 monclient: authenticate success, global_id 4381 2024-02-09T08:03:18.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.795+0000 7fa762941640 10 monclient: _renew_subs 2024-02-09T08:03:18.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.795+0000 7fa762941640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:18.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.795+0000 7fa762941640 1 -- 172.21.15.62:0/3103771502 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa75c1413c0 con 0x7fa75c0b5000 2024-02-09T08:03:18.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.795+0000 7fa758ff9640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:18.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.795+0000 7fa758ff9640 1 -- 172.21.15.62:0/3103771502 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa750007260 con 0x7fa75c0b5000 2024-02-09T08:03:18.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.795+0000 7fa758ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:18.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.795+0000 7fa758ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:03:18.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.795+0000 7fa758ff9640 10 monclient: dump: 2024-02-09T08:03:18.805 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:18.806 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:18.806 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:18.806 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:18.806 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:18.806 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:18.806 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:18.806 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:18.806 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:18.806 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:18.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.795+0000 7fa75a7fc640 4 set_mon_vals no callback set 2024-02-09T08:03:18.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.795+0000 7fa762941640 10 client.4381.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:03:18.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.795+0000 7fa762941640 10 monclient: _renew_subs 2024-02-09T08:03:18.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.795+0000 7fa762941640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:18.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.795+0000 7fa762941640 1 -- 172.21.15.62:0/3103771502 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa75c1357d0 con 0x7fa75c0b5000 2024-02-09T08:03:18.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.795+0000 7fa762941640 1 librados: init done 2024-02-09T08:03:18.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.796+0000 7fa7427fc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:18.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.796+0000 7fa7427fc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:18.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.796+0000 7fa7427fc640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:18.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.796+0000 7fa7427fc640 1 -- 172.21.15.62:0/3103771502 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa734005080 con 0x7fa75c0b5000 2024-02-09T08:03:18.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.811+0000 7f7f1d1dc640 10 monclient: get_monmap_and_config 2024-02-09T08:03:18.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.811+0000 7f7f1d1dc640 10 monclient: build_initial_monmap 2024-02-09T08:03:18.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.811+0000 7f7f1d1dc640 10 monclient: monmap: 2024-02-09T08:03:18.813 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:18.813 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:18.814 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:03:18.812528+0000 2024-02-09T08:03:18.814 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:03:18.812528+0000 2024-02-09T08:03:18.814 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:18.814 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:18.814 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:03:18.814 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:03:18.814 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:03:18.814 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:03:18.814 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:03:18.814 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:18.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.811+0000 7fc2db35c640 10 monclient: get_monmap_and_config 2024-02-09T08:03:18.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.811+0000 7fc2db35c640 10 monclient: build_initial_monmap 2024-02-09T08:03:18.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.811+0000 7fc2db35c640 10 monclient: monmap: 2024-02-09T08:03:18.815 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:18.815 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:18.815 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:03:18.812637+0000 2024-02-09T08:03:18.815 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:03:18.812637+0000 2024-02-09T08:03:18.815 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:18.815 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:18.815 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:03:18.815 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:03:18.815 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:03:18.815 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:03:18.815 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:03:18.815 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:18.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.812+0000 7f7f1d1dc640 1 Processor -- start 2024-02-09T08:03:18.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.812+0000 7fc2db35c640 1 Processor -- start 2024-02-09T08:03:18.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.812+0000 7f7f1d1dc640 1 -- start start 2024-02-09T08:03:18.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.812+0000 7f7f1d1dc640 10 monclient: init 2024-02-09T08:03:18.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.812+0000 7fc2db35c640 1 -- start start 2024-02-09T08:03:18.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.812+0000 7fc2db35c640 10 monclient: init 2024-02-09T08:03:18.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.812+0000 7f7f1d1dc640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:18.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.812+0000 7f7f1d1dc640 10 monclient: _add_conns ranks=[2,1,0,4,3] 2024-02-09T08:03:18.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.812+0000 7f7f1d1dc640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7f180b5000 0x7f7f1813f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:18.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.812+0000 7f7f1d1dc640 10 monclient(hunting): picked mon.noname-b con 0x7f7f180b5000 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:18.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.812+0000 7fc2db35c640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:18.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.812+0000 7fc2db35c640 10 monclient: _add_conns ranks=[4,2,0,1,3] 2024-02-09T08:03:18.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.812+0000 7fc2db35c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc2d4070af0 0x7fc2d40b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:18.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.812+0000 7fc2db35c640 10 monclient(hunting): picked mon.noname-c con 0x7fc2d4070af0 addr v2:172.21.15.103:3300/0 2024-02-09T08:03:18.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.812+0000 7f7f1d1dc640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f7f180a9e30 addr v1:172.21.15.103:6789/0 2024-02-09T08:03:18.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.812+0000 7fc2db35c640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc2d4070ed0 0x7fc2d41440c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:18.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.812+0000 7fc2db35c640 10 monclient(hunting): picked mon.noname-b con 0x7fc2d4070ed0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:18.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.812+0000 7fc2db35c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc2d413d630 addr v1:172.21.15.62:6789/0 2024-02-09T08:03:18.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.812+0000 7fc2db35c640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2d4072810 con 0x7fc2d413d630 2024-02-09T08:03:18.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.812+0000 7fc2db35c640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:18.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.812+0000 7fc2db35c640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2d4143c30 con 0x7fc2d4070af0 2024-02-09T08:03:18.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.812+0000 7fc2db35c640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:18.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.812+0000 7fc2db35c640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d4072a60 con 0x7fc2d4070ed0 2024-02-09T08:03:18.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.812+0000 7fc2db35c640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:18.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.813+0000 7fc2db35c640 10 monclient(hunting): authenticate will time out at 1442.173237s 2024-02-09T08:03:18.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.813+0000 7f7f1d1dc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f7f181464f0 addr v1:172.21.15.62:6789/0 2024-02-09T08:03:18.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.813+0000 7f7f1d1dc640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f180aa4a0 con 0x7f7f181464f0 2024-02-09T08:03:18.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.813+0000 7f7f1d1dc640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f180b2900 con 0x7f7f180a9e30 2024-02-09T08:03:18.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.813+0000 7f7f1d1dc640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:18.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.813+0000 7f7f1d1dc640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f18146900 con 0x7f7f180b5000 2024-02-09T08:03:18.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.813+0000 7f7f1d1dc640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:18.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.813+0000 7f7f1d1dc640 10 monclient(hunting): authenticate will time out at 1442.173367s 2024-02-09T08:03:18.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.813+0000 7f7f16d9d640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7f180b5000 0x7f7f1813f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:18.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.814+0000 7f7f1759e640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f7f181464f0 0x7f7f1814cdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34566/0 (socket says 172.21.15.62:34566) 2024-02-09T08:03:18.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.814+0000 7f7f1759e640 1 -- 172.21.15.62:0/1116392342 learned_addr learned my addr 172.21.15.62:0/1116392342 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-09T08:03:18.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.814+0000 7f7f16d9d640 10 monclient(hunting): get_auth_request con 0x7f7f180b5000 auth_method 0 2024-02-09T08:03:18.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.814+0000 7f7f16d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:18.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.814+0000 7f7f16d9d640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:18.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.814+0000 7f7f16d9d640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:18.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.814+0000 7fc2d98f9640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fc2d413d630 0x7fc2d413da80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34554/0 (socket says 172.21.15.62:34554) 2024-02-09T08:03:18.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.814+0000 7fc2d98f9640 1 -- 172.21.15.62:0/990981285 learned_addr learned my addr 172.21.15.62:0/990981285 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-09T08:03:18.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.814+0000 7fc2d88f7640 1 --2- 172.21.15.62:0/990981285 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc2d4070ed0 0x7fc2d41440c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:18.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.815+0000 7f7f16d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:18.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.815+0000 7f7f16d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:18.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.815+0000 7f7f16d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:18.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.816+0000 7f7f16d9d640 10 monclient(hunting): handle_auth_done global_id 4346 payload 274 2024-02-09T08:03:18.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.816+0000 7f7f16d9d640 1 -- 172.21.15.62:0/1116392342 >> v1:172.21.15.103:6789/0 conn(0x7f7f180a9e30 legacy=0x7f7f18145de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:18.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.816+0000 7f7f16d9d640 1 -- 172.21.15.62:0/1116392342 >> v1:172.21.15.62:6789/0 conn(0x7f7f181464f0 legacy=0x7f7f1814cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:18.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.816+0000 7f7f16d9d640 10 monclient: _finish_hunting 0 2024-02-09T08:03:18.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.816+0000 7f7f16d9d640 1 monclient: found mon.noname-b 2024-02-09T08:03:18.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.816+0000 7f7f16d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:18.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.816+0000 7f7f16d9d640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.62:3301/0 2024-02-09T08:03:18.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.816+0000 7f7f16d9d640 1 -- 172.21.15.62:0/1116392342 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f180ab5f0 con 0x7f7f180b5000 2024-02-09T08:03:18.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.817+0000 7fc2d88f7640 10 monclient(hunting): get_auth_request con 0x7fc2d4070ed0 auth_method 0 2024-02-09T08:03:18.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.817+0000 7fc2d88f7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:18.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.817+0000 7fc2d88f7640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:18.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.817+0000 7fc2d88f7640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:18.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.818+0000 7fc2d88f7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:18.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.818+0000 7fc2d88f7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:18.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.818+0000 7fc2d88f7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:18.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.820+0000 7fc2d88f7640 10 monclient(hunting): handle_auth_done global_id 4349 payload 274 2024-02-09T08:03:18.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.820+0000 7fc2d88f7640 1 -- 172.21.15.62:0/990981285 >> v2:172.21.15.103:3300/0 conn(0x7fc2d4070af0 msgr2=0x7fc2d40b0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:18.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.820+0000 7fc2d88f7640 1 --2- 172.21.15.62:0/990981285 >> v2:172.21.15.103:3300/0 conn(0x7fc2d4070af0 0x7fc2d40b0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:18.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.820+0000 7fc2d88f7640 1 -- 172.21.15.62:0/990981285 >> v1:172.21.15.62:6789/0 conn(0x7fc2d413d630 legacy=0x7fc2d413da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:18.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.820+0000 7fc2d88f7640 10 monclient: _finish_hunting 0 2024-02-09T08:03:18.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.820+0000 7fc2d88f7640 1 monclient: found mon.noname-b 2024-02-09T08:03:18.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.820+0000 7fc2d88f7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:18.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.820+0000 7fc2d88f7640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.62:3301/0 2024-02-09T08:03:18.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.820+0000 7fc2d88f7640 1 -- 172.21.15.62:0/990981285 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d4072d40 con 0x7fc2d4070ed0 2024-02-09T08:03:18.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.821+0000 7f7f16d9d640 1 --2- 172.21.15.62:0/1116392342 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7f180b5000 0x7f7f1813f6e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7f080097d0 tx=0x7f7f0802b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2017b4e6686ca0b3 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:18.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.824+0000 7fc2d88f7640 1 --2- 172.21.15.62:0/990981285 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc2d4070ed0 0x7fc2d41440c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc2c40097a0 tx=0x7fc2c402b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3bd4d2cb338c982 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:18.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.827+0000 7f7f15d9b640 1 -- 172.21.15.62:0/1116392342 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f08031780 con 0x7f7f180b5000 2024-02-09T08:03:18.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.827+0000 7f7f15d9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:18.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.827+0000 7f7f15d9b640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:03:18.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.827+0000 7f7f15d9b640 10 monclient: dump: 2024-02-09T08:03:18.832 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:18.832 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:18.833 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:18.833 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:18.833 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:18.833 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:18.833 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:18.833 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:18.833 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:18.833 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:18.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.827+0000 7f7f15d9b640 10 monclient: _finish_auth 0 2024-02-09T08:03:18.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.827+0000 7f7f15d9b640 10 monclient: _check_auth_tickets 2024-02-09T08:03:18.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.827+0000 7f7f15d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:18.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.827+0000 7f7f15d9b640 1 -- 172.21.15.62:0/1116392342 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f080318e0 con 0x7f7f180b5000 2024-02-09T08:03:18.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.827+0000 7f7f1d1dc640 5 monclient: authenticate success, global_id 4346 2024-02-09T08:03:18.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.827+0000 7f7f1d1dc640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-02-09T08:03:18.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.827+0000 7f7f15d9b640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:18.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.827+0000 7f7f15d9b640 1 -- 172.21.15.62:0/1116392342 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f08031c70 con 0x7f7f180b5000 2024-02-09T08:03:18.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.827+0000 7f7f15d9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:18.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.827+0000 7f7f15d9b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-09T08:03:18.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.827+0000 7f7f15d9b640 10 monclient: dump: 2024-02-09T08:03:18.834 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:18.834 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:18.834 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:18.834 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:18.834 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:18.834 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:18.834 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:18.834 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:18.834 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:18.834 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:18.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.827+0000 7f7f1d1dc640 10 monclient: get_monmap_and_config success 2024-02-09T08:03:18.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.827+0000 7f7f1d1dc640 4 set_mon_vals no callback set 2024-02-09T08:03:18.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.828+0000 7f7f1d1dc640 10 monclient: shutdown 2024-02-09T08:03:18.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.828+0000 7f7f1d1dc640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:18.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.828+0000 7f7f1d1dc640 1 -- 172.21.15.62:0/1116392342 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7f180b5000 msgr2=0x7f7f1813f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:18.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.828+0000 7f7f1d1dc640 1 --2- 172.21.15.62:0/1116392342 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7f180b5000 0x7f7f1813f6e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7f080097d0 tx=0x7f7f0802b820 comp rx=0 tx=0).stop 2024-02-09T08:03:18.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.828+0000 7f7f1d1dc640 1 -- 172.21.15.62:0/1116392342 shutdown_connections 2024-02-09T08:03:18.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.828+0000 7f7f1d1dc640 1 --2- 172.21.15.62:0/1116392342 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7f180b5000 0x7f7f1813f6e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:18.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.829+0000 7f7f1d1dc640 1 -- 172.21.15.62:0/1116392342 >> 172.21.15.62:0/1116392342 conn(0x7f7f18066bb0 msgr2=0x7f7f18066fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:18.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.829+0000 7f7f1d1dc640 1 -- 172.21.15.62:0/1116392342 shutdown_connections 2024-02-09T08:03:18.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.829+0000 7f7f1d1dc640 1 -- 172.21.15.62:0/1116392342 wait complete. 2024-02-09T08:03:18.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.830+0000 7f7f1d1dc640 10 monclient: build_initial_monmap 2024-02-09T08:03:18.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.830+0000 7f7f1d1dc640 10 monclient: monmap: 2024-02-09T08:03:18.835 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:18.835 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:03:18.836 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:03:18.836 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:03:18.836 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:18.836 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:18.836 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:03:18.836 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:03:18.836 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:03:18.836 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:18.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.830+0000 7f7f1d1dc640 1 librados: starting msgr at 2024-02-09T08:03:18.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.830+0000 7f7f1d1dc640 1 librados: starting objecter 2024-02-09T08:03:18.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.830+0000 7f7f1d1dc640 1 Processor -- start 2024-02-09T08:03:18.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.831+0000 7f7f1d1dc640 1 -- start start 2024-02-09T08:03:18.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.831+0000 7f7f1d1dc640 1 librados: setting wanted keys 2024-02-09T08:03:18.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.831+0000 7f7f1d1dc640 1 librados: calling monclient init 2024-02-09T08:03:18.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.831+0000 7f7f1d1dc640 10 monclient: init 2024-02-09T08:03:18.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.831+0000 7fc2cbfff640 1 -- 172.21.15.62:0/990981285 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c402e070 con 0x7fc2d4070ed0 2024-02-09T08:03:18.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.831+0000 7fc2cbfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:18.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.831+0000 7fc2cbfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:03:18.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.831+0000 7fc2cbfff640 10 monclient: dump: 2024-02-09T08:03:18.839 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:18.839 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:18.839 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:18.839 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:18.839 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:18.839 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:18.839 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:18.839 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:18.839 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:18.839 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:18.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.831+0000 7fc2cbfff640 10 monclient: _finish_auth 0 2024-02-09T08:03:18.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.831+0000 7fc2cbfff640 10 monclient: _check_auth_tickets 2024-02-09T08:03:18.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.831+0000 7fc2cbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:18.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.831+0000 7fc2cbfff640 1 -- 172.21.15.62:0/990981285 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c40315a0 con 0x7fc2d4070ed0 2024-02-09T08:03:18.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.831+0000 7fc2cbfff640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:18.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.831+0000 7fc2cbfff640 1 -- 172.21.15.62:0/990981285 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c4031930 con 0x7fc2d4070ed0 2024-02-09T08:03:18.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.831+0000 7fc2cbfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:18.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.831+0000 7fc2cbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-09T08:03:18.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.831+0000 7fc2cbfff640 10 monclient: dump: 2024-02-09T08:03:18.840 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:18.840 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:18.840 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:18.840 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:18.840 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:18.840 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:18.840 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:18.840 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:18.841 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:18.841 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:18.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.831+0000 7fc2db35c640 5 monclient: authenticate success, global_id 4349 2024-02-09T08:03:18.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.831+0000 7fc2db35c640 10 monclient: get_monmap_and_config success 2024-02-09T08:03:18.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.831+0000 7fc2db35c640 4 set_mon_vals no callback set 2024-02-09T08:03:18.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.831+0000 7f7f1d1dc640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:18.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.831+0000 7f7f1d1dc640 10 monclient: _add_conns ranks=[0,1,2] 2024-02-09T08:03:18.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.831+0000 7f7f1d1dc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f180a9e30 0x7f7f1813c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:18.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.831+0000 7f7f1d1dc640 10 monclient(hunting): picked mon.noname-a con 0x7f7f180a9e30 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:03:18.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.831+0000 7f7f1d1dc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f180b5000 0x7f7f181402c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:18.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.832+0000 7f7f1d1dc640 10 monclient(hunting): picked mon.noname-b con 0x7f7f180b5000 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:03:18.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.832+0000 7f7f1d1dc640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7f181464f0 0x7f7f18140800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:18.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.832+0000 7f7f1d1dc640 10 monclient(hunting): picked mon.noname-c con 0x7f7f181464f0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:18.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.832+0000 7f7f1d1dc640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:18.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.832+0000 7f7f1d1dc640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1813a0d0 con 0x7f7f180a9e30 2024-02-09T08:03:18.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.832+0000 7f7f1d1dc640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:18.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.832+0000 7f7f1d1dc640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f18139d80 con 0x7f7f180b5000 2024-02-09T08:03:18.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.832+0000 7fc2db35c640 10 monclient: shutdown 2024-02-09T08:03:18.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.832+0000 7fc2db35c640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:18.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.832+0000 7fc2db35c640 1 -- 172.21.15.62:0/990981285 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc2d4070ed0 msgr2=0x7fc2d41440c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:18.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.832+0000 7fc2db35c640 1 --2- 172.21.15.62:0/990981285 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc2d4070ed0 0x7fc2d41440c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc2c40097a0 tx=0x7fc2c402b840 comp rx=0 tx=0).stop 2024-02-09T08:03:18.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.832+0000 7f7f1d1dc640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:18.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.832+0000 7f7f1d1dc640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1813bb30 con 0x7f7f181464f0 2024-02-09T08:03:18.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.832+0000 7f7f1d1dc640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:18.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.832+0000 7f7f1d1dc640 10 monclient(hunting): authenticate will time out at 1442.192373s 2024-02-09T08:03:18.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.832+0000 7fc2db35c640 1 -- 172.21.15.62:0/990981285 shutdown_connections 2024-02-09T08:03:18.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.832+0000 7fc2db35c640 1 --2- 172.21.15.62:0/990981285 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc2d4070ed0 0x7fc2d41440c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:18.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.832+0000 7fc2db35c640 1 --2- 172.21.15.62:0/990981285 >> v2:172.21.15.103:3300/0 conn(0x7fc2d4070af0 0x7fc2d40b0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:18.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.832+0000 7fc2db35c640 1 -- 172.21.15.62:0/990981285 >> 172.21.15.62:0/990981285 conn(0x7fc2d40b6120 msgr2=0x7fc2d40b6530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:18.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.832+0000 7f7f16d9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f180a9e30 0x7f7f1813c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:18.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.832+0000 7fc2db35c640 1 -- 172.21.15.62:0/990981285 shutdown_connections 2024-02-09T08:03:18.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.832+0000 7fc2db35c640 1 -- 172.21.15.62:0/990981285 wait complete. 2024-02-09T08:03:18.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.832+0000 7f7f16d9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f180a9e30 0x7f7f1813c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:35198/0 (socket says 172.21.15.62:35198) 2024-02-09T08:03:18.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.832+0000 7f7f16d9d640 1 -- 172.21.15.62:0/1274026157 learned_addr learned my addr 172.21.15.62:0/1274026157 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:18.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.832+0000 7f7f16d9d640 10 monclient(hunting): get_auth_request con 0x7f7f180a9e30 auth_method 0 2024-02-09T08:03:18.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.832+0000 7f7f16d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:18.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.832+0000 7f7f16d9d640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:18.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.832+0000 7f7f16d9d640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:18.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.833+0000 7fc2db35c640 10 monclient: build_initial_monmap 2024-02-09T08:03:18.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.833+0000 7fc2db35c640 10 monclient: monmap: 2024-02-09T08:03:18.847 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:18.847 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:03:18.847 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:03:18.847 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:03:18.847 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:18.847 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:18.847 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:03:18.847 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:03:18.847 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:03:18.848 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:18.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.833+0000 7f7f16d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:18.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.833+0000 7f7f16d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:18.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.833+0000 7f7f16d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:18.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.833+0000 7fc2db35c640 1 librados: starting msgr at 2024-02-09T08:03:18.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.833+0000 7fc2db35c640 1 librados: starting objecter 2024-02-09T08:03:18.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.833+0000 7fc2db35c640 1 Processor -- start 2024-02-09T08:03:18.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.833+0000 7f7f1759e640 1 --2- 172.21.15.62:0/1274026157 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7f181464f0 0x7f7f18140800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:18.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.833+0000 7fc2db35c640 1 -- start start 2024-02-09T08:03:18.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.833+0000 7fc2db35c640 1 librados: setting wanted keys 2024-02-09T08:03:18.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.833+0000 7fc2db35c640 1 librados: calling monclient init 2024-02-09T08:03:18.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.833+0000 7fc2db35c640 10 monclient: init 2024-02-09T08:03:18.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.834+0000 7fc2db35c640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:18.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.834+0000 7fc2db35c640 10 monclient: _add_conns ranks=[2,1,0] 2024-02-09T08:03:18.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.834+0000 7fc2db35c640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc2d4070af0 0x7fc2d406b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:18.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.834+0000 7fc2db35c640 10 monclient(hunting): picked mon.noname-c con 0x7fc2d4070af0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:18.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.834+0000 7fc2db35c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2d4070ed0 0x7fc2d413f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:18.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.834+0000 7fc2db35c640 10 monclient(hunting): picked mon.noname-b con 0x7fc2d4070ed0 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:03:18.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.834+0000 7fc2db35c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2d413d630 0x7fc2d413fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:18.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.834+0000 7fc2db35c640 10 monclient(hunting): picked mon.noname-a con 0x7fc2d413d630 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:03:18.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.834+0000 7fc2db35c640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:18.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.834+0000 7fc2db35c640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d413ec30 con 0x7fc2d413d630 2024-02-09T08:03:18.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.834+0000 7fc2db35c640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:18.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.834+0000 7fc2db35c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d406cc10 con 0x7fc2d4070ed0 2024-02-09T08:03:18.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.834+0000 7fc2db35c640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:18.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.834+0000 7fc2db35c640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d413eea0 con 0x7fc2d4070af0 2024-02-09T08:03:18.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.834+0000 7fc2db35c640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:18.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.834+0000 7fc2db35c640 10 monclient(hunting): authenticate will time out at 1442.194538s 2024-02-09T08:03:18.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.835+0000 7f7f1759e640 10 monclient(hunting): get_auth_request con 0x7f7f181464f0 auth_method 0 2024-02-09T08:03:18.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.835+0000 7f7f1759e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:18.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.835+0000 7f7f1759e640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:18.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.835+0000 7f7f1759e640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:18.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.836+0000 7fc2d90f8640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc2d4070af0 0x7fc2d406b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:18.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.837+0000 7f7f16d9d640 10 monclient(hunting): handle_auth_done global_id 4392 payload 824 2024-02-09T08:03:18.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.837+0000 7f7f16d9d640 1 -- 172.21.15.62:0/1274026157 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7f181464f0 msgr2=0x7f7f18140800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:18.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.837+0000 7f7f16d9d640 1 --2- 172.21.15.62:0/1274026157 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7f181464f0 0x7f7f18140800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:18.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.837+0000 7f7f16d9d640 1 -- 172.21.15.62:0/1274026157 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f180b5000 msgr2=0x7f7f181402c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:18.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.837+0000 7f7f16d9d640 1 --2- 172.21.15.62:0/1274026157 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f180b5000 0x7f7f181402c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:18.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.837+0000 7f7f16d9d640 10 monclient: _finish_hunting 0 2024-02-09T08:03:18.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.837+0000 7f7f16d9d640 1 monclient: found mon.noname-a 2024-02-09T08:03:18.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.837+0000 7f7f16d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:18.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.837+0000 7f7f16d9d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-02-09T08:03:18.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.837+0000 7f7f16d9d640 1 -- 172.21.15.62:0/1274026157 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f08009400 con 0x7f7f180a9e30 2024-02-09T08:03:18.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.837+0000 7f7f1759e640 1 --2- 172.21.15.62:0/1274026157 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7f181464f0 0x7f7f18140800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-09T08:03:18.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.838+0000 7fc2d90f8640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc2d4070af0 0x7fc2d406b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:33132/0 (socket says 172.21.15.62:33132) 2024-02-09T08:03:18.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.838+0000 7fc2d90f8640 1 -- 172.21.15.62:0/3881776881 learned_addr learned my addr 172.21.15.62:0/3881776881 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:18.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.838+0000 7fc2d90f8640 10 monclient(hunting): get_auth_request con 0x7fc2d4070af0 auth_method 0 2024-02-09T08:03:18.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.838+0000 7fc2d90f8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:18.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.838+0000 7fc2d90f8640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:18.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.838+0000 7fc2d90f8640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:18.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.839+0000 7fc2d90f8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:18.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.839+0000 7fc2d90f8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:18.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.839+0000 7fc2d90f8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:18.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.839+0000 7f7f16d9d640 1 --2- 172.21.15.62:0/1274026157 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f180a9e30 0x7f7f1813c880 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7f080097d0 tx=0x7f7f080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:18.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.839+0000 7f7eff7fe640 10 client.?.objecter ms_handle_connect 0x7f7f180a9e30 2024-02-09T08:03:18.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.839+0000 7f7eff7fe640 10 client.?.objecter resend_mon_ops 2024-02-09T08:03:18.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.842+0000 7fc2d90f8640 10 monclient(hunting): handle_auth_done global_id 4355 payload 824 2024-02-09T08:03:18.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.842+0000 7fc2d90f8640 1 -- 172.21.15.62:0/3881776881 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2d4070ed0 msgr2=0x7fc2d413f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:18.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.842+0000 7fc2d90f8640 1 --2- 172.21.15.62:0/3881776881 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2d4070ed0 0x7fc2d413f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:18.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.842+0000 7fc2d90f8640 1 -- 172.21.15.62:0/3881776881 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2d413d630 msgr2=0x7fc2d413fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:18.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.842+0000 7fc2d90f8640 1 --2- 172.21.15.62:0/3881776881 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2d413d630 0x7fc2d413fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:18.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.842+0000 7fc2d90f8640 10 monclient: _finish_hunting 0 2024-02-09T08:03:18.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.842+0000 7fc2d90f8640 1 monclient: found mon.noname-c 2024-02-09T08:03:18.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.842+0000 7fc2d90f8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:18.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.842+0000 7fc2d90f8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-02-09T08:03:18.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.842+0000 7fc2d90f8640 1 -- 172.21.15.62:0/3881776881 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c4009400 con 0x7fc2d4070af0 2024-02-09T08:03:18.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.844+0000 7f7eff7fe640 1 -- 172.21.15.62:0/1274026157 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f080328a0 con 0x7f7f180a9e30 2024-02-09T08:03:18.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.844+0000 7f7eff7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:18.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.844+0000 7f7eff7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-09T08:03:18.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.844+0000 7f7eff7fe640 10 monclient: dump: 2024-02-09T08:03:18.859 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:18.859 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:18.859 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:18.859 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:18.859 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:18.860 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:18.860 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:18.860 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:18.860 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:18.860 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:18.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.844+0000 7f7eff7fe640 10 monclient: _finish_auth 0 2024-02-09T08:03:18.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.844+0000 7f7eff7fe640 10 monclient: _check_auth_tickets 2024-02-09T08:03:18.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.844+0000 7f7eff7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:18.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.844+0000 7f7f1d1dc640 5 monclient: authenticate success, global_id 4392 2024-02-09T08:03:18.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.844+0000 7f7eff7fe640 1 -- 172.21.15.62:0/1274026157 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f08032a20 con 0x7f7f180a9e30 2024-02-09T08:03:18.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.844+0000 7f7eff7fe640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:18.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.844+0000 7f7eff7fe640 1 -- 172.21.15.62:0/1274026157 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f08032dd0 con 0x7f7f180a9e30 2024-02-09T08:03:18.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.844+0000 7f7eff7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:18.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.845+0000 7f7eff7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-09T08:03:18.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.845+0000 7f7eff7fe640 10 monclient: dump: 2024-02-09T08:03:18.861 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:18.861 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:18.861 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:18.861 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:18.861 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:18.861 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:18.862 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:18.862 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:18.862 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:18.862 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:18.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.844+0000 7f7f1559a640 4 set_mon_vals no callback set 2024-02-09T08:03:18.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.845+0000 7f7f1d1dc640 10 monclient: _renew_subs 2024-02-09T08:03:18.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.845+0000 7f7f1d1dc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:03:18.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.845+0000 7f7f1d1dc640 1 -- 172.21.15.62:0/1274026157 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f1813be10 con 0x7f7f180a9e30 2024-02-09T08:03:18.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.845+0000 7f7f1d1dc640 10 client.4392.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:03:18.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.845+0000 7f7f1d1dc640 10 monclient: _renew_subs 2024-02-09T08:03:18.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.845+0000 7f7f1d1dc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:03:18.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.845+0000 7fc2d90f8640 1 --2- 172.21.15.62:0/3881776881 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc2d4070af0 0x7fc2d406b950 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc2d000b4a0 tx=0x7fc2d000b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:18.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.845+0000 7fc2c9ffb640 10 client.?.objecter ms_handle_connect 0x7fc2d4070af0 2024-02-09T08:03:18.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.845+0000 7f7f1d1dc640 1 -- 172.21.15.62:0/1274026157 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f1813af70 con 0x7f7f180a9e30 2024-02-09T08:03:18.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.845+0000 7fc2c9ffb640 10 client.?.objecter resend_mon_ops 2024-02-09T08:03:18.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.845+0000 7f7f1d1dc640 1 librados: init done 2024-02-09T08:03:18.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.846+0000 7f7f1d1dc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:18.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.846+0000 7f7f1d1dc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:18.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.846+0000 7f7f1d1dc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:03:18.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.846+0000 7f7f1d1dc640 1 -- 172.21.15.62:0/1274026157 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f1813a340 con 0x7f7f180a9e30 2024-02-09T08:03:18.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.850+0000 7fc2c9ffb640 1 -- 172.21.15.62:0/3881776881 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d0010610 con 0x7fc2d4070af0 2024-02-09T08:03:18.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.850+0000 7fc2c9ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:18.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.850+0000 7fc2c9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-09T08:03:18.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.850+0000 7fc2c9ffb640 10 monclient: dump: 2024-02-09T08:03:18.865 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:18.865 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:18.866 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:18.866 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:18.866 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:18.866 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:18.866 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:18.866 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:18.866 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:18.866 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:18.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.850+0000 7fc2c9ffb640 10 monclient: _finish_auth 0 2024-02-09T08:03:18.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.850+0000 7fc2c9ffb640 10 monclient: _check_auth_tickets 2024-02-09T08:03:18.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.850+0000 7fc2c9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:18.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.850+0000 7fc2c9ffb640 1 -- 172.21.15.62:0/3881776881 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d0010770 con 0x7fc2d4070af0 2024-02-09T08:03:18.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.850+0000 7fc2db35c640 5 monclient: authenticate success, global_id 4355 2024-02-09T08:03:18.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.850+0000 7fc2db35c640 10 monclient: _renew_subs 2024-02-09T08:03:18.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.850+0000 7fc2db35c640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:03:18.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.850+0000 7fc2db35c640 1 -- 172.21.15.62:0/3881776881 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2d406c6f0 con 0x7fc2d4070af0 2024-02-09T08:03:18.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.850+0000 7fc2c9ffb640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:18.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.850+0000 7fc2c9ffb640 1 -- 172.21.15.62:0/3881776881 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d0010b20 con 0x7fc2d4070af0 2024-02-09T08:03:18.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.850+0000 7fc2c9ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:18.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.850+0000 7fc2c9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-09T08:03:18.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.850+0000 7fc2c9ffb640 10 monclient: dump: 2024-02-09T08:03:18.867 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:18.867 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:18.867 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:18.867 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:18.867 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:18.867 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:18.867 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:18.867 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:18.868 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:18.868 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:18.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.850+0000 7fc2cb7fe640 4 set_mon_vals no callback set 2024-02-09T08:03:18.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.851+0000 7fc2db35c640 10 client.4355.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:03:18.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.851+0000 7fc2db35c640 10 monclient: _renew_subs 2024-02-09T08:03:18.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.851+0000 7fc2db35c640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:03:18.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.851+0000 7fc2db35c640 1 -- 172.21.15.62:0/3881776881 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2d406be90 con 0x7fc2d4070af0 2024-02-09T08:03:18.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.851+0000 7fc2db35c640 1 librados: init done 2024-02-09T08:03:18.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.851+0000 7fc2db35c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:18.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.851+0000 7fc2db35c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:18.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.851+0000 7fc2db35c640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:03:18.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.851+0000 7fc2db35c640 1 -- 172.21.15.62:0/3881776881 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2d406c930 con 0x7fc2d4070af0 2024-02-09T08:03:18.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.886+0000 7fc2c9ffb640 1 -- 172.21.15.62:0/3881776881 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fc2d0010c80 con 0x7fc2d4070af0 2024-02-09T08:03:18.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.886+0000 7fc2c9ffb640 1 --2- 172.21.15.62:0/3881776881 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fc2b806d1f0 0x7fc2b806f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:18.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.886+0000 7fc2d88f7640 1 --2- 172.21.15.62:0/3881776881 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fc2b806d1f0 0x7fc2b806f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:18.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.886+0000 7fc2d88f7640 10 monclient: get_auth_request con 0x7fc2b806d1f0 auth_method 0 2024-02-09T08:03:18.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.887+0000 7fc2c9ffb640 10 client.4355.objecter ms_handle_connect 0x7fc2b806d1f0 2024-02-09T08:03:18.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.887+0000 7fc2d88f7640 1 --2- 172.21.15.62:0/3881776881 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fc2b806d1f0 0x7fc2b806f6b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4036000 tx=0x7fc2c4030000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:18.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.897+0000 7f930a308640 10 monclient: get_monmap_and_config 2024-02-09T08:03:18.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.897+0000 7f930a308640 10 monclient: build_initial_monmap 2024-02-09T08:03:18.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.897+0000 7f930a308640 10 monclient: monmap: 2024-02-09T08:03:18.899 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:18.900 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:18.900 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:03:18.898630+0000 2024-02-09T08:03:18.900 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:03:18.898630+0000 2024-02-09T08:03:18.900 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:18.900 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:18.900 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:03:18.900 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:03:18.900 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:03:18.900 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:03:18.900 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:03:18.900 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:18.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.898+0000 7f930a308640 1 Processor -- start 2024-02-09T08:03:18.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.898+0000 7f930a308640 1 -- start start 2024-02-09T08:03:18.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.898+0000 7f930a308640 10 monclient: init 2024-02-09T08:03:18.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.898+0000 7f930a308640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:18.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.898+0000 7f930a308640 10 monclient: _add_conns ranks=[4,2,3,1,0] 2024-02-09T08:03:18.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.898+0000 7f930a308640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9304067110 0x7f93040a9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:18.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.898+0000 7f930a308640 10 monclient(hunting): picked mon.noname-c con 0x7f9304067110 addr v2:172.21.15.103:3300/0 2024-02-09T08:03:18.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.898+0000 7f930a308640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f930413f830 0x7f930413fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:18.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.898+0000 7f930a308640 10 monclient(hunting): picked mon.noname-b con 0x7f930413f830 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:18.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.898+0000 7f930a308640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f93041424c0 0x7f9304142930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:18.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.898+0000 7f930a308640 10 monclient(hunting): picked mon.noname-a con 0x7f93041424c0 addr v2:172.21.15.62:3300/0 2024-02-09T08:03:18.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.898+0000 7f930a308640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:18.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.898+0000 7f930a308640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93040674f0 con 0x7f93041424c0 2024-02-09T08:03:18.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.898+0000 7f930a308640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:18.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.898+0000 7f930a308640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93040aa090 con 0x7f9304067110 2024-02-09T08:03:18.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.898+0000 7f930a308640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:18.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.898+0000 7f930a308640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93040ab5b0 con 0x7f930413f830 2024-02-09T08:03:18.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.898+0000 7f930a308640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:18.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:18.899+0000 7f930a308640 10 monclient(hunting): authenticate will time out at 1442.259236s 2024-02-09T08:03:18.938 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-02-09T08:03:19.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.042+0000 7f9a0ccde640 10 monclient: get_monmap_and_config 2024-02-09T08:03:19.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.042+0000 7f9a0ccde640 10 monclient: build_initial_monmap 2024-02-09T08:03:19.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.042+0000 7f9a0ccde640 10 monclient: monmap: 2024-02-09T08:03:19.044 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:19.044 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:19.044 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:03:19.043366+0000 2024-02-09T08:03:19.045 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:03:19.043366+0000 2024-02-09T08:03:19.045 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:19.045 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:19.045 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:03:19.045 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:03:19.045 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:03:19.045 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:03:19.045 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:03:19.045 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:19.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.042+0000 7f9a0ccde640 1 Processor -- start 2024-02-09T08:03:19.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.042+0000 7f9a0ccde640 1 -- start start 2024-02-09T08:03:19.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.043+0000 7f9a0ccde640 10 monclient: init 2024-02-09T08:03:19.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.043+0000 7fa758ff9640 1 -- 172.21.15.62:0/3103771502 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fa7500073c0 con 0x7fa75c0b5000 2024-02-09T08:03:19.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.043+0000 7fa758ff9640 1 --2- 172.21.15.62:0/3103771502 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fa74806d1a0 0x7fa74806f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:19.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.043+0000 7fa75bfff640 1 --2- 172.21.15.62:0/3103771502 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fa74806d1a0 0x7fa74806f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:19.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.044+0000 7fa75bfff640 10 monclient: get_auth_request con 0x7fa74806d1a0 auth_method 0 2024-02-09T08:03:19.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.044+0000 7f9a0ccde640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:19.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.044+0000 7f9a0ccde640 10 monclient: _add_conns ranks=[3,0,4,2,1] 2024-02-09T08:03:19.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.044+0000 7f9a0ccde640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9a08067110 0x7f9a080a9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:19.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.044+0000 7f9a0ccde640 10 monclient(hunting): picked mon.noname-a con 0x7f9a08067110 addr v2:172.21.15.62:3300/0 2024-02-09T08:03:19.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.044+0000 7f9a0ccde640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f9a0813f830 addr v1:172.21.15.62:6789/0 2024-02-09T08:03:19.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.044+0000 7f9a0ccde640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9a08142bd0 0x7f9a0813fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:19.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.044+0000 7f9a0ccde640 10 monclient(hunting): picked mon.noname-c con 0x7f9a08142bd0 addr v2:172.21.15.103:3300/0 2024-02-09T08:03:19.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.044+0000 7f9a0ccde640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a080aa090 con 0x7f9a0813f830 2024-02-09T08:03:19.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.044+0000 7f9a0ccde640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:19.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.044+0000 7f9a0ccde640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a080674f0 con 0x7f9a08067110 2024-02-09T08:03:19.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.044+0000 7f9a0ccde640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:19.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.044+0000 7f9a0ccde640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a08143020 con 0x7f9a08142bd0 2024-02-09T08:03:19.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.044+0000 7f9a0ccde640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:19.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.044+0000 7f9a0ccde640 10 monclient(hunting): authenticate will time out at 1442.404442s 2024-02-09T08:03:19.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.044+0000 7fa75bfff640 1 --2- 172.21.15.62:0/3103771502 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fa74806d1a0 0x7fa74806f660 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa74c0011e0 tx=0x7fa74c007d30 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:19.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.044+0000 7fa758ff9640 10 client.4381.objecter ms_handle_connect 0x7fa74806d1a0 2024-02-09T08:03:19.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.045+0000 7fa758ff9640 1 -- 172.21.15.62:0/3103771502 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa750058330 con 0x7fa75c0b5000 2024-02-09T08:03:19.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.045+0000 7fa758ff9640 10 client.4381.objecter ms_dispatch 0x7fa75c000b90 osd_map(26..26 src has 1..26) v4 2024-02-09T08:03:19.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.045+0000 7fa758ff9640 3 client.4381.objecter handle_osd_map got epochs [26,26] > 0 2024-02-09T08:03:19.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.045+0000 7fa758ff9640 3 client.4381.objecter handle_osd_map decoding full epoch 26 2024-02-09T08:03:19.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.045+0000 7fa758ff9640 20 client.4381.objecter dump_active .. 0 homeless 2024-02-09T08:03:19.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.055+0000 7fa758ff9640 1 -- 172.21.15.62:0/3103771502 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa7500545d0 con 0x7fa75c0b5000 2024-02-09T08:03:19.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.055+0000 7fa758ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:19.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.055+0000 7fa758ff9640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:03:19.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.058+0000 7f9303fff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9304067110 0x7f93040a9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:19.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.059+0000 7f9303fff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9304067110 0x7f93040a9930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.62:40348/0 (socket says 172.21.15.62:40348) 2024-02-09T08:03:19.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.059+0000 7f9303fff640 1 -- 172.21.15.62:0/1305191456 learned_addr learned my addr 172.21.15.62:0/1305191456 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:19.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.059+0000 7f9303fff640 10 monclient(hunting): get_auth_request con 0x7f9304067110 auth_method 0 2024-02-09T08:03:19.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.059+0000 7f9303fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:19.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.059+0000 7f9303fff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:19.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.059+0000 7f9303fff640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:19.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.060+0000 7f9303fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:19.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.060+0000 7f9303fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:19.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.060+0000 7f9303fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:19.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.062+0000 7f9303fff640 10 monclient(hunting): handle_auth_done global_id 4384 payload 274 2024-02-09T08:03:19.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.062+0000 7f9303fff640 1 -- 172.21.15.62:0/1305191456 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f930413f830 msgr2=0x7f930413fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:19.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.062+0000 7f9303fff640 1 --2- 172.21.15.62:0/1305191456 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f930413f830 0x7f930413fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:19.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.062+0000 7f9303fff640 1 -- 172.21.15.62:0/1305191456 >> v2:172.21.15.62:3300/0 conn(0x7f93041424c0 msgr2=0x7f9304142930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:19.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.062+0000 7f9303fff640 1 --2- 172.21.15.62:0/1305191456 >> v2:172.21.15.62:3300/0 conn(0x7f93041424c0 0x7f9304142930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:19.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.062+0000 7f9303fff640 10 monclient: _finish_hunting 0 2024-02-09T08:03:19.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.062+0000 7f9303fff640 1 monclient: found mon.noname-c 2024-02-09T08:03:19.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.062+0000 7f9303fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:19.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.062+0000 7f9303fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.103:3300/0 2024-02-09T08:03:19.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.062+0000 7f9303fff640 1 -- 172.21.15.62:0/1305191456 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93040b4720 con 0x7f9304067110 2024-02-09T08:03:19.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.065+0000 7f9303fff640 1 --2- 172.21.15.62:0/1305191456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9304067110 0x7f93040a9930 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f93040b8f10 tx=0x7f92f402b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7a00fc39c58f644 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:19.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.067+0000 7f9a06d9d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9a08142bd0 0x7f9a0813fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:19.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.068+0000 7f9a06d9d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9a08142bd0 0x7f9a0813fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.62:40350/0 (socket says 172.21.15.62:40350) 2024-02-09T08:03:19.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.068+0000 7f9a06d9d640 1 -- 172.21.15.62:0/773767067 learned_addr learned my addr 172.21.15.62:0/773767067 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:19.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.068+0000 7f9a06d9d640 10 monclient(hunting): get_auth_request con 0x7f9a08142bd0 auth_method 0 2024-02-09T08:03:19.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.068+0000 7f9a06d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:19.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.068+0000 7f9a06d9d640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:19.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.068+0000 7f9a06d9d640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:19.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.071+0000 7f9a06d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:19.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.071+0000 7f9a06d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:19.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.071+0000 7f9a06d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:19.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.072+0000 7f9a06d9d640 10 monclient(hunting): handle_auth_done global_id 4387 payload 274 2024-02-09T08:03:19.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.072+0000 7f9a06d9d640 1 -- 172.21.15.62:0/773767067 >> v2:172.21.15.62:3300/0 conn(0x7f9a08067110 msgr2=0x7f9a080a9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:19.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.072+0000 7f9a06d9d640 1 --2- 172.21.15.62:0/773767067 >> v2:172.21.15.62:3300/0 conn(0x7f9a08067110 0x7f9a080a9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:19.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.072+0000 7f9a06d9d640 1 -- 172.21.15.62:0/773767067 >> v1:172.21.15.62:6789/0 conn(0x7f9a0813f830 legacy=0x7f9a081424c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:19.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.072+0000 7f9a06d9d640 10 monclient: _finish_hunting 0 2024-02-09T08:03:19.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.072+0000 7f9a06d9d640 1 monclient: found mon.noname-c 2024-02-09T08:03:19.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.072+0000 7f9a06d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:19.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.072+0000 7f9a06d9d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.103:3300/0 2024-02-09T08:03:19.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.072+0000 7f9a06d9d640 1 -- 172.21.15.62:0/773767067 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a080ab5b0 con 0x7f9a08142bd0 2024-02-09T08:03:19.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.074+0000 7f9a06d9d640 1 --2- 172.21.15.62:0/773767067 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a08142bd0 0x7f9a0813fc70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9a080b4460 tx=0x7f9a0002be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91d01aca23df7d80 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:19.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.076+0000 7f9302ffd640 1 -- 172.21.15.62:0/1305191456 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f40317e0 con 0x7f9304067110 2024-02-09T08:03:19.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.076+0000 7f9302ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:19.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.076+0000 7f9302ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-09T08:03:19.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.076+0000 7f9302ffd640 10 monclient: dump: 2024-02-09T08:03:19.079 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:19.079 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:19.079 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:19.079 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:19.079 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:19.079 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:19.080 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:19.080 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:19.080 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:19.080 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:19.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.076+0000 7f9302ffd640 10 monclient: _finish_auth 0 2024-02-09T08:03:19.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.076+0000 7f9302ffd640 10 monclient: _check_auth_tickets 2024-02-09T08:03:19.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.076+0000 7f9302ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:19.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.076+0000 7f9302ffd640 1 -- 172.21.15.62:0/1305191456 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92f4031940 con 0x7f9304067110 2024-02-09T08:03:19.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.076+0000 7f930a308640 5 monclient: authenticate success, global_id 4384 2024-02-09T08:03:19.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.076+0000 7f930a308640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-02-09T08:03:19.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.076+0000 7f9302ffd640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:19.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.076+0000 7f9302ffd640 1 -- 172.21.15.62:0/1305191456 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f4031cd0 con 0x7f9304067110 2024-02-09T08:03:19.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.076+0000 7f930a308640 10 monclient: get_monmap_and_config success 2024-02-09T08:03:19.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.076+0000 7f930a308640 4 set_mon_vals no callback set 2024-02-09T08:03:19.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.076+0000 7f9302ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:19.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.076+0000 7f9302ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:03:19.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.076+0000 7f9302ffd640 10 monclient: dump: 2024-02-09T08:03:19.081 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:19.081 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:19.081 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:19.081 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:19.081 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:19.081 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:19.081 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:19.082 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:19.082 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:19.082 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:19.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.077+0000 7f930a308640 10 monclient: shutdown 2024-02-09T08:03:19.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.077+0000 7f930a308640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:19.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.077+0000 7f930a308640 1 -- 172.21.15.62:0/1305191456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9304067110 msgr2=0x7f93040a9930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:19.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.077+0000 7f930a308640 1 --2- 172.21.15.62:0/1305191456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9304067110 0x7f93040a9930 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f93040b8f10 tx=0x7f92f402b880 comp rx=0 tx=0).stop 2024-02-09T08:03:19.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.077+0000 7f930a308640 1 -- 172.21.15.62:0/1305191456 shutdown_connections 2024-02-09T08:03:19.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.077+0000 7f930a308640 1 --2- 172.21.15.62:0/1305191456 >> v2:172.21.15.62:3300/0 conn(0x7f93041424c0 0x7f9304142930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:19.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.077+0000 7f930a308640 1 --2- 172.21.15.62:0/1305191456 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f930413f830 0x7f930413fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:19.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.077+0000 7f930a308640 1 --2- 172.21.15.62:0/1305191456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9304067110 0x7f93040a9930 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:19.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.077+0000 7f930a308640 1 -- 172.21.15.62:0/1305191456 >> 172.21.15.62:0/1305191456 conn(0x7f93040b4e20 msgr2=0x7f93040b5230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:19.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.077+0000 7f930a308640 1 -- 172.21.15.62:0/1305191456 shutdown_connections 2024-02-09T08:03:19.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.077+0000 7f930a308640 1 -- 172.21.15.62:0/1305191456 wait complete. 2024-02-09T08:03:19.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.078+0000 7f930a308640 10 monclient: build_initial_monmap 2024-02-09T08:03:19.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.078+0000 7f930a308640 10 monclient: monmap: 2024-02-09T08:03:19.086 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:19.086 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:03:19.086 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:03:19.086 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:03:19.086 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:19.086 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:19.086 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:03:19.086 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:03:19.086 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:03:19.086 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:19.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.078+0000 7f930a308640 1 librados: starting msgr at 2024-02-09T08:03:19.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.078+0000 7f930a308640 1 librados: starting objecter 2024-02-09T08:03:19.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.078+0000 7f930a308640 1 Processor -- start 2024-02-09T08:03:19.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.078+0000 7f930a308640 1 -- start start 2024-02-09T08:03:19.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.078+0000 7f930a308640 1 librados: setting wanted keys 2024-02-09T08:03:19.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.078+0000 7f930a308640 1 librados: calling monclient init 2024-02-09T08:03:19.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.078+0000 7f930a308640 10 monclient: init 2024-02-09T08:03:19.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.079+0000 7f930a308640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:19.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.079+0000 7f930a308640 10 monclient: _add_conns ranks=[2,0,1] 2024-02-09T08:03:19.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.079+0000 7f930a308640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9304067110 0x7f93040b0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:19.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.079+0000 7f930a308640 10 monclient(hunting): picked mon.noname-c con 0x7f9304067110 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:19.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.079+0000 7f930a308640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f930413f830 0x7f93040b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:19.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.079+0000 7f930a308640 10 monclient(hunting): picked mon.noname-a con 0x7f930413f830 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:03:19.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.079+0000 7f930a308640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93041424c0 0x7f93041db0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:19.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.079+0000 7f930a308640 10 monclient(hunting): picked mon.noname-b con 0x7f93041424c0 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:03:19.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.079+0000 7f930a308640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:19.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.079+0000 7f930a308640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93041dab80 con 0x7f930413f830 2024-02-09T08:03:19.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.079+0000 7f930a308640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:19.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.079+0000 7f930a308640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93040b0ed0 con 0x7f93041424c0 2024-02-09T08:03:19.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.079+0000 7f930a308640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:19.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.079+0000 7f930a308640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93040b18e0 con 0x7f9304067110 2024-02-09T08:03:19.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.079+0000 7f930a308640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:19.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.079+0000 7f930a308640 10 monclient(hunting): authenticate will time out at 1442.439738s 2024-02-09T08:03:19.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.079+0000 7f9a0559a640 1 -- 172.21.15.62:0/773767067 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0002c9f0 con 0x7f9a08142bd0 2024-02-09T08:03:19.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.079+0000 7f9a0559a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:19.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.079+0000 7f9a0559a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-09T08:03:19.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.079+0000 7f9a0559a640 10 monclient: dump: 2024-02-09T08:03:19.089 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:19.089 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:19.089 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:19.089 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:19.089 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:19.089 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:19.089 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:19.090 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:19.090 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:19.090 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:19.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.079+0000 7f9a0559a640 10 monclient: _finish_auth 0 2024-02-09T08:03:19.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.079+0000 7f9a0559a640 10 monclient: _check_auth_tickets 2024-02-09T08:03:19.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.079+0000 7f9a0559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:19.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.079+0000 7f9a0559a640 1 -- 172.21.15.62:0/773767067 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a0002cb50 con 0x7f9a08142bd0 2024-02-09T08:03:19.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.079+0000 7f9a0559a640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:19.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.079+0000 7f9a0559a640 1 -- 172.21.15.62:0/773767067 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a000343f0 con 0x7f9a08142bd0 2024-02-09T08:03:19.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.079+0000 7f9a0ccde640 5 monclient: authenticate success, global_id 4387 2024-02-09T08:03:19.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.079+0000 7f9a0ccde640 10 monclient: get_monmap_and_config success 2024-02-09T08:03:19.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.079+0000 7f9a0ccde640 4 set_mon_vals no callback set 2024-02-09T08:03:19.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.079+0000 7f9a0559a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:19.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.079+0000 7f9a0559a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:03:19.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.079+0000 7f9a0559a640 10 monclient: dump: 2024-02-09T08:03:19.091 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:19.091 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:19.091 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:19.092 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:19.092 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:19.092 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:19.092 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:19.092 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:19.092 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:19.092 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:19.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.080+0000 7f9a0ccde640 10 monclient: shutdown 2024-02-09T08:03:19.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.080+0000 7f9a0ccde640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:19.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.080+0000 7f9a0ccde640 1 -- 172.21.15.62:0/773767067 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a08142bd0 msgr2=0x7f9a0813fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:19.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.080+0000 7f9a0ccde640 1 --2- 172.21.15.62:0/773767067 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a08142bd0 0x7f9a0813fc70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9a080b4460 tx=0x7f9a0002be50 comp rx=0 tx=0).stop 2024-02-09T08:03:19.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.080+0000 7f93088a5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93041424c0 0x7f93041db0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:19.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.080+0000 7f9a0ccde640 1 -- 172.21.15.62:0/773767067 shutdown_connections 2024-02-09T08:03:19.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.080+0000 7f9a0ccde640 1 --2- 172.21.15.62:0/773767067 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a08142bd0 0x7f9a0813fc70 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:19.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.080+0000 7f9a0ccde640 1 --2- 172.21.15.62:0/773767067 >> v2:172.21.15.62:3300/0 conn(0x7f9a08067110 0x7f9a080a9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:19.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.080+0000 7f9a0ccde640 1 -- 172.21.15.62:0/773767067 >> 172.21.15.62:0/773767067 conn(0x7f9a080b4e20 msgr2=0x7f9a080b5230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:19.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.080+0000 7f9a0ccde640 1 -- 172.21.15.62:0/773767067 shutdown_connections 2024-02-09T08:03:19.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.080+0000 7f9a0ccde640 1 -- 172.21.15.62:0/773767067 wait complete. 2024-02-09T08:03:19.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.080+0000 7f93088a5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93041424c0 0x7f93041db0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.62:40364/0 (socket says 172.21.15.62:40364) 2024-02-09T08:03:19.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.080+0000 7f93088a5640 1 -- 172.21.15.62:0/2825182806 learned_addr learned my addr 172.21.15.62:0/2825182806 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:19.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.080+0000 7f93088a5640 10 monclient(hunting): get_auth_request con 0x7f93041424c0 auth_method 0 2024-02-09T08:03:19.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.080+0000 7f93088a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:19.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.080+0000 7f93088a5640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:19.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.080+0000 7f93088a5640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:19.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.081+0000 7f9a0ccde640 10 monclient: build_initial_monmap 2024-02-09T08:03:19.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.081+0000 7f9a0ccde640 10 monclient: monmap: 2024-02-09T08:03:19.096 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:19.096 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:03:19.096 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:03:19.096 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:03:19.096 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:19.096 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:19.096 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:03:19.096 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:03:19.097 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:03:19.097 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:19.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.081+0000 7f9a0ccde640 1 librados: starting msgr at 2024-02-09T08:03:19.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.081+0000 7f9a0ccde640 1 librados: starting objecter 2024-02-09T08:03:19.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.081+0000 7f9a0ccde640 1 Processor -- start 2024-02-09T08:03:19.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.081+0000 7f9a0ccde640 1 -- start start 2024-02-09T08:03:19.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.081+0000 7f9a0ccde640 1 librados: setting wanted keys 2024-02-09T08:03:19.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.081+0000 7f9a0ccde640 1 librados: calling monclient init 2024-02-09T08:03:19.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.081+0000 7f9a0ccde640 10 monclient: init 2024-02-09T08:03:19.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.082+0000 7f93088a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:19.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.082+0000 7f93088a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:19.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.082+0000 7f93088a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:19.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.082+0000 7f9a0ccde640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:19.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.082+0000 7f9a0ccde640 10 monclient: _add_conns ranks=[1,2,0] 2024-02-09T08:03:19.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.082+0000 7f9a0ccde640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a08067110 0x7f9a081464b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:19.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.082+0000 7f9a0ccde640 10 monclient(hunting): picked mon.noname-b con 0x7f9a08067110 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:03:19.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.082+0000 7f9a0ccde640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9a0813f830 0x7f9a081dacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:19.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.082+0000 7f9a0ccde640 10 monclient(hunting): picked mon.noname-c con 0x7f9a0813f830 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:19.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.082+0000 7f9a0ccde640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a08142bd0 0x7f9a081db1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:19.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.082+0000 7f9a0ccde640 10 monclient(hunting): picked mon.noname-a con 0x7f9a08142bd0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:03:19.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.082+0000 7f9a0ccde640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:19.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.082+0000 7f9a0ccde640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a08138810 con 0x7f9a08142bd0 2024-02-09T08:03:19.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.082+0000 7f9a0ccde640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:19.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.082+0000 7f9a0ccde640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a08138360 con 0x7f9a08067110 2024-02-09T08:03:19.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.082+0000 7f9a0ccde640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:19.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.082+0000 7f9a0ccde640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a08138a30 con 0x7f9a0813f830 2024-02-09T08:03:19.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.082+0000 7f9a0ccde640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:19.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.082+0000 7f9a0ccde640 10 monclient(hunting): authenticate will time out at 1442.442761s 2024-02-09T08:03:19.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.084+0000 7f93088a5640 10 monclient(hunting): handle_auth_done global_id 4390 payload 824 2024-02-09T08:03:19.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.084+0000 7f93088a5640 1 -- 172.21.15.62:0/2825182806 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9304067110 msgr2=0x7f93040b0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:19.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.084+0000 7f93088a5640 1 --2- 172.21.15.62:0/2825182806 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9304067110 0x7f93040b0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:19.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.084+0000 7f93088a5640 1 -- 172.21.15.62:0/2825182806 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f930413f830 msgr2=0x7f93040b13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:19.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.084+0000 7f93088a5640 1 --2- 172.21.15.62:0/2825182806 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f930413f830 0x7f93040b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:19.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.084+0000 7f93088a5640 10 monclient: _finish_hunting 0 2024-02-09T08:03:19.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.084+0000 7f93088a5640 1 monclient: found mon.noname-b 2024-02-09T08:03:19.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.084+0000 7f93088a5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:19.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.084+0000 7f93088a5640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.103:3300/0 2024-02-09T08:03:19.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.084+0000 7f93088a5640 1 -- 172.21.15.62:0/2825182806 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f40094d0 con 0x7f93041424c0 2024-02-09T08:03:19.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.087+0000 7f9a0659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a08067110 0x7f9a081464b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:19.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.087+0000 7f93088a5640 1 --2- 172.21.15.62:0/2825182806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93041424c0 0x7f93041db0a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f92fc00b970 tx=0x7f92fc00be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:19.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.087+0000 7f9300ff9640 10 client.?.objecter ms_handle_connect 0x7f93041424c0 2024-02-09T08:03:19.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.087+0000 7f9300ff9640 10 client.?.objecter resend_mon_ops 2024-02-09T08:03:19.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.088+0000 7f9a0659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a08067110 0x7f9a081464b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.62:40368/0 (socket says 172.21.15.62:40368) 2024-02-09T08:03:19.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.088+0000 7f9a0659c640 1 -- 172.21.15.62:0/400321566 learned_addr learned my addr 172.21.15.62:0/400321566 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:19.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.088+0000 7f9a0659c640 10 monclient(hunting): get_auth_request con 0x7f9a08067110 auth_method 0 2024-02-09T08:03:19.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.088+0000 7f9a0659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:19.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.088+0000 7f9a0659c640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:19.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.088+0000 7f9a0659c640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:19.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.089+0000 7f9a0659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:19.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.089+0000 7f9a0659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:19.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.089+0000 7f9a0659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:19.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.092+0000 7f9a0659c640 10 monclient(hunting): handle_auth_done global_id 4393 payload 824 2024-02-09T08:03:19.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.092+0000 7f9a0659c640 1 -- 172.21.15.62:0/400321566 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9a0813f830 msgr2=0x7f9a081dacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:19.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.092+0000 7f9a0659c640 1 --2- 172.21.15.62:0/400321566 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9a0813f830 0x7f9a081dacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:19.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.092+0000 7f9a0659c640 1 -- 172.21.15.62:0/400321566 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a08142bd0 msgr2=0x7f9a081db1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:19.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.092+0000 7f9a0659c640 1 --2- 172.21.15.62:0/400321566 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a08142bd0 0x7f9a081db1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:19.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.092+0000 7f9a0659c640 10 monclient: _finish_hunting 0 2024-02-09T08:03:19.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.092+0000 7f9a0659c640 1 monclient: found mon.noname-b 2024-02-09T08:03:19.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.092+0000 7f9a0659c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:19.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.092+0000 7f9a0659c640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.103:3300/0 2024-02-09T08:03:19.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.092+0000 7f9a0659c640 1 -- 172.21.15.62:0/400321566 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a00009b30 con 0x7f9a08067110 2024-02-09T08:03:19.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.096+0000 7f9a0659c640 1 --2- 172.21.15.62:0/400321566 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a08067110 0x7f9a081464b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f99f800b4a0 tx=0x7f99f800b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:19.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.096+0000 7f99f6ffd640 10 client.?.objecter ms_handle_connect 0x7f9a08067110 2024-02-09T08:03:19.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.096+0000 7f99f6ffd640 10 client.?.objecter resend_mon_ops 2024-02-09T08:03:19.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.097+0000 7f9300ff9640 1 -- 172.21.15.62:0/2825182806 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92fc00cb40 con 0x7f93041424c0 2024-02-09T08:03:19.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.097+0000 7f9300ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:19.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.097+0000 7f9300ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:03:19.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.097+0000 7f9300ff9640 10 monclient: dump: 2024-02-09T08:03:19.107 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:19.108 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:19.108 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:19.108 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:19.108 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:19.108 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:19.108 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:19.108 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:19.108 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:19.108 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:19.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.097+0000 7f9300ff9640 10 monclient: _finish_auth 0 2024-02-09T08:03:19.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.097+0000 7f9300ff9640 10 monclient: _check_auth_tickets 2024-02-09T08:03:19.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.097+0000 7f9300ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:19.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.097+0000 7f9300ff9640 1 -- 172.21.15.62:0/2825182806 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92fc00ccc0 con 0x7f93041424c0 2024-02-09T08:03:19.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.097+0000 7f9300ff9640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:19.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.097+0000 7f9300ff9640 1 -- 172.21.15.62:0/2825182806 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92fc014680 con 0x7f93041424c0 2024-02-09T08:03:19.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.097+0000 7f9300ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:19.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.097+0000 7f9300ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:03:19.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.097+0000 7f9300ff9640 10 monclient: dump: 2024-02-09T08:03:19.109 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:19.109 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:19.109 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:19.109 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:19.109 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:19.109 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:19.109 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:19.109 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:19.109 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:19.109 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:19.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.097+0000 7f930a308640 5 monclient: authenticate success, global_id 4390 2024-02-09T08:03:19.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.097+0000 7f930a308640 10 monclient: _renew_subs 2024-02-09T08:03:19.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.097+0000 7f930a308640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:19.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.097+0000 7f930a308640 1 -- 172.21.15.62:0/2825182806 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93040adb80 con 0x7f93041424c0 2024-02-09T08:03:19.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.097+0000 7f93027fc640 4 set_mon_vals no callback set 2024-02-09T08:03:19.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.098+0000 7f930a308640 10 client.4390.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:03:19.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.098+0000 7f930a308640 10 monclient: _renew_subs 2024-02-09T08:03:19.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.098+0000 7f930a308640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:19.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.098+0000 7f930a308640 1 -- 172.21.15.62:0/2825182806 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93041db7c0 con 0x7f93041424c0 2024-02-09T08:03:19.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.098+0000 7f930a308640 1 librados: init done 2024-02-09T08:03:19.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.099+0000 7f930a308640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:19.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.099+0000 7f930a308640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:19.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.099+0000 7f930a308640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:19.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.099+0000 7f930a308640 1 -- 172.21.15.62:0/2825182806 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f930404ef90 con 0x7f93041424c0 2024-02-09T08:03:19.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.101+0000 7f99f6ffd640 1 -- 172.21.15.62:0/400321566 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f8010610 con 0x7f9a08067110 2024-02-09T08:03:19.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.101+0000 7f99f6ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:19.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.101+0000 7f99f6ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:03:19.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.101+0000 7f99f6ffd640 10 monclient: dump: 2024-02-09T08:03:19.112 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:19.112 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:19.112 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:19.112 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:19.112 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:19.112 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:19.112 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:19.112 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:19.112 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:19.113 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:19.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.101+0000 7f99f6ffd640 10 monclient: _finish_auth 0 2024-02-09T08:03:19.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.101+0000 7f99f6ffd640 10 monclient: _check_auth_tickets 2024-02-09T08:03:19.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.101+0000 7f99f6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:19.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.101+0000 7f99f6ffd640 1 -- 172.21.15.62:0/400321566 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f8010770 con 0x7f9a08067110 2024-02-09T08:03:19.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.101+0000 7f99f6ffd640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:19.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.101+0000 7f99f6ffd640 1 -- 172.21.15.62:0/400321566 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f8010b20 con 0x7f9a08067110 2024-02-09T08:03:19.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.101+0000 7f9a0ccde640 5 monclient: authenticate success, global_id 4393 2024-02-09T08:03:19.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.101+0000 7f9a0ccde640 10 monclient: _renew_subs 2024-02-09T08:03:19.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.101+0000 7f9a0ccde640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:19.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.101+0000 7f9a0ccde640 1 -- 172.21.15.62:0/400321566 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a08145120 con 0x7f9a08067110 2024-02-09T08:03:19.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.101+0000 7f99f6ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:19.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.101+0000 7f9a04d99640 4 set_mon_vals no callback set 2024-02-09T08:03:19.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.101+0000 7f99f6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:03:19.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.101+0000 7f99f6ffd640 10 monclient: dump: 2024-02-09T08:03:19.114 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:19.114 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:19.114 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:19.114 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:19.114 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:19.114 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:19.114 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:19.114 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:19.114 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:19.114 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:19.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.101+0000 7f9a0ccde640 10 client.4393.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:03:19.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.101+0000 7f9a0ccde640 10 monclient: _renew_subs 2024-02-09T08:03:19.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.101+0000 7f9a0ccde640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:19.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.101+0000 7f9a0ccde640 1 -- 172.21.15.62:0/400321566 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a08134150 con 0x7f9a08067110 2024-02-09T08:03:19.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.101+0000 7f9a0ccde640 1 librados: init done 2024-02-09T08:03:19.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.102+0000 7f9a0ccde640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:19.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.102+0000 7f9a0ccde640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:19.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.102+0000 7f9a0ccde640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:19.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.102+0000 7f9a0ccde640 1 -- 172.21.15.62:0/400321566 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a08139e40 con 0x7f9a08067110 2024-02-09T08:03:19.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.156+0000 7f7eff7fe640 1 -- 172.21.15.62:0/1274026157 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f7f0804d3f0 con 0x7f7f180a9e30 2024-02-09T08:03:19.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.156+0000 7f7eff7fe640 1 --2- 172.21.15.62:0/1274026157 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f7f0406d220 0x7f7f0406f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:19.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.156+0000 7f7f1659c640 1 --2- 172.21.15.62:0/1274026157 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f7f0406d220 0x7f7f0406f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:19.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.156+0000 7f7f1659c640 10 monclient: get_auth_request con 0x7f7f0406d220 auth_method 0 2024-02-09T08:03:19.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.157+0000 7f7f1659c640 1 --2- 172.21.15.62:0/1274026157 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f7f0406d220 0x7f7f0406f6e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7f181451d0 tx=0x7f7f0c007990 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:19.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.157+0000 7f7eff7fe640 10 client.4392.objecter ms_handle_connect 0x7f7f0406d220 2024-02-09T08:03:19.159 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-02-09T08:03:19.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.179+0000 7f7eff7fe640 1 -- 172.21.15.62:0/1274026157 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7f0807afa0 con 0x7f7f180a9e30 2024-02-09T08:03:19.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.179+0000 7f7eff7fe640 10 client.4392.objecter ms_dispatch 0x7f7f18000b90 osd_map(26..26 src has 1..26) v4 2024-02-09T08:03:19.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.179+0000 7f7eff7fe640 3 client.4392.objecter handle_osd_map got epochs [26,26] > 0 2024-02-09T08:03:19.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.179+0000 7f7eff7fe640 3 client.4392.objecter handle_osd_map decoding full epoch 26 2024-02-09T08:03:19.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.180+0000 7f7eff7fe640 20 client.4392.objecter dump_active .. 0 homeless 2024-02-09T08:03:19.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.180+0000 7f7eff7fe640 1 -- 172.21.15.62:0/1274026157 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7f08076b40 con 0x7f7f180a9e30 2024-02-09T08:03:19.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.180+0000 7f7eff7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:19.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.180+0000 7f7eff7fe640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:03:19.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.239+0000 7fc2c9ffb640 1 -- 172.21.15.62:0/3881776881 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc2d0058f70 con 0x7fc2d4070af0 2024-02-09T08:03:19.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.240+0000 7fc2c9ffb640 10 client.4355.objecter ms_dispatch 0x7fc2d4000b90 osd_map(26..26 src has 1..26) v4 2024-02-09T08:03:19.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.240+0000 7fc2c9ffb640 3 client.4355.objecter handle_osd_map got epochs [26,26] > 0 2024-02-09T08:03:19.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.240+0000 7fc2c9ffb640 3 client.4355.objecter handle_osd_map decoding full epoch 26 2024-02-09T08:03:19.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.240+0000 7fc2c9ffb640 20 client.4355.objecter dump_active .. 0 homeless 2024-02-09T08:03:19.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.240+0000 7fc2c9ffb640 1 -- 172.21.15.62:0/3881776881 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc2d0054b10 con 0x7fc2d4070af0 2024-02-09T08:03:19.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.240+0000 7fc2c9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:19.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.240+0000 7fc2c9ffb640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:03:19.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.277+0000 7fb2004de640 10 monclient: get_monmap_and_config 2024-02-09T08:03:19.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.277+0000 7fb2004de640 10 monclient: build_initial_monmap 2024-02-09T08:03:19.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.277+0000 7fb2004de640 10 monclient: monmap: 2024-02-09T08:03:19.279 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:19.279 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:19.279 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:03:19.278233+0000 2024-02-09T08:03:19.279 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:03:19.278233+0000 2024-02-09T08:03:19.280 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:19.280 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:19.280 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:03:19.280 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:03:19.280 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:03:19.280 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:03:19.280 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:03:19.280 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:19.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.277+0000 7fb2004de640 1 Processor -- start 2024-02-09T08:03:19.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.277+0000 7fb2004de640 1 -- start start 2024-02-09T08:03:19.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.277+0000 7fb2004de640 10 monclient: init 2024-02-09T08:03:19.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.278+0000 7fb2004de640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:19.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.278+0000 7fb2004de640 10 monclient: _add_conns ranks=[2,4,1,0,3] 2024-02-09T08:03:19.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.278+0000 7fb2004de640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1f8067110 0x7fb1f80a9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:19.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.278+0000 7fb2004de640 10 monclient(hunting): picked mon.noname-b con 0x7fb1f8067110 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:19.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.278+0000 7fb2004de640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb1f813f830 0x7fb1f813fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:19.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.278+0000 7fb2004de640 10 monclient(hunting): picked mon.noname-c con 0x7fb1f813f830 addr v2:172.21.15.103:3300/0 2024-02-09T08:03:19.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.278+0000 7fb2004de640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb1f81424c0 addr v1:172.21.15.103:6789/0 2024-02-09T08:03:19.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.278+0000 7fb2004de640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1f80aa090 con 0x7fb1f81424c0 2024-02-09T08:03:19.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.278+0000 7fb2004de640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:19.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.278+0000 7fb2004de640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1f80674f0 con 0x7fb1f813f830 2024-02-09T08:03:19.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.278+0000 7fb2004de640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:19.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.278+0000 7fb2004de640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f8143040 con 0x7fb1f8067110 2024-02-09T08:03:19.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.278+0000 7fb2004de640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:19.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.278+0000 7fb2004de640 10 monclient(hunting): authenticate will time out at 1442.638821s 2024-02-09T08:03:19.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.279+0000 7fb1fe27a640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1f8067110 0x7fb1f80a9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:19.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.279+0000 7fb1fe27a640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1f8067110 0x7fb1f80a9930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:33160/0 (socket says 172.21.15.62:33160) 2024-02-09T08:03:19.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.279+0000 7fb1fe27a640 1 -- 172.21.15.62:0/916678213 learned_addr learned my addr 172.21.15.62:0/916678213 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:19.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.279+0000 7fb1fe27a640 10 monclient(hunting): get_auth_request con 0x7fb1f8067110 auth_method 0 2024-02-09T08:03:19.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.279+0000 7fb1fe27a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:19.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.279+0000 7fb1fe27a640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:19.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.279+0000 7fb1fe27a640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:19.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.280+0000 7fb1fe27a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:19.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.280+0000 7fb1fe27a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:19.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.280+0000 7fb1fe27a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:19.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.282+0000 7fb1fe27a640 10 monclient(hunting): handle_auth_done global_id 4358 payload 274 2024-02-09T08:03:19.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.282+0000 7fb1fe27a640 1 -- 172.21.15.62:0/916678213 >> v2:172.21.15.103:3300/0 conn(0x7fb1f813f830 msgr2=0x7fb1f813fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:19.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.282+0000 7fb1fe27a640 1 --2- 172.21.15.62:0/916678213 >> v2:172.21.15.103:3300/0 conn(0x7fb1f813f830 0x7fb1f813fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:19.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.282+0000 7fb1fe27a640 1 -- 172.21.15.62:0/916678213 >> v1:172.21.15.103:6789/0 conn(0x7fb1f81424c0 legacy=0x7fb1f8142930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:19.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.282+0000 7fb1fe27a640 10 monclient: _finish_hunting 0 2024-02-09T08:03:19.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.282+0000 7fb1fe27a640 1 monclient: found mon.noname-b 2024-02-09T08:03:19.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.282+0000 7fb1fe27a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:19.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.282+0000 7fb1fe27a640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.62:3301/0 2024-02-09T08:03:19.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.282+0000 7fb1fe27a640 1 -- 172.21.15.62:0/916678213 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f80ab5b0 con 0x7fb1f8067110 2024-02-09T08:03:19.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.284+0000 7fb1fe27a640 1 --2- 172.21.15.62:0/916678213 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1f8067110 0x7fb1f80a9930 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4009870 tx=0x7fb1f402b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d9292598d44c931 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:19.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.288+0000 7fb1fd278640 1 -- 172.21.15.62:0/916678213 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f40317c0 con 0x7fb1f8067110 2024-02-09T08:03:19.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.288+0000 7fb1fd278640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:19.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.288+0000 7fb1fd278640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:03:19.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.288+0000 7fb1fd278640 10 monclient: dump: 2024-02-09T08:03:19.290 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:19.290 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:19.290 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:19.290 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:19.290 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:19.291 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:19.291 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:19.291 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:19.291 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:19.291 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:19.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.288+0000 7fb1fd278640 10 monclient: _finish_auth 0 2024-02-09T08:03:19.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.288+0000 7fb1fd278640 10 monclient: _check_auth_tickets 2024-02-09T08:03:19.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.288+0000 7fb1fd278640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:19.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.288+0000 7fb1fd278640 1 -- 172.21.15.62:0/916678213 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f4031920 con 0x7fb1f8067110 2024-02-09T08:03:19.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.288+0000 7fb2004de640 5 monclient: authenticate success, global_id 4358 2024-02-09T08:03:19.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.288+0000 7fb2004de640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-02-09T08:03:19.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.288+0000 7fb1fd278640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:19.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.288+0000 7fb2004de640 10 monclient: get_monmap_and_config success 2024-02-09T08:03:19.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.288+0000 7fb2004de640 4 set_mon_vals no callback set 2024-02-09T08:03:19.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.288+0000 7fb1fd278640 1 -- 172.21.15.62:0/916678213 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f4031cb0 con 0x7fb1f8067110 2024-02-09T08:03:19.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.288+0000 7fb1fd278640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:19.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.288+0000 7fb1fd278640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-09T08:03:19.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.288+0000 7fb1fd278640 10 monclient: dump: 2024-02-09T08:03:19.292 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:19.292 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:19.292 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:19.292 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:19.292 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:19.292 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:19.292 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:19.292 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:19.293 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:19.293 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:19.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.288+0000 7fb2004de640 10 monclient: shutdown 2024-02-09T08:03:19.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.288+0000 7fb2004de640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:19.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.288+0000 7fb2004de640 1 -- 172.21.15.62:0/916678213 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1f8067110 msgr2=0x7fb1f80a9930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:19.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.288+0000 7fb2004de640 1 --2- 172.21.15.62:0/916678213 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1f8067110 0x7fb1f80a9930 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4009870 tx=0x7fb1f402b860 comp rx=0 tx=0).stop 2024-02-09T08:03:19.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.288+0000 7fb2004de640 1 -- 172.21.15.62:0/916678213 shutdown_connections 2024-02-09T08:03:19.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.288+0000 7fb2004de640 1 --2- 172.21.15.62:0/916678213 >> v2:172.21.15.103:3300/0 conn(0x7fb1f813f830 0x7fb1f813fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:19.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.288+0000 7fb2004de640 1 --2- 172.21.15.62:0/916678213 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1f8067110 0x7fb1f80a9930 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:19.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.288+0000 7fb2004de640 1 -- 172.21.15.62:0/916678213 >> 172.21.15.62:0/916678213 conn(0x7fb1f80b4e20 msgr2=0x7fb1f80b5230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:19.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.289+0000 7fb2004de640 1 -- 172.21.15.62:0/916678213 shutdown_connections 2024-02-09T08:03:19.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.289+0000 7fb2004de640 1 -- 172.21.15.62:0/916678213 wait complete. 2024-02-09T08:03:19.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.289+0000 7fb2004de640 10 monclient: build_initial_monmap 2024-02-09T08:03:19.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.289+0000 7fb2004de640 10 monclient: monmap: 2024-02-09T08:03:19.298 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:19.298 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:03:19.298 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:03:19.298 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:03:19.298 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:19.298 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:19.299 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:03:19.299 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:03:19.299 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:03:19.299 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:19.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.289+0000 7fb2004de640 1 librados: starting msgr at 2024-02-09T08:03:19.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.289+0000 7fb2004de640 1 librados: starting objecter 2024-02-09T08:03:19.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.290+0000 7fb2004de640 1 Processor -- start 2024-02-09T08:03:19.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.290+0000 7fb2004de640 1 -- start start 2024-02-09T08:03:19.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.290+0000 7fb2004de640 1 librados: setting wanted keys 2024-02-09T08:03:19.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.290+0000 7fb2004de640 1 librados: calling monclient init 2024-02-09T08:03:19.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.290+0000 7fb2004de640 10 monclient: init 2024-02-09T08:03:19.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.290+0000 7fb2004de640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:19.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.290+0000 7fb2004de640 10 monclient: _add_conns ranks=[2,0,1] 2024-02-09T08:03:19.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.290+0000 7fb2004de640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1f8067110 0x7fb1f81db420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:19.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.290+0000 7fb2004de640 10 monclient(hunting): picked mon.noname-c con 0x7fb1f8067110 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:19.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.290+0000 7fb2004de640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1f813f830 0x7fb1f81db960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:19.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.290+0000 7fb2004de640 10 monclient(hunting): picked mon.noname-a con 0x7fb1f813f830 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:03:19.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.290+0000 7fb2004de640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1f81424c0 0x7fb1f8133c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:19.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.290+0000 7fb2004de640 10 monclient(hunting): picked mon.noname-b con 0x7fb1f81424c0 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:03:19.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.290+0000 7fb2004de640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:19.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.290+0000 7fb2004de640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f80b7980 con 0x7fb1f813f830 2024-02-09T08:03:19.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.290+0000 7fb2004de640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:19.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.290+0000 7fb2004de640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f80acae0 con 0x7fb1f81424c0 2024-02-09T08:03:19.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.290+0000 7fb2004de640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:19.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.290+0000 7fb2004de640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f80acdc0 con 0x7fb1f8067110 2024-02-09T08:03:19.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.290+0000 7fb2004de640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:19.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.290+0000 7fb2004de640 10 monclient(hunting): authenticate will time out at 1442.650971s 2024-02-09T08:03:19.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.291+0000 7fb1fe27a640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1f8067110 0x7fb1f81db420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:19.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.291+0000 7fb1fda79640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1f813f830 0x7fb1f81db960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:19.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.291+0000 7fb1fe27a640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1f8067110 0x7fb1f81db420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:33172/0 (socket says 172.21.15.62:33172) 2024-02-09T08:03:19.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.291+0000 7fb1fe27a640 1 -- 172.21.15.62:0/2515505984 learned_addr learned my addr 172.21.15.62:0/2515505984 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:19.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.291+0000 7fb1fe27a640 10 monclient(hunting): get_auth_request con 0x7fb1f8067110 auth_method 0 2024-02-09T08:03:19.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.291+0000 7fb1fe27a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:19.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.291+0000 7fb1fe27a640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:19.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.291+0000 7fb1fe27a640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:19.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.291+0000 7fb1fda79640 10 monclient(hunting): get_auth_request con 0x7fb1f813f830 auth_method 0 2024-02-09T08:03:19.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.291+0000 7fb1fda79640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:19.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.291+0000 7fb1fda79640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:19.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.291+0000 7fb1fda79640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:19.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.292+0000 7fb1fe27a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:19.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.292+0000 7fb1fe27a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:19.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.292+0000 7fb1fe27a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:19.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.292+0000 7fb1fda79640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:19.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.292+0000 7fb1fda79640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:19.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.292+0000 7fb1fda79640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:19.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.295+0000 7fb1fe27a640 10 monclient(hunting): handle_auth_done global_id 4361 payload 824 2024-02-09T08:03:19.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.295+0000 7fb1fe27a640 1 -- 172.21.15.62:0/2515505984 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1f81424c0 msgr2=0x7fb1f8133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:19.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.295+0000 7fb1fe27a640 1 --2- 172.21.15.62:0/2515505984 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1f81424c0 0x7fb1f8133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:19.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.295+0000 7fb1fe27a640 1 -- 172.21.15.62:0/2515505984 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1f813f830 msgr2=0x7fb1f81db960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:19.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.295+0000 7fb1fe27a640 1 --2- 172.21.15.62:0/2515505984 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1f813f830 0x7fb1f81db960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:19.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.295+0000 7fb1fe27a640 10 monclient: _finish_hunting 0 2024-02-09T08:03:19.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.295+0000 7fb1fe27a640 1 monclient: found mon.noname-c 2024-02-09T08:03:19.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.295+0000 7fb1fe27a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:19.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.295+0000 7fb1fe27a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-02-09T08:03:19.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.295+0000 7fb1fe27a640 1 -- 172.21.15.62:0/2515505984 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f40094d0 con 0x7fb1f8067110 2024-02-09T08:03:19.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.298+0000 7fb1fe27a640 1 --2- 172.21.15.62:0/2515505984 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1f8067110 0x7fb1f81db420 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4000c00 tx=0x7fb1f40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:19.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.298+0000 7fb1eeffd640 10 client.?.objecter ms_handle_connect 0x7fb1f8067110 2024-02-09T08:03:19.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.298+0000 7fb1eeffd640 10 client.?.objecter resend_mon_ops 2024-02-09T08:03:19.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.302+0000 7fb1eeffd640 1 -- 172.21.15.62:0/2515505984 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f4032860 con 0x7fb1f8067110 2024-02-09T08:03:19.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.302+0000 7fb1eeffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:19.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.302+0000 7fb1eeffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-09T08:03:19.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.302+0000 7fb1eeffd640 10 monclient: dump: 2024-02-09T08:03:19.305 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:19.305 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:19.305 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:19.305 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:19.305 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:19.305 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:19.305 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:19.305 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:19.305 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:19.305 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:19.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.302+0000 7fb1eeffd640 10 monclient: _finish_auth 0 2024-02-09T08:03:19.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.302+0000 7fb1eeffd640 10 monclient: _check_auth_tickets 2024-02-09T08:03:19.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.302+0000 7fb1eeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:19.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.302+0000 7fb1eeffd640 1 -- 172.21.15.62:0/2515505984 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f40329e0 con 0x7fb1f8067110 2024-02-09T08:03:19.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.302+0000 7fb1eeffd640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:19.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.302+0000 7fb1eeffd640 1 -- 172.21.15.62:0/2515505984 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f4032d90 con 0x7fb1f8067110 2024-02-09T08:03:19.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.302+0000 7fb1eeffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:19.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.302+0000 7fb1eeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-09T08:03:19.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.302+0000 7fb1eeffd640 10 monclient: dump: 2024-02-09T08:03:19.306 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:19.306 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:19.306 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:19.306 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:19.306 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:19.306 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:19.306 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:19.307 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:19.307 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:19.307 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:19.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.302+0000 7fb2004de640 5 monclient: authenticate success, global_id 4361 2024-02-09T08:03:19.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.302+0000 7fb2004de640 10 monclient: _renew_subs 2024-02-09T08:03:19.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.302+0000 7fb1fca77640 4 set_mon_vals no callback set 2024-02-09T08:03:19.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.302+0000 7fb2004de640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:03:19.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.302+0000 7fb2004de640 1 -- 172.21.15.62:0/2515505984 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1f80ad0a0 con 0x7fb1f8067110 2024-02-09T08:03:19.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.302+0000 7fb2004de640 10 client.4361.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:03:19.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.302+0000 7fb2004de640 10 monclient: _renew_subs 2024-02-09T08:03:19.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.302+0000 7fb2004de640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:03:19.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.302+0000 7fb2004de640 1 -- 172.21.15.62:0/2515505984 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1f81dbea0 con 0x7fb1f8067110 2024-02-09T08:03:19.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.302+0000 7fb2004de640 1 librados: init done 2024-02-09T08:03:19.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.303+0000 7fb2004de640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:19.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.303+0000 7fb2004de640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:19.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.303+0000 7fb2004de640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:03:19.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.303+0000 7fb2004de640 1 -- 172.21.15.62:0/2515505984 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1f80b1a80 con 0x7fb1f8067110 2024-02-09T08:03:19.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.345+0000 7f9300ff9640 1 -- 172.21.15.62:0/2825182806 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f92fc01d3b0 con 0x7f93041424c0 2024-02-09T08:03:19.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.346+0000 7f9300ff9640 1 --2- 172.21.15.62:0/2825182806 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f92f006d1f0 0x7f92f006f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:19.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.346+0000 7f9303fff640 1 --2- 172.21.15.62:0/2825182806 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f92f006d1f0 0x7f92f006f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:19.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.346+0000 7f9303fff640 10 monclient: get_auth_request con 0x7f92f006d1f0 auth_method 0 2024-02-09T08:03:19.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.347+0000 7f9300ff9640 10 client.4390.objecter ms_handle_connect 0x7f92f006d1f0 2024-02-09T08:03:19.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.347+0000 7f9303fff640 1 --2- 172.21.15.62:0/2825182806 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f92f006d1f0 0x7f92f006f6b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f92f4036000 tx=0x7f92f4030000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:19.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.347+0000 7f9300ff9640 1 -- 172.21.15.62:0/2825182806 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f92fc00ce30 con 0x7f93041424c0 2024-02-09T08:03:19.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.347+0000 7f9300ff9640 10 client.4390.objecter ms_dispatch 0x7f9304000b90 osd_map(26..26 src has 1..26) v4 2024-02-09T08:03:19.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.347+0000 7f9300ff9640 3 client.4390.objecter handle_osd_map got epochs [26,26] > 0 2024-02-09T08:03:19.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.347+0000 7f9300ff9640 3 client.4390.objecter handle_osd_map decoding full epoch 26 2024-02-09T08:03:19.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.348+0000 7f9300ff9640 20 client.4390.objecter dump_active .. 0 homeless 2024-02-09T08:03:19.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.357+0000 7f9300ff9640 1 -- 172.21.15.62:0/2825182806 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f92fc055010 con 0x7f93041424c0 2024-02-09T08:03:19.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.357+0000 7f9300ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:19.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.357+0000 7f9300ff9640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:03:19.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.366+0000 7fa7427fc640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2024-02-09T08:03:19.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.366+0000 7fa7427fc640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2024-02-09T08:03:19.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.366+0000 7fa7427fc640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:19.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.366+0000 7fa7427fc640 1 -- 172.21.15.62:0/3103771502 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa734005600 con 0x7fa75c0b5000 2024-02-09T08:03:19.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.431+0000 7fc2db35c640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2024-02-09T08:03:19.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.431+0000 7fc2db35c640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2024-02-09T08:03:19.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.431+0000 7fc2db35c640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:03:19.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.431+0000 7fc2db35c640 1 -- 172.21.15.62:0/3881776881 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc2d406c8e0 con 0x7fc2d4070af0 2024-02-09T08:03:19.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.480+0000 7f7f1d1dc640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 6}] 2024-02-09T08:03:19.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.480+0000 7f7f1d1dc640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2024-02-09T08:03:19.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.480+0000 7f7f1d1dc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:03:19.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.480+0000 7f7f1d1dc640 1 -- 172.21.15.62:0/1274026157 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f7f1804ef90 con 0x7f7f180a9e30 2024-02-09T08:03:19.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.486+0000 7f7eff7fe640 1 -- 172.21.15.62:0/1274026157 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7f0807a200 con 0x7f7f180a9e30 2024-02-09T08:03:19.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.486+0000 7f7eff7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2024-02-09T08:03:19.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.486+0000 7f7eff7fe640 10 monclient: _finish_command 2 = system:0 2024-02-09T08:03:19.488 INFO:teuthology.orchestra.run.smithi062.stdout:64424509447 2024-02-09T08:03:19.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.488+0000 7f7f1d1dc640 10 librados: watch_flush enter 2024-02-09T08:03:19.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.488+0000 7f7f1d1dc640 10 librados: watch_flush exit 2024-02-09T08:03:19.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.488+0000 7f7f1d1dc640 20 client.4392.objecter shutdown clearing up homeless session... 2024-02-09T08:03:19.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.488+0000 7f7f1d1dc640 10 client.4392.objecter successfully canceled tick 2024-02-09T08:03:19.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.488+0000 7f7f1d1dc640 1 -- 172.21.15.62:0/1274026157 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f7f0406d220 msgr2=0x7f7f0406f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:19.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.488+0000 7f7f1d1dc640 1 --2- 172.21.15.62:0/1274026157 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f7f0406d220 0x7f7f0406f6e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7f181451d0 tx=0x7f7f0c007990 comp rx=0 tx=0).stop 2024-02-09T08:03:19.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.488+0000 7f7f1d1dc640 10 monclient: shutdown 2024-02-09T08:03:19.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.488+0000 7f7f1d1dc640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:19.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.488+0000 7f7f1d1dc640 1 -- 172.21.15.62:0/1274026157 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f180a9e30 msgr2=0x7f7f1813c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:19.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.488+0000 7f7f1d1dc640 1 --2- 172.21.15.62:0/1274026157 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f180a9e30 0x7f7f1813c880 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7f080097d0 tx=0x7f7f080046c0 comp rx=0 tx=0).stop 2024-02-09T08:03:19.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.488+0000 7f7f1d1dc640 1 -- 172.21.15.62:0/1274026157 shutdown_connections 2024-02-09T08:03:19.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.488+0000 7f7f1d1dc640 1 --2- 172.21.15.62:0/1274026157 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f7f0406d220 0x7f7f0406f6e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:19.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.488+0000 7f7f1d1dc640 1 --2- 172.21.15.62:0/1274026157 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7f181464f0 0x7f7f18140800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:19.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.488+0000 7f7f1d1dc640 1 --2- 172.21.15.62:0/1274026157 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f180b5000 0x7f7f181402c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:19.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.488+0000 7f7f1d1dc640 1 --2- 172.21.15.62:0/1274026157 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f180a9e30 0x7f7f1813c880 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:19.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.488+0000 7f7f1d1dc640 1 -- 172.21.15.62:0/1274026157 >> 172.21.15.62:0/1274026157 conn(0x7f7f18066bb0 msgr2=0x7f7f18145de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:19.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.488+0000 7f7f1d1dc640 1 -- 172.21.15.62:0/1274026157 shutdown_connections 2024-02-09T08:03:19.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.488+0000 7f7f1d1dc640 1 -- 172.21.15.62:0/1274026157 wait complete. 2024-02-09T08:03:19.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.488+0000 7f7f1d1dc640 1 librados: shutdown 2024-02-09T08:03:19.502 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.6 2024-02-09T08:03:19.503 DEBUG:teuthology.parallel:result is None 2024-02-09T08:03:19.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.514+0000 7fb1eeffd640 1 -- 172.21.15.62:0/2515505984 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fb1f404e450 con 0x7fb1f8067110 2024-02-09T08:03:19.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.514+0000 7fb1eeffd640 1 --2- 172.21.15.62:0/2515505984 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fb1dc06d1f0 0x7fb1dc06f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:19.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.515+0000 7fb1fda79640 1 --2- 172.21.15.62:0/2515505984 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fb1dc06d1f0 0x7fb1dc06f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:19.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.515+0000 7fb1fda79640 10 monclient: get_auth_request con 0x7fb1dc06d1f0 auth_method 0 2024-02-09T08:03:19.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.515+0000 7fb1fda79640 1 --2- 172.21.15.62:0/2515505984 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fb1dc06d1f0 0x7fb1dc06f6b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb1f80b8420 tx=0x7fb1e8009110 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:19.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.515+0000 7fb1eeffd640 10 client.4361.objecter ms_handle_connect 0x7fb1dc06d1f0 2024-02-09T08:03:19.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.574+0000 7f930a308640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2024-02-09T08:03:19.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.574+0000 7f930a308640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2024-02-09T08:03:19.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.575+0000 7f930a308640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:19.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.575+0000 7f930a308640 1 -- 172.21.15.62:0/2825182806 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f93040add70 con 0x7f93041424c0 2024-02-09T08:03:19.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.606+0000 7fb1eeffd640 1 -- 172.21.15.62:0/2515505984 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb1f407b2b0 con 0x7fb1f8067110 2024-02-09T08:03:19.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.606+0000 7fb1eeffd640 10 client.4361.objecter ms_dispatch 0x7fb1f8000b90 osd_map(26..26 src has 1..26) v4 2024-02-09T08:03:19.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.606+0000 7fb1eeffd640 3 client.4361.objecter handle_osd_map got epochs [26,26] > 0 2024-02-09T08:03:19.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.606+0000 7fb1eeffd640 3 client.4361.objecter handle_osd_map decoding full epoch 26 2024-02-09T08:03:19.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.606+0000 7fb1eeffd640 20 client.4361.objecter dump_active .. 0 homeless 2024-02-09T08:03:19.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.606+0000 7fb1eeffd640 1 -- 172.21.15.62:0/2515505984 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb1f4076e50 con 0x7fb1f8067110 2024-02-09T08:03:19.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.606+0000 7fb1eeffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:19.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.606+0000 7fb1eeffd640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:03:19.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.607+0000 7fc2c9ffb640 1 -- 172.21.15.62:0/3881776881 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc2d001e070 con 0x7fc2d4070af0 2024-02-09T08:03:19.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.607+0000 7fc2c9ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2024-02-09T08:03:19.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.607+0000 7fc2c9ffb640 10 monclient: _finish_command 2 = system:0 2024-02-09T08:03:19.610 INFO:teuthology.orchestra.run.smithi062.stdout:64424509446 2024-02-09T08:03:19.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.608+0000 7fc2db35c640 10 librados: watch_flush enter 2024-02-09T08:03:19.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.608+0000 7fc2db35c640 10 librados: watch_flush exit 2024-02-09T08:03:19.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.608+0000 7fc2db35c640 20 client.4355.objecter shutdown clearing up homeless session... 2024-02-09T08:03:19.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.608+0000 7fc2db35c640 10 client.4355.objecter successfully canceled tick 2024-02-09T08:03:19.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.609+0000 7fc2db35c640 1 -- 172.21.15.62:0/3881776881 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fc2b806d1f0 msgr2=0x7fc2b806f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:19.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.609+0000 7fc2db35c640 1 --2- 172.21.15.62:0/3881776881 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fc2b806d1f0 0x7fc2b806f6b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4036000 tx=0x7fc2c4030000 comp rx=0 tx=0).stop 2024-02-09T08:03:19.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.609+0000 7fc2db35c640 10 monclient: shutdown 2024-02-09T08:03:19.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.609+0000 7fc2db35c640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:19.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.609+0000 7fc2db35c640 1 -- 172.21.15.62:0/3881776881 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc2d4070af0 msgr2=0x7fc2d406b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:19.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.609+0000 7fc2db35c640 1 --2- 172.21.15.62:0/3881776881 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc2d4070af0 0x7fc2d406b950 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc2d000b4a0 tx=0x7fc2d000b960 comp rx=0 tx=0).stop 2024-02-09T08:03:19.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.609+0000 7fc2db35c640 1 -- 172.21.15.62:0/3881776881 shutdown_connections 2024-02-09T08:03:19.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.609+0000 7fc2db35c640 1 --2- 172.21.15.62:0/3881776881 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fc2b806d1f0 0x7fc2b806f6b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:19.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.609+0000 7fc2db35c640 1 --2- 172.21.15.62:0/3881776881 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2d413d630 0x7fc2d413fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:19.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.609+0000 7fc2db35c640 1 --2- 172.21.15.62:0/3881776881 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2d4070ed0 0x7fc2d413f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:19.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.609+0000 7fc2db35c640 1 --2- 172.21.15.62:0/3881776881 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc2d4070af0 0x7fc2d406b950 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:19.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.609+0000 7fc2db35c640 1 -- 172.21.15.62:0/3881776881 >> 172.21.15.62:0/3881776881 conn(0x7fc2d40b6120 msgr2=0x7fc2d413a660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:19.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.609+0000 7fc2db35c640 1 -- 172.21.15.62:0/3881776881 shutdown_connections 2024-02-09T08:03:19.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.609+0000 7fc2db35c640 1 -- 172.21.15.62:0/3881776881 wait complete. 2024-02-09T08:03:19.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.609+0000 7fc2db35c640 1 librados: shutdown 2024-02-09T08:03:19.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.614+0000 7f99f6ffd640 1 -- 172.21.15.62:0/400321566 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f99f8010c80 con 0x7f9a08067110 2024-02-09T08:03:19.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.614+0000 7f99f6ffd640 1 --2- 172.21.15.62:0/400321566 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f99e806d1a0 0x7f99e806f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:19.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.614+0000 7f9a05d9b640 1 --2- 172.21.15.62:0/400321566 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f99e806d1a0 0x7f99e806f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:19.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.614+0000 7f9a05d9b640 10 monclient: get_auth_request con 0x7f99e806d1a0 auth_method 0 2024-02-09T08:03:19.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.615+0000 7f99f6ffd640 10 client.4393.objecter ms_handle_connect 0x7f99e806d1a0 2024-02-09T08:03:19.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.615+0000 7f9a05d9b640 1 --2- 172.21.15.62:0/400321566 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f99e806d1a0 0x7f99e806f660 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9a08141fc0 tx=0x7f99fc007990 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:19.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.616+0000 7f99f6ffd640 1 -- 172.21.15.62:0/400321566 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f99f8058f80 con 0x7f9a08067110 2024-02-09T08:03:19.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.616+0000 7f99f6ffd640 10 client.4393.objecter ms_dispatch 0x7f9a08000b90 osd_map(26..26 src has 1..26) v4 2024-02-09T08:03:19.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.616+0000 7f99f6ffd640 3 client.4393.objecter handle_osd_map got epochs [26,26] > 0 2024-02-09T08:03:19.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.616+0000 7f99f6ffd640 3 client.4393.objecter handle_osd_map decoding full epoch 26 2024-02-09T08:03:19.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.616+0000 7f99f6ffd640 20 client.4393.objecter dump_active .. 0 homeless 2024-02-09T08:03:19.623 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.0 2024-02-09T08:03:19.623 DEBUG:teuthology.parallel:result is None 2024-02-09T08:03:19.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.628+0000 7f99f6ffd640 1 -- 172.21.15.62:0/400321566 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f99f8054b20 con 0x7f9a08067110 2024-02-09T08:03:19.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.628+0000 7f99f6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:19.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.628+0000 7f99f6ffd640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:03:19.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.638+0000 7f9300ff9640 1 -- 172.21.15.62:0/2825182806 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f92fc019090 con 0x7f93041424c0 2024-02-09T08:03:19.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.638+0000 7f9300ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2024-02-09T08:03:19.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.638+0000 7f9300ff9640 10 monclient: _finish_command 2 = system:0 2024-02-09T08:03:19.641 INFO:teuthology.orchestra.run.smithi062.stdout:68719476743 2024-02-09T08:03:19.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.640+0000 7f930a308640 10 librados: watch_flush enter 2024-02-09T08:03:19.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.640+0000 7f930a308640 10 librados: watch_flush exit 2024-02-09T08:03:19.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.640+0000 7f930a308640 20 client.4390.objecter shutdown clearing up homeless session... 2024-02-09T08:03:19.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.640+0000 7f930a308640 10 client.4390.objecter successfully canceled tick 2024-02-09T08:03:19.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.640+0000 7f930a308640 1 -- 172.21.15.62:0/2825182806 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f92f006d1f0 msgr2=0x7f92f006f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:19.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.640+0000 7f930a308640 1 --2- 172.21.15.62:0/2825182806 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f92f006d1f0 0x7f92f006f6b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f92f4036000 tx=0x7f92f4030000 comp rx=0 tx=0).stop 2024-02-09T08:03:19.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.640+0000 7f930a308640 10 monclient: shutdown 2024-02-09T08:03:19.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.640+0000 7f930a308640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:19.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.640+0000 7f930a308640 1 -- 172.21.15.62:0/2825182806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93041424c0 msgr2=0x7f93041db0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:19.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.640+0000 7f930a308640 1 --2- 172.21.15.62:0/2825182806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93041424c0 0x7f93041db0a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f92fc00b970 tx=0x7f92fc00be30 comp rx=0 tx=0).stop 2024-02-09T08:03:19.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.640+0000 7f930a308640 1 -- 172.21.15.62:0/2825182806 shutdown_connections 2024-02-09T08:03:19.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.640+0000 7f930a308640 1 --2- 172.21.15.62:0/2825182806 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f92f006d1f0 0x7f92f006f6b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:19.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.640+0000 7f930a308640 1 --2- 172.21.15.62:0/2825182806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93041424c0 0x7f93041db0a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:19.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.640+0000 7f930a308640 1 --2- 172.21.15.62:0/2825182806 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f930413f830 0x7f93040b13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:19.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.640+0000 7f930a308640 1 --2- 172.21.15.62:0/2825182806 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9304067110 0x7f93040b0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:19.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.640+0000 7f930a308640 1 -- 172.21.15.62:0/2825182806 >> 172.21.15.62:0/2825182806 conn(0x7f93040b4e20 msgr2=0x7f9304069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:19.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.641+0000 7f930a308640 1 -- 172.21.15.62:0/2825182806 shutdown_connections 2024-02-09T08:03:19.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.641+0000 7f930a308640 1 -- 172.21.15.62:0/2825182806 wait complete. 2024-02-09T08:03:19.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.641+0000 7f930a308640 1 librados: shutdown 2024-02-09T08:03:19.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.645+0000 7fa758ff9640 1 -- 172.21.15.62:0/3103771502 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa750020020 con 0x7fa75c0b5000 2024-02-09T08:03:19.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.645+0000 7fa758ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2024-02-09T08:03:19.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.645+0000 7fa758ff9640 10 monclient: _finish_command 2 = system:0 2024-02-09T08:03:19.648 INFO:teuthology.orchestra.run.smithi062.stdout:64424509446 2024-02-09T08:03:19.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.648+0000 7fa7427fc640 10 librados: watch_flush enter 2024-02-09T08:03:19.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.649+0000 7fa7427fc640 10 librados: watch_flush exit 2024-02-09T08:03:19.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.649+0000 7fa7427fc640 20 client.4381.objecter shutdown clearing up homeless session... 2024-02-09T08:03:19.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.649+0000 7fa7427fc640 10 client.4381.objecter successfully canceled tick 2024-02-09T08:03:19.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.649+0000 7fa7427fc640 1 -- 172.21.15.62:0/3103771502 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fa74806d1a0 msgr2=0x7fa74806f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:19.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.649+0000 7fa7427fc640 1 --2- 172.21.15.62:0/3103771502 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fa74806d1a0 0x7fa74806f660 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa74c0011e0 tx=0x7fa74c007d30 comp rx=0 tx=0).stop 2024-02-09T08:03:19.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.649+0000 7fa7427fc640 10 monclient: shutdown 2024-02-09T08:03:19.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.649+0000 7fa7427fc640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:19.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.649+0000 7fa7427fc640 1 -- 172.21.15.62:0/3103771502 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa75c0b5000 msgr2=0x7fa75c140940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:19.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.649+0000 7fa7427fc640 1 --2- 172.21.15.62:0/3103771502 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa75c0b5000 0x7fa75c140940 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa75000c400 tx=0x7fa75000c8c0 comp rx=0 tx=0).stop 2024-02-09T08:03:19.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.649+0000 7fa7427fc640 1 -- 172.21.15.62:0/3103771502 shutdown_connections 2024-02-09T08:03:19.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.649+0000 7fa7427fc640 1 --2- 172.21.15.62:0/3103771502 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fa74806d1a0 0x7fa74806f660 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:19.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.649+0000 7fa7427fc640 1 --2- 172.21.15.62:0/3103771502 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa75c13fdf0 0x7fa75c140e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:19.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.649+0000 7fa7427fc640 1 --2- 172.21.15.62:0/3103771502 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa75c0b5000 0x7fa75c140940 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:19.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.649+0000 7fa7427fc640 1 --2- 172.21.15.62:0/3103771502 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa75c0a9e30 0x7fa75c1350b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:19.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.649+0000 7fa7427fc640 1 -- 172.21.15.62:0/3103771502 >> 172.21.15.62:0/3103771502 conn(0x7fa75c066bb0 msgr2=0x7fa75c144fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:19.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.649+0000 7fa7427fc640 1 -- 172.21.15.62:0/3103771502 shutdown_connections 2024-02-09T08:03:19.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.649+0000 7fa7427fc640 1 -- 172.21.15.62:0/3103771502 wait complete. 2024-02-09T08:03:19.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.649+0000 7fa7427fc640 1 librados: shutdown 2024-02-09T08:03:19.655 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476743 got 68719476743 for osd.1 2024-02-09T08:03:19.655 DEBUG:teuthology.parallel:result is None 2024-02-09T08:03:19.663 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.2 2024-02-09T08:03:19.663 DEBUG:teuthology.parallel:result is None 2024-02-09T08:03:19.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.809+0000 7fb2004de640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2024-02-09T08:03:19.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.809+0000 7fb2004de640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2024-02-09T08:03:19.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.809+0000 7fb2004de640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:03:19.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.809+0000 7fb2004de640 1 -- 172.21.15.62:0/2515505984 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fb1f80b1a80 con 0x7fb1f8067110 2024-02-09T08:03:19.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.818+0000 7f9a0ccde640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2024-02-09T08:03:19.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.818+0000 7f9a0ccde640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2024-02-09T08:03:19.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.818+0000 7f9a0ccde640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:19.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.818+0000 7f9a0ccde640 1 -- 172.21.15.62:0/400321566 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9a08139e40 con 0x7f9a08067110 2024-02-09T08:03:19.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.824+0000 7fb1eeffd640 1 -- 172.21.15.62:0/2515505984 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb1f80b1a80 con 0x7fb1f8067110 2024-02-09T08:03:19.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.824+0000 7fb1eeffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2024-02-09T08:03:19.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.824+0000 7fb1eeffd640 10 monclient: _finish_command 2 = system:0 2024-02-09T08:03:19.826 INFO:teuthology.orchestra.run.smithi062.stdout:85899345930 2024-02-09T08:03:19.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.826+0000 7fb2004de640 10 librados: watch_flush enter 2024-02-09T08:03:19.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.826+0000 7fb2004de640 10 librados: watch_flush exit 2024-02-09T08:03:19.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.826+0000 7fb2004de640 20 client.4361.objecter shutdown clearing up homeless session... 2024-02-09T08:03:19.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.826+0000 7fb2004de640 10 client.4361.objecter successfully canceled tick 2024-02-09T08:03:19.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.826+0000 7fb2004de640 1 -- 172.21.15.62:0/2515505984 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fb1dc06d1f0 msgr2=0x7fb1dc06f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:19.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.826+0000 7fb2004de640 1 --2- 172.21.15.62:0/2515505984 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fb1dc06d1f0 0x7fb1dc06f6b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb1f80b8420 tx=0x7fb1e8009110 comp rx=0 tx=0).stop 2024-02-09T08:03:19.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.826+0000 7fb2004de640 10 monclient: shutdown 2024-02-09T08:03:19.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.826+0000 7fb2004de640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:19.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.826+0000 7fb2004de640 1 -- 172.21.15.62:0/2515505984 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1f8067110 msgr2=0x7fb1f81db420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:19.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.826+0000 7fb2004de640 1 --2- 172.21.15.62:0/2515505984 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1f8067110 0x7fb1f81db420 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4000c00 tx=0x7fb1f40046c0 comp rx=0 tx=0).stop 2024-02-09T08:03:19.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.826+0000 7fb2004de640 1 -- 172.21.15.62:0/2515505984 shutdown_connections 2024-02-09T08:03:19.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.826+0000 7fb2004de640 1 --2- 172.21.15.62:0/2515505984 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fb1dc06d1f0 0x7fb1dc06f6b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:19.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.826+0000 7fb2004de640 1 --2- 172.21.15.62:0/2515505984 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1f81424c0 0x7fb1f8133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:19.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.826+0000 7fb2004de640 1 --2- 172.21.15.62:0/2515505984 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1f813f830 0x7fb1f81db960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:19.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.826+0000 7fb2004de640 1 --2- 172.21.15.62:0/2515505984 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1f8067110 0x7fb1f81db420 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:19.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.826+0000 7fb2004de640 1 -- 172.21.15.62:0/2515505984 >> 172.21.15.62:0/2515505984 conn(0x7fb1f80b4e20 msgr2=0x7fb1f80b3050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:19.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.826+0000 7fb2004de640 1 -- 172.21.15.62:0/2515505984 shutdown_connections 2024-02-09T08:03:19.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.826+0000 7fb2004de640 1 -- 172.21.15.62:0/2515505984 wait complete. 2024-02-09T08:03:19.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.826+0000 7fb2004de640 1 librados: shutdown 2024-02-09T08:03:19.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.828+0000 7f99f6ffd640 1 -- 172.21.15.62:0/400321566 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9a08139e40 con 0x7f9a08067110 2024-02-09T08:03:19.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.828+0000 7f99f6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2024-02-09T08:03:19.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.828+0000 7f99f6ffd640 10 monclient: _finish_command 2 = system:0 2024-02-09T08:03:19.831 INFO:teuthology.orchestra.run.smithi062.stdout:90194313223 2024-02-09T08:03:19.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.830+0000 7f9a0ccde640 10 librados: watch_flush enter 2024-02-09T08:03:19.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.830+0000 7f9a0ccde640 10 librados: watch_flush exit 2024-02-09T08:03:19.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.830+0000 7f9a0ccde640 20 client.4393.objecter shutdown clearing up homeless session... 2024-02-09T08:03:19.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.830+0000 7f9a0ccde640 10 client.4393.objecter successfully canceled tick 2024-02-09T08:03:19.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.830+0000 7f9a0ccde640 1 -- 172.21.15.62:0/400321566 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f99e806d1a0 msgr2=0x7f99e806f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:19.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.830+0000 7f9a0ccde640 1 --2- 172.21.15.62:0/400321566 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f99e806d1a0 0x7f99e806f660 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9a08141fc0 tx=0x7f99fc007990 comp rx=0 tx=0).stop 2024-02-09T08:03:19.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.830+0000 7f9a0ccde640 10 monclient: shutdown 2024-02-09T08:03:19.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.830+0000 7f9a0ccde640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:19.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.830+0000 7f9a0ccde640 1 -- 172.21.15.62:0/400321566 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a08067110 msgr2=0x7f9a081464b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:19.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.830+0000 7f9a0ccde640 1 --2- 172.21.15.62:0/400321566 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a08067110 0x7f9a081464b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f99f800b4a0 tx=0x7f99f800b960 comp rx=0 tx=0).stop 2024-02-09T08:03:19.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.830+0000 7f9a0ccde640 1 -- 172.21.15.62:0/400321566 shutdown_connections 2024-02-09T08:03:19.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.830+0000 7f9a0ccde640 1 --2- 172.21.15.62:0/400321566 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f99e806d1a0 0x7f99e806f660 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:19.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.830+0000 7f9a0ccde640 1 --2- 172.21.15.62:0/400321566 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a08142bd0 0x7f9a081db1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:19.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.830+0000 7f9a0ccde640 1 --2- 172.21.15.62:0/400321566 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9a0813f830 0x7f9a081dacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:19.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.830+0000 7f9a0ccde640 1 --2- 172.21.15.62:0/400321566 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a08067110 0x7f9a081464b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:19.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.831+0000 7f9a0ccde640 1 -- 172.21.15.62:0/400321566 >> 172.21.15.62:0/400321566 conn(0x7f9a080b4e20 msgr2=0x7f9a0813c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:19.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.831+0000 7f9a0ccde640 1 -- 172.21.15.62:0/400321566 shutdown_connections 2024-02-09T08:03:19.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.831+0000 7f9a0ccde640 1 -- 172.21.15.62:0/400321566 wait complete. 2024-02-09T08:03:19.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.831+0000 7f9a0ccde640 1 librados: shutdown 2024-02-09T08:03:19.841 INFO:tasks.ceph.ceph_manager.ceph:need seq 85899345930 got 85899345930 for osd.4 2024-02-09T08:03:19.841 DEBUG:teuthology.parallel:result is None 2024-02-09T08:03:19.845 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313222 got 90194313223 for osd.3 2024-02-09T08:03:19.845 DEBUG:teuthology.parallel:result is None 2024-02-09T08:03:19.845 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-02-09T08:03:19.845 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-09T08:03:19.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.987+0000 7f0f72ffe640 10 monclient: get_monmap_and_config 2024-02-09T08:03:19.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.987+0000 7f0f72ffe640 10 monclient: build_initial_monmap 2024-02-09T08:03:19.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.987+0000 7f0f72ffe640 10 monclient: monmap: 2024-02-09T08:03:19.989 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:19.989 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:19.990 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:03:19.988176+0000 2024-02-09T08:03:19.990 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:03:19.988176+0000 2024-02-09T08:03:19.990 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:19.990 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:19.990 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:03:19.990 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:03:19.990 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:03:19.990 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:03:19.990 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:03:19.990 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:19.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.987+0000 7f0f72ffe640 1 Processor -- start 2024-02-09T08:03:19.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.987+0000 7f0f72ffe640 1 -- start start 2024-02-09T08:03:19.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.987+0000 7f0f72ffe640 10 monclient: init 2024-02-09T08:03:19.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.988+0000 7f0f72ffe640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:19.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.988+0000 7f0f72ffe640 10 monclient: _add_conns ranks=[1,3,2,0,4] 2024-02-09T08:03:19.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.988+0000 7f0f72ffe640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f0f6c0b5000 addr v1:172.21.15.103:6789/0 2024-02-09T08:03:19.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.988+0000 7f0f72ffe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0f6c0a9e30 0x7f0f6c145de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:19.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.988+0000 7f0f72ffe640 10 monclient(hunting): picked mon.noname-a con 0x7f0f6c0a9e30 addr v2:172.21.15.62:3300/0 2024-02-09T08:03:19.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.988+0000 7f0f72ffe640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0f6c13fdf0 0x7f0f6c146320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:19.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.988+0000 7f0f72ffe640 10 monclient(hunting): picked mon.noname-b con 0x7f0f6c13fdf0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:19.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.988+0000 7f0f72ffe640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f6c0aa4a0 con 0x7f0f6c0b5000 2024-02-09T08:03:19.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.988+0000 7f0f72ffe640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:19.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.988+0000 7f0f72ffe640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f6c0b53e0 con 0x7f0f6c0a9e30 2024-02-09T08:03:19.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.988+0000 7f0f72ffe640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:19.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.988+0000 7f0f72ffe640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c146860 con 0x7f0f6c13fdf0 2024-02-09T08:03:19.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.988+0000 7f0f72ffe640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:19.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.988+0000 7f0f72ffe640 10 monclient(hunting): authenticate will time out at 1443.348670s 2024-02-09T08:03:19.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.988+0000 7f0f70d9a640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f0f6c0b5000 0x7f0f6c13f6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.62:36680/0 (socket says 172.21.15.62:36680) 2024-02-09T08:03:19.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.988+0000 7f0f70d9a640 1 -- 172.21.15.62:0/3791411011 learned_addr learned my addr 172.21.15.62:0/3791411011 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-09T08:03:19.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.988+0000 7f0f6bfff640 1 --2- 172.21.15.62:0/3791411011 >> v2:172.21.15.62:3300/0 conn(0x7f0f6c0a9e30 0x7f0f6c145de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:19.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.989+0000 7f0f7159b640 1 --2- 172.21.15.62:0/3791411011 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0f6c13fdf0 0x7f0f6c146320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:19.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.989+0000 7f0f6bfff640 10 monclient(hunting): get_auth_request con 0x7f0f6c0a9e30 auth_method 0 2024-02-09T08:03:19.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.989+0000 7f0f6bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:19.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.989+0000 7f0f6bfff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:19.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.989+0000 7f0f6bfff640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:19.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.989+0000 7f0f7159b640 10 monclient(hunting): get_auth_request con 0x7f0f6c13fdf0 auth_method 0 2024-02-09T08:03:19.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.989+0000 7f0f7159b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:19.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.989+0000 7f0f7159b640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:19.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.989+0000 7f0f7159b640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:19.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.989+0000 7f0f6bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:19.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.989+0000 7f0f6bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:19.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.989+0000 7f0f6bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:19.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.990+0000 7f0f7159b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:19.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.990+0000 7f0f7159b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:19.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.990+0000 7f0f7159b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:19.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.991+0000 7f0f6b7fe640 1 -- 172.21.15.62:0/3791411011 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2415922181 0 0) 0x7f0f6c0aa4a0 con 0x7f0f6c0b5000 2024-02-09T08:03:19.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.991+0000 7f0f6b7fe640 10 monclient(hunting): _negotiate 2024-02-09T08:03:19.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.991+0000 7f0f6b7fe640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:19.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.991+0000 7f0f6b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:19.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.991+0000 7f0f6b7fe640 10 monclient(hunting): my global_id is 4396 2024-02-09T08:03:19.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.991+0000 7f0f6b7fe640 1 -- 172.21.15.62:0/3791411011 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f54003520 con 0x7f0f6c0b5000 2024-02-09T08:03:19.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.991+0000 7f0f6bfff640 10 monclient(hunting): handle_auth_done global_id 4398 payload 274 2024-02-09T08:03:19.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.991+0000 7f0f6bfff640 1 -- 172.21.15.62:0/3791411011 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0f6c13fdf0 msgr2=0x7f0f6c146320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:19.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.991+0000 7f0f6bfff640 1 --2- 172.21.15.62:0/3791411011 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0f6c13fdf0 0x7f0f6c146320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:19.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.991+0000 7f0f6bfff640 1 -- 172.21.15.62:0/3791411011 >> v1:172.21.15.103:6789/0 conn(0x7f0f6c0b5000 legacy=0x7f0f6c13f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:19.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.991+0000 7f0f6bfff640 10 monclient: _finish_hunting 0 2024-02-09T08:03:19.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.991+0000 7f0f6bfff640 1 monclient: found mon.noname-a 2024-02-09T08:03:19.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.991+0000 7f0f6bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:19.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.991+0000 7f0f6bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-02-09T08:03:19.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.991+0000 7f0f6bfff640 1 -- 172.21.15.62:0/3791411011 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f6c0b2900 con 0x7f0f6c0a9e30 2024-02-09T08:03:19.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.993+0000 7f0f6bfff640 1 --2- 172.21.15.62:0/3791411011 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f6c0a9e30 0x7f0f6c145de0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0f600097a0 tx=0x7f0f6002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e29f317ef865000 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:19.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.997+0000 7f0f6b7fe640 1 -- 172.21.15.62:0/3791411011 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6002e070 con 0x7f0f6c0a9e30 2024-02-09T08:03:19.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.997+0000 7f0f6b7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:20.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.997+0000 7f0f6b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-09T08:03:20.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.997+0000 7f0f6b7fe640 10 monclient: dump: 2024-02-09T08:03:20.000 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:20.000 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:20.000 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:20.000 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:20.000 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:20.000 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:20.000 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:20.000 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:20.000 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:20.000 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:20.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.997+0000 7f0f6b7fe640 10 monclient: _finish_auth 0 2024-02-09T08:03:20.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.997+0000 7f0f6b7fe640 10 monclient: _check_auth_tickets 2024-02-09T08:03:20.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.997+0000 7f0f6b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:20.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.997+0000 7f0f6b7fe640 1 -- 172.21.15.62:0/3791411011 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f600315a0 con 0x7f0f6c0a9e30 2024-02-09T08:03:20.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.997+0000 7f0f72ffe640 5 monclient: authenticate success, global_id 4398 2024-02-09T08:03:20.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.997+0000 7f0f72ffe640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-02-09T08:03:20.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.997+0000 7f0f6b7fe640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:20.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.997+0000 7f0f72ffe640 10 monclient: get_monmap_and_config success 2024-02-09T08:03:20.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.997+0000 7f0f72ffe640 4 set_mon_vals no callback set 2024-02-09T08:03:20.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.997+0000 7f0f6b7fe640 1 -- 172.21.15.62:0/3791411011 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f60031930 con 0x7f0f6c0a9e30 2024-02-09T08:03:20.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.997+0000 7f0f6b7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:20.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.997+0000 7f0f6b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-09T08:03:20.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.997+0000 7f0f6b7fe640 10 monclient: dump: 2024-02-09T08:03:20.001 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:20.001 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:20.002 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:20.002 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:20.002 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:20.002 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:20.002 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:20.002 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:20.002 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:20.002 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:20.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.998+0000 7f0f72ffe640 10 monclient: shutdown 2024-02-09T08:03:20.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.998+0000 7f0f72ffe640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:20.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.998+0000 7f0f72ffe640 1 -- 172.21.15.62:0/3791411011 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f6c0a9e30 msgr2=0x7f0f6c145de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:20.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.998+0000 7f0f72ffe640 1 --2- 172.21.15.62:0/3791411011 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f6c0a9e30 0x7f0f6c145de0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0f600097a0 tx=0x7f0f6002b840 comp rx=0 tx=0).stop 2024-02-09T08:03:20.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.998+0000 7f0f72ffe640 1 -- 172.21.15.62:0/3791411011 shutdown_connections 2024-02-09T08:03:20.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.998+0000 7f0f72ffe640 1 --2- 172.21.15.62:0/3791411011 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0f6c13fdf0 0x7f0f6c146320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:20.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.998+0000 7f0f72ffe640 1 --2- 172.21.15.62:0/3791411011 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f6c0a9e30 0x7f0f6c145de0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:20.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.998+0000 7f0f72ffe640 1 -- 172.21.15.62:0/3791411011 >> 172.21.15.62:0/3791411011 conn(0x7f0f6c066bb0 msgr2=0x7f0f6c066fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:20.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.998+0000 7f0f72ffe640 1 -- 172.21.15.62:0/3791411011 shutdown_connections 2024-02-09T08:03:20.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.998+0000 7f0f72ffe640 1 -- 172.21.15.62:0/3791411011 wait complete. 2024-02-09T08:03:20.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.999+0000 7f0f72ffe640 10 monclient: build_initial_monmap 2024-02-09T08:03:20.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.999+0000 7f0f72ffe640 10 monclient: monmap: 2024-02-09T08:03:20.007 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:20.007 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:03:20.007 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:03:20.007 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:03:20.007 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:20.007 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:20.007 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:03:20.007 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:03:20.007 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:03:20.007 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:20.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.999+0000 7f0f72ffe640 1 librados: starting msgr at 2024-02-09T08:03:20.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.999+0000 7f0f72ffe640 1 librados: starting objecter 2024-02-09T08:03:20.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.999+0000 7f0f72ffe640 1 Processor -- start 2024-02-09T08:03:20.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.999+0000 7f0f72ffe640 1 -- start start 2024-02-09T08:03:20.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.999+0000 7f0f72ffe640 1 librados: setting wanted keys 2024-02-09T08:03:20.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.999+0000 7f0f72ffe640 1 librados: calling monclient init 2024-02-09T08:03:20.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:19.999+0000 7f0f72ffe640 10 monclient: init 2024-02-09T08:03:20.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.000+0000 7f0f72ffe640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:20.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.000+0000 7f0f72ffe640 10 monclient: _add_conns ranks=[1,0,2] 2024-02-09T08:03:20.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.000+0000 7f0f72ffe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f6c0a9e30 0x7f0f6c13b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:20.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.000+0000 7f0f72ffe640 10 monclient(hunting): picked mon.noname-b con 0x7f0f6c0a9e30 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:03:20.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.000+0000 7f0f72ffe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f6c0b5000 0x7f0f6c1dad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:20.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.000+0000 7f0f72ffe640 10 monclient(hunting): picked mon.noname-a con 0x7f0f6c0b5000 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:03:20.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.000+0000 7f0f72ffe640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0f6c13fdf0 0x7f0f6c1346e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:20.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.000+0000 7f0f72ffe640 10 monclient(hunting): picked mon.noname-c con 0x7f0f6c13fdf0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:20.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.000+0000 7f0f72ffe640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:20.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.000+0000 7f0f72ffe640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c141d70 con 0x7f0f6c0b5000 2024-02-09T08:03:20.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.000+0000 7f0f72ffe640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:20.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.000+0000 7f0f72ffe640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c141fe0 con 0x7f0f6c0a9e30 2024-02-09T08:03:20.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.000+0000 7f0f72ffe640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:20.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.000+0000 7f0f72ffe640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c1407e0 con 0x7f0f6c13fdf0 2024-02-09T08:03:20.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.000+0000 7f0f72ffe640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:20.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.000+0000 7f0f72ffe640 10 monclient(hunting): authenticate will time out at 1443.360548s 2024-02-09T08:03:20.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.000+0000 7f0f6bfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f6c0b5000 0x7f0f6c1dad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:20.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.000+0000 7f0f70d9a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f6c0a9e30 0x7f0f6c13b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:20.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.000+0000 7f0f7159b640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0f6c13fdf0 0x7f0f6c1346e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:20.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.001+0000 7f0f6bfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f6c0b5000 0x7f0f6c1dad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47834/0 (socket says 172.21.15.62:47834) 2024-02-09T08:03:20.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.001+0000 7f0f6bfff640 1 -- 172.21.15.62:0/3115497363 learned_addr learned my addr 172.21.15.62:0/3115497363 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:20.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.001+0000 7f0f6bfff640 10 monclient(hunting): get_auth_request con 0x7f0f6c0b5000 auth_method 0 2024-02-09T08:03:20.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.001+0000 7f0f6bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:20.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.001+0000 7f0f6bfff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:20.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.001+0000 7f0f6bfff640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:20.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.001+0000 7f0f70d9a640 10 monclient(hunting): get_auth_request con 0x7f0f6c0a9e30 auth_method 0 2024-02-09T08:03:20.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.001+0000 7f0f70d9a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:20.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.001+0000 7f0f70d9a640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:20.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.001+0000 7f0f70d9a640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:20.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.001+0000 7f0f7159b640 10 monclient(hunting): get_auth_request con 0x7f0f6c13fdf0 auth_method 0 2024-02-09T08:03:20.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.001+0000 7f0f7159b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:20.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.001+0000 7f0f7159b640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:20.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.001+0000 7f0f7159b640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:20.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.001+0000 7f0f70d9a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:20.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.001+0000 7f0f70d9a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:20.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.001+0000 7f0f70d9a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:20.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.001+0000 7f0f6bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:20.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.001+0000 7f0f6bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:20.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.001+0000 7f0f6bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:20.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.001+0000 7f0f7159b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:20.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.001+0000 7f0f7159b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:20.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.001+0000 7f0f7159b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:20.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.003+0000 7f0f70d9a640 10 monclient(hunting): handle_auth_done global_id 4399 payload 824 2024-02-09T08:03:20.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.003+0000 7f0f70d9a640 1 -- 172.21.15.62:0/3115497363 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0f6c13fdf0 msgr2=0x7f0f6c1346e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:20.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.003+0000 7f0f70d9a640 1 --2- 172.21.15.62:0/3115497363 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0f6c13fdf0 0x7f0f6c1346e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:20.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.003+0000 7f0f70d9a640 1 -- 172.21.15.62:0/3115497363 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f6c0b5000 msgr2=0x7f0f6c1dad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:20.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.003+0000 7f0f70d9a640 1 --2- 172.21.15.62:0/3115497363 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f6c0b5000 0x7f0f6c1dad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:20.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.003+0000 7f0f70d9a640 10 monclient: _finish_hunting 0 2024-02-09T08:03:20.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.003+0000 7f0f70d9a640 1 monclient: found mon.noname-b 2024-02-09T08:03:20.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.003+0000 7f0f70d9a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:20.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.003+0000 7f0f70d9a640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.103:3300/0 2024-02-09T08:03:20.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.003+0000 7f0f70d9a640 1 -- 172.21.15.62:0/3115497363 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f60009400 con 0x7f0f6c0a9e30 2024-02-09T08:03:20.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.006+0000 7f0f70d9a640 1 --2- 172.21.15.62:0/3115497363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f6c0a9e30 0x7f0f6c13b280 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0f6400cae0 tx=0x7f0f6400a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:20.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.006+0000 7f0f697fa640 10 client.?.objecter ms_handle_connect 0x7f0f6c0a9e30 2024-02-09T08:03:20.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.006+0000 7f0f697fa640 10 client.?.objecter resend_mon_ops 2024-02-09T08:03:20.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.009+0000 7f0f697fa640 1 -- 172.21.15.62:0/3115497363 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6400ac40 con 0x7f0f6c0a9e30 2024-02-09T08:03:20.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.009+0000 7f0f697fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:20.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.009+0000 7f0f697fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:03:20.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.009+0000 7f0f697fa640 10 monclient: dump: 2024-02-09T08:03:20.014 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:20.014 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:20.014 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:20.014 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:20.015 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:20.015 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:20.015 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:20.015 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:20.015 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:20.015 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:20.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.009+0000 7f0f697fa640 10 monclient: _finish_auth 0 2024-02-09T08:03:20.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.009+0000 7f0f697fa640 10 monclient: _check_auth_tickets 2024-02-09T08:03:20.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.009+0000 7f0f697fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:20.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.009+0000 7f0f697fa640 1 -- 172.21.15.62:0/3115497363 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f6400ada0 con 0x7f0f6c0a9e30 2024-02-09T08:03:20.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.009+0000 7f0f72ffe640 5 monclient: authenticate success, global_id 4399 2024-02-09T08:03:20.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.010+0000 7f0f72ffe640 10 monclient: _renew_subs 2024-02-09T08:03:20.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.010+0000 7f0f72ffe640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:20.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.010+0000 7f0f72ffe640 1 -- 172.21.15.62:0/3115497363 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f6c0b4870 con 0x7f0f6c0a9e30 2024-02-09T08:03:20.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.010+0000 7f0f697fa640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:20.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.010+0000 7f0f697fa640 1 -- 172.21.15.62:0/3115497363 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f64012620 con 0x7f0f6c0a9e30 2024-02-09T08:03:20.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.010+0000 7f0f697fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:20.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.010+0000 7f0f697fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:03:20.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.010+0000 7f0f697fa640 10 monclient: dump: 2024-02-09T08:03:20.016 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:20.016 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:20.016 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:20.016 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:20.016 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:20.016 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:20.016 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:20.016 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:20.016 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:20.016 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:20.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.010+0000 7f0f6affd640 4 set_mon_vals no callback set 2024-02-09T08:03:20.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.010+0000 7f0f72ffe640 10 client.4399.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:03:20.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.010+0000 7f0f72ffe640 10 monclient: _renew_subs 2024-02-09T08:03:20.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.010+0000 7f0f72ffe640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:20.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.010+0000 7f0f72ffe640 1 -- 172.21.15.62:0/3115497363 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f6c134e00 con 0x7f0f6c0a9e30 2024-02-09T08:03:20.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.010+0000 7f0f72ffe640 1 librados: init done 2024-02-09T08:03:20.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.010+0000 7f0f72ffe640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:20.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.010+0000 7f0f72ffe640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:20.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.010+0000 7f0f72ffe640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:20.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.010+0000 7f0f72ffe640 1 -- 172.21.15.62:0/3115497363 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f6c0b4670 con 0x7f0f6c0a9e30 2024-02-09T08:03:20.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.255+0000 7f0f697fa640 1 -- 172.21.15.62:0/3115497363 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f0f64007070 con 0x7f0f6c0a9e30 2024-02-09T08:03:20.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.255+0000 7f0f697fa640 1 --2- 172.21.15.62:0/3115497363 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f0f5806d220 0x7f0f5806f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:20.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.256+0000 7f0f6bfff640 1 --2- 172.21.15.62:0/3115497363 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f0f5806d220 0x7f0f5806f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:20.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.256+0000 7f0f6bfff640 10 monclient: get_auth_request con 0x7f0f5806d220 auth_method 0 2024-02-09T08:03:20.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.256+0000 7f0f6bfff640 1 --2- 172.21.15.62:0/3115497363 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f0f5806d220 0x7f0f5806f6e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0f6002b880 tx=0x7f0f6003d040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:20.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.256+0000 7f0f697fa640 10 client.4399.objecter ms_handle_connect 0x7f0f5806d220 2024-02-09T08:03:20.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.258+0000 7f0f697fa640 1 -- 172.21.15.62:0/3115497363 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0f64058d70 con 0x7f0f6c0a9e30 2024-02-09T08:03:20.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.258+0000 7f0f697fa640 10 client.4399.objecter ms_dispatch 0x7f0f6c000b90 osd_map(26..26 src has 1..26) v4 2024-02-09T08:03:20.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.258+0000 7f0f697fa640 3 client.4399.objecter handle_osd_map got epochs [26,26] > 0 2024-02-09T08:03:20.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.258+0000 7f0f697fa640 3 client.4399.objecter handle_osd_map decoding full epoch 26 2024-02-09T08:03:20.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.258+0000 7f0f697fa640 20 client.4399.objecter dump_active .. 0 homeless 2024-02-09T08:03:20.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.268+0000 7f0f697fa640 1 -- 172.21.15.62:0/3115497363 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0f64055010 con 0x7f0f6c0a9e30 2024-02-09T08:03:20.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.268+0000 7f0f697fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:20.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.268+0000 7f0f697fa640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:03:20.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.444+0000 7f0f72ffe640 1 -- 172.21.15.62:0/3115497363 --> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0f6c140e00 con 0x7f0f5806d220 2024-02-09T08:03:20.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.447+0000 7f0f697fa640 1 -- 172.21.15.62:0/3115497363 <== mgr.4109 v2:172.21.15.103:6800/2270392189 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48080 (secure 0 0 0) 0x7f0f6c140e00 con 0x7f0f5806d220 2024-02-09T08:03:20.449 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T08:03:20.450 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-02-09T08:03:20.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.448+0000 7f0f72ffe640 10 librados: watch_flush enter 2024-02-09T08:03:20.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.448+0000 7f0f72ffe640 10 librados: watch_flush exit 2024-02-09T08:03:20.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.448+0000 7f0f72ffe640 20 client.4399.objecter shutdown clearing up homeless session... 2024-02-09T08:03:20.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.448+0000 7f0f72ffe640 10 client.4399.objecter successfully canceled tick 2024-02-09T08:03:20.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.449+0000 7f0f72ffe640 1 -- 172.21.15.62:0/3115497363 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f0f5806d220 msgr2=0x7f0f5806f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:20.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.449+0000 7f0f72ffe640 1 --2- 172.21.15.62:0/3115497363 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f0f5806d220 0x7f0f5806f6e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0f6002b880 tx=0x7f0f6003d040 comp rx=0 tx=0).stop 2024-02-09T08:03:20.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.449+0000 7f0f72ffe640 10 monclient: shutdown 2024-02-09T08:03:20.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.449+0000 7f0f72ffe640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:20.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.449+0000 7f0f72ffe640 1 -- 172.21.15.62:0/3115497363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f6c0a9e30 msgr2=0x7f0f6c13b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:20.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.449+0000 7f0f72ffe640 1 --2- 172.21.15.62:0/3115497363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f6c0a9e30 0x7f0f6c13b280 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0f6400cae0 tx=0x7f0f6400a060 comp rx=0 tx=0).stop 2024-02-09T08:03:20.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.449+0000 7f0f72ffe640 1 -- 172.21.15.62:0/3115497363 shutdown_connections 2024-02-09T08:03:20.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.449+0000 7f0f72ffe640 1 --2- 172.21.15.62:0/3115497363 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f0f5806d220 0x7f0f5806f6e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:20.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.449+0000 7f0f72ffe640 1 --2- 172.21.15.62:0/3115497363 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0f6c13fdf0 0x7f0f6c1346e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:20.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.449+0000 7f0f72ffe640 1 --2- 172.21.15.62:0/3115497363 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f6c0b5000 0x7f0f6c1dad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:20.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.449+0000 7f0f72ffe640 1 --2- 172.21.15.62:0/3115497363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f6c0a9e30 0x7f0f6c13b280 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:20.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.449+0000 7f0f72ffe640 1 -- 172.21.15.62:0/3115497363 >> 172.21.15.62:0/3115497363 conn(0x7f0f6c066bb0 msgr2=0x7f0f6c13c510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:20.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.449+0000 7f0f72ffe640 1 -- 172.21.15.62:0/3115497363 shutdown_connections 2024-02-09T08:03:20.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.449+0000 7f0f72ffe640 1 -- 172.21.15.62:0/3115497363 wait complete. 2024-02-09T08:03:20.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.449+0000 7f0f72ffe640 1 librados: shutdown 2024-02-09T08:03:20.462 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":43,"stamp":"2024-02-09T08:03:19.792173+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219048,"kb_used_data":2864,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755672,"statfs":{"total":773094113280,"available":772869808128,"internally_reserved":0,"allocated":2932736,"data_stored":1526512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":88,"apply_latency_ms":88,"commit_latency_ns":88000000,"apply_latency_ns":88000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.858883"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-09T08:03:14.731774+0000","last_change":"2024-02-09T08:03:12.925399+0000","last_active":"2024-02-09T08:03:14.731774+0000","last_peered":"2024-02-09T08:03:14.731774+0000","last_clean":"2024-02-09T08:03:14.731774+0000","last_became_active":"2024-02-09T08:03:12.920012+0000","last_became_peered":"2024-02-09T08:03:12.920012+0000","last_unstale":"2024-02-09T08:03:14.731774+0000","last_undegraded":"2024-02-09T08:03:14.731774+0000","last_fullsized":"2024-02-09T08:03:14.731774+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_clean_scrub_stamp":"2024-02-09T08:03:10.689497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T10:28:21.672589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-09T08:03:15.320018+0000","last_change":"2024-02-09T08:03:12.975632+0000","last_active":"2024-02-09T08:03:15.320018+0000","last_peered":"2024-02-09T08:03:15.320018+0000","last_clean":"2024-02-09T08:03:15.320018+0000","last_became_active":"2024-02-09T08:03:12.943786+0000","last_became_peered":"2024-02-09T08:03:12.943786+0000","last_unstale":"2024-02-09T08:03:15.320018+0000","last_undegraded":"2024-02-09T08:03:15.320018+0000","last_fullsized":"2024-02-09T08:03:15.320018+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_clean_scrub_stamp":"2024-02-09T08:03:10.689497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T14:17:25.431442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-09T08:03:14.710600+0000","last_change":"2024-02-09T08:03:12.390430+0000","last_active":"2024-02-09T08:03:14.710600+0000","last_peered":"2024-02-09T08:03:14.710600+0000","last_clean":"2024-02-09T08:03:14.710600+0000","last_became_active":"2024-02-09T08:03:12.385148+0000","last_became_peered":"2024-02-09T08:03:12.385148+0000","last_unstale":"2024-02-09T08:03:14.710600+0000","last_undegraded":"2024-02-09T08:03:14.710600+0000","last_fullsized":"2024-02-09T08:03:14.710600+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_clean_scrub_stamp":"2024-02-09T08:03:10.689497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T10:48:39.909252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-09T08:03:14.552898+0000","last_change":"2024-02-09T08:03:12.601407+0000","last_active":"2024-02-09T08:03:14.552898+0000","last_peered":"2024-02-09T08:03:14.552898+0000","last_clean":"2024-02-09T08:03:14.552898+0000","last_became_active":"2024-02-09T08:03:12.568245+0000","last_became_peered":"2024-02-09T08:03:12.568245+0000","last_unstale":"2024-02-09T08:03:14.552898+0000","last_undegraded":"2024-02-09T08:03:14.552898+0000","last_fullsized":"2024-02-09T08:03:14.552898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_clean_scrub_stamp":"2024-02-09T08:03:10.689497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T13:19:50.521695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-09T08:03:14.719505+0000","last_change":"2024-02-09T08:03:12.541068+0000","last_active":"2024-02-09T08:03:14.719505+0000","last_peered":"2024-02-09T08:03:14.719505+0000","last_clean":"2024-02-09T08:03:14.719505+0000","last_became_active":"2024-02-09T08:03:12.535306+0000","last_became_peered":"2024-02-09T08:03:12.535306+0000","last_unstale":"2024-02-09T08:03:14.719505+0000","last_undegraded":"2024-02-09T08:03:14.719505+0000","last_fullsized":"2024-02-09T08:03:14.719505+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_clean_scrub_stamp":"2024-02-09T08:03:10.689497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T16:45:31.048468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-09T08:03:14.548843+0000","last_change":"2024-02-09T08:03:12.225325+0000","last_active":"2024-02-09T08:03:14.548843+0000","last_peered":"2024-02-09T08:03:14.548843+0000","last_clean":"2024-02-09T08:03:14.548843+0000","last_became_active":"2024-02-09T08:03:12.197237+0000","last_became_peered":"2024-02-09T08:03:12.197237+0000","last_unstale":"2024-02-09T08:03:14.548843+0000","last_undegraded":"2024-02-09T08:03:14.548843+0000","last_fullsized":"2024-02-09T08:03:14.548843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_clean_scrub_stamp":"2024-02-09T08:03:10.689497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T09:53:22.604814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-09T08:03:14.723583+0000","last_change":"2024-02-09T08:03:12.238763+0000","last_active":"2024-02-09T08:03:14.723583+0000","last_peered":"2024-02-09T08:03:14.723583+0000","last_clean":"2024-02-09T08:03:14.723583+0000","last_became_active":"2024-02-09T08:03:12.210217+0000","last_became_peered":"2024-02-09T08:03:12.210217+0000","last_unstale":"2024-02-09T08:03:14.723583+0000","last_undegraded":"2024-02-09T08:03:14.723583+0000","last_fullsized":"2024-02-09T08:03:14.723583+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_clean_scrub_stamp":"2024-02-09T08:03:10.689497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T11:36:35.345417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-09T08:03:14.736185+0000","last_change":"2024-02-09T08:03:12.939816+0000","last_active":"2024-02-09T08:03:14.736185+0000","last_peered":"2024-02-09T08:03:14.736185+0000","last_clean":"2024-02-09T08:03:14.736185+0000","last_became_active":"2024-02-09T08:03:12.934488+0000","last_became_peered":"2024-02-09T08:03:12.934488+0000","last_unstale":"2024-02-09T08:03:14.736185+0000","last_undegraded":"2024-02-09T08:03:14.736185+0000","last_fullsized":"2024-02-09T08:03:14.736185+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_clean_scrub_stamp":"2024-02-09T08:03:10.689497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T08:15:00.733484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"21'76","reported_seq":131,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-09T08:03:14.876697+0000","last_change":"2024-02-09T08:02:58.788272+0000","last_active":"2024-02-09T08:03:14.876697+0000","last_peered":"2024-02-09T08:03:14.876697+0000","last_clean":"2024-02-09T08:03:14.876697+0000","last_became_active":"2024-02-09T08:02:58.754736+0000","last_became_peered":"2024-02-09T08:02:58.754736+0000","last_unstale":"2024-02-09T08:03:14.876697+0000","last_undegraded":"2024-02-09T08:03:14.876697+0000","last_fullsized":"2024-02-09T08:03:14.876697+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:02:56.594120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:02:56.594120+0000","last_clean_scrub_stamp":"2024-02-09T08:02:56.594120+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T17:35:01.118117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":21,"seq":90194313223,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":91354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.112}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.7200000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.039999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.890999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":18.940000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":22.138000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.425000000000001}]}]},{"osd":4,"up_from":20,"seq":85899345931,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":91354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.3620000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.351}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.489999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":14.4}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.558}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.099}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.704000000000001}]}]},{"osd":1,"up_from":16,"seq":68719476744,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":667648,"data_stored":489194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":270.50700000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":261.61900000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.3510000000000009}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.247}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":50.542000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.43}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.317}]}]},{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":91354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.076000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.614000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.4710000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.045}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":14.343999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.704000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.8019999999999996}]}]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":91354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.9219999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.4329999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.992000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.662000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.097999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.941000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.032999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":91354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.0380000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.432}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":292.142}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":97.271000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.391}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.779}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":30.693999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":91354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.8650000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.597}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":14.81}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":26.800999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.465}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":18.931999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":30.946999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":667648,"data_stored":489194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.284000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.7409999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.9359999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.1980000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.5299999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.917}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.862}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-09T08:03:20.463 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-09T08:03:20.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.566+0000 7f9b57f8d640 10 monclient: get_monmap_and_config 2024-02-09T08:03:20.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.566+0000 7f9b57f8d640 10 monclient: build_initial_monmap 2024-02-09T08:03:20.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.566+0000 7f9b57f8d640 10 monclient: monmap: 2024-02-09T08:03:20.569 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:20.569 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:20.569 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:03:20.567473+0000 2024-02-09T08:03:20.569 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:03:20.567473+0000 2024-02-09T08:03:20.569 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:20.569 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:20.569 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:03:20.569 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:03:20.569 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:03:20.569 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:03:20.569 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:03:20.570 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:20.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.566+0000 7f9b57f8d640 1 Processor -- start 2024-02-09T08:03:20.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.567+0000 7f9b57f8d640 1 -- start start 2024-02-09T08:03:20.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.567+0000 7f9b57f8d640 10 monclient: init 2024-02-09T08:03:20.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.567+0000 7f9b57f8d640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:20.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.567+0000 7f9b57f8d640 10 monclient: _add_conns ranks=[3,4,2,1,0] 2024-02-09T08:03:20.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.567+0000 7f9b57f8d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9b5006c360 0x7f9b500aa0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:20.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.567+0000 7f9b57f8d640 10 monclient(hunting): picked mon.noname-a con 0x7f9b5006c360 addr v2:172.21.15.62:3300/0 2024-02-09T08:03:20.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.567+0000 7f9b57f8d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9b500b1ca0 0x7f9b50142550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:20.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.567+0000 7f9b57f8d640 10 monclient(hunting): picked mon.noname-c con 0x7f9b500b1ca0 addr v2:172.21.15.103:3300/0 2024-02-09T08:03:20.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.567+0000 7f9b57f8d640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9b5013f700 0x7f9b5013fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:20.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.567+0000 7f9b57f8d640 10 monclient(hunting): picked mon.noname-b con 0x7f9b5013f700 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:20.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.567+0000 7f9b57f8d640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:20.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.567+0000 7f9b57f8d640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b5006c740 con 0x7f9b5006c360 2024-02-09T08:03:20.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.567+0000 7f9b57f8d640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:20.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.567+0000 7f9b57f8d640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b500a9930 con 0x7f9b500b1ca0 2024-02-09T08:03:20.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.567+0000 7f9b57f8d640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:20.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.567+0000 7f9b57f8d640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b500ab310 con 0x7f9b5013f700 2024-02-09T08:03:20.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.567+0000 7f9b57f8d640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:20.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.567+0000 7f9b57f8d640 10 monclient(hunting): authenticate will time out at 1443.927997s 2024-02-09T08:03:20.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.568+0000 7f9b55d29640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9b5006c360 0x7f9b500aa0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:20.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.568+0000 7f9b5652a640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9b5013f700 0x7f9b5013fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:20.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.568+0000 7f9b55528640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9b500b1ca0 0x7f9b50142550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:20.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.568+0000 7f9b55d29640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9b5006c360 0x7f9b500aa0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47842/0 (socket says 172.21.15.62:47842) 2024-02-09T08:03:20.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.568+0000 7f9b55d29640 1 -- 172.21.15.62:0/1164252371 learned_addr learned my addr 172.21.15.62:0/1164252371 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:20.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.568+0000 7f9b55d29640 10 monclient(hunting): get_auth_request con 0x7f9b5006c360 auth_method 0 2024-02-09T08:03:20.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.568+0000 7f9b55d29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:20.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.568+0000 7f9b55d29640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:20.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.568+0000 7f9b55d29640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:20.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.568+0000 7f9b55528640 10 monclient(hunting): get_auth_request con 0x7f9b500b1ca0 auth_method 0 2024-02-09T08:03:20.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.568+0000 7f9b55528640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:20.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.568+0000 7f9b55528640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:20.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.568+0000 7f9b55528640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:20.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.568+0000 7f9b5652a640 10 monclient(hunting): get_auth_request con 0x7f9b5013f700 auth_method 0 2024-02-09T08:03:20.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.568+0000 7f9b5652a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:20.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.568+0000 7f9b5652a640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:20.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.568+0000 7f9b5652a640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:20.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.569+0000 7f9b55528640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:20.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.569+0000 7f9b55528640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:20.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.569+0000 7f9b55528640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:20.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.569+0000 7f9b55d29640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:20.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.569+0000 7f9b55d29640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:20.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.569+0000 7f9b55d29640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:20.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.569+0000 7f9b5652a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:20.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.569+0000 7f9b5652a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:20.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.569+0000 7f9b5652a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:20.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.570+0000 7f9b55528640 10 monclient(hunting): handle_auth_done global_id 4402 payload 274 2024-02-09T08:03:20.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.570+0000 7f9b55528640 1 -- 172.21.15.62:0/1164252371 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9b5013f700 msgr2=0x7f9b5013fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:20.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.570+0000 7f9b55528640 1 --2- 172.21.15.62:0/1164252371 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9b5013f700 0x7f9b5013fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:20.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.570+0000 7f9b55528640 1 -- 172.21.15.62:0/1164252371 >> v2:172.21.15.62:3300/0 conn(0x7f9b5006c360 msgr2=0x7f9b500aa0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:20.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.570+0000 7f9b55528640 1 --2- 172.21.15.62:0/1164252371 >> v2:172.21.15.62:3300/0 conn(0x7f9b5006c360 0x7f9b500aa0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:20.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.570+0000 7f9b55528640 10 monclient: _finish_hunting 0 2024-02-09T08:03:20.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.570+0000 7f9b55528640 1 monclient: found mon.noname-c 2024-02-09T08:03:20.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.570+0000 7f9b55528640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:20.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.570+0000 7f9b55528640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.103:3300/0 2024-02-09T08:03:20.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.570+0000 7f9b55528640 1 -- 172.21.15.62:0/1164252371 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b500b4760 con 0x7f9b500b1ca0 2024-02-09T08:03:20.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.572+0000 7f9b55528640 1 --2- 172.21.15.62:0/1164252371 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b500b1ca0 0x7f9b50142550 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9b500b5a10 tx=0x7f9b4002b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e58eab8add093323 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:20.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.576+0000 7f9b54d27640 1 -- 172.21.15.62:0/1164252371 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4002f050 con 0x7f9b500b1ca0 2024-02-09T08:03:20.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.576+0000 7f9b54d27640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:20.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.576+0000 7f9b54d27640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-09T08:03:20.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.576+0000 7f9b54d27640 10 monclient: dump: 2024-02-09T08:03:20.579 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:20.579 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:20.579 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:20.579 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:20.579 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:20.579 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:20.579 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:20.580 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:20.580 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:20.580 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:20.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.576+0000 7f9b54d27640 10 monclient: _finish_auth 0 2024-02-09T08:03:20.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.576+0000 7f9b54d27640 10 monclient: _check_auth_tickets 2024-02-09T08:03:20.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.576+0000 7f9b54d27640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:20.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.576+0000 7f9b54d27640 1 -- 172.21.15.62:0/1164252371 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b40031700 con 0x7f9b500b1ca0 2024-02-09T08:03:20.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.576+0000 7f9b57f8d640 5 monclient: authenticate success, global_id 4402 2024-02-09T08:03:20.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.576+0000 7f9b57f8d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-02-09T08:03:20.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.576+0000 7f9b54d27640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:20.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.576+0000 7f9b57f8d640 10 monclient: get_monmap_and_config success 2024-02-09T08:03:20.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.576+0000 7f9b57f8d640 4 set_mon_vals no callback set 2024-02-09T08:03:20.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.576+0000 7f9b54d27640 1 -- 172.21.15.62:0/1164252371 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b40031a90 con 0x7f9b500b1ca0 2024-02-09T08:03:20.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.576+0000 7f9b54d27640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:20.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.576+0000 7f9b54d27640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:03:20.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.576+0000 7f9b54d27640 10 monclient: dump: 2024-02-09T08:03:20.581 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:20.581 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:20.581 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:20.581 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:20.581 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:20.581 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:20.581 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:20.581 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:20.581 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:20.581 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:20.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.577+0000 7f9b57f8d640 10 monclient: shutdown 2024-02-09T08:03:20.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.577+0000 7f9b57f8d640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:20.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.577+0000 7f9b57f8d640 1 -- 172.21.15.62:0/1164252371 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b500b1ca0 msgr2=0x7f9b50142550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:20.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.577+0000 7f9b57f8d640 1 --2- 172.21.15.62:0/1164252371 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b500b1ca0 0x7f9b50142550 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9b500b5a10 tx=0x7f9b4002b7a0 comp rx=0 tx=0).stop 2024-02-09T08:03:20.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.577+0000 7f9b57f8d640 1 -- 172.21.15.62:0/1164252371 shutdown_connections 2024-02-09T08:03:20.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.577+0000 7f9b57f8d640 1 --2- 172.21.15.62:0/1164252371 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b500b1ca0 0x7f9b50142550 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:20.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.577+0000 7f9b57f8d640 1 --2- 172.21.15.62:0/1164252371 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9b5013f700 0x7f9b5013fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:20.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.577+0000 7f9b57f8d640 1 --2- 172.21.15.62:0/1164252371 >> v2:172.21.15.62:3300/0 conn(0x7f9b5006c360 0x7f9b500aa0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:20.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.577+0000 7f9b57f8d640 1 -- 172.21.15.62:0/1164252371 >> 172.21.15.62:0/1164252371 conn(0x7f9b500b8320 msgr2=0x7f9b500b8730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:20.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.577+0000 7f9b57f8d640 1 -- 172.21.15.62:0/1164252371 shutdown_connections 2024-02-09T08:03:20.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.577+0000 7f9b57f8d640 1 -- 172.21.15.62:0/1164252371 wait complete. 2024-02-09T08:03:20.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.578+0000 7f9b57f8d640 10 monclient: build_initial_monmap 2024-02-09T08:03:20.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.578+0000 7f9b57f8d640 10 monclient: monmap: 2024-02-09T08:03:20.587 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:20.587 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:03:20.587 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:03:20.587 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:03:20.587 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:20.587 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:20.588 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:03:20.588 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:03:20.588 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:03:20.588 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:20.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.578+0000 7f9b57f8d640 1 librados: starting msgr at 2024-02-09T08:03:20.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.578+0000 7f9b57f8d640 1 librados: starting objecter 2024-02-09T08:03:20.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.578+0000 7f9b57f8d640 1 Processor -- start 2024-02-09T08:03:20.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.578+0000 7f9b57f8d640 1 -- start start 2024-02-09T08:03:20.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.578+0000 7f9b57f8d640 1 librados: setting wanted keys 2024-02-09T08:03:20.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.578+0000 7f9b57f8d640 1 librados: calling monclient init 2024-02-09T08:03:20.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.578+0000 7f9b57f8d640 10 monclient: init 2024-02-09T08:03:20.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.579+0000 7f9b57f8d640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:20.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.579+0000 7f9b57f8d640 10 monclient: _add_conns ranks=[0,2,1] 2024-02-09T08:03:20.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.579+0000 7f9b57f8d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b5006c360 0x7f9b500b0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:20.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.579+0000 7f9b57f8d640 10 monclient(hunting): picked mon.noname-a con 0x7f9b5006c360 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:03:20.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.579+0000 7f9b57f8d640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9b500b1ca0 0x7f9b501d7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:20.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.579+0000 7f9b57f8d640 10 monclient(hunting): picked mon.noname-c con 0x7f9b500b1ca0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:20.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.579+0000 7f9b57f8d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b5013f700 0x7f9b501daa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:20.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.579+0000 7f9b57f8d640 10 monclient(hunting): picked mon.noname-b con 0x7f9b5013f700 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:03:20.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.579+0000 7f9b57f8d640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:20.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.579+0000 7f9b57f8d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b500b0770 con 0x7f9b5006c360 2024-02-09T08:03:20.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.579+0000 7f9b57f8d640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:20.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.579+0000 7f9b57f8d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b501d7da0 con 0x7f9b5013f700 2024-02-09T08:03:20.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.579+0000 7f9b57f8d640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:20.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.579+0000 7f9b57f8d640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b501d7a80 con 0x7f9b500b1ca0 2024-02-09T08:03:20.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.579+0000 7f9b57f8d640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:20.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.579+0000 7f9b57f8d640 10 monclient(hunting): authenticate will time out at 1443.939497s 2024-02-09T08:03:20.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.579+0000 7f9b55528640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9b500b1ca0 0x7f9b501d7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:20.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.579+0000 7f9b5652a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b5013f700 0x7f9b501daa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:20.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.579+0000 7f9b55d29640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b5006c360 0x7f9b500b0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:20.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.580+0000 7f9b55528640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9b500b1ca0 0x7f9b501d7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:42550/0 (socket says 172.21.15.62:42550) 2024-02-09T08:03:20.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.580+0000 7f9b55528640 1 -- 172.21.15.62:0/847344897 learned_addr learned my addr 172.21.15.62:0/847344897 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:20.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.580+0000 7f9b55528640 10 monclient(hunting): get_auth_request con 0x7f9b500b1ca0 auth_method 0 2024-02-09T08:03:20.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.580+0000 7f9b55528640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:20.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.580+0000 7f9b55528640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:20.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.580+0000 7f9b55528640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:20.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.580+0000 7f9b5652a640 10 monclient(hunting): get_auth_request con 0x7f9b5013f700 auth_method 0 2024-02-09T08:03:20.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.580+0000 7f9b5652a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:20.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.580+0000 7f9b5652a640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:20.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.580+0000 7f9b5652a640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:20.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.580+0000 7f9b55d29640 10 monclient(hunting): get_auth_request con 0x7f9b5006c360 auth_method 0 2024-02-09T08:03:20.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.580+0000 7f9b55d29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:20.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.580+0000 7f9b55d29640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:20.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.580+0000 7f9b55d29640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:20.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.580+0000 7f9b55528640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:20.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.580+0000 7f9b55528640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:20.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.580+0000 7f9b55528640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:20.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.580+0000 7f9b5652a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:20.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.580+0000 7f9b5652a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:20.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.580+0000 7f9b5652a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:20.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.580+0000 7f9b55d29640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:20.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.580+0000 7f9b55d29640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:20.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.580+0000 7f9b55d29640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:20.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.583+0000 7f9b5652a640 10 monclient(hunting): handle_auth_done global_id 4405 payload 824 2024-02-09T08:03:20.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.583+0000 7f9b5652a640 1 -- 172.21.15.62:0/847344897 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9b500b1ca0 msgr2=0x7f9b501d7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:20.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.583+0000 7f9b5652a640 1 --2- 172.21.15.62:0/847344897 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9b500b1ca0 0x7f9b501d7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:20.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.583+0000 7f9b5652a640 1 -- 172.21.15.62:0/847344897 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b5006c360 msgr2=0x7f9b500b0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:20.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.583+0000 7f9b5652a640 1 --2- 172.21.15.62:0/847344897 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b5006c360 0x7f9b500b0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:20.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.583+0000 7f9b5652a640 10 monclient: _finish_hunting 0 2024-02-09T08:03:20.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.583+0000 7f9b5652a640 1 monclient: found mon.noname-b 2024-02-09T08:03:20.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.583+0000 7f9b5652a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:20.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.583+0000 7f9b5652a640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.103:3300/0 2024-02-09T08:03:20.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.583+0000 7f9b5652a640 1 -- 172.21.15.62:0/847344897 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b40009400 con 0x7f9b5013f700 2024-02-09T08:03:20.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.585+0000 7f9b5652a640 1 --2- 172.21.15.62:0/847344897 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b5013f700 0x7f9b501daa40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9b4800eba0 tx=0x7f9b4800c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:20.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.585+0000 7f9b467fc640 10 client.?.objecter ms_handle_connect 0x7f9b5013f700 2024-02-09T08:03:20.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.585+0000 7f9b467fc640 10 client.?.objecter resend_mon_ops 2024-02-09T08:03:20.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.589+0000 7f9b467fc640 1 -- 172.21.15.62:0/847344897 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4800cd20 con 0x7f9b5013f700 2024-02-09T08:03:20.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.589+0000 7f9b467fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:20.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.589+0000 7f9b467fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:03:20.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.589+0000 7f9b467fc640 10 monclient: dump: 2024-02-09T08:03:20.595 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:20.595 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:20.595 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:20.595 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:20.595 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:20.595 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:20.595 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:20.595 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:20.595 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:20.596 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:20.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.589+0000 7f9b467fc640 10 monclient: _finish_auth 0 2024-02-09T08:03:20.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.589+0000 7f9b467fc640 10 monclient: _check_auth_tickets 2024-02-09T08:03:20.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.589+0000 7f9b467fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:20.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.589+0000 7f9b467fc640 1 -- 172.21.15.62:0/847344897 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4800f040 con 0x7f9b5013f700 2024-02-09T08:03:20.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.589+0000 7f9b467fc640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:20.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.589+0000 7f9b467fc640 1 -- 172.21.15.62:0/847344897 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b480146c0 con 0x7f9b5013f700 2024-02-09T08:03:20.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.589+0000 7f9b57f8d640 5 monclient: authenticate success, global_id 4405 2024-02-09T08:03:20.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.589+0000 7f9b57f8d640 10 monclient: _renew_subs 2024-02-09T08:03:20.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.589+0000 7f9b57f8d640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:20.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.589+0000 7f9b57f8d640 1 -- 172.21.15.62:0/847344897 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b500b18d0 con 0x7f9b5013f700 2024-02-09T08:03:20.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.589+0000 7f9b47fff640 4 set_mon_vals no callback set 2024-02-09T08:03:20.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.589+0000 7f9b467fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:20.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.589+0000 7f9b467fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:03:20.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.589+0000 7f9b467fc640 10 monclient: dump: 2024-02-09T08:03:20.597 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:20.597 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:20.597 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:20.597 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:20.597 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:20.597 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:20.597 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:20.597 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:20.597 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:20.598 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:20.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.589+0000 7f9b57f8d640 10 client.4405.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:03:20.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.589+0000 7f9b57f8d640 10 monclient: _renew_subs 2024-02-09T08:03:20.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.589+0000 7f9b57f8d640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:20.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.589+0000 7f9b57f8d640 1 -- 172.21.15.62:0/847344897 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b501daf80 con 0x7f9b5013f700 2024-02-09T08:03:20.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.589+0000 7f9b57f8d640 1 librados: init done 2024-02-09T08:03:20.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.590+0000 7f9b57f8d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:20.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.590+0000 7f9b57f8d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:20.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.590+0000 7f9b57f8d640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:20.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.590+0000 7f9b57f8d640 1 -- 172.21.15.62:0/847344897 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b500b8a50 con 0x7f9b5013f700 2024-02-09T08:03:20.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.835+0000 7f9b467fc640 1 -- 172.21.15.62:0/847344897 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f9b48014820 con 0x7f9b5013f700 2024-02-09T08:03:20.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.836+0000 7f9b467fc640 1 --2- 172.21.15.62:0/847344897 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f9b3406d1f0 0x7f9b3406f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:20.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.836+0000 7f9b55d29640 1 --2- 172.21.15.62:0/847344897 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f9b3406d1f0 0x7f9b3406f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:20.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.836+0000 7f9b55d29640 10 monclient: get_auth_request con 0x7f9b3406d1f0 auth_method 0 2024-02-09T08:03:20.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.836+0000 7f9b467fc640 10 client.4405.objecter ms_handle_connect 0x7f9b3406d1f0 2024-02-09T08:03:20.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.836+0000 7f9b55d29640 1 --2- 172.21.15.62:0/847344897 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f9b3406d1f0 0x7f9b3406f6b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c009bd0 tx=0x7f9b4c009240 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:20.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.839+0000 7f9b467fc640 1 -- 172.21.15.62:0/847344897 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9b48059af0 con 0x7f9b5013f700 2024-02-09T08:03:20.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.839+0000 7f9b467fc640 10 client.4405.objecter ms_dispatch 0x7f9b50000b90 osd_map(26..26 src has 1..26) v4 2024-02-09T08:03:20.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.839+0000 7f9b467fc640 3 client.4405.objecter handle_osd_map got epochs [26,26] > 0 2024-02-09T08:03:20.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.839+0000 7f9b467fc640 3 client.4405.objecter handle_osd_map decoding full epoch 26 2024-02-09T08:03:20.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.839+0000 7f9b467fc640 20 client.4405.objecter dump_active .. 0 homeless 2024-02-09T08:03:20.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.851+0000 7f9b467fc640 1 -- 172.21.15.62:0/847344897 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9b48055d90 con 0x7f9b5013f700 2024-02-09T08:03:20.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.851+0000 7f9b467fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:20.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:20.851+0000 7f9b467fc640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:03:21.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.034+0000 7f9b57f8d640 1 -- 172.21.15.62:0/847344897 --> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9b50140010 con 0x7f9b3406d1f0 2024-02-09T08:03:21.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.037+0000 7f9b467fc640 1 -- 172.21.15.62:0/847344897 <== mgr.4109 v2:172.21.15.103:6800/2270392189 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48080 (secure 0 0 0) 0x7f9b50140010 con 0x7f9b3406d1f0 2024-02-09T08:03:21.039 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T08:03:21.040 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-02-09T08:03:21.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.039+0000 7f9b57f8d640 10 librados: watch_flush enter 2024-02-09T08:03:21.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.039+0000 7f9b57f8d640 10 librados: watch_flush exit 2024-02-09T08:03:21.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.039+0000 7f9b57f8d640 20 client.4405.objecter shutdown clearing up homeless session... 2024-02-09T08:03:21.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.039+0000 7f9b57f8d640 10 client.4405.objecter successfully canceled tick 2024-02-09T08:03:21.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.039+0000 7f9b57f8d640 1 -- 172.21.15.62:0/847344897 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f9b3406d1f0 msgr2=0x7f9b3406f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:21.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.039+0000 7f9b57f8d640 1 --2- 172.21.15.62:0/847344897 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f9b3406d1f0 0x7f9b3406f6b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c009bd0 tx=0x7f9b4c009240 comp rx=0 tx=0).stop 2024-02-09T08:03:21.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.039+0000 7f9b57f8d640 10 monclient: shutdown 2024-02-09T08:03:21.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.039+0000 7f9b57f8d640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:21.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.039+0000 7f9b57f8d640 1 -- 172.21.15.62:0/847344897 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b5013f700 msgr2=0x7f9b501daa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:21.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.039+0000 7f9b57f8d640 1 --2- 172.21.15.62:0/847344897 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b5013f700 0x7f9b501daa40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9b4800eba0 tx=0x7f9b4800c490 comp rx=0 tx=0).stop 2024-02-09T08:03:21.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.039+0000 7f9b57f8d640 1 -- 172.21.15.62:0/847344897 shutdown_connections 2024-02-09T08:03:21.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.039+0000 7f9b57f8d640 1 --2- 172.21.15.62:0/847344897 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f9b3406d1f0 0x7f9b3406f6b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:21.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.039+0000 7f9b57f8d640 1 --2- 172.21.15.62:0/847344897 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b5013f700 0x7f9b501daa40 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:21.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.039+0000 7f9b57f8d640 1 --2- 172.21.15.62:0/847344897 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9b500b1ca0 0x7f9b501d7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:21.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.039+0000 7f9b57f8d640 1 --2- 172.21.15.62:0/847344897 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b5006c360 0x7f9b500b0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:21.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.039+0000 7f9b57f8d640 1 -- 172.21.15.62:0/847344897 >> 172.21.15.62:0/847344897 conn(0x7f9b500b8320 msgr2=0x7f9b500b50f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:21.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.039+0000 7f9b57f8d640 1 -- 172.21.15.62:0/847344897 shutdown_connections 2024-02-09T08:03:21.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.039+0000 7f9b57f8d640 1 -- 172.21.15.62:0/847344897 wait complete. 2024-02-09T08:03:21.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.039+0000 7f9b57f8d640 1 librados: shutdown 2024-02-09T08:03:21.053 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":43,"stamp":"2024-02-09T08:03:19.792173+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219048,"kb_used_data":2864,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755672,"statfs":{"total":773094113280,"available":772869808128,"internally_reserved":0,"allocated":2932736,"data_stored":1526512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":88,"apply_latency_ms":88,"commit_latency_ns":88000000,"apply_latency_ns":88000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.858883"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-09T08:03:14.731774+0000","last_change":"2024-02-09T08:03:12.925399+0000","last_active":"2024-02-09T08:03:14.731774+0000","last_peered":"2024-02-09T08:03:14.731774+0000","last_clean":"2024-02-09T08:03:14.731774+0000","last_became_active":"2024-02-09T08:03:12.920012+0000","last_became_peered":"2024-02-09T08:03:12.920012+0000","last_unstale":"2024-02-09T08:03:14.731774+0000","last_undegraded":"2024-02-09T08:03:14.731774+0000","last_fullsized":"2024-02-09T08:03:14.731774+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_clean_scrub_stamp":"2024-02-09T08:03:10.689497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T10:28:21.672589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-09T08:03:15.320018+0000","last_change":"2024-02-09T08:03:12.975632+0000","last_active":"2024-02-09T08:03:15.320018+0000","last_peered":"2024-02-09T08:03:15.320018+0000","last_clean":"2024-02-09T08:03:15.320018+0000","last_became_active":"2024-02-09T08:03:12.943786+0000","last_became_peered":"2024-02-09T08:03:12.943786+0000","last_unstale":"2024-02-09T08:03:15.320018+0000","last_undegraded":"2024-02-09T08:03:15.320018+0000","last_fullsized":"2024-02-09T08:03:15.320018+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_clean_scrub_stamp":"2024-02-09T08:03:10.689497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T14:17:25.431442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-09T08:03:14.710600+0000","last_change":"2024-02-09T08:03:12.390430+0000","last_active":"2024-02-09T08:03:14.710600+0000","last_peered":"2024-02-09T08:03:14.710600+0000","last_clean":"2024-02-09T08:03:14.710600+0000","last_became_active":"2024-02-09T08:03:12.385148+0000","last_became_peered":"2024-02-09T08:03:12.385148+0000","last_unstale":"2024-02-09T08:03:14.710600+0000","last_undegraded":"2024-02-09T08:03:14.710600+0000","last_fullsized":"2024-02-09T08:03:14.710600+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_clean_scrub_stamp":"2024-02-09T08:03:10.689497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T10:48:39.909252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-09T08:03:14.552898+0000","last_change":"2024-02-09T08:03:12.601407+0000","last_active":"2024-02-09T08:03:14.552898+0000","last_peered":"2024-02-09T08:03:14.552898+0000","last_clean":"2024-02-09T08:03:14.552898+0000","last_became_active":"2024-02-09T08:03:12.568245+0000","last_became_peered":"2024-02-09T08:03:12.568245+0000","last_unstale":"2024-02-09T08:03:14.552898+0000","last_undegraded":"2024-02-09T08:03:14.552898+0000","last_fullsized":"2024-02-09T08:03:14.552898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_clean_scrub_stamp":"2024-02-09T08:03:10.689497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T13:19:50.521695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-09T08:03:14.719505+0000","last_change":"2024-02-09T08:03:12.541068+0000","last_active":"2024-02-09T08:03:14.719505+0000","last_peered":"2024-02-09T08:03:14.719505+0000","last_clean":"2024-02-09T08:03:14.719505+0000","last_became_active":"2024-02-09T08:03:12.535306+0000","last_became_peered":"2024-02-09T08:03:12.535306+0000","last_unstale":"2024-02-09T08:03:14.719505+0000","last_undegraded":"2024-02-09T08:03:14.719505+0000","last_fullsized":"2024-02-09T08:03:14.719505+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_clean_scrub_stamp":"2024-02-09T08:03:10.689497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T16:45:31.048468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-09T08:03:14.548843+0000","last_change":"2024-02-09T08:03:12.225325+0000","last_active":"2024-02-09T08:03:14.548843+0000","last_peered":"2024-02-09T08:03:14.548843+0000","last_clean":"2024-02-09T08:03:14.548843+0000","last_became_active":"2024-02-09T08:03:12.197237+0000","last_became_peered":"2024-02-09T08:03:12.197237+0000","last_unstale":"2024-02-09T08:03:14.548843+0000","last_undegraded":"2024-02-09T08:03:14.548843+0000","last_fullsized":"2024-02-09T08:03:14.548843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_clean_scrub_stamp":"2024-02-09T08:03:10.689497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T09:53:22.604814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-09T08:03:14.723583+0000","last_change":"2024-02-09T08:03:12.238763+0000","last_active":"2024-02-09T08:03:14.723583+0000","last_peered":"2024-02-09T08:03:14.723583+0000","last_clean":"2024-02-09T08:03:14.723583+0000","last_became_active":"2024-02-09T08:03:12.210217+0000","last_became_peered":"2024-02-09T08:03:12.210217+0000","last_unstale":"2024-02-09T08:03:14.723583+0000","last_undegraded":"2024-02-09T08:03:14.723583+0000","last_fullsized":"2024-02-09T08:03:14.723583+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_clean_scrub_stamp":"2024-02-09T08:03:10.689497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T11:36:35.345417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-09T08:03:14.736185+0000","last_change":"2024-02-09T08:03:12.939816+0000","last_active":"2024-02-09T08:03:14.736185+0000","last_peered":"2024-02-09T08:03:14.736185+0000","last_clean":"2024-02-09T08:03:14.736185+0000","last_became_active":"2024-02-09T08:03:12.934488+0000","last_became_peered":"2024-02-09T08:03:12.934488+0000","last_unstale":"2024-02-09T08:03:14.736185+0000","last_undegraded":"2024-02-09T08:03:14.736185+0000","last_fullsized":"2024-02-09T08:03:14.736185+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_clean_scrub_stamp":"2024-02-09T08:03:10.689497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T08:15:00.733484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"21'76","reported_seq":131,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-02-09T08:03:14.876697+0000","last_change":"2024-02-09T08:02:58.788272+0000","last_active":"2024-02-09T08:03:14.876697+0000","last_peered":"2024-02-09T08:03:14.876697+0000","last_clean":"2024-02-09T08:03:14.876697+0000","last_became_active":"2024-02-09T08:02:58.754736+0000","last_became_peered":"2024-02-09T08:02:58.754736+0000","last_unstale":"2024-02-09T08:03:14.876697+0000","last_undegraded":"2024-02-09T08:03:14.876697+0000","last_fullsized":"2024-02-09T08:03:14.876697+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:02:56.594120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:02:56.594120+0000","last_clean_scrub_stamp":"2024-02-09T08:02:56.594120+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T17:35:01.118117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":21,"seq":90194313223,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":91354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.112}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.7200000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.039999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.890999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":18.940000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":22.138000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.425000000000001}]}]},{"osd":4,"up_from":20,"seq":85899345931,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":91354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.3620000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.351}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.489999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":14.4}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.558}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.099}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.704000000000001}]}]},{"osd":1,"up_from":16,"seq":68719476744,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":667648,"data_stored":489194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":270.50700000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":261.61900000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.3510000000000009}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.247}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":50.542000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.43}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.317}]}]},{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":91354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.076000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.614000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.4710000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.045}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":14.343999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.704000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.8019999999999996}]}]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":91354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.9219999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.4329999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.992000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.662000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.097999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.941000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.032999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":91354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.0380000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.432}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":292.142}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":97.271000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.391}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.779}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":30.693999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":91354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.8650000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.597}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":14.81}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":26.800999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.465}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":18.931999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":30.946999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":667648,"data_stored":489194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.284000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.7409999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.9359999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.1980000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.5299999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.917}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.862}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-09T08:03:21.054 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-02-09T08:03:21.054 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-02-09T08:03:21.054 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-02-09T08:03:21.054 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-02-09T08:03:21.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.152+0000 7f0a052b0640 10 monclient: get_monmap_and_config 2024-02-09T08:03:21.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.152+0000 7f0a052b0640 10 monclient: build_initial_monmap 2024-02-09T08:03:21.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.152+0000 7f0a052b0640 10 monclient: monmap: 2024-02-09T08:03:21.154 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:21.154 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:21.155 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:03:21.153404+0000 2024-02-09T08:03:21.155 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:03:21.153404+0000 2024-02-09T08:03:21.155 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:21.155 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:21.155 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:03:21.155 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:03:21.155 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:03:21.155 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:03:21.155 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:03:21.155 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:21.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.152+0000 7f0a052b0640 1 Processor -- start 2024-02-09T08:03:21.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.152+0000 7f0a052b0640 1 -- start start 2024-02-09T08:03:21.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.152+0000 7f0a052b0640 10 monclient: init 2024-02-09T08:03:21.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.153+0000 7f0a052b0640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:21.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.153+0000 7f0a052b0640 10 monclient: _add_conns ranks=[3,2,0,1,4] 2024-02-09T08:03:21.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.153+0000 7f0a052b0640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0a000ae8f0 0x7f0a00142f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:21.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.153+0000 7f0a052b0640 10 monclient(hunting): picked mon.noname-a con 0x7f0a000ae8f0 addr v2:172.21.15.62:3300/0 2024-02-09T08:03:21.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.153+0000 7f0a052b0640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a000aecd0 0x7f0a000aac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:21.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.153+0000 7f0a052b0640 10 monclient(hunting): picked mon.noname-b con 0x7f0a000aecd0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:21.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.153+0000 7f0a052b0640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f0a000ad810 addr v1:172.21.15.62:6789/0 2024-02-09T08:03:21.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.153+0000 7f0a052b0640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a00142770 con 0x7f0a000ad810 2024-02-09T08:03:21.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.153+0000 7f0a052b0640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:21.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.153+0000 7f0a052b0640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a000ad110 con 0x7f0a000ae8f0 2024-02-09T08:03:21.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.153+0000 7f0a052b0640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:21.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.153+0000 7f0a052b0640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a000ad3f0 con 0x7f0a000aecd0 2024-02-09T08:03:21.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.153+0000 7f0a052b0640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:21.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.153+0000 7f0a052b0640 10 monclient(hunting): authenticate will time out at 1444.513794s 2024-02-09T08:03:21.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.154+0000 7f09fe7fc640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a000aecd0 0x7f0a000aac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:21.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.154+0000 7f09ff7fe640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f0a000ad810 0x7f0a0013f210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:40866/0 (socket says 172.21.15.62:40866) 2024-02-09T08:03:21.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.154+0000 7f09ff7fe640 1 -- 172.21.15.62:0/646612812 learned_addr learned my addr 172.21.15.62:0/646612812 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-09T08:03:21.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.154+0000 7f09feffd640 1 --2- 172.21.15.62:0/646612812 >> v2:172.21.15.62:3300/0 conn(0x7f0a000ae8f0 0x7f0a00142f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:21.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.154+0000 7f09fe7fc640 10 monclient(hunting): get_auth_request con 0x7f0a000aecd0 auth_method 0 2024-02-09T08:03:21.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.154+0000 7f09fe7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:21.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.154+0000 7f09fe7fc640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:21.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.154+0000 7f09fe7fc640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:21.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.155+0000 7f09feffd640 10 monclient(hunting): get_auth_request con 0x7f0a000ae8f0 auth_method 0 2024-02-09T08:03:21.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.155+0000 7f09feffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:21.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.155+0000 7f09feffd640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:21.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.155+0000 7f09feffd640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:21.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.155+0000 7f09fe7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:21.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.155+0000 7f09fe7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:21.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.155+0000 7f09fe7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:21.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.155+0000 7f09feffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:21.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.155+0000 7f09feffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:21.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.155+0000 7f09feffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:21.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.157+0000 7f09fe7fc640 10 monclient(hunting): handle_auth_done global_id 4376 payload 274 2024-02-09T08:03:21.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.157+0000 7f09fe7fc640 1 -- 172.21.15.62:0/646612812 >> v2:172.21.15.62:3300/0 conn(0x7f0a000ae8f0 msgr2=0x7f0a00142f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:03:21.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.157+0000 7f09fe7fc640 1 --2- 172.21.15.62:0/646612812 >> v2:172.21.15.62:3300/0 conn(0x7f0a000ae8f0 0x7f0a00142f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:21.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.157+0000 7f09fe7fc640 1 -- 172.21.15.62:0/646612812 >> v1:172.21.15.62:6789/0 conn(0x7f0a000ad810 legacy=0x7f0a0013f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:21.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.157+0000 7f09fe7fc640 10 monclient: _finish_hunting 0 2024-02-09T08:03:21.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.157+0000 7f09fe7fc640 1 monclient: found mon.noname-b 2024-02-09T08:03:21.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.157+0000 7f09fe7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:21.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.157+0000 7f09fe7fc640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.62:3301/0 2024-02-09T08:03:21.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.157+0000 7f09fe7fc640 1 -- 172.21.15.62:0/646612812 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a000adcd0 con 0x7f0a000aecd0 2024-02-09T08:03:21.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.159+0000 7f09fe7fc640 1 --2- 172.21.15.62:0/646612812 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a000aecd0 0x7f0a000aac50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f09e80097a0 tx=0x7f09e802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b333cc5dce8ff22e server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:21.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.163+0000 7f09fdffb640 1 -- 172.21.15.62:0/646612812 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e802e070 con 0x7f0a000aecd0 2024-02-09T08:03:21.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.163+0000 7f09fdffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:21.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.163+0000 7f09fdffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:03:21.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.163+0000 7f09fdffb640 10 monclient: dump: 2024-02-09T08:03:21.166 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:21.166 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:21.166 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:21.166 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:21.166 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:21.166 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:21.166 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:21.167 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:21.167 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:21.167 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:21.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.163+0000 7f09fdffb640 10 monclient: _finish_auth 0 2024-02-09T08:03:21.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.163+0000 7f09fdffb640 10 monclient: _check_auth_tickets 2024-02-09T08:03:21.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.163+0000 7f09fdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:21.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.163+0000 7f09fdffb640 1 -- 172.21.15.62:0/646612812 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e80315a0 con 0x7f0a000aecd0 2024-02-09T08:03:21.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.163+0000 7f09fdffb640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:21.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.163+0000 7f09fdffb640 1 -- 172.21.15.62:0/646612812 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e8031930 con 0x7f0a000aecd0 2024-02-09T08:03:21.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.163+0000 7f0a052b0640 5 monclient: authenticate success, global_id 4376 2024-02-09T08:03:21.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.163+0000 7f0a052b0640 10 monclient: get_monmap_and_config success 2024-02-09T08:03:21.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.163+0000 7f0a052b0640 4 set_mon_vals no callback set 2024-02-09T08:03:21.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.163+0000 7f09fdffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:21.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.163+0000 7f09fdffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-09T08:03:21.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.163+0000 7f09fdffb640 10 monclient: dump: 2024-02-09T08:03:21.168 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:21.168 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:21.168 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:21.168 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:21.168 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:21.168 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:21.168 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:21.168 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:21.168 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:21.168 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:21.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.163+0000 7f0a052b0640 10 monclient: shutdown 2024-02-09T08:03:21.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.163+0000 7f0a052b0640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:21.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.163+0000 7f0a052b0640 1 -- 172.21.15.62:0/646612812 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a000aecd0 msgr2=0x7f0a000aac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:21.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.163+0000 7f0a052b0640 1 --2- 172.21.15.62:0/646612812 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a000aecd0 0x7f0a000aac50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f09e80097a0 tx=0x7f09e802b840 comp rx=0 tx=0).stop 2024-02-09T08:03:21.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.163+0000 7f0a052b0640 1 -- 172.21.15.62:0/646612812 shutdown_connections 2024-02-09T08:03:21.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.163+0000 7f0a052b0640 1 --2- 172.21.15.62:0/646612812 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a000aecd0 0x7f0a000aac50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:21.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.163+0000 7f0a052b0640 1 --2- 172.21.15.62:0/646612812 >> v2:172.21.15.62:3300/0 conn(0x7f0a000ae8f0 0x7f0a00142f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:21.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.163+0000 7f0a052b0640 1 -- 172.21.15.62:0/646612812 >> 172.21.15.62:0/646612812 conn(0x7f0a000b3ef0 msgr2=0x7f0a000b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:21.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.163+0000 7f0a052b0640 1 -- 172.21.15.62:0/646612812 shutdown_connections 2024-02-09T08:03:21.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.164+0000 7f0a052b0640 1 -- 172.21.15.62:0/646612812 wait complete. 2024-02-09T08:03:21.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.164+0000 7f0a052b0640 10 monclient: build_initial_monmap 2024-02-09T08:03:21.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.164+0000 7f0a052b0640 10 monclient: monmap: 2024-02-09T08:03:21.172 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:03:21.172 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:03:21.172 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:03:21.172 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:03:21.173 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:03:21.173 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:21.173 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:03:21.173 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:03:21.173 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:03:21.173 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:21.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.165+0000 7f0a052b0640 1 librados: starting msgr at 2024-02-09T08:03:21.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.165+0000 7f0a052b0640 1 librados: starting objecter 2024-02-09T08:03:21.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.165+0000 7f0a052b0640 1 Processor -- start 2024-02-09T08:03:21.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.165+0000 7f0a052b0640 1 -- start start 2024-02-09T08:03:21.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.165+0000 7f0a052b0640 1 librados: setting wanted keys 2024-02-09T08:03:21.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.165+0000 7f0a052b0640 1 librados: calling monclient init 2024-02-09T08:03:21.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.165+0000 7f0a052b0640 10 monclient: init 2024-02-09T08:03:21.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.165+0000 7f0a052b0640 10 monclient: _reopen_session rank -1 2024-02-09T08:03:21.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.165+0000 7f0a052b0640 10 monclient: _add_conns ranks=[1,0,2] 2024-02-09T08:03:21.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.165+0000 7f0a052b0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a000ad810 0x7f0a001c9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:21.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.165+0000 7f0a052b0640 10 monclient(hunting): picked mon.noname-b con 0x7f0a000ad810 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:03:21.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.165+0000 7f0a052b0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a000ae8f0 0x7f0a001c9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:21.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.165+0000 7f0a052b0640 10 monclient(hunting): picked mon.noname-a con 0x7f0a000ae8f0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:03:21.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.165+0000 7f0a052b0640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a001d82b0 0x7f0a001d8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:21.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.165+0000 7f0a052b0640 10 monclient(hunting): picked mon.noname-c con 0x7f0a001d82b0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:03:21.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.165+0000 7f0a052b0640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:21.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.165+0000 7f0a052b0640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a001d7e90 con 0x7f0a000ae8f0 2024-02-09T08:03:21.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.165+0000 7f0a052b0640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:21.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.165+0000 7f0a052b0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a001c9560 con 0x7f0a000ad810 2024-02-09T08:03:21.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.165+0000 7f0a052b0640 10 monclient(hunting): start opening mon connection 2024-02-09T08:03:21.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.165+0000 7f0a052b0640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a001cb480 con 0x7f0a001d82b0 2024-02-09T08:03:21.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.165+0000 7f0a052b0640 10 monclient(hunting): _renew_subs 2024-02-09T08:03:21.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.165+0000 7f0a052b0640 10 monclient(hunting): authenticate will time out at 1444.526118s 2024-02-09T08:03:21.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.166+0000 7f09ff7fe640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a001d82b0 0x7f0a001d8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:21.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.166+0000 7f09fe7fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a000ae8f0 0x7f0a001c9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:21.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.166+0000 7f09feffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a000ad810 0x7f0a001c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:21.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.166+0000 7f09fe7fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a000ae8f0 0x7f0a001c9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47858/0 (socket says 172.21.15.62:47858) 2024-02-09T08:03:21.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.166+0000 7f09fe7fc640 1 -- 172.21.15.62:0/1220247331 learned_addr learned my addr 172.21.15.62:0/1220247331 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:03:21.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.166+0000 7f09fe7fc640 10 monclient(hunting): get_auth_request con 0x7f0a000ae8f0 auth_method 0 2024-02-09T08:03:21.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.166+0000 7f09fe7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:21.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.166+0000 7f09fe7fc640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:21.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.166+0000 7f09fe7fc640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:21.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.166+0000 7f09feffd640 10 monclient(hunting): get_auth_request con 0x7f0a000ad810 auth_method 0 2024-02-09T08:03:21.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.166+0000 7f09feffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:21.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.166+0000 7f09feffd640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:21.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.166+0000 7f09feffd640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:21.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.166+0000 7f09ff7fe640 10 monclient(hunting): get_auth_request con 0x7f0a001d82b0 auth_method 0 2024-02-09T08:03:21.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.166+0000 7f09ff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:03:21.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.166+0000 7f09ff7fe640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:03:21.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.166+0000 7f09ff7fe640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:03:21.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.167+0000 7f09feffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:21.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.167+0000 7f09feffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:21.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.167+0000 7f09feffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:21.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.167+0000 7f09fe7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:21.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.167+0000 7f09fe7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:21.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.167+0000 7f09fe7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:21.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.167+0000 7f09ff7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:03:21.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.167+0000 7f09ff7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:03:21.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.167+0000 7f09ff7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:03:21.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.169+0000 7f09feffd640 10 monclient(hunting): handle_auth_done global_id 4408 payload 824 2024-02-09T08:03:21.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.169+0000 7f09feffd640 1 -- 172.21.15.62:0/1220247331 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a001d82b0 msgr2=0x7f0a001d8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:21.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.169+0000 7f09feffd640 1 --2- 172.21.15.62:0/1220247331 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a001d82b0 0x7f0a001d8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:21.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.169+0000 7f09feffd640 1 -- 172.21.15.62:0/1220247331 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a000ae8f0 msgr2=0x7f0a001c9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:21.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.169+0000 7f09feffd640 1 --2- 172.21.15.62:0/1220247331 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a000ae8f0 0x7f0a001c9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:21.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.169+0000 7f09feffd640 10 monclient: _finish_hunting 0 2024-02-09T08:03:21.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.169+0000 7f09feffd640 1 monclient: found mon.noname-b 2024-02-09T08:03:21.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.169+0000 7f09feffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:03:21.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.169+0000 7f09feffd640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.103:3300/0 2024-02-09T08:03:21.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.169+0000 7f09feffd640 1 -- 172.21.15.62:0/1220247331 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e8009400 con 0x7f0a000ad810 2024-02-09T08:03:21.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.172+0000 7f09feffd640 1 --2- 172.21.15.62:0/1220247331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a000ad810 0x7f0a001c9020 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f09f8009db0 tx=0x7f09f800c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:21.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.172+0000 7f09f77fe640 10 client.?.objecter ms_handle_connect 0x7f0a000ad810 2024-02-09T08:03:21.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.172+0000 7f09f77fe640 10 client.?.objecter resend_mon_ops 2024-02-09T08:03:21.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.176+0000 7f09f77fe640 1 -- 172.21.15.62:0/1220247331 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f8014480 con 0x7f0a000ad810 2024-02-09T08:03:21.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.176+0000 7f09f77fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:21.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.176+0000 7f09f77fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:03:21.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.176+0000 7f09f77fe640 10 monclient: dump: 2024-02-09T08:03:21.179 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:21.179 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:21.179 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:21.179 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:21.179 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:21.179 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:21.179 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:21.179 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:21.180 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:21.180 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:21.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.176+0000 7f09f77fe640 10 monclient: _finish_auth 0 2024-02-09T08:03:21.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.176+0000 7f09f77fe640 10 monclient: _check_auth_tickets 2024-02-09T08:03:21.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.176+0000 7f09f77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:03:21.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.176+0000 7f0a052b0640 5 monclient: authenticate success, global_id 4408 2024-02-09T08:03:21.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.176+0000 7f09f77fe640 1 -- 172.21.15.62:0/1220247331 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09f800f040 con 0x7f0a000ad810 2024-02-09T08:03:21.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.176+0000 7f09f77fe640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:03:21.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.176+0000 7f09f77fe640 1 -- 172.21.15.62:0/1220247331 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f8014800 con 0x7f0a000ad810 2024-02-09T08:03:21.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.176+0000 7f0a052b0640 10 monclient: _renew_subs 2024-02-09T08:03:21.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.176+0000 7f0a052b0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:21.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.176+0000 7f0a052b0640 1 -- 172.21.15.62:0/1220247331 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a001ca480 con 0x7f0a000ad810 2024-02-09T08:03:21.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.176+0000 7f09fd7fa640 4 set_mon_vals no callback set 2024-02-09T08:03:21.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.176+0000 7f09f77fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:03:21.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.176+0000 7f09f77fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:03:21.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.176+0000 7f09f77fe640 10 monclient: dump: 2024-02-09T08:03:21.181 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:03:21.181 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:03:21.181 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:21.181 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:03:21.181 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:03:21.181 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:03:21.181 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:03:21.181 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:03:21.181 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:03:21.181 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:03:21.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.176+0000 7f0a052b0640 10 client.4408.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:03:21.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.176+0000 7f0a052b0640 10 monclient: _renew_subs 2024-02-09T08:03:21.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.176+0000 7f0a052b0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:21.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.176+0000 7f0a052b0640 1 -- 172.21.15.62:0/1220247331 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a0013e550 con 0x7f0a000ad810 2024-02-09T08:03:21.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.176+0000 7f0a052b0640 1 librados: init done 2024-02-09T08:03:21.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.177+0000 7f0a052b0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:21.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.177+0000 7f0a052b0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:21.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.177+0000 7f0a052b0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:21.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.177+0000 7f0a052b0640 1 -- 172.21.15.62:0/1220247331 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a0004ef90 con 0x7f0a000ad810 2024-02-09T08:03:21.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.198+0000 7f09f77fe640 1 -- 172.21.15.62:0/1220247331 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f09f8014960 con 0x7f0a000ad810 2024-02-09T08:03:21.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.198+0000 7f09f77fe640 1 --2- 172.21.15.62:0/1220247331 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f09e006d1f0 0x7f09e006f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:03:21.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.198+0000 7f09fe7fc640 1 --2- 172.21.15.62:0/1220247331 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f09e006d1f0 0x7f09e006f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:03:21.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.198+0000 7f09fe7fc640 10 monclient: get_auth_request con 0x7f09e006d1f0 auth_method 0 2024-02-09T08:03:21.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.199+0000 7f09fe7fc640 1 --2- 172.21.15.62:0/1220247331 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f09e006d1f0 0x7f09e006f6b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f09e802b880 tx=0x7f09e803d040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:03:21.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.199+0000 7f09f77fe640 10 client.4408.objecter ms_handle_connect 0x7f09e006d1f0 2024-02-09T08:03:21.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.200+0000 7f09f77fe640 1 -- 172.21.15.62:0/1220247331 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f09f8059d80 con 0x7f0a000ad810 2024-02-09T08:03:21.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.200+0000 7f09f77fe640 10 client.4408.objecter ms_dispatch 0x7f0a00000b90 osd_map(26..26 src has 1..26) v4 2024-02-09T08:03:21.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.200+0000 7f09f77fe640 3 client.4408.objecter handle_osd_map got epochs [26,26] > 0 2024-02-09T08:03:21.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.200+0000 7f09f77fe640 3 client.4408.objecter handle_osd_map decoding full epoch 26 2024-02-09T08:03:21.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.200+0000 7f09f77fe640 20 client.4408.objecter dump_active .. 0 homeless 2024-02-09T08:03:21.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.438+0000 7f09f77fe640 1 -- 172.21.15.62:0/1220247331 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f09f8056020 con 0x7f0a000ad810 2024-02-09T08:03:21.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.438+0000 7f09f77fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:03:21.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.438+0000 7f09f77fe640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:03:21.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.657+0000 7f0a052b0640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2024-02-09T08:03:21.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.657+0000 7f0a052b0640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2024-02-09T08:03:21.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.657+0000 7f0a052b0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:03:21.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.657+0000 7f0a052b0640 1 -- 172.21.15.62:0/1220247331 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f0a0013c6f0 con 0x7f0a000ad810 2024-02-09T08:03:21.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.662+0000 7f09f77fe640 1 -- 172.21.15.62:0/1220247331 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f09f80596e0 con 0x7f0a000ad810 2024-02-09T08:03:21.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.662+0000 7f09f77fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2024-02-09T08:03:21.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.662+0000 7f09f77fe640 10 monclient: _finish_command 2 = system:0 2024-02-09T08:03:21.665 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T08:03:21.665 INFO:teuthology.orchestra.run.smithi062.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-02-09T08:03:21.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.664+0000 7f0a052b0640 10 librados: watch_flush enter 2024-02-09T08:03:21.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.664+0000 7f0a052b0640 10 librados: watch_flush exit 2024-02-09T08:03:21.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.664+0000 7f0a052b0640 20 client.4408.objecter shutdown clearing up homeless session... 2024-02-09T08:03:21.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.664+0000 7f0a052b0640 10 client.4408.objecter successfully canceled tick 2024-02-09T08:03:21.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.664+0000 7f0a052b0640 1 -- 172.21.15.62:0/1220247331 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f09e006d1f0 msgr2=0x7f09e006f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:21.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.664+0000 7f0a052b0640 1 --2- 172.21.15.62:0/1220247331 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f09e006d1f0 0x7f09e006f6b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f09e802b880 tx=0x7f09e803d040 comp rx=0 tx=0).stop 2024-02-09T08:03:21.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.664+0000 7f0a052b0640 10 monclient: shutdown 2024-02-09T08:03:21.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.665+0000 7f0a052b0640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:03:21.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.665+0000 7f0a052b0640 1 -- 172.21.15.62:0/1220247331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a000ad810 msgr2=0x7f0a001c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:03:21.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.665+0000 7f0a052b0640 1 --2- 172.21.15.62:0/1220247331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a000ad810 0x7f0a001c9020 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f09f8009db0 tx=0x7f09f800c490 comp rx=0 tx=0).stop 2024-02-09T08:03:21.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.665+0000 7f0a052b0640 1 -- 172.21.15.62:0/1220247331 shutdown_connections 2024-02-09T08:03:21.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.665+0000 7f0a052b0640 1 --2- 172.21.15.62:0/1220247331 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f09e006d1f0 0x7f09e006f6b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:21.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.665+0000 7f0a052b0640 1 --2- 172.21.15.62:0/1220247331 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a001d82b0 0x7f0a001d8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:21.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.665+0000 7f0a052b0640 1 --2- 172.21.15.62:0/1220247331 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a000ae8f0 0x7f0a001c9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:21.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.665+0000 7f0a052b0640 1 --2- 172.21.15.62:0/1220247331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a000ad810 0x7f0a001c9020 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:03:21.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.665+0000 7f0a052b0640 1 -- 172.21.15.62:0/1220247331 >> 172.21.15.62:0/1220247331 conn(0x7f0a000b3ef0 msgr2=0x7f0a000a9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:03:21.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.665+0000 7f0a052b0640 1 -- 172.21.15.62:0/1220247331 shutdown_connections 2024-02-09T08:03:21.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.665+0000 7f0a052b0640 1 -- 172.21.15.62:0/1220247331 wait complete. 2024-02-09T08:03:21.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:03:21.665+0000 7f0a052b0640 1 librados: shutdown 2024-02-09T08:03:21.678 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-02-09T08:03:21.679 INFO:teuthology.run_tasks:Running task workunit... 2024-02-09T08:03:21.693 INFO:tasks.workunit:Pulling workunits from ref 0089f33ec7e39da1a9e0f281bf62a5b44e1951f6 2024-02-09T08:03:21.694 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-02-09T08:03:21.694 DEBUG:teuthology.orchestra.run.smithi062:> stat -- /home/ubuntu/cephtest/mnt.0 2024-02-09T08:03:21.708 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-09T08:03:21.708 INFO:teuthology.orchestra.run.smithi062.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-02-09T08:03:21.709 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-02-09T08:03:21.763 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-02-09T08:03:21.763 DEBUG:teuthology.orchestra.run.smithi062:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-02-09T08:03:21.817 INFO:tasks.workunit:timeout=6h 2024-02-09T08:03:21.817 INFO:tasks.workunit:cleanup=True 2024-02-09T08:03:21.818 DEBUG:teuthology.orchestra.run.smithi062:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 0089f33ec7e39da1a9e0f281bf62a5b44e1951f6 2024-02-09T08:03:21.874 INFO:tasks.workunit.client.0.smithi062.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-02-09T08:03:25.027 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:01:34.433 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:03:25.031 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:01:34.438 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:03:25.071 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:01:34.478 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:03:25.077 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:01:34.474 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:03:25.079 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:01:34.476 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:03:25.081 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:01:34.488 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:03:25.082 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:01:34.489 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:03:25.118 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:01:34.514 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:03:25.130 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:01:34.537 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:03:45.074 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:01:54.480 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:03:45.124 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:01:54.531 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:03:45.144 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:01:54.551 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:03:45.169 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:01:54.565 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:03:45.170 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:01:54.567 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:03:45.182 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:01:54.589 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:03:45.184 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:01:54.581 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:03:45.187 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:01:54.594 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:03:45.205 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:01:54.612 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:04:05.227 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:02:14.634 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:04:05.231 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:02:14.638 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:04:05.252 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:02:14.658 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:04:05.282 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:02:14.679 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:04:05.283 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:02:14.680 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:04:05.297 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:02:14.694 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:04:05.308 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:02:14.715 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:04:05.315 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:02:14.722 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:04:05.337 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:02:14.744 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:04:08.183 INFO:tasks.workunit.client.0.smithi062.stderr:Updating files: 98% (11946/12104) Updating files: 99% (11983/12104) Updating files: 100% (12104/12104) Updating files: 100% (12104/12104), done. 2024-02-09T08:04:08.599 INFO:tasks.workunit.client.0.smithi062.stderr:Note: switching to '0089f33ec7e39da1a9e0f281bf62a5b44e1951f6'. 2024-02-09T08:04:08.599 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-02-09T08:04:08.600 INFO:tasks.workunit.client.0.smithi062.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-02-09T08:04:08.600 INFO:tasks.workunit.client.0.smithi062.stderr:changes and commit them, and you can discard any commits you make in this 2024-02-09T08:04:08.600 INFO:tasks.workunit.client.0.smithi062.stderr:state without impacting any branches by switching back to a branch. 2024-02-09T08:04:08.600 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-02-09T08:04:08.600 INFO:tasks.workunit.client.0.smithi062.stderr:If you want to create a new branch to retain commits you create, you may 2024-02-09T08:04:08.600 INFO:tasks.workunit.client.0.smithi062.stderr:do so (now or later) by using -c with the switch command. Example: 2024-02-09T08:04:08.600 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-02-09T08:04:08.600 INFO:tasks.workunit.client.0.smithi062.stderr: git switch -c 2024-02-09T08:04:08.600 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-02-09T08:04:08.600 INFO:tasks.workunit.client.0.smithi062.stderr:Or undo this operation with: 2024-02-09T08:04:08.600 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-02-09T08:04:08.600 INFO:tasks.workunit.client.0.smithi062.stderr: git switch - 2024-02-09T08:04:08.600 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-02-09T08:04:08.601 INFO:tasks.workunit.client.0.smithi062.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-02-09T08:04:08.601 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-02-09T08:04:08.601 INFO:tasks.workunit.client.0.smithi062.stderr:HEAD is now at 0089f33ec7e Merge branch 'wip-revert-pr-54312' of https://github.com/ljflores/ceph into wip-yuri2-testing-2024-02-08-0727 2024-02-09T08:04:08.604 DEBUG:teuthology.orchestra.run.smithi062:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-02-09T08:04:08.665 INFO:tasks.workunit.client.0.smithi062.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-02-09T08:04:08.667 INFO:tasks.workunit.client.0.smithi062.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-09T08:04:08.667 INFO:tasks.workunit.client.0.smithi062.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-02-09T08:04:09.317 INFO:tasks.workunit.client.0.smithi062.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-02-09T08:04:09.389 INFO:tasks.workunit.client.0.smithi062.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-02-09T08:04:09.428 INFO:tasks.workunit.client.0.smithi062.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-09T08:04:09.429 INFO:tasks.workunit.client.0.smithi062.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-09T08:04:09.430 INFO:tasks.workunit.client.0.smithi062.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-02-09T08:04:09.468 INFO:tasks.workunit.client.0.smithi062.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-09T08:04:09.471 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-02-09T08:04:09.471 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-02-09T08:04:09.526 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2024-02-09T08:04:09.527 INFO:tasks.workunit:Running workunit rados/test.sh... 2024-02-09T08:04:09.527 DEBUG:teuthology.orchestra.run.smithi062:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0089f33ec7e39da1a9e0f281bf62a5b44e1951f6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh 2024-02-09T08:04:09.586 INFO:tasks.workunit.client.0.smithi062.stderr:+ parallel=1 2024-02-09T08:04:09.586 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' '' = --serial ']' 2024-02-09T08:04:09.586 INFO:tasks.workunit.client.0.smithi062.stderr:+ crimson=0 2024-02-09T08:04:09.586 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' '' = --crimson ']' 2024-02-09T08:04:09.586 INFO:tasks.workunit.client.0.smithi062.stderr:+ color= 2024-02-09T08:04:09.586 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -t 1 ']' 2024-02-09T08:04:09.586 INFO:tasks.workunit.client.0.smithi062.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2024-02-09T08:04:09.586 INFO:tasks.workunit.client.0.smithi062.stderr:+ GTEST_OUTPUT=xml:/home/ubuntu/cephtest/archive/gtest_xml_report 2024-02-09T08:04:09.586 INFO:tasks.workunit.client.0.smithi062.stderr:+ declare -A pids 2024-02-09T08:04:09.586 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-09T08:04:09.586 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-09T08:04:09.587 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s api_aio 2024-02-09T08:04:09.587 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' api_aio' 2024-02-09T08:04:09.587 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo api_aio 2024-02-09T08:04:09.587 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-09T08:04:09.587 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=api_aio 2024-02-09T08:04:09.587 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=40823 2024-02-09T08:04:09.587 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test api_aio on pid 40823' 2024-02-09T08:04:09.588 INFO:tasks.workunit.client.0.smithi062.stdout:test api_aio on pid 40823 2024-02-09T08:04:09.591 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=40823 2024-02-09T08:04:09.591 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_aio.xml 2>&1 | tee ceph_test_rados_api_aio.log | sed "s/^/ api_aio: /"' 2024-02-09T08:04:09.591 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-09T08:04:09.591 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-09T08:04:09.591 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s api_aio_pp 2024-02-09T08:04:09.591 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' api_aio_pp' 2024-02-09T08:04:09.591 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo api_aio_pp 2024-02-09T08:04:09.591 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-09T08:04:09.591 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -f /etc/bashrc ']' 2024-02-09T08:04:09.591 INFO:tasks.workunit.client.0.smithi062.stderr:+ . /etc/bashrc 2024-02-09T08:04:09.592 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -z '' ']' 2024-02-09T08:04:09.592 INFO:tasks.workunit.client.0.smithi062.stderr:++ BASHRCSOURCED=Y 2024-02-09T08:04:09.592 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.592 INFO:tasks.workunit.client.0.smithi062.stderr:++ shopt -q login_shell 2024-02-09T08:04:09.592 INFO:tasks.workunit.client.0.smithi062.stderr:+++ umask 2024-02-09T08:04:09.592 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' 0022 -eq 0 ']' 2024-02-09T08:04:09.592 INFO:tasks.workunit.client.0.smithi062.stderr:++ SHELL=/bin/bash 2024-02-09T08:04:09.592 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.592 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-09T08:04:09.592 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.592 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-09T08:04:09.592 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-09T08:04:09.592 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.592 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-09T08:04:09.592 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.593 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-09T08:04:09.593 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:09.593 INFO:tasks.workunit.client.0.smithi062.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:09.593 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.593 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-09T08:04:09.593 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.593 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-09T08:04:09.593 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.593 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=api_aio_pp 2024-02-09T08:04:09.593 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=40830 2024-02-09T08:04:09.593 INFO:tasks.workunit.client.0.smithi062.stdout:test api_aio_pp on pid 40830 2024-02-09T08:04:09.599 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test api_aio_pp on pid 40830' 2024-02-09T08:04:09.599 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=40830 2024-02-09T08:04:09.599 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-09T08:04:09.599 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-09T08:04:09.599 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_aio_pp.xml 2>&1 | tee ceph_test_rados_api_aio_pp.log | sed "s/^/ api_aio_pp: /"' 2024-02-09T08:04:09.599 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s api_io 2024-02-09T08:04:09.599 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' api_io' 2024-02-09T08:04:09.599 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo api_io 2024-02-09T08:04:09.599 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-09T08:04:09.599 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -f /etc/bashrc ']' 2024-02-09T08:04:09.599 INFO:tasks.workunit.client.0.smithi062.stderr:+ . /etc/bashrc 2024-02-09T08:04:09.599 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -z '' ']' 2024-02-09T08:04:09.599 INFO:tasks.workunit.client.0.smithi062.stderr:++ BASHRCSOURCED=Y 2024-02-09T08:04:09.600 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.600 INFO:tasks.workunit.client.0.smithi062.stderr:++ shopt -q login_shell 2024-02-09T08:04:09.600 INFO:tasks.workunit.client.0.smithi062.stderr:+++ umask 2024-02-09T08:04:09.600 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' 0022 -eq 0 ']' 2024-02-09T08:04:09.600 INFO:tasks.workunit.client.0.smithi062.stderr:++ SHELL=/bin/bash 2024-02-09T08:04:09.600 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.600 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-09T08:04:09.600 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.600 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-09T08:04:09.600 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-09T08:04:09.600 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.600 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-09T08:04:09.600 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.600 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-09T08:04:09.601 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:09.601 INFO:tasks.workunit.client.0.smithi062.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:09.601 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.601 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-09T08:04:09.601 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.601 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-09T08:04:09.601 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.601 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'grep=grep --color=auto' 2024-02-09T08:04:09.601 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-09T08:04:09.601 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-09T08:04:09.601 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.601 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-09T08:04:09.601 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.601 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorls.sh 2024-02-09T08:04:09.601 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' '!' -t 0 ']' 2024-02-09T08:04:09.603 INFO:tasks.workunit.client.0.smithi062.stderr:+++ return 2024-02-09T08:04:09.603 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.603 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-09T08:04:09.603 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.603 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-09T08:04:09.604 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export S_COLORS=auto 2024-02-09T08:04:09.604 INFO:tasks.workunit.client.0.smithi062.stderr:+++ S_COLORS=auto 2024-02-09T08:04:09.604 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.604 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-09T08:04:09.604 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.604 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-09T08:04:09.604 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.604 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=api_io 2024-02-09T08:04:09.604 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=40839 2024-02-09T08:04:09.604 INFO:tasks.workunit.client.0.smithi062.stdout:test api_io on pid 40839 2024-02-09T08:04:09.610 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test api_io on pid 40839' 2024-02-09T08:04:09.610 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=40839 2024-02-09T08:04:09.610 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-09T08:04:09.610 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-09T08:04:09.610 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_io.xml 2>&1 | tee ceph_test_rados_api_io.log | sed "s/^/ api_io: /"' 2024-02-09T08:04:09.610 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s api_io_pp 2024-02-09T08:04:09.610 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' api_io_pp' 2024-02-09T08:04:09.610 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo api_io_pp 2024-02-09T08:04:09.610 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-09T08:04:09.610 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -f /etc/bashrc ']' 2024-02-09T08:04:09.610 INFO:tasks.workunit.client.0.smithi062.stderr:+ . /etc/bashrc 2024-02-09T08:04:09.610 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -z '' ']' 2024-02-09T08:04:09.610 INFO:tasks.workunit.client.0.smithi062.stderr:++ BASHRCSOURCED=Y 2024-02-09T08:04:09.611 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.611 INFO:tasks.workunit.client.0.smithi062.stderr:++ shopt -q login_shell 2024-02-09T08:04:09.611 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'grep=grep --color=auto' 2024-02-09T08:04:09.611 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-09T08:04:09.611 INFO:tasks.workunit.client.0.smithi062.stderr:+++ umask 2024-02-09T08:04:09.611 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-09T08:04:09.611 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.611 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-09T08:04:09.611 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.611 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorls.sh 2024-02-09T08:04:09.611 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' 0022 -eq 0 ']' 2024-02-09T08:04:09.611 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' '!' -t 0 ']' 2024-02-09T08:04:09.611 INFO:tasks.workunit.client.0.smithi062.stderr:++ SHELL=/bin/bash 2024-02-09T08:04:09.611 INFO:tasks.workunit.client.0.smithi062.stderr:+++ return 2024-02-09T08:04:09.611 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.612 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-09T08:04:09.612 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.612 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-09T08:04:09.612 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.612 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-09T08:04:09.612 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.612 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-09T08:04:09.612 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export S_COLORS=auto 2024-02-09T08:04:09.612 INFO:tasks.workunit.client.0.smithi062.stderr:+++ S_COLORS=auto 2024-02-09T08:04:09.612 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.612 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-09T08:04:09.612 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.612 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-09T08:04:09.612 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-09T08:04:09.613 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.613 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.613 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-09T08:04:09.613 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.613 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-09T08:04:09.613 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:09.613 INFO:tasks.workunit.client.0.smithi062.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:09.613 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.613 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-09T08:04:09.613 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.613 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-09T08:04:09.613 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.613 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-09T08:04:09.613 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-09T08:04:09.613 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-09T08:04:09.614 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.614 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-09T08:04:09.614 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.614 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-09T08:04:09.614 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-09T08:04:09.614 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.614 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=api_io_pp 2024-02-09T08:04:09.614 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=40851 2024-02-09T08:04:09.614 INFO:tasks.workunit.client.0.smithi062.stdout:test api_io_pp on pid 40851 2024-02-09T08:04:09.620 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test api_io_pp on pid 40851' 2024-02-09T08:04:09.620 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=40851 2024-02-09T08:04:09.620 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-09T08:04:09.620 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-09T08:04:09.621 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_io_pp.xml 2>&1 | tee ceph_test_rados_api_io_pp.log | sed "s/^/ api_io_pp: /"' 2024-02-09T08:04:09.621 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s api_asio 2024-02-09T08:04:09.621 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' api_asio' 2024-02-09T08:04:09.621 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo api_asio 2024-02-09T08:04:09.621 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -f /etc/bashrc ']' 2024-02-09T08:04:09.621 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-09T08:04:09.621 INFO:tasks.workunit.client.0.smithi062.stderr:+ . /etc/bashrc 2024-02-09T08:04:09.621 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -z '' ']' 2024-02-09T08:04:09.621 INFO:tasks.workunit.client.0.smithi062.stderr:++ BASHRCSOURCED=Y 2024-02-09T08:04:09.621 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.621 INFO:tasks.workunit.client.0.smithi062.stderr:++ shopt -q login_shell 2024-02-09T08:04:09.621 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'grep=grep --color=auto' 2024-02-09T08:04:09.621 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-09T08:04:09.621 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-09T08:04:09.621 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-09T08:04:09.622 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-09T08:04:09.622 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.622 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-09T08:04:09.622 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-09T08:04:09.622 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.622 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorls.sh 2024-02-09T08:04:09.622 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.622 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-09T08:04:09.622 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' '!' -t 0 ']' 2024-02-09T08:04:09.622 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.622 INFO:tasks.workunit.client.0.smithi062.stderr:+++ return 2024-02-09T08:04:09.622 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-09T08:04:09.622 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.622 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-09T08:04:09.622 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.623 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-09T08:04:09.623 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-09T08:04:09.623 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export S_COLORS=auto 2024-02-09T08:04:09.623 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-09T08:04:09.623 INFO:tasks.workunit.client.0.smithi062.stderr:+++ S_COLORS=auto 2024-02-09T08:04:09.623 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.623 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.623 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-09T08:04:09.623 INFO:tasks.workunit.client.0.smithi062.stderr:+++ umask 2024-02-09T08:04:09.623 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.623 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-09T08:04:09.623 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.623 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-09T08:04:09.623 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-09T08:04:09.623 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.624 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-09T08:04:09.624 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.624 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-09T08:04:09.624 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' 0022 -eq 0 ']' 2024-02-09T08:04:09.624 INFO:tasks.workunit.client.0.smithi062.stderr:++ SHELL=/bin/bash 2024-02-09T08:04:09.624 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-09T08:04:09.624 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.624 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-09T08:04:09.624 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.624 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.624 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-09T08:04:09.624 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/gawk.sh 2024-02-09T08:04:09.624 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.624 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-09T08:04:09.624 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.625 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-09T08:04:09.625 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-09T08:04:09.625 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.625 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/lang.sh 2024-02-09T08:04:09.625 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.625 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-09T08:04:09.625 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.625 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-09T08:04:09.625 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup 2024-02-09T08:04:09.625 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:09.625 INFO:tasks.workunit.client.0.smithi062.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:09.625 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.625 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-09T08:04:09.625 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.625 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-09T08:04:09.626 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.626 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/locale 2024-02-09T08:04:09.626 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=api_asio 2024-02-09T08:04:09.626 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:09.626 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-09T08:04:09.626 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:09.626 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-09T08:04:09.626 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-09T08:04:09.626 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=40866 2024-02-09T08:04:09.626 INFO:tasks.workunit.client.0.smithi062.stdout:test api_asio on pid 40866 2024-02-09T08:04:09.634 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test api_asio on pid 40866' 2024-02-09T08:04:09.635 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=40866 2024-02-09T08:04:09.635 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-09T08:04:09.635 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-09T08:04:09.635 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_asio --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_asio.xml 2>&1 | tee ceph_test_rados_api_asio.log | sed "s/^/ api_asio: /"' 2024-02-09T08:04:09.635 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-09T08:04:09.635 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s api_list 2024-02-09T08:04:09.635 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' api_list' 2024-02-09T08:04:09.635 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo api_list 2024-02-09T08:04:09.635 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-09T08:04:09.635 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-09T08:04:09.635 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-09T08:04:09.635 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.635 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-09T08:04:09.635 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.636 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-09T08:04:09.636 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-09T08:04:09.636 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-09T08:04:09.636 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-09T08:04:09.636 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.636 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-09T08:04:09.636 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-09T08:04:09.636 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.636 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-09T08:04:09.636 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.636 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-09T08:04:09.636 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-09T08:04:09.636 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.636 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-09T08:04:09.637 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.637 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/gawk.sh 2024-02-09T08:04:09.637 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'grep=grep --color=auto' 2024-02-09T08:04:09.637 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-09T08:04:09.637 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -f /etc/bashrc ']' 2024-02-09T08:04:09.637 INFO:tasks.workunit.client.0.smithi062.stderr:+ . /etc/bashrc 2024-02-09T08:04:09.637 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-09T08:04:09.637 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.637 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.637 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-09T08:04:09.637 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-09T08:04:09.637 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.637 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/lang.sh 2024-02-09T08:04:09.637 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.637 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorls.sh 2024-02-09T08:04:09.638 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup 2024-02-09T08:04:09.638 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' '!' -t 0 ']' 2024-02-09T08:04:09.638 INFO:tasks.workunit.client.0.smithi062.stderr:+++ return 2024-02-09T08:04:09.638 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.638 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-09T08:04:09.638 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.638 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-09T08:04:09.638 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -z '' ']' 2024-02-09T08:04:09.638 INFO:tasks.workunit.client.0.smithi062.stderr:++ BASHRCSOURCED=Y 2024-02-09T08:04:09.638 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.638 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export S_COLORS=auto 2024-02-09T08:04:09.638 INFO:tasks.workunit.client.0.smithi062.stderr:++ shopt -q login_shell 2024-02-09T08:04:09.638 INFO:tasks.workunit.client.0.smithi062.stderr:+++ S_COLORS=auto 2024-02-09T08:04:09.638 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.638 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-09T08:04:09.639 INFO:tasks.workunit.client.0.smithi062.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-09T08:04:09.639 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.639 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-09T08:04:09.639 INFO:tasks.workunit.client.0.smithi062.stderr:++++ export LANG=en_US.UTF-8 2024-02-09T08:04:09.639 INFO:tasks.workunit.client.0.smithi062.stderr:++++ LANG=en_US.UTF-8 2024-02-09T08:04:09.639 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.639 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:09.639 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-09T08:04:09.639 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:09.639 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/locale 2024-02-09T08:04:09.639 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG=en_US.UTF-8 2024-02-09T08:04:09.639 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup config 2024-02-09T08:04:09.639 INFO:tasks.workunit.client.0.smithi062.stderr:+++ umask 2024-02-09T08:04:09.639 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:09.639 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:09.639 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' dumb = linux ']' 2024-02-09T08:04:09.640 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' 0022 -eq 0 ']' 2024-02-09T08:04:09.640 INFO:tasks.workunit.client.0.smithi062.stderr:++ SHELL=/bin/bash 2024-02-09T08:04:09.640 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.640 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.640 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-09T08:04:09.640 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.640 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/less.sh 2024-02-09T08:04:09.640 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-09T08:04:09.640 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-09T08:04:09.640 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.640 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-09T08:04:09.640 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.640 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/which2.sh 2024-02-09T08:04:09.640 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.641 INFO:tasks.workunit.client.0.smithi062.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-09T08:04:09.641 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-09T08:04:09.641 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-09T08:04:09.641 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.641 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-09T08:04:09.641 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.641 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-09T08:04:09.641 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:09.641 INFO:tasks.workunit.client.0.smithi062.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:09.641 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.641 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-09T08:04:09.641 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.641 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-09T08:04:09.641 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.641 INFO:tasks.workunit.client.0.smithi062.stderr:+++++ readlink /proc/40823/exe 2024-02-09T08:04:09.642 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:09.642 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-09T08:04:09.642 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:09.642 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-09T08:04:09.642 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-09T08:04:09.642 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=api_list 2024-02-09T08:04:09.642 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=40884 2024-02-09T08:04:09.642 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-09T08:04:09.642 INFO:tasks.workunit.client.0.smithi062.stdout:test api_list on pid 40884 2024-02-09T08:04:09.649 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test api_list on pid 40884' 2024-02-09T08:04:09.649 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=40884 2024-02-09T08:04:09.649 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_list --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_list.xml 2>&1 | tee ceph_test_rados_api_list.log | sed "s/^/ api_list: /"' 2024-02-09T08:04:09.649 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-09T08:04:09.650 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-09T08:04:09.650 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s api_lock 2024-02-09T08:04:09.650 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' api_lock' 2024-02-09T08:04:09.650 INFO:tasks.workunit.client.0.smithi062.stderr:++++ basename /usr/bin/bash 2024-02-09T08:04:09.650 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-09T08:04:09.650 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-09T08:04:09.650 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-09T08:04:09.650 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.650 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-09T08:04:09.650 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.650 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-09T08:04:09.650 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-09T08:04:09.650 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.650 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-09T08:04:09.650 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.651 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/gawk.sh 2024-02-09T08:04:09.651 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.651 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-09T08:04:09.651 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-09T08:04:09.651 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo api_lock 2024-02-09T08:04:09.651 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.651 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/lang.sh 2024-02-09T08:04:09.651 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-09T08:04:09.651 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-09T08:04:09.651 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup 2024-02-09T08:04:09.651 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-09T08:04:09.651 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.651 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-09T08:04:09.651 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.652 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-09T08:04:09.652 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-09T08:04:09.652 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_declare='declare -f' 2024-02-09T08:04:09.652 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_opt=-f 2024-02-09T08:04:09.652 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export which_declare 2024-02-09T08:04:09.652 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.652 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export -f which 2024-02-09T08:04:09.652 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/locale 2024-02-09T08:04:09.652 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset i 2024-02-09T08:04:09.652 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -f /etc/bashrc ']' 2024-02-09T08:04:09.652 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset -f pathmunge 2024-02-09T08:04:09.652 INFO:tasks.workunit.client.0.smithi062.stderr:+ . /etc/bashrc 2024-02-09T08:04:09.652 INFO:tasks.workunit.client.0.smithi062.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-09T08:04:09.652 INFO:tasks.workunit.client.0.smithi062.stderr:+ export PATH 2024-02-09T08:04:09.652 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-09T08:04:09.653 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -z '' ']' 2024-02-09T08:04:09.653 INFO:tasks.workunit.client.0.smithi062.stderr:++ BASHRCSOURCED=Y 2024-02-09T08:04:09.653 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.653 INFO:tasks.workunit.client.0.smithi062.stderr:++ shopt -q login_shell 2024-02-09T08:04:09.653 INFO:tasks.workunit.client.0.smithi062.stderr:+ unset rc 2024-02-09T08:04:09.653 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'grep=grep --color=auto' 2024-02-09T08:04:09.653 INFO:tasks.workunit.client.0.smithi062.stderr:+++ umask 2024-02-09T08:04:09.653 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-09T08:04:09.653 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-09T08:04:09.653 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.653 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_api_aio --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_aio.xml 2024-02-09T08:04:09.653 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-09T08:04:09.653 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.653 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorls.sh 2024-02-09T08:04:09.653 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' '!' -t 0 ']' 2024-02-09T08:04:09.654 INFO:tasks.workunit.client.0.smithi062.stderr:+++ return 2024-02-09T08:04:09.654 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.654 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-09T08:04:09.654 INFO:tasks.workunit.client.0.smithi062.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-09T08:04:09.654 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.654 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-09T08:04:09.654 INFO:tasks.workunit.client.0.smithi062.stderr:++++ export LANG=en_US.UTF-8 2024-02-09T08:04:09.654 INFO:tasks.workunit.client.0.smithi062.stderr:++++ LANG=en_US.UTF-8 2024-02-09T08:04:09.654 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export S_COLORS=auto 2024-02-09T08:04:09.654 INFO:tasks.workunit.client.0.smithi062.stderr:+++ S_COLORS=auto 2024-02-09T08:04:09.654 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.654 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:09.654 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-09T08:04:09.654 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-09T08:04:09.654 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.655 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-09T08:04:09.655 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:09.655 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG=en_US.UTF-8 2024-02-09T08:04:09.655 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.655 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup config 2024-02-09T08:04:09.655 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:09.655 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_api_aio.log 2024-02-09T08:04:09.655 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:09.655 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:09.655 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' dumb = linux ']' 2024-02-09T08:04:09.655 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' 0022 -eq 0 ']' 2024-02-09T08:04:09.655 INFO:tasks.workunit.client.0.smithi062.stderr:++ SHELL=/bin/bash 2024-02-09T08:04:09.655 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.655 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-09T08:04:09.655 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.655 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/less.sh 2024-02-09T08:04:09.656 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.656 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-09T08:04:09.656 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.656 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-09T08:04:09.656 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-09T08:04:09.656 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.656 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.656 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-09T08:04:09.656 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/which2.sh 2024-02-09T08:04:09.656 INFO:tasks.workunit.client.0.smithi062.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-09T08:04:09.656 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-09T08:04:09.656 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.656 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-09T08:04:09.656 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.657 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-09T08:04:09.657 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:09.657 INFO:tasks.workunit.client.0.smithi062.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:09.657 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.657 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-09T08:04:09.657 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.657 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-09T08:04:09.657 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.657 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-09T08:04:09.657 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ api_aio: /' 2024-02-09T08:04:09.657 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:09.657 INFO:tasks.workunit.client.0.smithi062.stderr:+++++ readlink /proc/40830/exe 2024-02-09T08:04:09.657 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-09T08:04:09.657 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-09T08:04:09.657 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=api_lock 2024-02-09T08:04:09.658 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-09T08:04:09.658 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=40903 2024-02-09T08:04:09.658 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test api_lock on pid 40903' 2024-02-09T08:04:09.658 INFO:tasks.workunit.client.0.smithi062.stdout:test api_lock on pid 40903 2024-02-09T08:04:09.666 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_lock.xml 2>&1 | tee ceph_test_rados_api_lock.log | sed "s/^/ api_lock: /"' 2024-02-09T08:04:09.666 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=40903 2024-02-09T08:04:09.666 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-09T08:04:09.667 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-09T08:04:09.667 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-09T08:04:09.667 INFO:tasks.workunit.client.0.smithi062.stderr:++++ basename /usr/bin/bash 2024-02-09T08:04:09.667 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s api_lock_pp 2024-02-09T08:04:09.667 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-09T08:04:09.667 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-09T08:04:09.667 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.667 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' api_lock_pp' 2024-02-09T08:04:09.667 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-09T08:04:09.667 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.667 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-09T08:04:09.667 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-09T08:04:09.667 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.667 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-09T08:04:09.667 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.668 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/gawk.sh 2024-02-09T08:04:09.668 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.668 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-09T08:04:09.668 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.668 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/lang.sh 2024-02-09T08:04:09.668 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo api_lock_pp 2024-02-09T08:04:09.668 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup 2024-02-09T08:04:09.668 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_declare='declare -f' 2024-02-09T08:04:09.668 INFO:tasks.workunit.client.0.smithi062.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-09T08:04:09.668 INFO:tasks.workunit.client.0.smithi062.stderr:++++ export LANG=en_US.UTF-8 2024-02-09T08:04:09.668 INFO:tasks.workunit.client.0.smithi062.stderr:++++ LANG=en_US.UTF-8 2024-02-09T08:04:09.668 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:09.668 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_opt=-f 2024-02-09T08:04:09.668 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -f /etc/bashrc ']' 2024-02-09T08:04:09.669 INFO:tasks.workunit.client.0.smithi062.stderr:+ . /etc/bashrc 2024-02-09T08:04:09.669 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export which_declare 2024-02-09T08:04:09.669 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-09T08:04:09.669 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export -f which 2024-02-09T08:04:09.669 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset i 2024-02-09T08:04:09.669 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-09T08:04:09.669 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-09T08:04:09.669 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-09T08:04:09.669 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:09.669 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG=en_US.UTF-8 2024-02-09T08:04:09.669 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.669 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-09T08:04:09.669 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup config 2024-02-09T08:04:09.669 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.669 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-09T08:04:09.669 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/locale 2024-02-09T08:04:09.670 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:09.670 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-09T08:04:09.670 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -z '' ']' 2024-02-09T08:04:09.670 INFO:tasks.workunit.client.0.smithi062.stderr:++ BASHRCSOURCED=Y 2024-02-09T08:04:09.670 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-09T08:04:09.670 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.670 INFO:tasks.workunit.client.0.smithi062.stderr:++ shopt -q login_shell 2024-02-09T08:04:09.670 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.670 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset -f pathmunge 2024-02-09T08:04:09.670 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:09.670 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' dumb = linux ']' 2024-02-09T08:04:09.670 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.670 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-09T08:04:09.670 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.670 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/less.sh 2024-02-09T08:04:09.671 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-09T08:04:09.671 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.671 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-09T08:04:09.671 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.671 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/which2.sh 2024-02-09T08:04:09.671 INFO:tasks.workunit.client.0.smithi062.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-09T08:04:09.671 INFO:tasks.workunit.client.0.smithi062.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-09T08:04:09.671 INFO:tasks.workunit.client.0.smithi062.stderr:+++ umask 2024-02-09T08:04:09.671 INFO:tasks.workunit.client.0.smithi062.stderr:+ export PATH 2024-02-09T08:04:09.671 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-09T08:04:09.671 INFO:tasks.workunit.client.0.smithi062.stderr:+ unset rc 2024-02-09T08:04:09.671 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' 0022 -eq 0 ']' 2024-02-09T08:04:09.671 INFO:tasks.workunit.client.0.smithi062.stderr:++ SHELL=/bin/bash 2024-02-09T08:04:09.671 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_api_aio_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_aio_pp.xml 2024-02-09T08:04:09.671 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.672 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-09T08:04:09.672 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.672 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-09T08:04:09.672 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ api_aio_pp: /' 2024-02-09T08:04:09.672 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_api_aio_pp.log 2024-02-09T08:04:09.672 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-09T08:04:09.672 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.672 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:09.672 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-09T08:04:09.672 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-09T08:04:09.672 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:09.672 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-09T08:04:09.672 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-09T08:04:09.672 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.673 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-09T08:04:09.673 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:09.673 INFO:tasks.workunit.client.0.smithi062.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:09.673 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.673 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-09T08:04:09.673 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.673 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-09T08:04:09.673 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.673 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-09T08:04:09.673 INFO:tasks.workunit.client.0.smithi062.stderr:+++++ readlink /proc/40839/exe 2024-02-09T08:04:09.673 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'grep=grep --color=auto' 2024-02-09T08:04:09.673 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=api_lock_pp 2024-02-09T08:04:09.673 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-09T08:04:09.673 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=40922 2024-02-09T08:04:09.673 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-09T08:04:09.674 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.674 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-09T08:04:09.674 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.674 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorls.sh 2024-02-09T08:04:09.674 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' '!' -t 0 ']' 2024-02-09T08:04:09.674 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test api_lock_pp on pid 40922' 2024-02-09T08:04:09.674 INFO:tasks.workunit.client.0.smithi062.stderr:+++ return 2024-02-09T08:04:09.674 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.674 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-09T08:04:09.674 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.674 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-09T08:04:09.675 INFO:tasks.workunit.client.0.smithi062.stdout:test api_lock_pp on pid 40922 2024-02-09T08:04:09.685 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export S_COLORS=auto 2024-02-09T08:04:09.686 INFO:tasks.workunit.client.0.smithi062.stderr:+++ S_COLORS=auto 2024-02-09T08:04:09.686 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.686 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-09T08:04:09.686 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.686 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-09T08:04:09.686 INFO:tasks.workunit.client.0.smithi062.stderr:++++ basename /usr/bin/bash 2024-02-09T08:04:09.686 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.686 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=40922 2024-02-09T08:04:09.686 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-09T08:04:09.686 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-09T08:04:09.686 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-09T08:04:09.686 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-09T08:04:09.686 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-09T08:04:09.686 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_lock_pp.xml 2>&1 | tee ceph_test_rados_api_lock_pp.log | sed "s/^/ api_lock_pp: /"' 2024-02-09T08:04:09.687 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.687 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-09T08:04:09.687 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.687 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-09T08:04:09.687 INFO:tasks.workunit.client.0.smithi062.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-09T08:04:09.687 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-09T08:04:09.687 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s api_misc 2024-02-09T08:04:09.687 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.687 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-09T08:04:09.687 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.687 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/gawk.sh 2024-02-09T08:04:09.687 INFO:tasks.workunit.client.0.smithi062.stderr:++++ export LANG=en_US.UTF-8 2024-02-09T08:04:09.687 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.687 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-09T08:04:09.687 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.688 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/lang.sh 2024-02-09T08:04:09.688 INFO:tasks.workunit.client.0.smithi062.stderr:++++ LANG=en_US.UTF-8 2024-02-09T08:04:09.688 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup 2024-02-09T08:04:09.688 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' api_misc' 2024-02-09T08:04:09.688 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:09.688 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-09T08:04:09.688 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:09.688 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG=en_US.UTF-8 2024-02-09T08:04:09.688 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup config 2024-02-09T08:04:09.688 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/locale 2024-02-09T08:04:09.688 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:09.688 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_declare='declare -f' 2024-02-09T08:04:09.688 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_opt=-f 2024-02-09T08:04:09.688 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export which_declare 2024-02-09T08:04:09.689 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export -f which 2024-02-09T08:04:09.689 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset i 2024-02-09T08:04:09.689 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset -f pathmunge 2024-02-09T08:04:09.689 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:09.689 INFO:tasks.workunit.client.0.smithi062.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-09T08:04:09.689 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo api_misc 2024-02-09T08:04:09.689 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' dumb = linux ']' 2024-02-09T08:04:09.689 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.689 INFO:tasks.workunit.client.0.smithi062.stderr:+ export PATH 2024-02-09T08:04:09.689 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-09T08:04:09.689 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-09T08:04:09.689 INFO:tasks.workunit.client.0.smithi062.stderr:+ unset rc 2024-02-09T08:04:09.689 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.689 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/less.sh 2024-02-09T08:04:09.689 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-09T08:04:09.689 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.690 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-09T08:04:09.690 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_api_io --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_io.xml 2024-02-09T08:04:09.690 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.690 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -f /etc/bashrc ']' 2024-02-09T08:04:09.690 INFO:tasks.workunit.client.0.smithi062.stderr:+ . /etc/bashrc 2024-02-09T08:04:09.690 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/which2.sh 2024-02-09T08:04:09.690 INFO:tasks.workunit.client.0.smithi062.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-09T08:04:09.690 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -z '' ']' 2024-02-09T08:04:09.690 INFO:tasks.workunit.client.0.smithi062.stderr:++ BASHRCSOURCED=Y 2024-02-09T08:04:09.690 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.690 INFO:tasks.workunit.client.0.smithi062.stderr:++ shopt -q login_shell 2024-02-09T08:04:09.690 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ api_io: /' 2024-02-09T08:04:09.690 INFO:tasks.workunit.client.0.smithi062.stderr:+++ umask 2024-02-09T08:04:09.690 INFO:tasks.workunit.client.0.smithi062.stderr:+++++ readlink /proc/40851/exe 2024-02-09T08:04:09.691 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'grep=grep --color=auto' 2024-02-09T08:04:09.691 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-09T08:04:09.691 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-09T08:04:09.691 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.691 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-09T08:04:09.691 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.691 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorls.sh 2024-02-09T08:04:09.691 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' 0022 -eq 0 ']' 2024-02-09T08:04:09.691 INFO:tasks.workunit.client.0.smithi062.stderr:++ SHELL=/bin/bash 2024-02-09T08:04:09.691 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' '!' -t 0 ']' 2024-02-09T08:04:09.691 INFO:tasks.workunit.client.0.smithi062.stderr:+++ return 2024-02-09T08:04:09.691 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.691 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-09T08:04:09.691 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.691 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-09T08:04:09.692 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.692 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export S_COLORS=auto 2024-02-09T08:04:09.692 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-09T08:04:09.692 INFO:tasks.workunit.client.0.smithi062.stderr:+++ S_COLORS=auto 2024-02-09T08:04:09.692 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.692 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.692 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-09T08:04:09.692 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-09T08:04:09.692 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.692 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-09T08:04:09.692 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.692 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-09T08:04:09.692 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.692 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-09T08:04:09.692 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.693 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-09T08:04:09.693 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:09.693 INFO:tasks.workunit.client.0.smithi062.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:09.693 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.693 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-09T08:04:09.693 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.693 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-09T08:04:09.693 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.693 INFO:tasks.workunit.client.0.smithi062.stderr:++++ basename /usr/bin/bash 2024-02-09T08:04:09.693 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-09T08:04:09.693 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-09T08:04:09.693 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-09T08:04:09.693 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-09T08:04:09.693 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.693 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-09T08:04:09.694 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.694 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-09T08:04:09.694 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-09T08:04:09.694 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.694 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_api_io.log 2024-02-09T08:04:09.694 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_declare='declare -f' 2024-02-09T08:04:09.694 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_opt=-f 2024-02-09T08:04:09.694 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export which_declare 2024-02-09T08:04:09.694 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export -f which 2024-02-09T08:04:09.694 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset i 2024-02-09T08:04:09.694 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset -f pathmunge 2024-02-09T08:04:09.694 INFO:tasks.workunit.client.0.smithi062.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-09T08:04:09.694 INFO:tasks.workunit.client.0.smithi062.stderr:+ export PATH 2024-02-09T08:04:09.694 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-09T08:04:09.694 INFO:tasks.workunit.client.0.smithi062.stderr:+ unset rc 2024-02-09T08:04:09.695 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:09.695 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-09T08:04:09.695 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:09.695 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-09T08:04:09.695 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-09T08:04:09.695 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_api_io_pp.log 2024-02-09T08:04:09.695 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-09T08:04:09.695 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ api_io_pp: /' 2024-02-09T08:04:09.695 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=api_misc 2024-02-09T08:04:09.695 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=40947 2024-02-09T08:04:09.695 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-09T08:04:09.696 INFO:tasks.workunit.client.0.smithi062.stdout:test api_misc on pid 40947 2024-02-09T08:04:09.703 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test api_misc on pid 40947' 2024-02-09T08:04:09.703 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=40947 2024-02-09T08:04:09.703 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-09T08:04:09.703 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-09T08:04:09.703 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-09T08:04:09.703 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_api_io_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_io_pp.xml 2024-02-09T08:04:09.703 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-09T08:04:09.703 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.704 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-09T08:04:09.704 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.704 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-09T08:04:09.704 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-09T08:04:09.704 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.704 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s api_misc_pp 2024-02-09T08:04:09.704 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_misc.xml 2>&1 | tee ceph_test_rados_api_misc.log | sed "s/^/ api_misc: /"' 2024-02-09T08:04:09.704 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' api_misc_pp' 2024-02-09T08:04:09.704 INFO:tasks.workunit.client.0.smithi062.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-09T08:04:09.704 INFO:tasks.workunit.client.0.smithi062.stderr:++++ export LANG=en_US.UTF-8 2024-02-09T08:04:09.704 INFO:tasks.workunit.client.0.smithi062.stderr:++++ LANG=en_US.UTF-8 2024-02-09T08:04:09.704 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:09.704 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-09T08:04:09.705 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:09.705 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG=en_US.UTF-8 2024-02-09T08:04:09.705 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup config 2024-02-09T08:04:09.705 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:09.705 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-09T08:04:09.705 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-09T08:04:09.705 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-09T08:04:09.705 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.705 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-09T08:04:09.705 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.705 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-09T08:04:09.705 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:09.705 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-09T08:04:09.705 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.705 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-09T08:04:09.706 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.706 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/gawk.sh 2024-02-09T08:04:09.706 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' dumb = linux ']' 2024-02-09T08:04:09.706 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.706 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.706 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-09T08:04:09.706 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.706 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/lang.sh 2024-02-09T08:04:09.706 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-09T08:04:09.706 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup 2024-02-09T08:04:09.706 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.706 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -f /etc/bashrc ']' 2024-02-09T08:04:09.706 INFO:tasks.workunit.client.0.smithi062.stderr:+ . /etc/bashrc 2024-02-09T08:04:09.706 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/less.sh 2024-02-09T08:04:09.706 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-09T08:04:09.706 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -z '' ']' 2024-02-09T08:04:09.707 INFO:tasks.workunit.client.0.smithi062.stderr:++ BASHRCSOURCED=Y 2024-02-09T08:04:09.707 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.707 INFO:tasks.workunit.client.0.smithi062.stderr:++ shopt -q login_shell 2024-02-09T08:04:09.707 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.707 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/locale 2024-02-09T08:04:09.707 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-09T08:04:09.707 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.707 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/which2.sh 2024-02-09T08:04:09.707 INFO:tasks.workunit.client.0.smithi062.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-09T08:04:09.707 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-09T08:04:09.707 INFO:tasks.workunit.client.0.smithi062.stderr:+++ umask 2024-02-09T08:04:09.707 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' 0022 -eq 0 ']' 2024-02-09T08:04:09.707 INFO:tasks.workunit.client.0.smithi062.stderr:++ SHELL=/bin/bash 2024-02-09T08:04:09.707 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.707 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo api_misc_pp 2024-02-09T08:04:09.708 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-09T08:04:09.708 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.708 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-09T08:04:09.708 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-09T08:04:09.708 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.708 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-09T08:04:09.708 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:09.708 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-09T08:04:09.708 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.708 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:09.708 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-09T08:04:09.708 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-09T08:04:09.708 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-09T08:04:09.708 INFO:tasks.workunit.client.0.smithi062.stderr:+++++ readlink /proc/40866/exe 2024-02-09T08:04:09.709 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:09.709 INFO:tasks.workunit.client.0.smithi062.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:09.709 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.709 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-09T08:04:09.709 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.709 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-09T08:04:09.709 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.709 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-09T08:04:09.709 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=api_misc_pp 2024-02-09T08:04:09.709 INFO:tasks.workunit.client.0.smithi062.stderr:++++ basename /usr/bin/bash 2024-02-09T08:04:09.709 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=40962 2024-02-09T08:04:09.709 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test api_misc_pp on pid 40962' 2024-02-09T08:04:09.710 INFO:tasks.workunit.client.0.smithi062.stdout:test api_misc_pp on pid 40962 2024-02-09T08:04:09.715 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=40962 2024-02-09T08:04:09.715 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-09T08:04:09.716 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-09T08:04:09.716 INFO:tasks.workunit.client.0.smithi062.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-09T08:04:09.716 INFO:tasks.workunit.client.0.smithi062.stderr:++++ export LANG=en_US.UTF-8 2024-02-09T08:04:09.716 INFO:tasks.workunit.client.0.smithi062.stderr:++++ LANG=en_US.UTF-8 2024-02-09T08:04:09.716 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:09.716 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s api_tier_pp 2024-02-09T08:04:09.716 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_declare='declare -f' 2024-02-09T08:04:09.716 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-09T08:04:09.716 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:09.716 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG=en_US.UTF-8 2024-02-09T08:04:09.716 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup config 2024-02-09T08:04:09.716 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_opt=-f 2024-02-09T08:04:09.716 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' api_tier_pp' 2024-02-09T08:04:09.716 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export which_declare 2024-02-09T08:04:09.717 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export -f which 2024-02-09T08:04:09.717 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:09.717 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset i 2024-02-09T08:04:09.717 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset -f pathmunge 2024-02-09T08:04:09.717 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:09.717 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' dumb = linux ']' 2024-02-09T08:04:09.717 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.717 INFO:tasks.workunit.client.0.smithi062.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-09T08:04:09.717 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-09T08:04:09.717 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.717 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/less.sh 2024-02-09T08:04:09.717 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-09T08:04:09.717 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.717 INFO:tasks.workunit.client.0.smithi062.stderr:+ export PATH 2024-02-09T08:04:09.717 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-09T08:04:09.718 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.718 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/which2.sh 2024-02-09T08:04:09.718 INFO:tasks.workunit.client.0.smithi062.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-09T08:04:09.718 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-09T08:04:09.718 INFO:tasks.workunit.client.0.smithi062.stderr:+ unset rc 2024-02-09T08:04:09.718 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo api_tier_pp 2024-02-09T08:04:09.718 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_api_asio --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_asio.xml 2024-02-09T08:04:09.718 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_api_asio.log 2024-02-09T08:04:09.718 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'grep=grep --color=auto' 2024-02-09T08:04:09.718 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-09T08:04:09.718 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-09T08:04:09.718 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-09T08:04:09.718 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.718 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ api_asio: /' 2024-02-09T08:04:09.718 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-09T08:04:09.719 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.719 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorls.sh 2024-02-09T08:04:09.719 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' '!' -t 0 ']' 2024-02-09T08:04:09.719 INFO:tasks.workunit.client.0.smithi062.stderr:+++ return 2024-02-09T08:04:09.719 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.719 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-09T08:04:09.719 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.719 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-09T08:04:09.719 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export S_COLORS=auto 2024-02-09T08:04:09.719 INFO:tasks.workunit.client.0.smithi062.stderr:+++ S_COLORS=auto 2024-02-09T08:04:09.719 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.719 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-09T08:04:09.719 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.719 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-09T08:04:09.720 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.720 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_misc_pp.xml 2>&1 | tee ceph_test_rados_api_misc_pp.log | sed "s/^/ api_misc_pp: /"' 2024-02-09T08:04:09.720 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -f /etc/bashrc ']' 2024-02-09T08:04:09.720 INFO:tasks.workunit.client.0.smithi062.stderr:+ . /etc/bashrc 2024-02-09T08:04:09.720 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -z '' ']' 2024-02-09T08:04:09.720 INFO:tasks.workunit.client.0.smithi062.stderr:++ BASHRCSOURCED=Y 2024-02-09T08:04:09.720 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.720 INFO:tasks.workunit.client.0.smithi062.stderr:++ shopt -q login_shell 2024-02-09T08:04:09.720 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=api_tier_pp 2024-02-09T08:04:09.720 INFO:tasks.workunit.client.0.smithi062.stderr:+++++ readlink /proc/40884/exe 2024-02-09T08:04:09.720 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=40976 2024-02-09T08:04:09.720 INFO:tasks.workunit.client.0.smithi062.stdout:test api_tier_pp on pid 40976 2024-02-09T08:04:09.746 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test api_tier_pp on pid 40976' 2024-02-09T08:04:09.746 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=40976 2024-02-09T08:04:09.746 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-09T08:04:09.746 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-09T08:04:09.747 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s api_pool 2024-02-09T08:04:09.747 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_tier_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_tier_pp.xml 2>&1 | tee ceph_test_rados_api_tier_pp.log | sed "s/^/ api_tier_pp: /"' 2024-02-09T08:04:09.747 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-09T08:04:09.747 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-09T08:04:09.747 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' api_pool' 2024-02-09T08:04:09.747 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-09T08:04:09.747 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.747 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-09T08:04:09.747 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.747 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-09T08:04:09.747 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-09T08:04:09.747 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.747 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo api_pool 2024-02-09T08:04:09.747 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -f /etc/bashrc ']' 2024-02-09T08:04:09.747 INFO:tasks.workunit.client.0.smithi062.stderr:++++ basename /usr/bin/bash 2024-02-09T08:04:09.748 INFO:tasks.workunit.client.0.smithi062.stderr:+ . /etc/bashrc 2024-02-09T08:04:09.748 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -z '' ']' 2024-02-09T08:04:09.748 INFO:tasks.workunit.client.0.smithi062.stderr:++ BASHRCSOURCED=Y 2024-02-09T08:04:09.748 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.748 INFO:tasks.workunit.client.0.smithi062.stderr:++ shopt -q login_shell 2024-02-09T08:04:09.748 INFO:tasks.workunit.client.0.smithi062.stderr:+++ umask 2024-02-09T08:04:09.748 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_declare='declare -f' 2024-02-09T08:04:09.748 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_opt=-f 2024-02-09T08:04:09.748 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' 0022 -eq 0 ']' 2024-02-09T08:04:09.748 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export which_declare 2024-02-09T08:04:09.748 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export -f which 2024-02-09T08:04:09.748 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset i 2024-02-09T08:04:09.748 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset -f pathmunge 2024-02-09T08:04:09.749 INFO:tasks.workunit.client.0.smithi062.stderr:++ SHELL=/bin/bash 2024-02-09T08:04:09.749 INFO:tasks.workunit.client.0.smithi062.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-09T08:04:09.749 INFO:tasks.workunit.client.0.smithi062.stderr:+ export PATH 2024-02-09T08:04:09.749 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.749 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-09T08:04:09.749 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.749 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-09T08:04:09.749 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-09T08:04:09.749 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-09T08:04:09.749 INFO:tasks.workunit.client.0.smithi062.stderr:+ unset rc 2024-02-09T08:04:09.749 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.749 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-09T08:04:09.749 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.749 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-09T08:04:09.750 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:09.750 INFO:tasks.workunit.client.0.smithi062.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:09.750 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.750 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-09T08:04:09.750 INFO:tasks.workunit.client.0.smithi062.stderr:+++ umask 2024-02-09T08:04:09.750 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.750 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ api_list: /' 2024-02-09T08:04:09.750 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-09T08:04:09.750 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.750 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' 0022 -eq 0 ']' 2024-02-09T08:04:09.750 INFO:tasks.workunit.client.0.smithi062.stderr:++ SHELL=/bin/bash 2024-02-09T08:04:09.750 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.750 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-09T08:04:09.750 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.750 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-09T08:04:09.751 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-09T08:04:09.751 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.751 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-09T08:04:09.751 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.751 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-09T08:04:09.751 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:09.751 INFO:tasks.workunit.client.0.smithi062.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:09.751 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.751 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-09T08:04:09.751 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.751 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-09T08:04:09.751 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.751 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'grep=grep --color=auto' 2024-02-09T08:04:09.751 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-09T08:04:09.751 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-09T08:04:09.752 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.752 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-09T08:04:09.752 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.752 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-09T08:04:09.752 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorls.sh 2024-02-09T08:04:09.752 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-09T08:04:09.752 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-09T08:04:09.752 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.752 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-09T08:04:09.752 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.752 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-09T08:04:09.752 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-09T08:04:09.752 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.752 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-09T08:04:09.752 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.753 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/gawk.sh 2024-02-09T08:04:09.753 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' '!' -t 0 ']' 2024-02-09T08:04:09.753 INFO:tasks.workunit.client.0.smithi062.stderr:+++ return 2024-02-09T08:04:09.753 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.753 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.753 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-09T08:04:09.753 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.753 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/lang.sh 2024-02-09T08:04:09.753 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-09T08:04:09.753 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup 2024-02-09T08:04:09.753 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.753 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-09T08:04:09.753 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export S_COLORS=auto 2024-02-09T08:04:09.753 INFO:tasks.workunit.client.0.smithi062.stderr:+++ S_COLORS=auto 2024-02-09T08:04:09.753 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.754 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-09T08:04:09.754 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.754 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-09T08:04:09.754 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.754 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'grep=grep --color=auto' 2024-02-09T08:04:09.754 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-09T08:04:09.754 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-09T08:04:09.754 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.754 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-09T08:04:09.754 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.754 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorls.sh 2024-02-09T08:04:09.754 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' '!' -t 0 ']' 2024-02-09T08:04:09.754 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/locale 2024-02-09T08:04:09.754 INFO:tasks.workunit.client.0.smithi062.stderr:+++ return 2024-02-09T08:04:09.754 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.755 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-09T08:04:09.755 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.755 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'grep=grep --color=auto' 2024-02-09T08:04:09.755 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-09T08:04:09.755 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-09T08:04:09.755 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export S_COLORS=auto 2024-02-09T08:04:09.755 INFO:tasks.workunit.client.0.smithi062.stderr:+++ S_COLORS=auto 2024-02-09T08:04:09.755 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.755 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-09T08:04:09.755 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.755 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-09T08:04:09.755 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.755 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-09T08:04:09.755 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.755 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-09T08:04:09.756 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.756 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorls.sh 2024-02-09T08:04:09.756 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' '!' -t 0 ']' 2024-02-09T08:04:09.756 INFO:tasks.workunit.client.0.smithi062.stderr:+++ return 2024-02-09T08:04:09.756 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.756 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-09T08:04:09.756 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.756 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-09T08:04:09.756 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export S_COLORS=auto 2024-02-09T08:04:09.756 INFO:tasks.workunit.client.0.smithi062.stderr:+++ S_COLORS=auto 2024-02-09T08:04:09.756 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.756 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-09T08:04:09.756 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.756 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-09T08:04:09.756 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.757 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:09.757 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-09T08:04:09.757 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:09.757 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_api_list --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_list.xml 2024-02-09T08:04:09.757 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-09T08:04:09.757 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-09T08:04:09.757 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-09T08:04:09.757 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-09T08:04:09.757 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-09T08:04:09.757 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.757 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-09T08:04:09.757 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.757 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-09T08:04:09.757 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-09T08:04:09.758 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.758 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-09T08:04:09.758 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-09T08:04:09.758 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-09T08:04:09.758 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.758 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-09T08:04:09.758 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.758 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-09T08:04:09.758 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-09T08:04:09.758 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.758 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-09T08:04:09.758 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-09T08:04:09.758 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-09T08:04:09.758 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.758 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-09T08:04:09.758 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.759 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-09T08:04:09.759 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-09T08:04:09.759 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.759 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-09T08:04:09.759 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.759 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/gawk.sh 2024-02-09T08:04:09.759 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.759 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-09T08:04:09.759 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.759 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/lang.sh 2024-02-09T08:04:09.759 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup 2024-02-09T08:04:09.759 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/locale 2024-02-09T08:04:09.759 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-09T08:04:09.759 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-09T08:04:09.759 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-09T08:04:09.760 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.760 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-09T08:04:09.760 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.760 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-09T08:04:09.760 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-09T08:04:09.760 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.760 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-09T08:04:09.760 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.760 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/gawk.sh 2024-02-09T08:04:09.760 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.760 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-09T08:04:09.760 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.760 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-09T08:04:09.760 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-09T08:04:09.760 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-09T08:04:09.761 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.761 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-09T08:04:09.761 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.761 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/lang.sh 2024-02-09T08:04:09.761 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-09T08:04:09.761 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup 2024-02-09T08:04:09.761 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:09.761 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-09T08:04:09.761 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:09.761 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-09T08:04:09.761 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.761 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-09T08:04:09.761 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.761 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/gawk.sh 2024-02-09T08:04:09.762 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-09T08:04:09.762 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-09T08:04:09.762 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.762 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-09T08:04:09.762 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.762 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/lang.sh 2024-02-09T08:04:09.762 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup 2024-02-09T08:04:09.762 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-09T08:04:09.762 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_api_list.log 2024-02-09T08:04:09.762 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-09T08:04:09.762 INFO:tasks.workunit.client.0.smithi062.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-09T08:04:09.762 INFO:tasks.workunit.client.0.smithi062.stderr:++++ export LANG=en_US.UTF-8 2024-02-09T08:04:09.762 INFO:tasks.workunit.client.0.smithi062.stderr:++++ LANG=en_US.UTF-8 2024-02-09T08:04:09.762 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:09.762 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-09T08:04:09.762 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:09.763 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG=en_US.UTF-8 2024-02-09T08:04:09.763 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup config 2024-02-09T08:04:09.763 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:09.763 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:09.763 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' dumb = linux ']' 2024-02-09T08:04:09.763 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.763 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-09T08:04:09.763 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.763 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/less.sh 2024-02-09T08:04:09.763 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-09T08:04:09.763 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.763 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-09T08:04:09.763 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.763 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/which2.sh 2024-02-09T08:04:09.764 INFO:tasks.workunit.client.0.smithi062.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-09T08:04:09.764 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-09T08:04:09.764 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/locale 2024-02-09T08:04:09.764 INFO:tasks.workunit.client.0.smithi062.stderr:+++++ readlink /proc/40947/exe 2024-02-09T08:04:09.764 INFO:tasks.workunit.client.0.smithi062.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-09T08:04:09.764 INFO:tasks.workunit.client.0.smithi062.stderr:++++ export LANG=en_US.UTF-8 2024-02-09T08:04:09.764 INFO:tasks.workunit.client.0.smithi062.stderr:++++ LANG=en_US.UTF-8 2024-02-09T08:04:09.764 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:09.764 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/locale 2024-02-09T08:04:09.764 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-09T08:04:09.764 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:09.764 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG=en_US.UTF-8 2024-02-09T08:04:09.764 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup config 2024-02-09T08:04:09.764 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:09.764 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:09.765 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' dumb = linux ']' 2024-02-09T08:04:09.765 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.765 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-09T08:04:09.765 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.765 INFO:tasks.workunit.client.0.smithi062.stderr:++++ basename /usr/bin/bash 2024-02-09T08:04:09.765 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/less.sh 2024-02-09T08:04:09.765 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-09T08:04:09.765 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_declare='declare -f' 2024-02-09T08:04:09.765 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_opt=-f 2024-02-09T08:04:09.765 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export which_declare 2024-02-09T08:04:09.765 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export -f which 2024-02-09T08:04:09.765 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:09.765 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-09T08:04:09.765 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset i 2024-02-09T08:04:09.765 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:09.766 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-09T08:04:09.766 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-09T08:04:09.766 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset -f pathmunge 2024-02-09T08:04:09.766 INFO:tasks.workunit.client.0.smithi062.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-09T08:04:09.766 INFO:tasks.workunit.client.0.smithi062.stderr:+ export PATH 2024-02-09T08:04:09.766 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-09T08:04:09.766 INFO:tasks.workunit.client.0.smithi062.stderr:+ unset rc 2024-02-09T08:04:09.766 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-09T08:04:09.766 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-09T08:04:09.766 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-09T08:04:09.766 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.766 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-09T08:04:09.766 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:09.766 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-09T08:04:09.766 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.767 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-09T08:04:09.767 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:09.767 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-09T08:04:09.767 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-09T08:04:09.767 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-09T08:04:09.767 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=api_pool 2024-02-09T08:04:09.767 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.767 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41029 2024-02-09T08:04:09.767 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test api_pool on pid 41029' 2024-02-09T08:04:09.767 INFO:tasks.workunit.client.0.smithi062.stdout:test api_pool on pid 41029 2024-02-09T08:04:09.770 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=41029 2024-02-09T08:04:09.770 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-09T08:04:09.770 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-09T08:04:09.770 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-09T08:04:09.770 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s api_snapshots 2024-02-09T08:04:09.770 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' api_snapshots' 2024-02-09T08:04:09.770 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo api_snapshots 2024-02-09T08:04:09.770 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-09T08:04:09.770 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_pool --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_pool.xml 2>&1 | tee ceph_test_rados_api_pool.log | sed "s/^/ api_pool: /"' 2024-02-09T08:04:09.770 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -f /etc/bashrc ']' 2024-02-09T08:04:09.770 INFO:tasks.workunit.client.0.smithi062.stderr:+ . /etc/bashrc 2024-02-09T08:04:09.770 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -z '' ']' 2024-02-09T08:04:09.770 INFO:tasks.workunit.client.0.smithi062.stderr:++ BASHRCSOURCED=Y 2024-02-09T08:04:09.770 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.771 INFO:tasks.workunit.client.0.smithi062.stderr:++ shopt -q login_shell 2024-02-09T08:04:09.771 INFO:tasks.workunit.client.0.smithi062.stderr:+++ umask 2024-02-09T08:04:09.771 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=api_snapshots 2024-02-09T08:04:09.771 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' 0022 -eq 0 ']' 2024-02-09T08:04:09.771 INFO:tasks.workunit.client.0.smithi062.stderr:++ SHELL=/bin/bash 2024-02-09T08:04:09.771 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41037 2024-02-09T08:04:09.771 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test api_snapshots on pid 41037' 2024-02-09T08:04:09.771 INFO:tasks.workunit.client.0.smithi062.stdout:test api_snapshots on pid 41037 2024-02-09T08:04:09.784 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=41037 2024-02-09T08:04:09.784 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.784 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-09T08:04:09.784 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.784 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-09T08:04:09.784 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-09T08:04:09.784 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-09T08:04:09.784 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-09T08:04:09.784 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.784 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-09T08:04:09.785 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.785 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-09T08:04:09.785 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:09.785 INFO:tasks.workunit.client.0.smithi062.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:09.785 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.785 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-09T08:04:09.785 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.785 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-09T08:04:09.785 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.785 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s api_snapshots_pp 2024-02-09T08:04:09.785 INFO:tasks.workunit.client.0.smithi062.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-09T08:04:09.785 INFO:tasks.workunit.client.0.smithi062.stderr:++++ export LANG=en_US.UTF-8 2024-02-09T08:04:09.785 INFO:tasks.workunit.client.0.smithi062.stderr:++++ LANG=en_US.UTF-8 2024-02-09T08:04:09.785 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:09.785 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-09T08:04:09.786 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:09.786 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG=en_US.UTF-8 2024-02-09T08:04:09.786 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup config 2024-02-09T08:04:09.786 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:09.786 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:09.786 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' dumb = linux ']' 2024-02-09T08:04:09.786 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.786 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-09T08:04:09.786 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.786 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/less.sh 2024-02-09T08:04:09.786 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-09T08:04:09.786 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.786 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-09T08:04:09.786 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.786 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/which2.sh 2024-02-09T08:04:09.787 INFO:tasks.workunit.client.0.smithi062.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-09T08:04:09.787 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' api_snapshots_pp' 2024-02-09T08:04:09.787 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_snapshots.xml 2>&1 | tee ceph_test_rados_api_snapshots.log | sed "s/^/ api_snapshots: /"' 2024-02-09T08:04:09.787 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-09T08:04:09.787 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.787 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-09T08:04:09.787 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-09T08:04:09.787 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.787 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-09T08:04:09.787 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.787 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-09T08:04:09.787 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-09T08:04:09.787 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-09T08:04:09.787 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.787 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-09T08:04:09.788 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.788 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/gawk.sh 2024-02-09T08:04:09.788 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.788 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/which2.sh 2024-02-09T08:04:09.788 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.788 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-09T08:04:09.788 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.788 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/lang.sh 2024-02-09T08:04:09.788 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup 2024-02-09T08:04:09.788 INFO:tasks.workunit.client.0.smithi062.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-09T08:04:09.788 INFO:tasks.workunit.client.0.smithi062.stderr:+++++ readlink /proc/40962/exe 2024-02-09T08:04:09.788 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ api_misc: /' 2024-02-09T08:04:09.788 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo api_snapshots_pp 2024-02-09T08:04:09.788 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_api_misc --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_misc.xml 2024-02-09T08:04:09.789 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-09T08:04:09.789 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -f /etc/bashrc ']' 2024-02-09T08:04:09.789 INFO:tasks.workunit.client.0.smithi062.stderr:+ . /etc/bashrc 2024-02-09T08:04:09.789 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -z '' ']' 2024-02-09T08:04:09.789 INFO:tasks.workunit.client.0.smithi062.stderr:++ BASHRCSOURCED=Y 2024-02-09T08:04:09.789 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.789 INFO:tasks.workunit.client.0.smithi062.stderr:++ shopt -q login_shell 2024-02-09T08:04:09.789 INFO:tasks.workunit.client.0.smithi062.stderr:+++ umask 2024-02-09T08:04:09.789 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' 0022 -eq 0 ']' 2024-02-09T08:04:09.789 INFO:tasks.workunit.client.0.smithi062.stderr:++++ basename /usr/bin/bash 2024-02-09T08:04:09.789 INFO:tasks.workunit.client.0.smithi062.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-09T08:04:09.789 INFO:tasks.workunit.client.0.smithi062.stderr:++++ export LANG=en_US.UTF-8 2024-02-09T08:04:09.789 INFO:tasks.workunit.client.0.smithi062.stderr:++ SHELL=/bin/bash 2024-02-09T08:04:09.789 INFO:tasks.workunit.client.0.smithi062.stderr:++++ LANG=en_US.UTF-8 2024-02-09T08:04:09.789 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.790 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:09.790 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-09T08:04:09.790 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:09.790 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-09T08:04:09.790 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.790 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-09T08:04:09.790 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG=en_US.UTF-8 2024-02-09T08:04:09.790 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup config 2024-02-09T08:04:09.790 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-09T08:04:09.790 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.790 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-09T08:04:09.790 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.790 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-09T08:04:09.790 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:09.790 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:09.791 INFO:tasks.workunit.client.0.smithi062.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:09.791 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.791 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-09T08:04:09.791 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.791 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-09T08:04:09.791 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.791 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:09.791 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' dumb = linux ']' 2024-02-09T08:04:09.791 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.791 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-09T08:04:09.791 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.791 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/less.sh 2024-02-09T08:04:09.791 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'grep=grep --color=auto' 2024-02-09T08:04:09.791 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-09T08:04:09.791 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.792 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-09T08:04:09.792 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.792 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/which2.sh 2024-02-09T08:04:09.792 INFO:tasks.workunit.client.0.smithi062.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-09T08:04:09.792 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-09T08:04:09.792 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-09T08:04:09.792 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.792 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_declare='declare -f' 2024-02-09T08:04:09.792 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-09T08:04:09.792 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.792 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorls.sh 2024-02-09T08:04:09.792 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-09T08:04:09.792 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' '!' -t 0 ']' 2024-02-09T08:04:09.792 INFO:tasks.workunit.client.0.smithi062.stderr:+++ return 2024-02-09T08:04:09.793 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.793 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-09T08:04:09.793 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.793 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-09T08:04:09.793 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export S_COLORS=auto 2024-02-09T08:04:09.793 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_opt=-f 2024-02-09T08:04:09.793 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export which_declare 2024-02-09T08:04:09.793 INFO:tasks.workunit.client.0.smithi062.stderr:+++ S_COLORS=auto 2024-02-09T08:04:09.793 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.793 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-09T08:04:09.793 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.793 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-09T08:04:09.793 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.793 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export -f which 2024-02-09T08:04:09.793 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset i 2024-02-09T08:04:09.794 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset -f pathmunge 2024-02-09T08:04:09.794 INFO:tasks.workunit.client.0.smithi062.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-09T08:04:09.794 INFO:tasks.workunit.client.0.smithi062.stderr:+ export PATH 2024-02-09T08:04:09.794 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-09T08:04:09.794 INFO:tasks.workunit.client.0.smithi062.stderr:+ unset rc 2024-02-09T08:04:09.794 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_api_misc_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_misc_pp.xml 2024-02-09T08:04:09.794 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=api_snapshots_pp 2024-02-09T08:04:09.794 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'grep=grep --color=auto' 2024-02-09T08:04:09.794 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_api_misc.log 2024-02-09T08:04:09.794 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-09T08:04:09.794 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-09T08:04:09.794 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.794 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-09T08:04:09.794 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.794 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorls.sh 2024-02-09T08:04:09.794 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41082 2024-02-09T08:04:09.795 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test api_snapshots_pp on pid 41082' 2024-02-09T08:04:09.795 INFO:tasks.workunit.client.0.smithi062.stdout:test api_snapshots_pp on pid 41082 2024-02-09T08:04:09.802 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=41082 2024-02-09T08:04:09.802 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-09T08:04:09.802 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-09T08:04:09.802 INFO:tasks.workunit.client.0.smithi062.stderr:+++++ readlink /proc/40976/exe 2024-02-09T08:04:09.802 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/locale 2024-02-09T08:04:09.802 INFO:tasks.workunit.client.0.smithi062.stderr:+++++ readlink /proc/40903/exe 2024-02-09T08:04:09.802 INFO:tasks.workunit.client.0.smithi062.stderr:++++ basename /usr/bin/bash 2024-02-09T08:04:09.802 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s api_stat 2024-02-09T08:04:09.803 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' api_stat' 2024-02-09T08:04:09.803 INFO:tasks.workunit.client.0.smithi062.stderr:++++ basename /usr/bin/bash 2024-02-09T08:04:09.803 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_api_misc_pp.log 2024-02-09T08:04:09.803 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_declare='declare -f' 2024-02-09T08:04:09.803 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_opt=-f 2024-02-09T08:04:09.803 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export which_declare 2024-02-09T08:04:09.803 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export -f which 2024-02-09T08:04:09.803 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset i 2024-02-09T08:04:09.803 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset -f pathmunge 2024-02-09T08:04:09.803 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-09T08:04:09.803 INFO:tasks.workunit.client.0.smithi062.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-09T08:04:09.803 INFO:tasks.workunit.client.0.smithi062.stderr:+ export PATH 2024-02-09T08:04:09.803 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo api_stat 2024-02-09T08:04:09.803 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-09T08:04:09.804 INFO:tasks.workunit.client.0.smithi062.stderr:+ unset rc 2024-02-09T08:04:09.804 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:09.804 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-09T08:04:09.804 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:09.804 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-09T08:04:09.804 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-09T08:04:09.804 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_declare='declare -f' 2024-02-09T08:04:09.804 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_opt=-f 2024-02-09T08:04:09.804 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-09T08:04:09.804 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-09T08:04:09.804 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-09T08:04:09.804 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-09T08:04:09.804 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export which_declare 2024-02-09T08:04:09.804 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export -f which 2024-02-09T08:04:09.804 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.805 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset i 2024-02-09T08:04:09.805 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-09T08:04:09.805 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset -f pathmunge 2024-02-09T08:04:09.805 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.805 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-09T08:04:09.805 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-09T08:04:09.805 INFO:tasks.workunit.client.0.smithi062.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-09T08:04:09.805 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.805 INFO:tasks.workunit.client.0.smithi062.stderr:+ export PATH 2024-02-09T08:04:09.805 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-09T08:04:09.805 INFO:tasks.workunit.client.0.smithi062.stderr:+ unset rc 2024-02-09T08:04:09.805 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ api_lock: /' 2024-02-09T08:04:09.805 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' '!' -t 0 ']' 2024-02-09T08:04:09.805 INFO:tasks.workunit.client.0.smithi062.stderr:+++ return 2024-02-09T08:04:09.806 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.806 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-09T08:04:09.806 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.806 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-09T08:04:09.806 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export S_COLORS=auto 2024-02-09T08:04:09.806 INFO:tasks.workunit.client.0.smithi062.stderr:+++ S_COLORS=auto 2024-02-09T08:04:09.806 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.806 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-09T08:04:09.806 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.806 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-09T08:04:09.806 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.806 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ api_misc_pp: /' 2024-02-09T08:04:09.806 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_api_tier_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_tier_pp.xml 2024-02-09T08:04:09.806 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_api_tier_pp.log 2024-02-09T08:04:09.806 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_snapshots_pp.xml 2>&1 | tee ceph_test_rados_api_snapshots_pp.log | sed "s/^/ api_snapshots_pp: /"' 2024-02-09T08:04:09.807 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_api_lock.log 2024-02-09T08:04:09.807 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -f /etc/bashrc ']' 2024-02-09T08:04:09.807 INFO:tasks.workunit.client.0.smithi062.stderr:+ . /etc/bashrc 2024-02-09T08:04:09.807 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=api_stat 2024-02-09T08:04:09.807 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -z '' ']' 2024-02-09T08:04:09.807 INFO:tasks.workunit.client.0.smithi062.stderr:++ BASHRCSOURCED=Y 2024-02-09T08:04:09.807 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.807 INFO:tasks.workunit.client.0.smithi062.stderr:++ shopt -q login_shell 2024-02-09T08:04:09.807 INFO:tasks.workunit.client.0.smithi062.stderr:+++ umask 2024-02-09T08:04:09.807 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' 0022 -eq 0 ']' 2024-02-09T08:04:09.807 INFO:tasks.workunit.client.0.smithi062.stderr:++ SHELL=/bin/bash 2024-02-09T08:04:09.807 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.807 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-09T08:04:09.807 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ api_tier_pp: /' 2024-02-09T08:04:09.807 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.808 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-09T08:04:09.808 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-09T08:04:09.808 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.808 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-09T08:04:09.808 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.808 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41108 2024-02-09T08:04:09.808 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test api_stat on pid 41108' 2024-02-09T08:04:09.808 INFO:tasks.workunit.client.0.smithi062.stdout:test api_stat on pid 41108 2024-02-09T08:04:09.819 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=41108 2024-02-09T08:04:09.819 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_api_lock --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_lock.xml 2024-02-09T08:04:09.819 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-09T08:04:09.819 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-09T08:04:09.819 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-09T08:04:09.819 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:09.819 INFO:tasks.workunit.client.0.smithi062.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:09.819 INFO:tasks.workunit.client.0.smithi062.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-09T08:04:09.819 INFO:tasks.workunit.client.0.smithi062.stderr:++++ export LANG=en_US.UTF-8 2024-02-09T08:04:09.819 INFO:tasks.workunit.client.0.smithi062.stderr:++++ LANG=en_US.UTF-8 2024-02-09T08:04:09.820 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:09.820 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-09T08:04:09.820 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.820 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:09.820 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG=en_US.UTF-8 2024-02-09T08:04:09.820 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup config 2024-02-09T08:04:09.820 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:09.820 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-09T08:04:09.820 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:09.820 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' dumb = linux ']' 2024-02-09T08:04:09.820 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.820 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.820 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-09T08:04:09.820 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.821 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-09T08:04:09.821 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.821 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/less.sh 2024-02-09T08:04:09.821 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-09T08:04:09.821 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.821 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-09T08:04:09.821 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.821 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/which2.sh 2024-02-09T08:04:09.821 INFO:tasks.workunit.client.0.smithi062.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-09T08:04:09.821 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-09T08:04:09.821 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-09T08:04:09.821 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-09T08:04:09.821 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.821 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-09T08:04:09.821 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.822 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-09T08:04:09.822 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-09T08:04:09.822 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.822 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-09T08:04:09.822 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.822 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/gawk.sh 2024-02-09T08:04:09.822 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.822 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-09T08:04:09.822 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.822 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/lang.sh 2024-02-09T08:04:09.822 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup 2024-02-09T08:04:09.822 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_stat.xml 2>&1 | tee ceph_test_rados_api_stat.log | sed "s/^/ api_stat: /"' 2024-02-09T08:04:09.822 INFO:tasks.workunit.client.0.smithi062.stderr:+++++ readlink /proc/40922/exe 2024-02-09T08:04:09.822 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/locale 2024-02-09T08:04:09.822 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -f /etc/bashrc ']' 2024-02-09T08:04:09.823 INFO:tasks.workunit.client.0.smithi062.stderr:+ . /etc/bashrc 2024-02-09T08:04:09.823 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -z '' ']' 2024-02-09T08:04:09.823 INFO:tasks.workunit.client.0.smithi062.stderr:++ BASHRCSOURCED=Y 2024-02-09T08:04:09.823 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.823 INFO:tasks.workunit.client.0.smithi062.stderr:++ shopt -q login_shell 2024-02-09T08:04:09.823 INFO:tasks.workunit.client.0.smithi062.stderr:++++ basename /usr/bin/bash 2024-02-09T08:04:09.823 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-09T08:04:09.823 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-09T08:04:09.823 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-09T08:04:09.823 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.823 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-09T08:04:09.823 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.823 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-09T08:04:09.823 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-09T08:04:09.823 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.824 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_declare='declare -f' 2024-02-09T08:04:09.824 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_opt=-f 2024-02-09T08:04:09.824 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export which_declare 2024-02-09T08:04:09.824 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export -f which 2024-02-09T08:04:09.824 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset i 2024-02-09T08:04:09.824 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset -f pathmunge 2024-02-09T08:04:09.824 INFO:tasks.workunit.client.0.smithi062.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-09T08:04:09.824 INFO:tasks.workunit.client.0.smithi062.stderr:+ export PATH 2024-02-09T08:04:09.824 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-09T08:04:09.824 INFO:tasks.workunit.client.0.smithi062.stderr:+ unset rc 2024-02-09T08:04:09.824 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:09.824 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-09T08:04:09.824 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:09.824 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-09T08:04:09.825 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-09T08:04:09.825 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-09T08:04:09.825 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s api_stat_pp 2024-02-09T08:04:09.825 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' api_stat_pp' 2024-02-09T08:04:09.825 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'grep=grep --color=auto' 2024-02-09T08:04:09.825 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-09T08:04:09.825 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-09T08:04:09.825 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.825 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-09T08:04:09.825 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.825 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorls.sh 2024-02-09T08:04:09.825 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' '!' -t 0 ']' 2024-02-09T08:04:09.825 INFO:tasks.workunit.client.0.smithi062.stderr:+++ return 2024-02-09T08:04:09.825 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.825 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-09T08:04:09.826 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.826 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-09T08:04:09.826 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export S_COLORS=auto 2024-02-09T08:04:09.826 INFO:tasks.workunit.client.0.smithi062.stderr:+++ S_COLORS=auto 2024-02-09T08:04:09.826 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.826 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-09T08:04:09.826 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.826 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-09T08:04:09.826 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.826 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo api_stat_pp 2024-02-09T08:04:09.826 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_api_lock_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_lock_pp.xml 2024-02-09T08:04:09.826 INFO:tasks.workunit.client.0.smithi062.stderr:+++ umask 2024-02-09T08:04:09.826 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' 0022 -eq 0 ']' 2024-02-09T08:04:09.826 INFO:tasks.workunit.client.0.smithi062.stderr:++ SHELL=/bin/bash 2024-02-09T08:04:09.826 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.827 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-09T08:04:09.827 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.827 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-09T08:04:09.827 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-09T08:04:09.827 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.827 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-09T08:04:09.827 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.827 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-09T08:04:09.827 INFO:tasks.workunit.client.0.smithi062.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-09T08:04:09.827 INFO:tasks.workunit.client.0.smithi062.stderr:++++ export LANG=en_US.UTF-8 2024-02-09T08:04:09.827 INFO:tasks.workunit.client.0.smithi062.stderr:++++ LANG=en_US.UTF-8 2024-02-09T08:04:09.827 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:09.827 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-09T08:04:09.827 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:09.827 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG=en_US.UTF-8 2024-02-09T08:04:09.828 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup config 2024-02-09T08:04:09.828 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:09.828 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:09.828 INFO:tasks.workunit.client.0.smithi062.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:09.828 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:09.828 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' dumb = linux ']' 2024-02-09T08:04:09.828 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.828 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-09T08:04:09.828 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.828 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/less.sh 2024-02-09T08:04:09.828 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.828 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-09T08:04:09.828 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.828 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-09T08:04:09.829 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.829 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/which2.sh 2024-02-09T08:04:09.829 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-09T08:04:09.829 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-09T08:04:09.829 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.829 INFO:tasks.workunit.client.0.smithi062.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-09T08:04:09.829 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-09T08:04:09.829 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.829 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-09T08:04:09.829 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-09T08:04:09.829 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.829 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-09T08:04:09.829 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_api_lock_pp.log 2024-02-09T08:04:09.829 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.829 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-09T08:04:09.829 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-09T08:04:09.830 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.830 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ api_lock_pp: /' 2024-02-09T08:04:09.830 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [==========] Running 12 tests from 1 test suite. 2024-02-09T08:04:09.830 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [----------] Global test environment set-up. 2024-02-09T08:04:09.830 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [----------] 12 tests from AsioRados 2024-02-09T08:04:09.830 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.698+0000 7f6e8a839780 10 monclient: get_monmap_and_config 2024-02-09T08:04:09.830 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.698+0000 7f6e8a839780 10 monclient: build_initial_monmap 2024-02-09T08:04:09.830 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.698+0000 7f6e8a839780 10 monclient: monmap: 2024-02-09T08:04:09.830 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: epoch 0 2024-02-09T08:04:09.830 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:04:09.830 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: last_changed 0.000000 2024-02-09T08:04:09.831 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: created 0.000000 2024-02-09T08:04:09.831 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: min_mon_release 0 (unknown) 2024-02-09T08:04:09.831 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: election_strategy: 1 2024-02-09T08:04:09.831 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:04:09.831 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:04:09.831 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:04:09.831 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.831 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.698+0000 7f6e8a839780 1 Processor -- start 2024-02-09T08:04:09.831 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.699+0000 7f6e8a839780 1 -- start start 2024-02-09T08:04:09.831 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.699+0000 7f6e8a839780 10 monclient: init 2024-02-09T08:04:09.831 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.699+0000 7f6e8a839780 10 monclient: _reopen_session rank -1 2024-02-09T08:04:09.831 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.699+0000 7f6e8a839780 10 monclient: _add_conns ranks=[0,2,1] 2024-02-09T08:04:09.831 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.699+0000 7f6e8a839780 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c0f27e2590 0x55c0f2870e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:04:09.831 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.699+0000 7f6e8a839780 10 monclient(hunting): picked mon.noname-a con 0x55c0f27e2590 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:04:09.832 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.699+0000 7f6e8a839780 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55c0f27e2b80 0x55c0f27de6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:04:09.832 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.699+0000 7f6e8a839780 10 monclient(hunting): picked mon.noname-c con 0x55c0f27e2b80 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:04:09.832 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.699+0000 7f6e8a839780 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c0f27e45f0 0x55c0f286d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:04:09.832 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.699+0000 7f6e8a839780 10 monclient(hunting): picked mon.noname-b con 0x55c0f27e45f0 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:04:09.832 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.699+0000 7f6e8a839780 10 monclient(hunting): start opening mon connection 2024-02-09T08:04:09.832 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.699+0000 7f6e8a839780 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0f275f260 con 0x55c0f27e2590 2024-02-09T08:04:09.832 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.699+0000 7f6e8a839780 10 monclient(hunting): start opening mon connection 2024-02-09T08:04:09.832 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.699+0000 7f6e8a839780 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0f2715820 con 0x55c0f27e45f0 2024-02-09T08:04:09.832 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.699+0000 7f6e8a839780 10 monclient(hunting): start opening mon connection 2024-02-09T08:04:09.832 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.699+0000 7f6e8a839780 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c0f26f8540 con 0x55c0f27e2b80 2024-02-09T08:04:09.832 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.700+0000 7f6e8a839780 10 monclient(hunting): _renew_subs 2024-02-09T08:04:09.832 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.700+0000 7f6e8a839780 10 monclient(hunting): authenticate will time out at 1493.060238s 2024-02-09T08:04:09.837 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-09T08:04:09.837 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-09T08:04:09.837 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-09T08:04:09.837 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.837 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-09T08:04:09.837 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.837 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-09T08:04:09.837 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-09T08:04:09.837 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.837 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-09T08:04:09.837 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.837 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/gawk.sh 2024-02-09T08:04:09.838 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.838 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-09T08:04:09.838 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.838 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/lang.sh 2024-02-09T08:04:09.838 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-09T08:04:09.838 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-09T08:04:09.838 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup 2024-02-09T08:04:09.838 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-09T08:04:09.838 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.838 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-09T08:04:09.838 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.838 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-09T08:04:09.838 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-09T08:04:09.838 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.838 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-09T08:04:09.839 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.839 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/gawk.sh 2024-02-09T08:04:09.839 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.839 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-09T08:04:09.839 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.839 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/lang.sh 2024-02-09T08:04:09.839 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup 2024-02-09T08:04:09.839 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/locale 2024-02-09T08:04:09.839 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/locale 2024-02-09T08:04:09.839 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-09T08:04:09.839 INFO:tasks.workunit.client.0.smithi062.stderr:+++++ readlink /proc/41029/exe 2024-02-09T08:04:09.839 INFO:tasks.workunit.client.0.smithi062.stderr:++++ basename /usr/bin/bash 2024-02-09T08:04:09.839 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:09.839 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-09T08:04:09.839 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:09.840 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-09T08:04:09.840 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-09T08:04:09.840 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=api_stat_pp 2024-02-09T08:04:09.840 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41173 2024-02-09T08:04:09.840 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: test api_stat_pp on pid 41173 2024-02-09T08:04:09.843 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test api_stat_pp on pid 41173' 2024-02-09T08:04:09.843 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=41173 2024-02-09T08:04:09.843 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-09T08:04:09.843 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-09T08:04:09.843 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_declare='declare -f' 2024-02-09T08:04:09.843 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_opt=-f 2024-02-09T08:04:09.844 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export which_declare 2024-02-09T08:04:09.844 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export -f which 2024-02-09T08:04:09.844 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset i 2024-02-09T08:04:09.844 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset -f pathmunge 2024-02-09T08:04:09.844 INFO:tasks.workunit.client.0.smithi062.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-09T08:04:09.844 INFO:tasks.workunit.client.0.smithi062.stderr:+ export PATH 2024-02-09T08:04:09.844 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-09T08:04:09.844 INFO:tasks.workunit.client.0.smithi062.stderr:+ unset rc 2024-02-09T08:04:09.844 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-09T08:04:09.844 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s api_watch_notify 2024-02-09T08:04:09.844 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'grep=grep --color=auto' 2024-02-09T08:04:09.844 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-09T08:04:09.844 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-09T08:04:09.844 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.845 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-09T08:04:09.845 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.845 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorls.sh 2024-02-09T08:04:09.845 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' '!' -t 0 ']' 2024-02-09T08:04:09.845 INFO:tasks.workunit.client.0.smithi062.stderr:+++ return 2024-02-09T08:04:09.845 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.845 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-09T08:04:09.845 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.845 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-09T08:04:09.845 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export S_COLORS=auto 2024-02-09T08:04:09.845 INFO:tasks.workunit.client.0.smithi062.stderr:+++ S_COLORS=auto 2024-02-09T08:04:09.845 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.845 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-09T08:04:09.845 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.845 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-09T08:04:09.846 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.846 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' api_watch_notify' 2024-02-09T08:04:09.846 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ api_pool: /' 2024-02-09T08:04:09.846 INFO:tasks.workunit.client.0.smithi062.stdout:2024-02-09T08:04:09.702+0000 7f6e881a4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c0f27e45f0 0x55c0f286d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:04:09.846 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.702+0000 7f6e881a4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c0f27e45f0 0x55c0f286d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.62:33666/0 (socket says 172.21.15.62:33666) 2024-02-09T08:04:09.846 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.702+0000 7f6e881a4640 1 -- 172.21.15.62:0/3723394325 learned_addr learned my addr 172.21.15.62:0/3723394325 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:04:09.846 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.702+0000 7f6e881a4640 10 monclient(hunting): get_auth_request con 0x55c0f27e45f0 auth_method 0 2024-02-09T08:04:09.846 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.702+0000 7f6e881a4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:04:09.846 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.702+0000 7f6e881a4640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:04:09.846 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.702+0000 7f6e881a4640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:04:09.846 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.703+0000 7f6e881a4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:04:09.847 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.703+0000 7f6e881a4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:04:09.847 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.703+0000 7f6e881a4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:04:09.847 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.704+0000 7f6e871a2640 1 --2- 172.21.15.62:0/3723394325 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55c0f27e2b80 0x55c0f27de6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:04:09.847 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.711+0000 7f6e881a4640 10 monclient(hunting): handle_auth_done global_id 4429 payload 274 2024-02-09T08:04:09.847 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.712+0000 7f6e881a4640 1 -- 172.21.15.62:0/3723394325 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55c0f27e2b80 msgr2=0x55c0f27de6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:04:09.847 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.712+0000 7f6e881a4640 1 --2- 172.21.15.62:0/3723394325 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55c0f27e2b80 0x55c0f27de6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:04:09.847 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.712+0000 7f6e881a4640 1 -- 172.21.15.62:0/3723394325 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c0f27e2590 msgr2=0x55c0f2870e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:04:09.847 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.712+0000 7f6e881a4640 1 --2- 172.21.15.62:0/3723394325 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c0f27e2590 0x55c0f2870e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:04:09.847 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.712+0000 7f6e881a4640 10 monclient: _finish_hunting 0 2024-02-09T08:04:09.847 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.712+0000 7f6e881a4640 1 monclient: found mon.noname-b 2024-02-09T08:04:09.847 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.712+0000 7f6e881a4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:04:09.847 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.712+0000 7f6e881a4640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.103:3300/0 2024-02-09T08:04:09.847 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.712+0000 7f6e881a4640 1 -- 172.21.15.62:0/3723394325 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e78005de0 con 0x55c0f27e45f0 2024-02-09T08:04:09.860 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:09.860 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-09T08:04:09.860 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:09.860 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-09T08:04:09.860 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-09T08:04:09.861 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_api_pool --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_pool.xml 2024-02-09T08:04:09.861 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-09T08:04:09.861 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_stat_pp.xml 2>&1 | tee ceph_test_rados_api_stat_pp.log | sed "s/^/ api_stat_pp: /"' 2024-02-09T08:04:09.861 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -f /etc/bashrc ']' 2024-02-09T08:04:09.861 INFO:tasks.workunit.client.0.smithi062.stderr:+ . /etc/bashrc 2024-02-09T08:04:09.861 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -z '' ']' 2024-02-09T08:04:09.861 INFO:tasks.workunit.client.0.smithi062.stderr:++ BASHRCSOURCED=Y 2024-02-09T08:04:09.861 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.861 INFO:tasks.workunit.client.0.smithi062.stderr:++ shopt -q login_shell 2024-02-09T08:04:09.861 INFO:tasks.workunit.client.0.smithi062.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-09T08:04:09.861 INFO:tasks.workunit.client.0.smithi062.stderr:++++ export LANG=en_US.UTF-8 2024-02-09T08:04:09.861 INFO:tasks.workunit.client.0.smithi062.stderr:++++ LANG=en_US.UTF-8 2024-02-09T08:04:09.861 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:09.861 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-09T08:04:09.862 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:09.862 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG=en_US.UTF-8 2024-02-09T08:04:09.862 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup config 2024-02-09T08:04:09.862 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:09.862 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:09.862 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' dumb = linux ']' 2024-02-09T08:04:09.862 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.862 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-09T08:04:09.862 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.862 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/less.sh 2024-02-09T08:04:09.862 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-09T08:04:09.862 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.862 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-09T08:04:09.862 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.862 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/which2.sh 2024-02-09T08:04:09.863 INFO:tasks.workunit.client.0.smithi062.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-09T08:04:09.863 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_api_pool.log 2024-02-09T08:04:09.863 INFO:tasks.workunit.client.0.smithi062.stderr:+++ umask 2024-02-09T08:04:09.863 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' 0022 -eq 0 ']' 2024-02-09T08:04:09.863 INFO:tasks.workunit.client.0.smithi062.stderr:++ SHELL=/bin/bash 2024-02-09T08:04:09.863 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.863 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-09T08:04:09.863 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.863 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-09T08:04:09.863 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-09T08:04:09.863 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.863 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-09T08:04:09.863 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.863 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-09T08:04:09.863 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:09.864 INFO:tasks.workunit.client.0.smithi062.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:09.864 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.864 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-09T08:04:09.864 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.864 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-09T08:04:09.864 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.864 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-09T08:04:09.864 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-09T08:04:09.864 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-09T08:04:09.864 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.864 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-09T08:04:09.864 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.864 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-09T08:04:09.864 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-09T08:04:09.864 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.865 INFO:tasks.workunit.client.0.smithi062.stderr:+++++ readlink /proc/41082/exe 2024-02-09T08:04:09.865 INFO:tasks.workunit.client.0.smithi062.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-09T08:04:09.865 INFO:tasks.workunit.client.0.smithi062.stderr:++++ export LANG=en_US.UTF-8 2024-02-09T08:04:09.865 INFO:tasks.workunit.client.0.smithi062.stderr:++++ LANG=en_US.UTF-8 2024-02-09T08:04:09.865 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:09.865 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-09T08:04:09.865 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:09.865 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG=en_US.UTF-8 2024-02-09T08:04:09.865 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup config 2024-02-09T08:04:09.865 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:09.865 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:09.865 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' dumb = linux ']' 2024-02-09T08:04:09.865 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.865 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-09T08:04:09.865 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.866 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/less.sh 2024-02-09T08:04:09.866 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-09T08:04:09.866 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.866 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-09T08:04:09.866 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.866 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/which2.sh 2024-02-09T08:04:09.866 INFO:tasks.workunit.client.0.smithi062.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-09T08:04:09.866 INFO:tasks.workunit.client.0.smithi062.stderr:+++++ readlink /proc/41037/exe 2024-02-09T08:04:09.866 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'grep=grep --color=auto' 2024-02-09T08:04:09.866 INFO:tasks.workunit.client.0.smithi062.stderr:++++ basename /usr/bin/bash 2024-02-09T08:04:09.866 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-09T08:04:09.866 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-09T08:04:09.866 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.866 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-09T08:04:09.866 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-09T08:04:09.866 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.867 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorls.sh 2024-02-09T08:04:09.867 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' '!' -t 0 ']' 2024-02-09T08:04:09.867 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-09T08:04:09.867 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-09T08:04:09.867 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.867 INFO:tasks.workunit.client.0.smithi062.stderr:+++ return 2024-02-09T08:04:09.867 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.867 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-09T08:04:09.867 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.867 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-09T08:04:09.867 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export S_COLORS=auto 2024-02-09T08:04:09.867 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-09T08:04:09.867 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.867 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-09T08:04:09.867 INFO:tasks.workunit.client.0.smithi062.stderr:+++ S_COLORS=auto 2024-02-09T08:04:09.868 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-09T08:04:09.868 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.868 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-09T08:04:09.868 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.868 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/gawk.sh 2024-02-09T08:04:09.868 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.868 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-09T08:04:09.868 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.868 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.868 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-09T08:04:09.868 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.868 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_declare='declare -f' 2024-02-09T08:04:09.868 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_opt=-f 2024-02-09T08:04:09.868 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-09T08:04:09.868 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.869 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/lang.sh 2024-02-09T08:04:09.869 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export which_declare 2024-02-09T08:04:09.869 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export -f which 2024-02-09T08:04:09.869 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup 2024-02-09T08:04:09.869 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset i 2024-02-09T08:04:09.869 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset -f pathmunge 2024-02-09T08:04:09.869 INFO:tasks.workunit.client.0.smithi062.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-09T08:04:09.869 INFO:tasks.workunit.client.0.smithi062.stderr:+ export PATH 2024-02-09T08:04:09.869 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/locale 2024-02-09T08:04:09.869 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-09T08:04:09.869 INFO:tasks.workunit.client.0.smithi062.stderr:+ unset rc 2024-02-09T08:04:09.869 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_api_snapshots --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_snapshots.xml 2024-02-09T08:04:09.869 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_api_snapshots.log 2024-02-09T08:04:09.869 INFO:tasks.workunit.client.0.smithi062.stderr:++++ basename /usr/bin/bash 2024-02-09T08:04:09.869 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-09T08:04:09.870 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-09T08:04:09.870 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_declare='declare -f' 2024-02-09T08:04:09.870 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_opt=-f 2024-02-09T08:04:09.870 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export which_declare 2024-02-09T08:04:09.870 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-09T08:04:09.870 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.870 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export -f which 2024-02-09T08:04:09.870 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset i 2024-02-09T08:04:09.870 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-09T08:04:09.870 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.870 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-09T08:04:09.870 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset -f pathmunge 2024-02-09T08:04:09.870 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-09T08:04:09.870 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.870 INFO:tasks.workunit.client.0.smithi062.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-09T08:04:09.871 INFO:tasks.workunit.client.0.smithi062.stderr:+ export PATH 2024-02-09T08:04:09.871 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-09T08:04:09.871 INFO:tasks.workunit.client.0.smithi062.stderr:+ unset rc 2024-02-09T08:04:09.871 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo api_watch_notify 2024-02-09T08:04:09.871 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ api_snapshots_pp: /' 2024-02-09T08:04:09.871 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-09T08:04:09.871 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_api_snapshots_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_snapshots_pp.xml 2024-02-09T08:04:09.871 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_api_snapshots_pp.log 2024-02-09T08:04:09.871 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=api_watch_notify 2024-02-09T08:04:09.871 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:09.871 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-09T08:04:09.871 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:09.871 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41248 2024-02-09T08:04:09.872 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.722+0000 7f6e881a4640 1 --2- 172.21.15.62:0/3723394325 >> [v2:172.21.15test api_watch_notify on pid 41248 2024-02-09T08:04:09.878 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test api_watch_notify on pid 41248' 2024-02-09T08:04:09.878 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=41248 2024-02-09T08:04:09.878 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-09T08:04:09.879 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-09T08:04:09.879 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-09T08:04:09.879 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ api_snapshots: /' 2024-02-09T08:04:09.879 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-09T08:04:09.879 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_watch_notify.xml 2>&1 | tee ceph_test_rados_api_watch_notify.log | sed "s/^/ api_watch_notify: /"' 2024-02-09T08:04:09.879 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s api_watch_notify_pp 2024-02-09T08:04:09.879 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' api_watch_notify_pp' 2024-02-09T08:04:09.879 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -f /etc/bashrc ']' 2024-02-09T08:04:09.879 INFO:tasks.workunit.client.0.smithi062.stderr:+ . /etc/bashrc 2024-02-09T08:04:09.879 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-09T08:04:09.879 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -z '' ']' 2024-02-09T08:04:09.879 INFO:tasks.workunit.client.0.smithi062.stderr:++ BASHRCSOURCED=Y 2024-02-09T08:04:09.879 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.879 INFO:tasks.workunit.client.0.smithi062.stderr:++ shopt -q login_shell 2024-02-09T08:04:09.880 INFO:tasks.workunit.client.0.smithi062.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-09T08:04:09.880 INFO:tasks.workunit.client.0.smithi062.stderr:++++ export LANG=en_US.UTF-8 2024-02-09T08:04:09.880 INFO:tasks.workunit.client.0.smithi062.stderr:++++ LANG=en_US.UTF-8 2024-02-09T08:04:09.880 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:09.880 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-09T08:04:09.880 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:09.880 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG=en_US.UTF-8 2024-02-09T08:04:09.880 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup config 2024-02-09T08:04:09.880 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:09.880 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:09.880 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' dumb = linux ']' 2024-02-09T08:04:09.880 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.880 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-09T08:04:09.880 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.881 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/less.sh 2024-02-09T08:04:09.881 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-09T08:04:09.881 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.881 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-09T08:04:09.881 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.881 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/which2.sh 2024-02-09T08:04:09.881 INFO:tasks.workunit.client.0.smithi062.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-09T08:04:09.881 INFO:tasks.workunit.client.0.smithi062.stderr:+++ umask 2024-02-09T08:04:09.881 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo api_watch_notify_pp 2024-02-09T08:04:09.881 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' 0022 -eq 0 ']' 2024-02-09T08:04:09.881 INFO:tasks.workunit.client.0.smithi062.stderr:++ SHELL=/bin/bash 2024-02-09T08:04:09.881 INFO:tasks.workunit.client.0.smithi062.stderr:+++++ readlink /proc/41108/exe 2024-02-09T08:04:09.881 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.881 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-09T08:04:09.881 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-09T08:04:09.882 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-09T08:04:09.882 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-09T08:04:09.882 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-09T08:04:09.882 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.882 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-09T08:04:09.882 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.882 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-09T08:04:09.882 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.882 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-09T08:04:09.882 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.882 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-09T08:04:09.882 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.882 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/gawk.sh 2024-02-09T08:04:09.882 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-09T08:04:09.882 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.883 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-09T08:04:09.883 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.883 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/lang.sh 2024-02-09T08:04:09.883 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup 2024-02-09T08:04:09.883 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-09T08:04:09.883 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.883 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-09T08:04:09.883 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.883 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-09T08:04:09.883 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:09.883 INFO:tasks.workunit.client.0.smithi062.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:09.883 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.883 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-09T08:04:09.883 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.883 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-09T08:04:09.884 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.884 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/locale 2024-02-09T08:04:09.884 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=api_watch_notify_pp 2024-02-09T08:04:09.884 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41267 2024-02-09T08:04:09.884 INFO:tasks.workunit.client.0.smithi062.stdout:test api_watch_notify_pp on pid 41267 2024-02-09T08:04:09.891 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test api_watch_notify_pp on pid 41267' 2024-02-09T08:04:09.891 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=41267 2024-02-09T08:04:09.891 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-09T08:04:09.891 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-09T08:04:09.891 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_watch_notify_pp.xml 2>&1 | tee ceph_test_rados_api_watch_notify_pp.log | sed "s/^/ api_watch_notify_pp: /"' 2024-02-09T08:04:09.892 INFO:tasks.workunit.client.0.smithi062.stderr:++++ basename /usr/bin/bash 2024-02-09T08:04:09.892 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'grep=grep --color=auto' 2024-02-09T08:04:09.892 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-09T08:04:09.892 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-09T08:04:09.892 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.892 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-09T08:04:09.892 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.892 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorls.sh 2024-02-09T08:04:09.892 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' '!' -t 0 ']' 2024-02-09T08:04:09.892 INFO:tasks.workunit.client.0.smithi062.stderr:+++ return 2024-02-09T08:04:09.892 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.892 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-09T08:04:09.892 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.892 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-09T08:04:09.893 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export S_COLORS=auto 2024-02-09T08:04:09.893 INFO:tasks.workunit.client.0.smithi062.stderr:+++ S_COLORS=auto 2024-02-09T08:04:09.893 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -f /etc/bashrc ']' 2024-02-09T08:04:09.893 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.893 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-09T08:04:09.893 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.893 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-09T08:04:09.893 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.893 INFO:tasks.workunit.client.0.smithi062.stderr:+ . /etc/bashrc 2024-02-09T08:04:09.893 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -z '' ']' 2024-02-09T08:04:09.893 INFO:tasks.workunit.client.0.smithi062.stderr:++ BASHRCSOURCED=Y 2024-02-09T08:04:09.893 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.893 INFO:tasks.workunit.client.0.smithi062.stderr:++ shopt -q login_shell 2024-02-09T08:04:09.893 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_declare='declare -f' 2024-02-09T08:04:09.893 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_opt=-f 2024-02-09T08:04:09.894 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export which_declare 2024-02-09T08:04:09.894 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export -f which 2024-02-09T08:04:09.894 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset i 2024-02-09T08:04:09.894 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset -f pathmunge 2024-02-09T08:04:09.894 INFO:tasks.workunit.client.0.smithi062.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-09T08:04:09.894 INFO:tasks.workunit.client.0.smithi062.stderr:+ export PATH 2024-02-09T08:04:09.894 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-09T08:04:09.894 INFO:tasks.workunit.client.0.smithi062.stderr:+ unset rc 2024-02-09T08:04:09.894 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_api_stat --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_stat.xml 2024-02-09T08:04:09.894 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_api_stat.log 2024-02-09T08:04:09.894 INFO:tasks.workunit.client.0.smithi062.stderr:+++ umask 2024-02-09T08:04:09.894 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' 0022 -eq 0 ']' 2024-02-09T08:04:09.894 INFO:tasks.workunit.client.0.smithi062.stderr:++ SHELL=/bin/bash 2024-02-09T08:04:09.894 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.894 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-09T08:04:09.895 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.895 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-09T08:04:09.895 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-09T08:04:09.895 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.895 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-09T08:04:09.895 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.895 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-09T08:04:09.895 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:09.895 INFO:tasks.workunit.client.0.smithi062.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:09.895 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.895 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-09T08:04:09.895 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.895 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-09T08:04:09.895 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.896 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-09T08:04:09.896 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-09T08:04:09.896 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-09T08:04:09.896 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.896 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-09T08:04:09.896 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.896 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-09T08:04:09.896 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-09T08:04:09.896 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.896 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'grep=grep --color=auto' 2024-02-09T08:04:09.896 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-09T08:04:09.896 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-09T08:04:09.896 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.896 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-09T08:04:09.897 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ api_stat: /' 2024-02-09T08:04:09.897 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.897 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorls.sh 2024-02-09T08:04:09.897 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' '!' -t 0 ']' 2024-02-09T08:04:09.897 INFO:tasks.workunit.client.0.smithi062.stderr:+++ return 2024-02-09T08:04:09.897 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.897 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-09T08:04:09.897 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.897 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-09T08:04:09.897 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export S_COLORS=auto 2024-02-09T08:04:09.897 INFO:tasks.workunit.client.0.smithi062.stderr:+++ S_COLORS=auto 2024-02-09T08:04:09.897 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.897 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-09T08:04:09.897 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.897 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-09T08:04:09.898 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.898 INFO:tasks.workunit.client.0.smithi062.stdout:.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c0f27e45f0 0x55c0f286d670 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6e7801b8a0 tx=0x7f6e7804c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c15f10b60b0b4d73 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:04:09.898 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.767+0000 7f6e861a0640 1 -- 172.21.15.62:0/3723394325 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7804ab70 con 0x55c0f27e45f0 2024-02-09T08:04:09.898 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.767+0000 7f6e861a0640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:04:09.898 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.767+0000 7f6e861a0640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:04:09.898 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.767+0000 7f6e861a0640 10 monclient: dump: 2024-02-09T08:04:09.898 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: epoch 1 2024-02-09T08:04:09.898 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:04:09.898 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:04:09.898 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:04:09.899 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: min_mon_release 19 (squid) 2024-02-09T08:04:09.899 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: election_strategy: 1 2024-02-09T08:04:09.899 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:04:09.899 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:04:09.899 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:04:09.899 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.899 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.767+0000 7f6e861a0640 10 monclient: _finish_auth 0 2024-02-09T08:04:09.899 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.767+0000 7f6e861a0640 10 monclient: _check_auth_tickets 2024-02-09T08:04:09.899 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.767+0000 7f6e861a0640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:04:09.899 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.767+0000 7f6e861a0640 1 -- 172.21.15.62:0/3723394325 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e78052440 con 0x55c0f27e45f0 2024-02-09T08:04:09.899 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.767+0000 7f6e861a0640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:04:09.899 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.767+0000 7f6e861a0640 1 -- 172.21.15.62:0/3723394325 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e780527f0 con 0x55c0f27e45f0 2024-02-09T08:04:09.899 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.767+0000 7f6e861a0640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:04:09.899 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.767+0000 7f6e861a0640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:04:09.899 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.767+0000 7f6e861a0640 10 monclient: dump: 2024-02-09T08:04:09.900 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: epoch 1 2024-02-09T08:04:09.900 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:04:09.900 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:04:09.900 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:04:09.900 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: min_mon_release 19 (squid) 2024-02-09T08:04:09.900 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: election_strategy: 1 2024-02-09T08:04:09.900 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:04:09.900 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:04:09.900 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:04:09.900 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.900 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.768+0000 7f6e8a839780 5 monclient: authenticate success, global_id 4429 2024-02-09T08:04:09.900 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.768+0000 7f6e8a839780 10 monclient: get_monmap_and_config success 2024-02-09T08:04:09.900 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.768+0000 7f6e8a839780 4 set_mon_vals no callback set 2024-02-09T08:04:09.900 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.768+0000 7f6e8a839780 10 monclient: shutdown 2024-02-09T08:04:09.901 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.768+0000 7f6e8a839780 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:04:09.902 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-09T08:04:09.903 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-09T08:04:09.903 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-09T08:04:09.903 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.903 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-09T08:04:09.903 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.903 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-09T08:04:09.903 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-09T08:04:09.903 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s api_cmd 2024-02-09T08:04:09.903 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.903 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-09T08:04:09.903 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.903 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/gawk.sh 2024-02-09T08:04:09.903 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.903 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-09T08:04:09.904 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' api_cmd' 2024-02-09T08:04:09.904 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.904 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/lang.sh 2024-02-09T08:04:09.904 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup 2024-02-09T08:04:09.904 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/locale 2024-02-09T08:04:09.904 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:09.904 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-09T08:04:09.904 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:09.904 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-09T08:04:09.904 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-09T08:04:09.904 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.768+0000 7f6e8a839780 1 -- 172.21.15.62:0/3723394325 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c0f27e45f0 msgr2=0x55c0f286d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:04:09.904 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.768+0000 7f6e8a839780 1 --2- 172.21.15.62:0/3723394325 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c0f27e45f0 0x55c0f286d670 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6e7801b8a0 tx=0x7f6e7804c000 comp rx=0 tx=0).stop 2024-02-09T08:04:09.905 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.769+0000 7f6e8a839780 1 -- 172.21.15.62:0/3723394325 shutdown_connections 2024-02-09T08:04:09.905 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.769+0000 7f6e8a839780 1 --2- 172.21.15.62:0/3723394325 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c0f27e45f0 0x55c0f286d670 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:04:09.905 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.769+0000 7f6e8a839780 1 --2- 172.21.15.62:0/3723394325 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55c0f27e2b80 0x55c0f27de6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:04:09.905 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.769+0000 7f6e8a839780 1 --2- 172.21.15.62:0/3723394325 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c0f27e2590 0x55c0f2870e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:04:09.905 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.769+0000 7f6e8a839780 1 -- 172.21.15.62:0/3723394325 >> 172.21.15.62:0/3723394325 conn(0x55c0f27e5550 msgr2=0x55c0f27dfdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:04:09.905 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.769+0000 7f6e8a839780 1 -- 172.21.15.62:0/3723394325 shutdown_connections 2024-02-09T08:04:09.905 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.769+0000 7f6e8a839780 1 -- 172.21.15.62:0/3723394325 wait complete. 2024-02-09T08:04:09.905 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.769+0000 7f6e8a839780 10 monclient: build_initial_monmap 2024-02-09T08:04:09.905 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.769+0000 7f6e8a839780 10 monclient: monmap: 2024-02-09T08:04:09.905 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: epoch 0 2024-02-09T08:04:09.905 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:04:09.905 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: last_changed 0.000000 2024-02-09T08:04:09.905 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: created 0.000000 2024-02-09T08:04:09.905 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: min_mon_release 0 (unknown) 2024-02-09T08:04:09.906 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: election_strategy: 1 2024-02-09T08:04:09.906 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:04:09.906 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:04:09.906 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:04:09.906 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.906 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.770+0000 7f6e8a839780 1 librados: starting msgr at 2024-02-09T08:04:09.906 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.770+0000 7f6e8a839780 1 librados: starting objecter 2024-02-09T08:04:09.906 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.770+0000 7f6e8a839780 1 Processor -- start 2024-02-09T08:04:09.906 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.770+0000 7f6e8a839780 1 -- start start 2024-02-09T08:04:09.906 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.770+0000 7f6e8a839780 1 librados: setting wanted keys 2024-02-09T08:04:09.906 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.770+0000 7f6e8a839780 1 librados: calling monclient init 2024-02-09T08:04:09.906 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.770+0000 7f6e8a839780 10 monclient: init 2024-02-09T08:04:09.906 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.771+0000 7f6e8a839780 10 monclient: _reopen_session rank -1 2024-02-09T08:04:09.906 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.771+0000 7f6e8a839780 10 monclient: _add_conns ranks=[1,2,0] 2024-02-09T08:04:09.907 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.771+0000 7f6e8a839780 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c0f27e2590 0x55c0f2865c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:04:09.907 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.771+0000 7f6e8a839780 10 monclient(hunting): picked mon.noname-b con 0x55c0f27e2590 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:04:09.907 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.771+0000 7f6e8a839780 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55c0f27e2b80 0x55c0f2866150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:04:09.916 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:09.917 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-09T08:04:09.917 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:09.917 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-09T08:04:09.917 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-09T08:04:09.917 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-09T08:04:09.917 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-09T08:04:09.917 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-09T08:04:09.917 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-09T08:04:09.917 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-09T08:04:09.917 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.917 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-09T08:04:09.917 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.917 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-09T08:04:09.917 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-09T08:04:09.918 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.918 INFO:tasks.workunit.client.0.smithi062.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-09T08:04:09.918 INFO:tasks.workunit.client.0.smithi062.stderr:++++ export LANG=en_US.UTF-8 2024-02-09T08:04:09.918 INFO:tasks.workunit.client.0.smithi062.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-09T08:04:09.918 INFO:tasks.workunit.client.0.smithi062.stderr:++++ export LANG=en_US.UTF-8 2024-02-09T08:04:09.918 INFO:tasks.workunit.client.0.smithi062.stderr:++++ LANG=en_US.UTF-8 2024-02-09T08:04:09.918 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:09.918 INFO:tasks.workunit.client.0.smithi062.stderr:++++ LANG=en_US.UTF-8 2024-02-09T08:04:09.918 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:09.918 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-09T08:04:09.918 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:09.918 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG=en_US.UTF-8 2024-02-09T08:04:09.918 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup config 2024-02-09T08:04:09.918 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-09T08:04:09.918 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:09.919 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:09.919 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:09.919 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' dumb = linux ']' 2024-02-09T08:04:09.919 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.919 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG=en_US.UTF-8 2024-02-09T08:04:09.919 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup config 2024-02-09T08:04:09.919 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:09.919 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-09T08:04:09.919 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.919 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/less.sh 2024-02-09T08:04:09.919 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-09T08:04:09.919 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.919 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:09.919 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' dumb = linux ']' 2024-02-09T08:04:09.919 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.920 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-09T08:04:09.920 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.920 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/less.sh 2024-02-09T08:04:09.920 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-09T08:04:09.920 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-09T08:04:09.920 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.920 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/which2.sh 2024-02-09T08:04:09.920 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.920 INFO:tasks.workunit.client.0.smithi062.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-09T08:04:09.920 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-09T08:04:09.920 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.920 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/which2.sh 2024-02-09T08:04:09.920 INFO:tasks.workunit.client.0.smithi062.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-09T08:04:09.920 INFO:tasks.workunit.client.0.smithi062.stderr:+++++ readlink /proc/41173/exe 2024-02-09T08:04:09.920 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-09T08:04:09.921 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-09T08:04:09.921 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-09T08:04:09.921 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.921 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-09T08:04:09.921 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.921 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-09T08:04:09.921 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-09T08:04:09.921 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.921 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-09T08:04:09.921 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.921 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/gawk.sh 2024-02-09T08:04:09.921 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.921 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-09T08:04:09.921 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.921 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/lang.sh 2024-02-09T08:04:09.922 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup 2024-02-09T08:04:09.922 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/locale 2024-02-09T08:04:09.922 INFO:tasks.workunit.client.0.smithi062.stderr:++++ basename /usr/bin/bash 2024-02-09T08:04:09.922 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:09.922 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-09T08:04:09.922 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:09.922 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo api_cmd 2024-02-09T08:04:09.922 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-09T08:04:09.922 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-09T08:04:09.922 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-09T08:04:09.922 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-09T08:04:09.922 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_declare='declare -f' 2024-02-09T08:04:09.922 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_opt=-f 2024-02-09T08:04:09.922 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export which_declare 2024-02-09T08:04:09.922 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export -f which 2024-02-09T08:04:09.923 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset i 2024-02-09T08:04:09.923 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset -f pathmunge 2024-02-09T08:04:09.923 INFO:tasks.workunit.client.0.smithi062.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-09T08:04:09.923 INFO:tasks.workunit.client.0.smithi062.stderr:+ export PATH 2024-02-09T08:04:09.923 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-09T08:04:09.923 INFO:tasks.workunit.client.0.smithi062.stderr:+ unset rc 2024-02-09T08:04:09.923 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_api_stat_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_stat_pp.xml 2024-02-09T08:04:09.923 INFO:tasks.workunit.client.0.smithi062.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-09T08:04:09.923 INFO:tasks.workunit.client.0.smithi062.stderr:++++ export LANG=en_US.UTF-8 2024-02-09T08:04:09.923 INFO:tasks.workunit.client.0.smithi062.stderr:++++ LANG=en_US.UTF-8 2024-02-09T08:04:09.923 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:09.923 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-09T08:04:09.923 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:09.923 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG=en_US.UTF-8 2024-02-09T08:04:09.924 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup config 2024-02-09T08:04:09.924 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=api_cmd 2024-02-09T08:04:09.924 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:09.924 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:09.924 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' dumb = linux ']' 2024-02-09T08:04:09.924 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.924 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-09T08:04:09.924 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.924 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/less.sh 2024-02-09T08:04:09.924 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-09T08:04:09.924 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ api_stat_pp: /' 2024-02-09T08:04:09.924 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.924 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-09T08:04:09.924 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.924 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41318 2024-02-09T08:04:09.925 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/which2.sh 2024-02-09T08:04:09.925 INFO:tasks.workunit.client.0.smithi062.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-09T08:04:09.925 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 202test api_cmd on pid 41318 2024-02-09T08:04:09.926 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test api_cmd on pid 41318' 2024-02-09T08:04:09.927 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=41318 2024-02-09T08:04:09.927 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-09T08:04:09.927 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-09T08:04:09.927 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_api_stat_pp.log 2024-02-09T08:04:09.927 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s api_cmd_pp 2024-02-09T08:04:09.927 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' api_cmd_pp' 2024-02-09T08:04:09.927 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo api_cmd_pp 2024-02-09T08:04:09.927 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-09T08:04:09.927 INFO:tasks.workunit.client.0.smithi062.stderr:+++++ readlink /proc/41248/exe 2024-02-09T08:04:09.927 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_cmd.xml 2>&1 | tee ceph_test_rados_api_cmd.log | sed "s/^/ api_cmd: /"' 2024-02-09T08:04:09.927 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=api_cmd_pp 2024-02-09T08:04:09.927 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41325 2024-02-09T08:04:09.927 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -f /etc/bashrc ']' 2024-02-09T08:04:09.927 INFO:tasks.workunit.client.0.smithi062.stderr:+ . /etc/bashrc 2024-02-09T08:04:09.927 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test api_cmd_pp on pid 41325' 2024-02-09T08:04:09.928 INFO:tasks.workunit.client.0.smithi062.stdout:test api_cmd_pp on pid 41325 2024-02-09T08:04:09.932 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=41325 2024-02-09T08:04:09.932 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -z '' ']' 2024-02-09T08:04:09.932 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-09T08:04:09.932 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-09T08:04:09.932 INFO:tasks.workunit.client.0.smithi062.stderr:++ BASHRCSOURCED=Y 2024-02-09T08:04:09.932 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.932 INFO:tasks.workunit.client.0.smithi062.stderr:++ shopt -q login_shell 2024-02-09T08:04:09.933 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_cmd_pp.xml 2>&1 | tee ceph_test_rados_api_cmd_pp.log | sed "s/^/ api_cmd_pp: /"' 2024-02-09T08:04:09.933 INFO:tasks.workunit.client.0.smithi062.stderr:+++ umask 2024-02-09T08:04:09.933 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' 0022 -eq 0 ']' 2024-02-09T08:04:09.933 INFO:tasks.workunit.client.0.smithi062.stderr:++ SHELL=/bin/bash 2024-02-09T08:04:09.933 INFO:tasks.workunit.client.0.smithi062.stderr:++++ basename /usr/bin/bash 2024-02-09T08:04:09.933 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.933 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-09T08:04:09.933 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.933 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-09T08:04:09.933 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-09T08:04:09.933 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.933 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-09T08:04:09.933 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.933 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-09T08:04:09.934 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:09.934 INFO:tasks.workunit.client.0.smithi062.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:09.934 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -f /etc/bashrc ']' 2024-02-09T08:04:09.934 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.934 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-09T08:04:09.934 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.934 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-09T08:04:09.934 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.934 INFO:tasks.workunit.client.0.smithi062.stderr:+ . /etc/bashrc 2024-02-09T08:04:09.934 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_declare='declare -f' 2024-02-09T08:04:09.934 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -z '' ']' 2024-02-09T08:04:09.934 INFO:tasks.workunit.client.0.smithi062.stderr:++ BASHRCSOURCED=Y 2024-02-09T08:04:09.934 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.934 INFO:tasks.workunit.client.0.smithi062.stderr:++ shopt -q login_shell 2024-02-09T08:04:09.934 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_opt=-f 2024-02-09T08:04:09.935 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export which_declare 2024-02-09T08:04:09.935 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export -f which 2024-02-09T08:04:09.935 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset i 2024-02-09T08:04:09.935 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset -f pathmunge 2024-02-09T08:04:09.935 INFO:tasks.workunit.client.0.smithi062.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-09T08:04:09.935 INFO:tasks.workunit.client.0.smithi062.stderr:+ export PATH 2024-02-09T08:04:09.935 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-09T08:04:09.935 INFO:tasks.workunit.client.0.smithi062.stderr:+ unset rc 2024-02-09T08:04:09.935 INFO:tasks.workunit.client.0.smithi062.stderr:+++ umask 2024-02-09T08:04:09.935 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' 0022 -eq 0 ']' 2024-02-09T08:04:09.935 INFO:tasks.workunit.client.0.smithi062.stderr:++ SHELL=/bin/bash 2024-02-09T08:04:09.935 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.935 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-09T08:04:09.935 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_api_watch_notify --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_watch_notify.xml 2024-02-09T08:04:09.935 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.936 INFO:tasks.workunit.client.0.smithi062.stdout:4-02-09T08:04:09.771+0000 7f6e8a839780 10 monclient(hunting): picked mon.noname-c con 0x55c0f27e2b80 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:04:09.936 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.771+0000 7f6e8a839780 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c0f27e45f0 0x55c0f2866690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:04:09.936 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.771+0000 7f6e8a839780 10 monclient(hunting): picked mon.noname-a con 0x55c0f27e45f0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:04:09.936 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.771+0000 7f6e8a839780 10 monclient(hunting): start opening mon connection 2024-02-09T08:04:09.936 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.771+0000 7f6e8a839780 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0f26d7520 con 0x55c0f27e45f0 2024-02-09T08:04:09.936 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.771+0000 7f6e8a839780 10 monclient(hunting): start opening mon connection 2024-02-09T08:04:09.936 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.771+0000 7f6e8a839780 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0f2915b20 con 0x55c0f27e2590 2024-02-09T08:04:09.936 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.771+0000 7f6e8a839780 10 monclient(hunting): start opening mon connection 2024-02-09T08:04:09.936 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.771+0000 7f6e8a839780 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c0f2877c00 con 0x55c0f27e2b80 2024-02-09T08:04:09.936 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.771+0000 7f6e8a839780 10 monclient(hunting): _renew_subs 2024-02-09T08:04:09.936 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.771+0000 7f6e8a839780 10 monclient(hunting): authenticate will time out at 1493.131472s 2024-02-09T08:04:09.937 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.784+0000 7f6e881a4640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c0f27e45f0 0x55c0f2866690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:04:09.937 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.786+0000 7f6e881a4640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c0f27e45f0 0x55c0f2866690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43646/0 (socket says 172.21.15.62:43646) 2024-02-09T08:04:09.937 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.786+0000 7f6e881a4640 1 -- 172.21.15.62:0/4151497593 learned_addr learned my addr 172.21.15.62:0/4151497593 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:04:09.937 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.786+0000 7f6e881a4640 10 monclient(hunting): get_auth_request con 0x55c0f27e45f0 auth_method 0 2024-02-09T08:04:09.937 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.786+0000 7f6e881a4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:04:09.937 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.786+0000 7f6e881a4640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:04:09.937 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.786+0000 7f6e881a4640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:04:09.937 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.787+0000 7f6e881a4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:04:09.937 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.787+0000 7f6e881a4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:04:09.937 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.787+0000 7f6e881a4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:04:09.937 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.791+0000 7f6e871a2640 1 --2- 172.21.15.62:0/4151497593 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55c0f27e2b80 0x55c0f2866150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:04:09.937 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.791+0000 7f6e871a2640 10 monclient(hunting): get_auth_request con 0x55c0f27e2b80 auth_method 0 2024-02-09T08:04:09.942 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-09T08:04:09.942 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_api_watch_notify.log 2024-02-09T08:04:09.943 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-09T08:04:09.943 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.943 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-09T08:04:09.943 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.943 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-09T08:04:09.943 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:09.943 INFO:tasks.workunit.client.0.smithi062.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:09.943 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.943 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-09T08:04:09.943 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.943 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-09T08:04:09.943 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.943 INFO:tasks.workunit.client.0.smithi062.stderr:+++++ readlink /proc/41267/exe 2024-02-09T08:04:09.943 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ api_watch_notify: /' 2024-02-09T08:04:09.943 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s api_service 2024-02-09T08:04:09.944 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' api_service' 2024-02-09T08:04:09.944 INFO:tasks.workunit.client.0.smithi062.stderr:++++ basename /usr/bin/bash 2024-02-09T08:04:09.944 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'grep=grep --color=auto' 2024-02-09T08:04:09.944 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-09T08:04:09.944 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo api_service 2024-02-09T08:04:09.944 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-09T08:04:09.944 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.944 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-09T08:04:09.944 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.944 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorls.sh 2024-02-09T08:04:09.944 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' '!' -t 0 ']' 2024-02-09T08:04:09.944 INFO:tasks.workunit.client.0.smithi062.stderr:+++ return 2024-02-09T08:04:09.944 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.944 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-09T08:04:09.945 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.945 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-09T08:04:09.945 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_declare='declare -f' 2024-02-09T08:04:09.945 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_opt=-f 2024-02-09T08:04:09.945 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export which_declare 2024-02-09T08:04:09.945 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-09T08:04:09.945 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export S_COLORS=auto 2024-02-09T08:04:09.945 INFO:tasks.workunit.client.0.smithi062.stderr:+++ S_COLORS=auto 2024-02-09T08:04:09.945 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.945 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-09T08:04:09.945 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.945 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-09T08:04:09.945 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.945 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export -f which 2024-02-09T08:04:09.945 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset i 2024-02-09T08:04:09.945 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset -f pathmunge 2024-02-09T08:04:09.946 INFO:tasks.workunit.client.0.smithi062.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-09T08:04:09.946 INFO:tasks.workunit.client.0.smithi062.stderr:+ export PATH 2024-02-09T08:04:09.946 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-09T08:04:09.946 INFO:tasks.workunit.client.0.smithi062.stderr:+ unset rc 2024-02-09T08:04:09.946 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_watch_notify_pp.xml 2024-02-09T08:04:09.946 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=api_service 2024-02-09T08:04:09.946 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41355 2024-02-09T08:04:09.946 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.791+0000 7f6e871a2640 10 monclient(hunting): get_auth_rtest api_service on pid 41355 2024-02-09T08:04:09.952 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test api_service on pid 41355' 2024-02-09T08:04:09.953 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=41355 2024-02-09T08:04:09.953 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-09T08:04:09.953 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-09T08:04:09.953 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s api_service_pp 2024-02-09T08:04:09.953 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' api_service_pp' 2024-02-09T08:04:09.953 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_service.xml 2>&1 | tee ceph_test_rados_api_service.log | sed "s/^/ api_service: /"' 2024-02-09T08:04:09.953 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-09T08:04:09.953 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-09T08:04:09.953 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-09T08:04:09.953 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.953 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_api_watch_notify_pp.log 2024-02-09T08:04:09.953 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-09T08:04:09.953 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.954 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-09T08:04:09.954 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ api_watch_notify_pp: /' 2024-02-09T08:04:09.954 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-09T08:04:09.954 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.954 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -f /etc/bashrc ']' 2024-02-09T08:04:09.954 INFO:tasks.workunit.client.0.smithi062.stderr:+ . /etc/bashrc 2024-02-09T08:04:09.954 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -z '' ']' 2024-02-09T08:04:09.954 INFO:tasks.workunit.client.0.smithi062.stderr:++ BASHRCSOURCED=Y 2024-02-09T08:04:09.954 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.954 INFO:tasks.workunit.client.0.smithi062.stderr:++ shopt -q login_shell 2024-02-09T08:04:09.954 INFO:tasks.workunit.client.0.smithi062.stderr:+++ umask 2024-02-09T08:04:09.954 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' 0022 -eq 0 ']' 2024-02-09T08:04:09.954 INFO:tasks.workunit.client.0.smithi062.stderr:++ SHELL=/bin/bash 2024-02-09T08:04:09.954 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.954 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-09T08:04:09.955 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.955 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-09T08:04:09.955 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-09T08:04:09.955 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.955 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-09T08:04:09.955 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.955 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-09T08:04:09.955 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:09.955 INFO:tasks.workunit.client.0.smithi062.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:09.955 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.955 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-09T08:04:09.955 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.955 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-09T08:04:09.955 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.956 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-09T08:04:09.956 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'grep=grep --color=auto' 2024-02-09T08:04:09.956 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo api_service_pp 2024-02-09T08:04:09.956 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-09T08:04:09.956 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-09T08:04:09.956 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.956 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-09T08:04:09.956 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.956 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorls.sh 2024-02-09T08:04:09.956 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' '!' -t 0 ']' 2024-02-09T08:04:09.956 INFO:tasks.workunit.client.0.smithi062.stderr:+++ return 2024-02-09T08:04:09.956 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.956 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-09T08:04:09.956 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.957 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-09T08:04:09.957 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export S_COLORS=auto 2024-02-09T08:04:09.957 INFO:tasks.workunit.client.0.smithi062.stderr:+++ S_COLORS=auto 2024-02-09T08:04:09.957 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.957 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-09T08:04:09.957 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.957 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-09T08:04:09.957 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.957 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=api_service_pp 2024-02-09T08:04:09.957 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41385 2024-02-09T08:04:09.957 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test api_service_pp on pid 41385' 2024-02-09T08:04:09.957 INFO:tasks.workunit.client.0.smithi062.stdout:test api_service_pp on pid 41385 2024-02-09T08:04:09.967 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=41385 2024-02-09T08:04:09.967 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-09T08:04:09.967 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-09T08:04:09.967 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s api_c_write_operations 2024-02-09T08:04:09.967 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' api_c_write_operations' 2024-02-09T08:04:09.967 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-09T08:04:09.967 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-09T08:04:09.967 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-09T08:04:09.967 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.967 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-09T08:04:09.967 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.967 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-09T08:04:09.967 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-09T08:04:09.968 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.968 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-09T08:04:09.968 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.968 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/gawk.sh 2024-02-09T08:04:09.968 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.968 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-09T08:04:09.968 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.968 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/lang.sh 2024-02-09T08:04:09.968 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup 2024-02-09T08:04:09.968 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/locale 2024-02-09T08:04:09.968 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:09.968 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-09T08:04:09.968 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:09.968 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-09T08:04:09.968 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-09T08:04:09.969 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-09T08:04:09.969 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'grep=grep --color=auto' 2024-02-09T08:04:09.969 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-09T08:04:09.969 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-09T08:04:09.969 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.969 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_service_pp.xml 2>&1 | tee ceph_test_rados_api_service_pp.log | sed "s/^/ api_service_pp: /"' 2024-02-09T08:04:09.969 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo api_c_write_operations 2024-02-09T08:04:09.969 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-09T08:04:09.969 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.969 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorls.sh 2024-02-09T08:04:09.969 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' '!' -t 0 ']' 2024-02-09T08:04:09.969 INFO:tasks.workunit.client.0.smithi062.stderr:+++ return 2024-02-09T08:04:09.969 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.969 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-09T08:04:09.969 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.970 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-09T08:04:09.970 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export S_COLORS=auto 2024-02-09T08:04:09.970 INFO:tasks.workunit.client.0.smithi062.stderr:+++ S_COLORS=auto 2024-02-09T08:04:09.970 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.970 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-09T08:04:09.970 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.970 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-09T08:04:09.970 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.970 INFO:tasks.workunit.client.0.smithi062.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-09T08:04:09.970 INFO:tasks.workunit.client.0.smithi062.stderr:++++ export LANG=en_US.UTF-8 2024-02-09T08:04:09.970 INFO:tasks.workunit.client.0.smithi062.stderr:++++ LANG=en_US.UTF-8 2024-02-09T08:04:09.970 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:09.970 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-09T08:04:09.970 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:09.970 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG=en_US.UTF-8 2024-02-09T08:04:09.971 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup config 2024-02-09T08:04:09.971 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:09.971 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:09.971 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' dumb = linux ']' 2024-02-09T08:04:09.971 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.971 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-09T08:04:09.971 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.971 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/less.sh 2024-02-09T08:04:09.971 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-09T08:04:09.971 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.971 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-09T08:04:09.971 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.971 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -f /etc/bashrc ']' 2024-02-09T08:04:09.971 INFO:tasks.workunit.client.0.smithi062.stderr:+ . /etc/bashrc 2024-02-09T08:04:09.971 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/which2.sh 2024-02-09T08:04:09.972 INFO:tasks.workunit.client.0.smithi062.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-09T08:04:09.972 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -z '' ']' 2024-02-09T08:04:09.972 INFO:tasks.workunit.client.0.smithi062.stderr:++ BASHRCSOURCED=Y 2024-02-09T08:04:09.972 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.972 INFO:tasks.workunit.client.0.smithi062.stderr:++ shopt -q login_shell 2024-02-09T08:04:09.972 INFO:tasks.workunit.client.0.smithi062.stderr:+++ umask 2024-02-09T08:04:09.972 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-09T08:04:09.972 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' 0022 -eq 0 ']' 2024-02-09T08:04:09.972 INFO:tasks.workunit.client.0.smithi062.stderr:++ SHELL=/bin/bash 2024-02-09T08:04:09.972 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.972 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-09T08:04:09.972 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.972 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-09T08:04:09.972 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-09T08:04:09.972 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.973 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-09T08:04:09.973 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.973 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-09T08:04:09.973 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:09.973 INFO:tasks.workunit.client.0.smithi062.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:09.973 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.973 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-09T08:04:09.973 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-09T08:04:09.973 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.973 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-09T08:04:09.973 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-09T08:04:09.973 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.973 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-09T08:04:09.973 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.973 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-09T08:04:09.974 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-09T08:04:09.974 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.974 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-09T08:04:09.974 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.974 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=api_c_write_operations 2024-02-09T08:04:09.974 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41413 2024-02-09T08:04:09.974 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test api_c_write_operations on pid 41413' 2024-02-09T08:04:09.974 INFO:tasks.workunit.client.0.smithi062.stdout:test api_c_write_operations on pid 41413 2024-02-09T08:04:09.983 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=41413 2024-02-09T08:04:09.983 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-09T08:04:09.983 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-09T08:04:09.983 INFO:tasks.workunit.client.0.smithi062.stderr:+++++ readlink /proc/41318/exe 2024-02-09T08:04:09.983 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_write_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_c_write_operations.xml 2>&1 | tee ceph_test_rados_api_c_write_operations.log | sed "s/^/ api_c_write_operations: /"' 2024-02-09T08:04:09.983 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-09T08:04:09.983 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s api_c_read_operations 2024-02-09T08:04:09.983 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-09T08:04:09.983 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-09T08:04:09.983 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.983 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-09T08:04:09.984 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' api_c_read_operations' 2024-02-09T08:04:09.984 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.984 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-09T08:04:09.984 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-09T08:04:09.984 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.984 INFO:tasks.workunit.client.0.smithi062.stderr:++++ basename /usr/bin/bash 2024-02-09T08:04:09.984 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'grep=grep --color=auto' 2024-02-09T08:04:09.984 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo api_c_read_operations 2024-02-09T08:04:09.984 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-09T08:04:09.984 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-09T08:04:09.984 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -f /etc/bashrc ']' 2024-02-09T08:04:09.984 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.984 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-09T08:04:09.984 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.985 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorls.sh 2024-02-09T08:04:09.985 INFO:tasks.workunit.client.0.smithi062.stderr:+ . /etc/bashrc 2024-02-09T08:04:09.985 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' '!' -t 0 ']' 2024-02-09T08:04:09.985 INFO:tasks.workunit.client.0.smithi062.stderr:+++ return 2024-02-09T08:04:09.985 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.985 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-09T08:04:09.985 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.985 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-09T08:04:09.985 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export S_COLORS=auto 2024-02-09T08:04:09.985 INFO:tasks.workunit.client.0.smithi062.stderr:+++ S_COLORS=auto 2024-02-09T08:04:09.985 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.985 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-09T08:04:09.985 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -z '' ']' 2024-02-09T08:04:09.985 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.985 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-09T08:04:09.986 INFO:tasks.workunit.client.0.smithi062.stderr:++ BASHRCSOURCED=Y 2024-02-09T08:04:09.986 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.986 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.986 INFO:tasks.workunit.client.0.smithi062.stderr:++ shopt -q login_shell 2024-02-09T08:04:09.986 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_declare='declare -f' 2024-02-09T08:04:09.986 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_opt=-f 2024-02-09T08:04:09.986 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export which_declare 2024-02-09T08:04:09.986 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export -f which 2024-02-09T08:04:09.986 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset i 2024-02-09T08:04:09.986 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset -f pathmunge 2024-02-09T08:04:09.986 INFO:tasks.workunit.client.0.smithi062.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-09T08:04:09.986 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-09T08:04:09.986 INFO:tasks.workunit.client.0.smithi062.stderr:+ export PATH 2024-02-09T08:04:09.986 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-09T08:04:09.987 INFO:tasks.workunit.client.0.smithi062.stderr:+ unset rc 2024-02-09T08:04:09.987 INFO:tasks.workunit.client.0.smithi062.stderr:+++ umask 2024-02-09T08:04:09.987 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' 0022 -eq 0 ']' 2024-02-09T08:04:09.987 INFO:tasks.workunit.client.0.smithi062.stderr:++ SHELL=/bin/bash 2024-02-09T08:04:09.987 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.987 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-09T08:04:09.987 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.987 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-09T08:04:09.987 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-09T08:04:09.987 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-09T08:04:09.987 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-09T08:04:09.987 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-09T08:04:09.987 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.987 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-09T08:04:09.987 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-09T08:04:09.988 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.988 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-09T08:04:09.988 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-09T08:04:09.988 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.988 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-09T08:04:09.988 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.988 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/gawk.sh 2024-02-09T08:04:09.988 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-09T08:04:09.988 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-09T08:04:09.988 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.988 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-09T08:04:09.988 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.988 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/lang.sh 2024-02-09T08:04:09.988 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup 2024-02-09T08:04:09.989 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.989 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-09T08:04:09.989 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.989 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-09T08:04:09.989 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-09T08:04:09.989 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-09T08:04:09.989 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.989 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-09T08:04:09.989 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-09T08:04:09.989 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.989 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-09T08:04:09.989 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.989 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-09T08:04:09.989 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:09.989 INFO:tasks.workunit.client.0.smithi062.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:09.989 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.990 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-09T08:04:09.990 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.990 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-09T08:04:09.990 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=api_c_read_operations 2024-02-09T08:04:09.990 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.990 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-09T08:04:09.990 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.990 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-09T08:04:09.990 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-09T08:04:09.990 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41437 2024-02-09T08:04:09.990 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test api_c_read_operations on pid 41437' 2024-02-09T08:04:09.990 INFO:tasks.workunit.client.0.smithi062.stdout:test api_c_read_operations on pid 41437 2024-02-09T08:04:09.995 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=41437 2024-02-09T08:04:09.995 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-09T08:04:09.995 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-09T08:04:09.995 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.995 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-09T08:04:09.995 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.995 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/gawk.sh 2024-02-09T08:04:09.995 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.995 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.995 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-09T08:04:09.995 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.995 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/lang.sh 2024-02-09T08:04:09.995 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup 2024-02-09T08:04:09.995 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/locale 2024-02-09T08:04:09.995 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s api_cls_remote_reads 2024-02-09T08:04:09.996 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' api_cls_remote_reads' 2024-02-09T08:04:09.996 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_api_cmd --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_cmd.xml 2024-02-09T08:04:09.996 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_api_cmd.log 2024-02-09T08:04:09.996 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo api_cls_remote_reads 2024-02-09T08:04:09.996 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ api_cmd: /' 2024-02-09T08:04:09.996 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-09T08:04:09.996 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:09.996 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-09T08:04:09.996 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:09.996 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-09T08:04:09.996 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-09T08:04:09.996 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_read_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_c_read_operations.xml 2>&1 | tee ceph_test_rados_api_c_read_operations.log | sed "s/^/ api_c_read_operations: /"' 2024-02-09T08:04:09.996 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'grep=grep --color=auto' 2024-02-09T08:04:09.996 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-09T08:04:09.997 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-09T08:04:09.997 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.997 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-09T08:04:09.997 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.997 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorls.sh 2024-02-09T08:04:09.997 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' '!' -t 0 ']' 2024-02-09T08:04:09.997 INFO:tasks.workunit.client.0.smithi062.stderr:+++ return 2024-02-09T08:04:09.997 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.997 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-09T08:04:09.997 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.997 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-09T08:04:09.997 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export S_COLORS=auto 2024-02-09T08:04:09.997 INFO:tasks.workunit.client.0.smithi062.stderr:+++ S_COLORS=auto 2024-02-09T08:04:09.997 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:09.997 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-09T08:04:09.998 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:09.998 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-09T08:04:09.998 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:09.998 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=api_cls_remote_reads 2024-02-09T08:04:09.998 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41454 2024-02-09T08:04:09.998 INFO:tasks.workunit.client.0.smithi062.stdout:test api_cls_remote_reads on pid 41454 2024-02-09T08:04:10.017 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test api_cls_remote_reads on pid 41454' 2024-02-09T08:04:10.017 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=41454 2024-02-09T08:04:10.017 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-09T08:04:10.017 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-09T08:04:10.017 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -f /etc/bashrc ']' 2024-02-09T08:04:10.017 INFO:tasks.workunit.client.0.smithi062.stderr:+ . /etc/bashrc 2024-02-09T08:04:10.017 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -z '' ']' 2024-02-09T08:04:10.017 INFO:tasks.workunit.client.0.smithi062.stderr:++ BASHRCSOURCED=Y 2024-02-09T08:04:10.017 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.017 INFO:tasks.workunit.client.0.smithi062.stderr:++ shopt -q login_shell 2024-02-09T08:04:10.017 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-09T08:04:10.018 INFO:tasks.workunit.client.0.smithi062.stderr:+++ umask 2024-02-09T08:04:10.018 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' 0022 -eq 0 ']' 2024-02-09T08:04:10.018 INFO:tasks.workunit.client.0.smithi062.stderr:++ SHELL=/bin/bash 2024-02-09T08:04:10.018 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.018 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-09T08:04:10.018 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-09T08:04:10.018 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.018 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-09T08:04:10.018 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-09T08:04:10.018 INFO:tasks.workunit.client.0.smithi062.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-09T08:04:10.018 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-09T08:04:10.018 INFO:tasks.workunit.client.0.smithi062.stderr:++++ export LANG=en_US.UTF-8 2024-02-09T08:04:10.018 INFO:tasks.workunit.client.0.smithi062.stderr:++++ LANG=en_US.UTF-8 2024-02-09T08:04:10.018 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.018 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-09T08:04:10.019 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:10.019 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.019 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-09T08:04:10.019 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-09T08:04:10.019 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-09T08:04:10.019 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.019 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:10.019 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-09T08:04:10.019 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG=en_US.UTF-8 2024-02-09T08:04:10.019 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.019 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-09T08:04:10.019 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup config 2024-02-09T08:04:10.019 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-09T08:04:10.019 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:10.019 INFO:tasks.workunit.client.0.smithi062.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:10.020 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:10.020 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.020 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-09T08:04:10.020 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.020 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-09T08:04:10.020 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.020 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.020 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/gawk.sh 2024-02-09T08:04:10.020 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-09T08:04:10.020 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.020 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:10.020 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' dumb = linux ']' 2024-02-09T08:04:10.020 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.020 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-09T08:04:10.021 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.021 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.021 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/less.sh 2024-02-09T08:04:10.021 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-09T08:04:10.021 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.021 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/lang.sh 2024-02-09T08:04:10.021 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-09T08:04:10.021 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/locale 2024-02-09T08:04:10.021 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.021 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup 2024-02-09T08:04:10.021 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-09T08:04:10.021 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.021 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/which2.sh 2024-02-09T08:04:10.021 INFO:tasks.workunit.client.0.smithi062.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-09T08:04:10.021 INFO:tasks.workunit.client.0.smithi062.stderr:+++++ readlink /proc/41325/exe 2024-02-09T08:04:10.022 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-09T08:04:10.022 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-09T08:04:10.022 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-09T08:04:10.022 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.022 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-09T08:04:10.022 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.022 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-09T08:04:10.022 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-09T08:04:10.022 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.022 INFO:tasks.workunit.client.0.smithi062.stderr:++++ basename /usr/bin/bash 2024-02-09T08:04:10.022 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'grep=grep --color=auto' 2024-02-09T08:04:10.022 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cls_remote_reads --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_cls_remote_reads.xml 2>&1 | tee ceph_test_rados_api_cls_remote_reads.log | sed "s/^/ api_cls_remote_reads: /"' 2024-02-09T08:04:10.022 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_declare='declare -f' 2024-02-09T08:04:10.022 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-09T08:04:10.022 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-09T08:04:10.023 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.023 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-09T08:04:10.023 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.023 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorls.sh 2024-02-09T08:04:10.023 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' '!' -t 0 ']' 2024-02-09T08:04:10.023 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s list_parallel 2024-02-09T08:04:10.023 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/locale 2024-02-09T08:04:10.023 INFO:tasks.workunit.client.0.smithi062.stderr:+++ return 2024-02-09T08:04:10.023 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.023 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-09T08:04:10.023 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.023 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-09T08:04:10.023 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_opt=-f 2024-02-09T08:04:10.023 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export S_COLORS=auto 2024-02-09T08:04:10.023 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' list_parallel' 2024-02-09T08:04:10.024 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export which_declare 2024-02-09T08:04:10.024 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export -f which 2024-02-09T08:04:10.024 INFO:tasks.workunit.client.0.smithi062.stderr:+++ S_COLORS=auto 2024-02-09T08:04:10.024 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset i 2024-02-09T08:04:10.024 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset -f pathmunge 2024-02-09T08:04:10.024 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.024 INFO:tasks.workunit.client.0.smithi062.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-09T08:04:10.024 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-09T08:04:10.024 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.024 INFO:tasks.workunit.client.0.smithi062.stderr:+ export PATH 2024-02-09T08:04:10.024 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-09T08:04:10.024 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-09T08:04:10.024 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.024 INFO:tasks.workunit.client.0.smithi062.stderr:+ unset rc 2024-02-09T08:04:10.024 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -f /etc/bashrc ']' 2024-02-09T08:04:10.025 INFO:tasks.workunit.client.0.smithi062.stderr:+ . /etc/bashrc 2024-02-09T08:04:10.025 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -z '' ']' 2024-02-09T08:04:10.025 INFO:tasks.workunit.client.0.smithi062.stderr:++ BASHRCSOURCED=Y 2024-02-09T08:04:10.025 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.025 INFO:tasks.workunit.client.0.smithi062.stderr:++ shopt -q login_shell 2024-02-09T08:04:10.025 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_api_cmd_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_cmd_pp.xml 2024-02-09T08:04:10.025 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-09T08:04:10.025 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-09T08:04:10.025 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:10.025 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_api_cmd_pp.log 2024-02-09T08:04:10.025 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-09T08:04:10.025 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-09T08:04:10.025 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.025 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-09T08:04:10.025 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:10.026 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.026 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-09T08:04:10.026 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-09T08:04:10.026 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-09T08:04:10.026 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-09T08:04:10.026 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.026 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-09T08:04:10.026 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.026 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/gawk.sh 2024-02-09T08:04:10.026 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.026 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-09T08:04:10.026 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.026 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/lang.sh 2024-02-09T08:04:10.026 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup 2024-02-09T08:04:10.026 INFO:tasks.workunit.client.0.smithi062.stderr:+++ umask 2024-02-09T08:04:10.027 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ api_cmd_pp: /' 2024-02-09T08:04:10.027 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' 0022 -eq 0 ']' 2024-02-09T08:04:10.027 INFO:tasks.workunit.client.0.smithi062.stderr:++ SHELL=/bin/bash 2024-02-09T08:04:10.027 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.027 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-09T08:04:10.027 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.027 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-09T08:04:10.027 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-09T08:04:10.027 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.027 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-09T08:04:10.027 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.027 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-09T08:04:10.027 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-09T08:04:10.027 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:10.027 INFO:tasks.workunit.client.0.smithi062.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:10.028 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.028 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/locale 2024-02-09T08:04:10.028 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-09T08:04:10.028 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.028 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-09T08:04:10.028 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.028 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-09T08:04:10.028 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-09T08:04:10.028 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-09T08:04:10.028 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.028 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-09T08:04:10.028 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.028 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-09T08:04:10.028 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-09T08:04:10.028 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.029 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:10.029 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-09T08:04:10.029 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:10.029 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-09T08:04:10.029 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-09T08:04:10.029 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-09T08:04:10.029 INFO:tasks.workunit.client.0.smithi062.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-09T08:04:10.029 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:10.029 INFO:tasks.workunit.client.0.smithi062.stderr:++++ export LANG=en_US.UTF-8 2024-02-09T08:04:10.029 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-09T08:04:10.029 INFO:tasks.workunit.client.0.smithi062.stderr:++++ LANG=en_US.UTF-8 2024-02-09T08:04:10.029 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:10.029 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-09T08:04:10.029 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-09T08:04:10.029 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:10.030 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-09T08:04:10.030 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo list_parallel 2024-02-09T08:04:10.030 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:10.030 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG=en_US.UTF-8 2024-02-09T08:04:10.030 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup config 2024-02-09T08:04:10.030 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:10.030 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:10.030 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' dumb = linux ']' 2024-02-09T08:04:10.030 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.030 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-09T08:04:10.030 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-09T08:04:10.030 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-09T08:04:10.030 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.030 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/less.sh 2024-02-09T08:04:10.030 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-09T08:04:10.031 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.031 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-09T08:04:10.031 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.031 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/which2.sh 2024-02-09T08:04:10.031 INFO:tasks.workunit.client.0.smithi062.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-09T08:04:10.031 INFO:tasks.workunit.client.0.smithi062.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-09T08:04:10.031 INFO:tasks.workunit.client.0.smithi062.stderr:++++ export LANG=en_US.UTF-8 2024-02-09T08:04:10.031 INFO:tasks.workunit.client.0.smithi062.stderr:+++++ readlink /proc/41385/exe 2024-02-09T08:04:10.031 INFO:tasks.workunit.client.0.smithi062.stderr:++++ LANG=en_US.UTF-8 2024-02-09T08:04:10.031 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:10.031 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-09T08:04:10.031 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:10.031 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG=en_US.UTF-8 2024-02-09T08:04:10.031 INFO:tasks.workunit.client.0.smithi062.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-09T08:04:10.031 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup config 2024-02-09T08:04:10.032 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:10.032 INFO:tasks.workunit.client.0.smithi062.stderr:++++ export LANG=en_US.UTF-8 2024-02-09T08:04:10.032 INFO:tasks.workunit.client.0.smithi062.stderr:++++ LANG=en_US.UTF-8 2024-02-09T08:04:10.032 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:10.032 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-09T08:04:10.032 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:10.032 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG=en_US.UTF-8 2024-02-09T08:04:10.032 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup config 2024-02-09T08:04:10.032 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:10.032 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:10.032 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:10.032 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' dumb = linux ']' 2024-02-09T08:04:10.032 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.032 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-09T08:04:10.033 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.033 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/less.sh 2024-02-09T08:04:10.033 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-09T08:04:10.033 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' dumb = linux ']' 2024-02-09T08:04:10.033 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.033 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-09T08:04:10.033 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.033 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/less.sh 2024-02-09T08:04:10.033 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.033 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-09T08:04:10.033 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.033 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-09T08:04:10.033 INFO:tasks.workunit.client.0.smithi062.stderr:++++ basename /usr/bin/bash 2024-02-09T08:04:10.033 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.033 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/which2.sh 2024-02-09T08:04:10.033 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-09T08:04:10.034 INFO:tasks.workunit.client.0.smithi062.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-09T08:04:10.034 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.034 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/which2.sh 2024-02-09T08:04:10.034 INFO:tasks.workunit.client.0.smithi062.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-09T08:04:10.034 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=list_parallel 2024-02-09T08:04:10.034 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41524 2024-02-09T08:04:10.034 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test list_parallel on pid 41524' 2024-02-09T08:04:10.034 INFO:tasks.workunit.client.0.smithi062.stdout:test list_parallel on pid 41524 2024-02-09T08:04:10.049 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=41524 2024-02-09T08:04:10.049 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-09T08:04:10.049 INFO:tasks.workunit.client.0.smithi062.stderr:+++++ readlink /proc/41355/exe 2024-02-09T08:04:10.049 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-09T08:04:10.049 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_declare='declare -f' 2024-02-09T08:04:10.050 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_opt=-f 2024-02-09T08:04:10.050 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export which_declare 2024-02-09T08:04:10.050 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export -f which 2024-02-09T08:04:10.050 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset i 2024-02-09T08:04:10.050 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset -f pathmunge 2024-02-09T08:04:10.050 INFO:tasks.workunit.client.0.smithi062.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-09T08:04:10.050 INFO:tasks.workunit.client.0.smithi062.stderr:+ export PATH 2024-02-09T08:04:10.050 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-09T08:04:10.050 INFO:tasks.workunit.client.0.smithi062.stderr:+ unset rc 2024-02-09T08:04:10.050 INFO:tasks.workunit.client.0.smithi062.stderr:+++++ readlink /proc/41413/exe 2024-02-09T08:04:10.050 INFO:tasks.workunit.client.0.smithi062.stderr:++++ basename /usr/bin/bash 2024-02-09T08:04:10.050 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_list_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-list_parallel.xml 2>&1 | tee ceph_test_rados_list_parallel.log | sed "s/^/ list_parallel: /"' 2024-02-09T08:04:10.050 INFO:tasks.workunit.client.0.smithi062.stderr:++++ basename /usr/bin/bash 2024-02-09T08:04:10.050 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-09T08:04:10.051 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-09T08:04:10.051 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_api_service_pp.log 2024-02-09T08:04:10.051 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-09T08:04:10.051 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.051 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-09T08:04:10.051 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.051 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-09T08:04:10.051 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-09T08:04:10.051 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.051 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-09T08:04:10.051 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.051 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/gawk.sh 2024-02-09T08:04:10.051 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ api_service_pp: /' 2024-02-09T08:04:10.051 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.051 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-09T08:04:10.052 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_declare='declare -f' 2024-02-09T08:04:10.052 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.052 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_opt=-f 2024-02-09T08:04:10.052 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/lang.sh 2024-02-09T08:04:10.052 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup 2024-02-09T08:04:10.052 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export which_declare 2024-02-09T08:04:10.052 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export -f which 2024-02-09T08:04:10.052 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset i 2024-02-09T08:04:10.052 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset -f pathmunge 2024-02-09T08:04:10.052 INFO:tasks.workunit.client.0.smithi062.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-09T08:04:10.052 INFO:tasks.workunit.client.0.smithi062.stderr:+ export PATH 2024-02-09T08:04:10.052 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-09T08:04:10.052 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_declare='declare -f' 2024-02-09T08:04:10.052 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_opt=-f 2024-02-09T08:04:10.052 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export which_declare 2024-02-09T08:04:10.053 INFO:tasks.workunit.client.0.smithi062.stderr:+ unset rc 2024-02-09T08:04:10.053 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/locale 2024-02-09T08:04:10.053 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export -f which 2024-02-09T08:04:10.053 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset i 2024-02-09T08:04:10.053 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset -f pathmunge 2024-02-09T08:04:10.053 INFO:tasks.workunit.client.0.smithi062.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-09T08:04:10.053 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -f /etc/bashrc ']' 2024-02-09T08:04:10.053 INFO:tasks.workunit.client.0.smithi062.stderr:+ . /etc/bashrc 2024-02-09T08:04:10.053 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_api_service --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_service.xml 2024-02-09T08:04:10.053 INFO:tasks.workunit.client.0.smithi062.stderr:+ export PATH 2024-02-09T08:04:10.053 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-09T08:04:10.053 INFO:tasks.workunit.client.0.smithi062.stderr:+ unset rc 2024-02-09T08:04:10.053 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s open_pools_parallel 2024-02-09T08:04:10.053 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -z '' ']' 2024-02-09T08:04:10.053 INFO:tasks.workunit.client.0.smithi062.stderr:++ BASHRCSOURCED=Y 2024-02-09T08:04:10.054 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.054 INFO:tasks.workunit.client.0.smithi062.stderr:++ shopt -q login_shell 2024-02-09T08:04:10.054 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_api_service.log 2024-02-09T08:04:10.054 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' open_pools_parallel' 2024-02-09T08:04:10.054 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'grep=grep --color=auto' 2024-02-09T08:04:10.054 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:10.054 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-09T08:04:10.054 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-09T08:04:10.054 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.054 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_api_c_write_operations.log 2024-02-09T08:04:10.054 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-09T08:04:10.054 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:10.054 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-09T08:04:10.054 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.054 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorls.sh 2024-02-09T08:04:10.055 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-09T08:04:10.055 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' '!' -t 0 ']' 2024-02-09T08:04:10.055 INFO:tasks.workunit.client.0.smithi062.stderr:+++ return 2024-02-09T08:04:10.055 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.055 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-09T08:04:10.055 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.055 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-09T08:04:10.055 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-09T08:04:10.055 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ api_c_write_operations: /' 2024-02-09T08:04:10.055 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export S_COLORS=auto 2024-02-09T08:04:10.055 INFO:tasks.workunit.client.0.smithi062.stderr:+++ S_COLORS=auto 2024-02-09T08:04:10.055 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.055 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-09T08:04:10.056 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.056 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-09T08:04:10.056 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.056 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_api_service_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_service_pp.xml 2024-02-09T08:04:10.056 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-09T08:04:10.056 INFO:tasks.workunit.client.0.smithi062.stderr:+++ umask 2024-02-09T08:04:10.056 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ api_service: /' 2024-02-09T08:04:10.056 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' 0022 -eq 0 ']' 2024-02-09T08:04:10.056 INFO:tasks.workunit.client.0.smithi062.stderr:++ SHELL=/bin/bash 2024-02-09T08:04:10.056 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.056 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-09T08:04:10.056 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.056 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-09T08:04:10.056 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-09T08:04:10.056 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.057 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-09T08:04:10.057 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.057 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-09T08:04:10.057 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:10.057 INFO:tasks.workunit.client.0.smithi062.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:10.057 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.057 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-09T08:04:10.057 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.057 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-09T08:04:10.057 INFO:tasks.workunit.client.0.smithi062.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-09T08:04:10.057 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.057 INFO:tasks.workunit.client.0.smithi062.stderr:++++ export LANG=en_US.UTF-8 2024-02-09T08:04:10.057 INFO:tasks.workunit.client.0.smithi062.stderr:++++ LANG=en_US.UTF-8 2024-02-09T08:04:10.057 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:10.057 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-09T08:04:10.058 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:10.058 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG=en_US.UTF-8 2024-02-09T08:04:10.058 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup config 2024-02-09T08:04:10.058 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:10.058 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:10.058 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' dumb = linux ']' 2024-02-09T08:04:10.058 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.058 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-09T08:04:10.058 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.058 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/less.sh 2024-02-09T08:04:10.058 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-09T08:04:10.058 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.058 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-09T08:04:10.058 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.058 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'grep=grep --color=auto' 2024-02-09T08:04:10.059 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/which2.sh 2024-02-09T08:04:10.059 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-09T08:04:10.059 INFO:tasks.workunit.client.0.smithi062.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-09T08:04:10.059 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-09T08:04:10.059 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.059 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-09T08:04:10.059 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.059 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorls.sh 2024-02-09T08:04:10.059 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' '!' -t 0 ']' 2024-02-09T08:04:10.059 INFO:tasks.workunit.client.0.smithi062.stderr:+++ return 2024-02-09T08:04:10.059 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.059 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-09T08:04:10.059 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.059 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-09T08:04:10.059 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export S_COLORS=auto 2024-02-09T08:04:10.060 INFO:tasks.workunit.client.0.smithi062.stderr:+++ S_COLORS=auto 2024-02-09T08:04:10.060 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-09T08:04:10.060 INFO:tasks.workunit.client.0.smithi062.stderr:+++++ readlink /proc/41437/exe 2024-02-09T08:04:10.060 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-09T08:04:10.060 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-09T08:04:10.060 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.060 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.060 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-09T08:04:10.060 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-09T08:04:10.060 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.060 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-09T08:04:10.060 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.060 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-09T08:04:10.060 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.061 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-09T08:04:10.061 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.061 INFO:tasks.workunit.client.0.smithi062.stderr:++++ basename /usr/bin/bash 2024-02-09T08:04:10.061 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_api_c_write_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_c_write_operations.xml 2024-02-09T08:04:10.061 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_declare='declare -f' 2024-02-09T08:04:10.061 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo open_pools_parallel 2024-02-09T08:04:10.061 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_opt=-f 2024-02-09T08:04:10.061 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export which_declare 2024-02-09T08:04:10.061 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export -f which 2024-02-09T08:04:10.061 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset i 2024-02-09T08:04:10.061 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset -f pathmunge 2024-02-09T08:04:10.061 INFO:tasks.workunit.client.0.smithi062.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-09T08:04:10.061 INFO:tasks.workunit.client.0.smithi062.stderr:+ export PATH 2024-02-09T08:04:10.061 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-09T08:04:10.061 INFO:tasks.workunit.client.0.smithi062.stderr:+ unset rc 2024-02-09T08:04:10.061 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_api_c_read_operations.log 2024-02-09T08:04:10.062 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-09T08:04:10.062 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=open_pools_parallel 2024-02-09T08:04:10.062 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41555 2024-02-09T08:04:10.062 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test open_pools_parallel on pid 41555' 2024-02-09T08:04:10.062 INFO:tasks.workunit.client.0.smithi062.stdout:test open_pools_parallel on pid 41555 2024-02-09T08:04:10.073 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=41555 2024-02-09T08:04:10.073 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-09T08:04:10.073 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-09T08:04:10.073 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s delete_pools_parallel 2024-02-09T08:04:10.073 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' delete_pools_parallel' 2024-02-09T08:04:10.073 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_open_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-open_pools_parallel.xml 2>&1 | tee ceph_test_rados_open_pools_parallel.log | sed "s/^/ open_pools_parallel: /"' 2024-02-09T08:04:10.073 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -f /etc/bashrc ']' 2024-02-09T08:04:10.074 INFO:tasks.workunit.client.0.smithi062.stderr:+ . /etc/bashrc 2024-02-09T08:04:10.074 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_api_c_read_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_c_read_operations.xml 2024-02-09T08:04:10.074 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -z '' ']' 2024-02-09T08:04:10.074 INFO:tasks.workunit.client.0.smithi062.stderr:++ BASHRCSOURCED=Y 2024-02-09T08:04:10.074 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.074 INFO:tasks.workunit.client.0.smithi062.stderr:++ shopt -q login_shell 2024-02-09T08:04:10.074 INFO:tasks.workunit.client.0.smithi062.stderr:+++ umask 2024-02-09T08:04:10.074 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' 0022 -eq 0 ']' 2024-02-09T08:04:10.074 INFO:tasks.workunit.client.0.smithi062.stderr:++ SHELL=/bin/bash 2024-02-09T08:04:10.074 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.074 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-09T08:04:10.074 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.074 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-09T08:04:10.074 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-09T08:04:10.074 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-09T08:04:10.075 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-09T08:04:10.075 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-09T08:04:10.075 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.075 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-09T08:04:10.075 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.075 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-09T08:04:10.075 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:10.075 INFO:tasks.workunit.client.0.smithi062.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:10.075 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.075 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-09T08:04:10.075 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.075 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-09T08:04:10.075 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.075 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.075 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-09T08:04:10.076 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.076 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-09T08:04:10.076 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-09T08:04:10.076 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.076 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-09T08:04:10.076 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.076 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/gawk.sh 2024-02-09T08:04:10.076 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.076 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-09T08:04:10.076 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.076 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/lang.sh 2024-02-09T08:04:10.076 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup 2024-02-09T08:04:10.076 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/locale 2024-02-09T08:04:10.076 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:10.076 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-09T08:04:10.077 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:10.077 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-09T08:04:10.077 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-09T08:04:10.077 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-09T08:04:10.077 INFO:tasks.workunit.client.0.smithi062.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-09T08:04:10.077 INFO:tasks.workunit.client.0.smithi062.stderr:++++ export LANG=en_US.UTF-8 2024-02-09T08:04:10.077 INFO:tasks.workunit.client.0.smithi062.stderr:++++ LANG=en_US.UTF-8 2024-02-09T08:04:10.077 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:10.077 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-09T08:04:10.077 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:10.077 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG=en_US.UTF-8 2024-02-09T08:04:10.077 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup config 2024-02-09T08:04:10.077 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:10.077 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:10.077 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' dumb = linux ']' 2024-02-09T08:04:10.078 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.078 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-09T08:04:10.078 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.078 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/less.sh 2024-02-09T08:04:10.078 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-09T08:04:10.078 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.078 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-09T08:04:10.078 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.078 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/which2.sh 2024-02-09T08:04:10.078 INFO:tasks.workunit.client.0.smithi062.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-09T08:04:10.078 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo delete_pools_parallel 2024-02-09T08:04:10.078 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'grep=grep --color=auto' 2024-02-09T08:04:10.078 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-09T08:04:10.078 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-09T08:04:10.078 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.079 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-09T08:04:10.079 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.079 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorls.sh 2024-02-09T08:04:10.079 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' '!' -t 0 ']' 2024-02-09T08:04:10.079 INFO:tasks.workunit.client.0.smithi062.stderr:+++ return 2024-02-09T08:04:10.079 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.079 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-09T08:04:10.079 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.079 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-09T08:04:10.079 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export S_COLORS=auto 2024-02-09T08:04:10.079 INFO:tasks.workunit.client.0.smithi062.stderr:+++ S_COLORS=auto 2024-02-09T08:04:10.079 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.079 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-09T08:04:10.079 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.079 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-09T08:04:10.080 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.080 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-09T08:04:10.080 INFO:tasks.workunit.client.0.smithi062.stderr:+++++ readlink /proc/41454/exe 2024-02-09T08:04:10.080 INFO:tasks.workunit.client.0.smithi062.stderr:++++ basename /usr/bin/bash 2024-02-09T08:04:10.080 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ api_c_read_operations: /' 2024-02-09T08:04:10.080 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-09T08:04:10.080 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-09T08:04:10.080 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-09T08:04:10.080 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.080 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-09T08:04:10.080 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.080 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-09T08:04:10.080 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-09T08:04:10.080 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_declare='declare -f' 2024-02-09T08:04:10.080 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_opt=-f 2024-02-09T08:04:10.081 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export which_declare 2024-02-09T08:04:10.081 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.081 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export -f which 2024-02-09T08:04:10.081 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset i 2024-02-09T08:04:10.081 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset -f pathmunge 2024-02-09T08:04:10.081 INFO:tasks.workunit.client.0.smithi062.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-09T08:04:10.081 INFO:tasks.workunit.client.0.smithi062.stderr:+ export PATH 2024-02-09T08:04:10.081 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-09T08:04:10.081 INFO:tasks.workunit.client.0.smithi062.stderr:+ unset rc 2024-02-09T08:04:10.081 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_api_cls_remote_reads.log 2024-02-09T08:04:10.081 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_api_cls_remote_reads --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_cls_remote_reads.xml 2024-02-09T08:04:10.081 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=delete_pools_parallel 2024-02-09T08:04:10.081 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41587 2024-02-09T08:04:10.081 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test delete_pools_parallel on pid 41587' 2024-02-09T08:04:10.082 INFO:tasks.workunit.client.0.smithi062.stdout:test delete_pools_parallel on pid 41587 2024-02-09T08:04:10.089 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=41587 2024-02-09T08:04:10.089 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-02-09T08:04:10.089 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-09T08:04:10.089 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ api_cls_remote_reads: /' 2024-02-09T08:04:10.089 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_delete_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-delete_pools_parallel.xml 2>&1 | tee ceph_test_rados_delete_pools_parallel.log | sed "s/^/ delete_pools_parallel: /"' 2024-02-09T08:04:10.089 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s cls 2024-02-09T08:04:10.089 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' cls' 2024-02-09T08:04:10.089 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -f /etc/bashrc ']' 2024-02-09T08:04:10.089 INFO:tasks.workunit.client.0.smithi062.stderr:+ . /etc/bashrc 2024-02-09T08:04:10.089 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -z '' ']' 2024-02-09T08:04:10.089 INFO:tasks.workunit.client.0.smithi062.stderr:++ BASHRCSOURCED=Y 2024-02-09T08:04:10.090 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.090 INFO:tasks.workunit.client.0.smithi062.stderr:++ shopt -q login_shell 2024-02-09T08:04:10.090 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-09T08:04:10.090 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-09T08:04:10.090 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-09T08:04:10.090 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.090 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-09T08:04:10.090 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.090 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-09T08:04:10.090 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-09T08:04:10.090 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.090 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-09T08:04:10.090 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-09T08:04:10.090 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-09T08:04:10.090 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.091 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-09T08:04:10.091 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.091 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-09T08:04:10.091 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-09T08:04:10.091 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.091 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-09T08:04:10.091 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.091 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/gawk.sh 2024-02-09T08:04:10.091 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.091 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-09T08:04:10.091 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.091 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/lang.sh 2024-02-09T08:04:10.091 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup 2024-02-09T08:04:10.091 INFO:tasks.workunit.client.0.smithi062.stderr:+++ umask 2024-02-09T08:04:10.091 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' 0022 -eq 0 ']' 2024-02-09T08:04:10.092 INFO:tasks.workunit.client.0.smithi062.stderr:++ SHELL=/bin/bash 2024-02-09T08:04:10.092 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-09T08:04:10.092 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-09T08:04:10.092 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-09T08:04:10.092 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.092 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-09T08:04:10.092 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.092 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-09T08:04:10.092 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-09T08:04:10.092 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.092 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-09T08:04:10.092 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.092 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/gawk.sh 2024-02-09T08:04:10.092 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.092 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.093 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-09T08:04:10.093 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.093 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/lang.sh 2024-02-09T08:04:10.093 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup 2024-02-09T08:04:10.093 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-09T08:04:10.093 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.093 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-09T08:04:10.093 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-09T08:04:10.093 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.093 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-09T08:04:10.093 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.093 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-09T08:04:10.093 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:10.093 INFO:tasks.workunit.client.0.smithi062.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:10.093 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.094 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-09T08:04:10.094 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.094 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-09T08:04:10.094 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.094 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-09T08:04:10.094 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo cls 2024-02-09T08:04:10.094 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=cls 2024-02-09T08:04:10.094 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41627 2024-02-09T08:04:10.094 INFO:tasks.workunit.client.0.smithi062.stdout:test cls on pid 41627 2024-02-09T08:04:10.102 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test cls on pid 41627' 2024-02-09T08:04:10.102 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=41627 2024-02-09T08:04:10.102 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-02-09T08:04:10.102 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-09T08:04:10.102 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s cmd 2024-02-09T08:04:10.102 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' cmd' 2024-02-09T08:04:10.102 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_cls 2>&1 | tee ceph_test_neorados_cls.log | sed "s/^/ cls: /"' 2024-02-09T08:04:10.103 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -f /etc/bashrc ']' 2024-02-09T08:04:10.103 INFO:tasks.workunit.client.0.smithi062.stderr:+ . /etc/bashrc 2024-02-09T08:04:10.103 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -z '' ']' 2024-02-09T08:04:10.103 INFO:tasks.workunit.client.0.smithi062.stderr:++ BASHRCSOURCED=Y 2024-02-09T08:04:10.103 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.103 INFO:tasks.workunit.client.0.smithi062.stderr:++ shopt -q login_shell 2024-02-09T08:04:10.103 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/locale 2024-02-09T08:04:10.103 INFO:tasks.workunit.client.0.smithi062.stderr:+++ umask 2024-02-09T08:04:10.103 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' 0022 -eq 0 ']' 2024-02-09T08:04:10.103 INFO:tasks.workunit.client.0.smithi062.stderr:++ SHELL=/bin/bash 2024-02-09T08:04:10.103 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:10.103 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-09T08:04:10.103 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.103 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:10.103 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-09T08:04:10.104 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-09T08:04:10.104 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-09T08:04:10.104 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.104 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-09T08:04:10.104 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/locale 2024-02-09T08:04:10.104 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-09T08:04:10.104 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.104 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-09T08:04:10.104 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.104 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-09T08:04:10.104 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-09T08:04:10.104 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:10.104 INFO:tasks.workunit.client.0.smithi062.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:10.104 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.105 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-09T08:04:10.105 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.105 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-09T08:04:10.105 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.105 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-09T08:04:10.105 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo cmd 2024-02-09T08:04:10.105 INFO:tasks.workunit.client.0.smithi062.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-09T08:04:10.105 INFO:tasks.workunit.client.0.smithi062.stderr:++++ export LANG=en_US.UTF-8 2024-02-09T08:04:10.105 INFO:tasks.workunit.client.0.smithi062.stderr:++++ LANG=en_US.UTF-8 2024-02-09T08:04:10.105 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:10.105 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-09T08:04:10.105 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:10.105 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG=en_US.UTF-8 2024-02-09T08:04:10.105 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup config 2024-02-09T08:04:10.105 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:10.106 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:10.106 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:10.106 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-09T08:04:10.106 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' dumb = linux ']' 2024-02-09T08:04:10.106 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:10.106 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-09T08:04:10.106 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-09T08:04:10.106 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.106 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-09T08:04:10.106 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.106 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/less.sh 2024-02-09T08:04:10.106 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-09T08:04:10.106 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.106 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-09T08:04:10.106 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'grep=grep --color=auto' 2024-02-09T08:04:10.106 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.107 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/which2.sh 2024-02-09T08:04:10.107 INFO:tasks.workunit.client.0.smithi062.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-09T08:04:10.107 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-09T08:04:10.107 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-09T08:04:10.107 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.107 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-09T08:04:10.107 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.107 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorls.sh 2024-02-09T08:04:10.107 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' '!' -t 0 ']' 2024-02-09T08:04:10.107 INFO:tasks.workunit.client.0.smithi062.stderr:+++ return 2024-02-09T08:04:10.107 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.107 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-09T08:04:10.107 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.107 INFO:tasks.workunit.client.0.smithi062.stderr:+++++ readlink /proc/41555/exe 2024-02-09T08:04:10.107 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-09T08:04:10.108 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export S_COLORS=auto 2024-02-09T08:04:10.108 INFO:tasks.workunit.client.0.smithi062.stderr:+++ S_COLORS=auto 2024-02-09T08:04:10.108 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.108 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-09T08:04:10.108 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.108 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-09T08:04:10.108 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.108 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=cmd 2024-02-09T08:04:10.108 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41666 2024-02-09T08:04:10.108 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test cmd on pid 41666' 2024-02-09T08:04:10.108 INFO:tasks.workunit.client.0.smithi062.stdout:test cmd on pid 41666 2024-02-09T08:04:10.119 INFO:tasks.workunit.client.0.smithi062.stderr:++++ basename /usr/bin/bash 2024-02-09T08:04:10.119 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=41666 2024-02-09T08:04:10.119 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-02-09T08:04:10.119 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-09T08:04:10.119 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-09T08:04:10.120 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_declare='declare -f' 2024-02-09T08:04:10.120 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_opt=-f 2024-02-09T08:04:10.120 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export which_declare 2024-02-09T08:04:10.120 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export -f which 2024-02-09T08:04:10.120 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset i 2024-02-09T08:04:10.120 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset -f pathmunge 2024-02-09T08:04:10.120 INFO:tasks.workunit.client.0.smithi062.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-09T08:04:10.120 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s handler_error 2024-02-09T08:04:10.120 INFO:tasks.workunit.client.0.smithi062.stderr:+ export PATH 2024-02-09T08:04:10.120 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_cmd 2>&1 | tee ceph_test_neorados_cmd.log | sed "s/^/ cmd: /"' 2024-02-09T08:04:10.120 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-09T08:04:10.120 INFO:tasks.workunit.client.0.smithi062.stderr:+ unset rc 2024-02-09T08:04:10.120 INFO:tasks.workunit.client.0.smithi062.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-09T08:04:10.120 INFO:tasks.workunit.client.0.smithi062.stderr:++++ export LANG=en_US.UTF-8 2024-02-09T08:04:10.121 INFO:tasks.workunit.client.0.smithi062.stderr:++++ LANG=en_US.UTF-8 2024-02-09T08:04:10.121 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:10.121 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' handler_error' 2024-02-09T08:04:10.121 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_open_pools_parallel.log 2024-02-09T08:04:10.121 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-09T08:04:10.121 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:10.121 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG=en_US.UTF-8 2024-02-09T08:04:10.121 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ open_pools_parallel: /' 2024-02-09T08:04:10.121 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup config 2024-02-09T08:04:10.121 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:10.121 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:10.121 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' dumb = linux ']' 2024-02-09T08:04:10.121 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -f /etc/bashrc ']' 2024-02-09T08:04:10.121 INFO:tasks.workunit.client.0.smithi062.stderr:+ . /etc/bashrc 2024-02-09T08:04:10.121 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.122 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -z '' ']' 2024-02-09T08:04:10.122 INFO:tasks.workunit.client.0.smithi062.stderr:++ BASHRCSOURCED=Y 2024-02-09T08:04:10.122 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.122 INFO:tasks.workunit.client.0.smithi062.stderr:++ shopt -q login_shell 2024-02-09T08:04:10.122 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-09T08:04:10.122 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.122 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/less.sh 2024-02-09T08:04:10.122 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-09T08:04:10.122 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_open_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-open_pools_parallel.xml 2024-02-09T08:04:10.122 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.122 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-09T08:04:10.122 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.122 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/which2.sh 2024-02-09T08:04:10.122 INFO:tasks.workunit.client.0.smithi062.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-09T08:04:10.122 INFO:tasks.workunit.client.0.smithi062.stderr:+++ umask 2024-02-09T08:04:10.123 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' 0022 -eq 0 ']' 2024-02-09T08:04:10.123 INFO:tasks.workunit.client.0.smithi062.stderr:++ SHELL=/bin/bash 2024-02-09T08:04:10.123 INFO:tasks.workunit.client.0.smithi062.stderr:+++++ readlink /proc/41524/exe 2024-02-09T08:04:10.123 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.123 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-09T08:04:10.123 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.123 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-09T08:04:10.123 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-09T08:04:10.123 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.123 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-09T08:04:10.123 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.123 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-09T08:04:10.123 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:10.123 INFO:tasks.workunit.client.0.smithi062.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:10.123 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'grep=grep --color=auto' 2024-02-09T08:04:10.124 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.124 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-09T08:04:10.124 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-09T08:04:10.124 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.124 INFO:tasks.workunit.client.0.smithi062.stderr:++++ basename /usr/bin/bash 2024-02-09T08:04:10.124 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-09T08:04:10.124 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.124 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorls.sh 2024-02-09T08:04:10.124 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-09T08:04:10.124 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' '!' -t 0 ']' 2024-02-09T08:04:10.124 INFO:tasks.workunit.client.0.smithi062.stderr:+++ return 2024-02-09T08:04:10.124 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.124 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-09T08:04:10.124 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.124 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-09T08:04:10.125 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export S_COLORS=auto 2024-02-09T08:04:10.125 INFO:tasks.workunit.client.0.smithi062.stderr:+++ S_COLORS=auto 2024-02-09T08:04:10.125 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.125 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-09T08:04:10.125 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.125 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-09T08:04:10.125 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.125 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.125 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-09T08:04:10.125 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.125 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-09T08:04:10.125 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-09T08:04:10.125 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-09T08:04:10.125 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.125 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-09T08:04:10.126 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_declare='declare -f' 2024-02-09T08:04:10.126 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.126 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-09T08:04:10.126 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-09T08:04:10.126 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_opt=-f 2024-02-09T08:04:10.126 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export which_declare 2024-02-09T08:04:10.126 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.126 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export -f which 2024-02-09T08:04:10.126 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset i 2024-02-09T08:04:10.126 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset -f pathmunge 2024-02-09T08:04:10.126 INFO:tasks.workunit.client.0.smithi062.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-09T08:04:10.126 INFO:tasks.workunit.client.0.smithi062.stderr:+ export PATH 2024-02-09T08:04:10.126 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-09T08:04:10.126 INFO:tasks.workunit.client.0.smithi062.stderr:+ unset rc 2024-02-09T08:04:10.126 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_list_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-list_parallel.xml 2024-02-09T08:04:10.127 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_list_parallel.log 2024-02-09T08:04:10.127 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo handler_error 2024-02-09T08:04:10.127 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ list_parallel: /' 2024-02-09T08:04:10.127 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-09T08:04:10.127 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-09T08:04:10.127 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-09T08:04:10.127 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-09T08:04:10.127 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.127 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-09T08:04:10.127 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.127 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-09T08:04:10.127 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-09T08:04:10.127 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.127 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=handler_error 2024-02-09T08:04:10.127 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-09T08:04:10.127 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-09T08:04:10.128 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-09T08:04:10.128 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41706 2024-02-09T08:04:10.128 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.128 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-09T08:04:10.128 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.128 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-09T08:04:10.128 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test handler_error on pid 41706' 2024-02-09T08:04:10.128 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-09T08:04:10.128 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.128 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-09T08:04:10.128 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.128 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/gawk.sh 2024-02-09T08:04:10.129 INFO:tasks.workunit.client.0.smithi062.stdout:test handler_error on pid 41706 2024-02-09T08:04:10.135 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=41706 2024-02-09T08:04:10.135 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.135 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-02-09T08:04:10.135 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-09T08:04:10.135 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-09T08:04:10.136 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.136 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/lang.sh 2024-02-09T08:04:10.136 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup 2024-02-09T08:04:10.136 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s io 2024-02-09T08:04:10.136 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' io' 2024-02-09T08:04:10.136 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/locale 2024-02-09T08:04:10.136 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo io 2024-02-09T08:04:10.136 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-09T08:04:10.136 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:10.136 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-09T08:04:10.136 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:10.136 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-09T08:04:10.136 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_handler_error 2>&1 | tee ceph_test_neorados_handler_error.log | sed "s/^/ handler_error: /"' 2024-02-09T08:04:10.136 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-09T08:04:10.136 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -f /etc/bashrc ']' 2024-02-09T08:04:10.137 INFO:tasks.workunit.client.0.smithi062.stderr:+ . /etc/bashrc 2024-02-09T08:04:10.137 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'grep=grep --color=auto' 2024-02-09T08:04:10.137 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -z '' ']' 2024-02-09T08:04:10.137 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-09T08:04:10.137 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-09T08:04:10.137 INFO:tasks.workunit.client.0.smithi062.stderr:++ BASHRCSOURCED=Y 2024-02-09T08:04:10.137 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.137 INFO:tasks.workunit.client.0.smithi062.stderr:++ shopt -q login_shell 2024-02-09T08:04:10.137 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.137 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-09T08:04:10.137 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.137 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorls.sh 2024-02-09T08:04:10.137 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' '!' -t 0 ']' 2024-02-09T08:04:10.137 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-09T08:04:10.137 INFO:tasks.workunit.client.0.smithi062.stderr:+++ return 2024-02-09T08:04:10.138 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.138 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-09T08:04:10.138 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.138 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-09T08:04:10.138 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export S_COLORS=auto 2024-02-09T08:04:10.138 INFO:tasks.workunit.client.0.smithi062.stderr:+++ S_COLORS=auto 2024-02-09T08:04:10.138 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.138 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-09T08:04:10.138 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.138 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-09T08:04:10.138 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.138 INFO:tasks.workunit.client.0.smithi062.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-09T08:04:10.138 INFO:tasks.workunit.client.0.smithi062.stderr:++++ export LANG=en_US.UTF-8 2024-02-09T08:04:10.138 INFO:tasks.workunit.client.0.smithi062.stderr:++++ LANG=en_US.UTF-8 2024-02-09T08:04:10.138 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:10.139 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-09T08:04:10.139 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:10.139 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG=en_US.UTF-8 2024-02-09T08:04:10.139 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup config 2024-02-09T08:04:10.139 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:10.139 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:10.139 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' dumb = linux ']' 2024-02-09T08:04:10.139 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.139 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-09T08:04:10.139 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.139 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/less.sh 2024-02-09T08:04:10.139 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-09T08:04:10.139 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.139 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-09T08:04:10.139 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.140 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/which2.sh 2024-02-09T08:04:10.140 INFO:tasks.workunit.client.0.smithi062.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-09T08:04:10.140 INFO:tasks.workunit.client.0.smithi062.stderr:+++++ readlink /proc/41587/exe 2024-02-09T08:04:10.140 INFO:tasks.workunit.client.0.smithi062.stderr:++++ basename /usr/bin/bash 2024-02-09T08:04:10.140 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-09T08:04:10.140 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-09T08:04:10.140 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-09T08:04:10.140 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.140 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=io 2024-02-09T08:04:10.140 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-09T08:04:10.140 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.140 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-09T08:04:10.140 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41724 2024-02-09T08:04:10.140 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test io on pid 41724' 2024-02-09T08:04:10.141 INFO:tasks.workunit.client.0.smithi062.stdout:test io on pid 41724 2024-02-09T08:04:10.145 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=41724 2024-02-09T08:04:10.145 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-02-09T08:04:10.146 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-09T08:04:10.146 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_declare='declare -f' 2024-02-09T08:04:10.146 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_opt=-f 2024-02-09T08:04:10.146 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export which_declare 2024-02-09T08:04:10.146 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export -f which 2024-02-09T08:04:10.146 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset i 2024-02-09T08:04:10.146 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset -f pathmunge 2024-02-09T08:04:10.146 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-09T08:04:10.146 INFO:tasks.workunit.client.0.smithi062.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-09T08:04:10.146 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.146 INFO:tasks.workunit.client.0.smithi062.stderr:+ export PATH 2024-02-09T08:04:10.146 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-09T08:04:10.146 INFO:tasks.workunit.client.0.smithi062.stderr:+ unset rc 2024-02-09T08:04:10.146 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_delete_pools_parallel.log 2024-02-09T08:04:10.146 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s ec_io 2024-02-09T08:04:10.147 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' ec_io' 2024-02-09T08:04:10.147 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ delete_pools_parallel: /' 2024-02-09T08:04:10.147 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo ec_io 2024-02-09T08:04:10.147 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_io 2>&1 | tee ceph_test_neorados_io.log | sed "s/^/ io: /"' 2024-02-09T08:04:10.147 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-09T08:04:10.147 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -f /etc/bashrc ']' 2024-02-09T08:04:10.147 INFO:tasks.workunit.client.0.smithi062.stderr:+ . /etc/bashrc 2024-02-09T08:04:10.147 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -z '' ']' 2024-02-09T08:04:10.147 INFO:tasks.workunit.client.0.smithi062.stderr:++ BASHRCSOURCED=Y 2024-02-09T08:04:10.147 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.147 INFO:tasks.workunit.client.0.smithi062.stderr:++ shopt -q login_shell 2024-02-09T08:04:10.147 INFO:tasks.workunit.client.0.smithi062.stderr:+++ umask 2024-02-09T08:04:10.147 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' 0022 -eq 0 ']' 2024-02-09T08:04:10.147 INFO:tasks.workunit.client.0.smithi062.stderr:++ SHELL=/bin/bash 2024-02-09T08:04:10.147 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.148 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-09T08:04:10.148 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.148 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-09T08:04:10.148 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-09T08:04:10.148 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.148 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-09T08:04:10.148 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.148 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-09T08:04:10.148 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:10.148 INFO:tasks.workunit.client.0.smithi062.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:10.148 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.148 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-09T08:04:10.148 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.148 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-09T08:04:10.149 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.149 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=ec_io 2024-02-09T08:04:10.149 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41737 2024-02-09T08:04:10.149 INFO:tasks.workunit.client.0.smithi062.stdout:test ec_io on pid 41737 2024-02-09T08:04:10.154 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test ec_io on pid 41737' 2024-02-09T08:04:10.155 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=41737 2024-02-09T08:04:10.155 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_ec_io 2>&1 | tee ceph_test_neorados_ec_io.log | sed "s/^/ ec_io: /"' 2024-02-09T08:04:10.155 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-02-09T08:04:10.155 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-09T08:04:10.155 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s list 2024-02-09T08:04:10.155 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' list' 2024-02-09T08:04:10.155 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo list 2024-02-09T08:04:10.155 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-09T08:04:10.155 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -f /etc/bashrc ']' 2024-02-09T08:04:10.155 INFO:tasks.workunit.client.0.smithi062.stderr:+ . /etc/bashrc 2024-02-09T08:04:10.155 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -z '' ']' 2024-02-09T08:04:10.155 INFO:tasks.workunit.client.0.smithi062.stderr:++ BASHRCSOURCED=Y 2024-02-09T08:04:10.155 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.156 INFO:tasks.workunit.client.0.smithi062.stderr:++ shopt -q login_shell 2024-02-09T08:04:10.156 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-09T08:04:10.156 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-09T08:04:10.156 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-09T08:04:10.156 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.156 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-09T08:04:10.156 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.156 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-09T08:04:10.156 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-09T08:04:10.156 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.156 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-09T08:04:10.156 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.156 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/gawk.sh 2024-02-09T08:04:10.156 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.156 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-09T08:04:10.157 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.157 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/lang.sh 2024-02-09T08:04:10.157 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup 2024-02-09T08:04:10.157 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/locale 2024-02-09T08:04:10.157 INFO:tasks.workunit.client.0.smithi062.stderr:+++ umask 2024-02-09T08:04:10.157 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' 0022 -eq 0 ']' 2024-02-09T08:04:10.157 INFO:tasks.workunit.client.0.smithi062.stderr:++ SHELL=/bin/bash 2024-02-09T08:04:10.157 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.157 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-09T08:04:10.157 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.157 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-09T08:04:10.157 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-09T08:04:10.157 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.157 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-09T08:04:10.157 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.158 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-09T08:04:10.158 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:10.158 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-09T08:04:10.158 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:10.158 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-09T08:04:10.158 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-09T08:04:10.158 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:10.158 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'grep=grep --color=auto' 2024-02-09T08:04:10.158 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-09T08:04:10.158 INFO:tasks.workunit.client.0.smithi062.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:10.158 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.158 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-09T08:04:10.158 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-09T08:04:10.158 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.158 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-09T08:04:10.159 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.159 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-09T08:04:10.159 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.159 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=list 2024-02-09T08:04:10.159 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-09T08:04:10.159 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-09T08:04:10.159 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-09T08:04:10.159 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-09T08:04:10.159 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41752 2024-02-09T08:04:10.159 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.159 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test list on pid 41752' 2024-02-09T08:04:10.159 INFO:tasks.workunit.client.0.smithi062.stdout:test list on pid 41752 2024-02-09T08:04:10.177 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-09T08:04:10.177 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=41752 2024-02-09T08:04:10.177 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.177 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-09T08:04:10.177 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-02-09T08:04:10.177 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-09T08:04:10.178 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.178 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-09T08:04:10.178 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.178 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-09T08:04:10.178 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.178 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/gawk.sh 2024-02-09T08:04:10.178 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorls.sh 2024-02-09T08:04:10.178 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.178 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-09T08:04:10.178 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_list 2>&1 | tee ceph_test_neorados_list.log | sed "s/^/ list: /"' 2024-02-09T08:04:10.178 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.178 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/lang.sh 2024-02-09T08:04:10.178 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup 2024-02-09T08:04:10.178 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' '!' -t 0 ']' 2024-02-09T08:04:10.179 INFO:tasks.workunit.client.0.smithi062.stderr:+++ return 2024-02-09T08:04:10.179 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.179 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-09T08:04:10.179 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.179 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -f /etc/bashrc ']' 2024-02-09T08:04:10.179 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-09T08:04:10.179 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export S_COLORS=auto 2024-02-09T08:04:10.179 INFO:tasks.workunit.client.0.smithi062.stderr:+++ S_COLORS=auto 2024-02-09T08:04:10.179 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.179 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-09T08:04:10.179 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.179 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-09T08:04:10.179 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.179 INFO:tasks.workunit.client.0.smithi062.stderr:+ . /etc/bashrc 2024-02-09T08:04:10.179 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/locale 2024-02-09T08:04:10.180 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -z '' ']' 2024-02-09T08:04:10.180 INFO:tasks.workunit.client.0.smithi062.stderr:++ BASHRCSOURCED=Y 2024-02-09T08:04:10.180 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.180 INFO:tasks.workunit.client.0.smithi062.stderr:++ shopt -q login_shell 2024-02-09T08:04:10.180 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s ec_list 2024-02-09T08:04:10.180 INFO:tasks.workunit.client.0.smithi062.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-09T08:04:10.180 INFO:tasks.workunit.client.0.smithi062.stderr:++++ export LANG=en_US.UTF-8 2024-02-09T08:04:10.180 INFO:tasks.workunit.client.0.smithi062.stderr:++++ LANG=en_US.UTF-8 2024-02-09T08:04:10.180 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' ec_list' 2024-02-09T08:04:10.180 INFO:tasks.workunit.client.0.smithi062.stderr:+++ umask 2024-02-09T08:04:10.180 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:10.180 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-09T08:04:10.180 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:10.180 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG=en_US.UTF-8 2024-02-09T08:04:10.181 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup config 2024-02-09T08:04:10.181 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' 0022 -eq 0 ']' 2024-02-09T08:04:10.181 INFO:tasks.workunit.client.0.smithi062.stderr:++ SHELL=/bin/bash 2024-02-09T08:04:10.181 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:10.181 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.181 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-09T08:04:10.181 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.181 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-09T08:04:10.181 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-09T08:04:10.181 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:10.181 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' dumb = linux ']' 2024-02-09T08:04:10.181 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.181 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.181 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-09T08:04:10.182 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.182 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-09T08:04:10.182 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:10.182 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-09T08:04:10.182 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.182 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/less.sh 2024-02-09T08:04:10.182 INFO:tasks.workunit.client.0.smithi062.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:10.182 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-09T08:04:10.182 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.182 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-09T08:04:10.182 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.182 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/which2.sh 2024-02-09T08:04:10.182 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.182 INFO:tasks.workunit.client.0.smithi062.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-09T08:04:10.183 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-09T08:04:10.183 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.183 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-09T08:04:10.183 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.183 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:10.183 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-09T08:04:10.183 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:10.183 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-09T08:04:10.183 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-09T08:04:10.183 INFO:tasks.workunit.client.0.smithi062.stderr:+++++ readlink /proc/41627/exe 2024-02-09T08:04:10.183 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-09T08:04:10.183 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'grep=grep --color=auto' 2024-02-09T08:04:10.183 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-09T08:04:10.183 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-09T08:04:10.183 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.184 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-09T08:04:10.184 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.184 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorls.sh 2024-02-09T08:04:10.184 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' '!' -t 0 ']' 2024-02-09T08:04:10.184 INFO:tasks.workunit.client.0.smithi062.stderr:+++ return 2024-02-09T08:04:10.184 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.184 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-09T08:04:10.184 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.184 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-09T08:04:10.184 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export S_COLORS=auto 2024-02-09T08:04:10.184 INFO:tasks.workunit.client.0.smithi062.stderr:+++ S_COLORS=auto 2024-02-09T08:04:10.184 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.184 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-09T08:04:10.184 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.184 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-09T08:04:10.185 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.185 INFO:tasks.workunit.client.0.smithi062.stderr:++++ basename /usr/bin/bash 2024-02-09T08:04:10.185 INFO:tasks.workunit.client.0.smithi062.stderr:+++ umask 2024-02-09T08:04:10.185 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' 0022 -eq 0 ']' 2024-02-09T08:04:10.185 INFO:tasks.workunit.client.0.smithi062.stderr:++ SHELL=/bin/bash 2024-02-09T08:04:10.185 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.185 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-09T08:04:10.185 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.185 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-09T08:04:10.185 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-09T08:04:10.185 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.185 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-09T08:04:10.185 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.185 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-09T08:04:10.185 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:10.186 INFO:tasks.workunit.client.0.smithi062.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:10.186 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.186 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-09T08:04:10.186 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.186 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-09T08:04:10.186 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.186 INFO:tasks.workunit.client.0.smithi062.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-09T08:04:10.186 INFO:tasks.workunit.client.0.smithi062.stderr:++++ export LANG=en_US.UTF-8 2024-02-09T08:04:10.186 INFO:tasks.workunit.client.0.smithi062.stderr:++++ LANG=en_US.UTF-8 2024-02-09T08:04:10.186 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:10.186 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-09T08:04:10.186 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_declare='declare -f' 2024-02-09T08:04:10.186 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:10.186 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG=en_US.UTF-8 2024-02-09T08:04:10.186 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup config 2024-02-09T08:04:10.187 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_opt=-f 2024-02-09T08:04:10.187 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:10.187 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export which_declare 2024-02-09T08:04:10.187 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'grep=grep --color=auto' 2024-02-09T08:04:10.187 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:10.187 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' dumb = linux ']' 2024-02-09T08:04:10.187 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-09T08:04:10.187 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.187 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-09T08:04:10.187 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-09T08:04:10.187 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.187 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/less.sh 2024-02-09T08:04:10.187 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.187 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-09T08:04:10.187 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.188 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorls.sh 2024-02-09T08:04:10.188 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-09T08:04:10.188 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.188 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-09T08:04:10.188 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.188 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/which2.sh 2024-02-09T08:04:10.188 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' '!' -t 0 ']' 2024-02-09T08:04:10.188 INFO:tasks.workunit.client.0.smithi062.stderr:+++ return 2024-02-09T08:04:10.188 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.188 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-09T08:04:10.188 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.188 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-09T08:04:10.188 INFO:tasks.workunit.client.0.smithi062.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-09T08:04:10.188 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export S_COLORS=auto 2024-02-09T08:04:10.189 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export -f which 2024-02-09T08:04:10.189 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset i 2024-02-09T08:04:10.189 INFO:tasks.workunit.client.0.smithi062.stderr:+++ S_COLORS=auto 2024-02-09T08:04:10.189 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.189 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-09T08:04:10.189 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.189 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-09T08:04:10.189 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.189 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset -f pathmunge 2024-02-09T08:04:10.189 INFO:tasks.workunit.client.0.smithi062.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-09T08:04:10.189 INFO:tasks.workunit.client.0.smithi062.stderr:+ export PATH 2024-02-09T08:04:10.189 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-09T08:04:10.189 INFO:tasks.workunit.client.0.smithi062.stderr:+ unset rc 2024-02-09T08:04:10.189 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_neorados_cls 2024-02-09T08:04:10.190 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ cls: /' 2024-02-09T08:04:10.190 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_delete_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-delete_pools_parallel.xml 2024-02-09T08:04:10.190 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-09T08:04:10.190 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-09T08:04:10.190 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-09T08:04:10.190 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.190 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-09T08:04:10.190 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.190 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-09T08:04:10.190 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-09T08:04:10.190 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.190 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-09T08:04:10.190 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-09T08:04:10.190 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-09T08:04:10.190 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.190 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-09T08:04:10.191 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.191 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-09T08:04:10.191 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-09T08:04:10.191 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.191 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-09T08:04:10.191 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-09T08:04:10.191 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-09T08:04:10.191 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.191 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-09T08:04:10.191 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.191 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-09T08:04:10.191 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-09T08:04:10.191 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.191 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-09T08:04:10.191 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.192 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/gawk.sh 2024-02-09T08:04:10.192 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.192 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-09T08:04:10.192 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.192 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/lang.sh 2024-02-09T08:04:10.192 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup 2024-02-09T08:04:10.192 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/locale 2024-02-09T08:04:10.192 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'grep=grep --color=auto' 2024-02-09T08:04:10.192 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-09T08:04:10.192 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-09T08:04:10.192 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.192 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-09T08:04:10.192 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.192 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorls.sh 2024-02-09T08:04:10.193 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' '!' -t 0 ']' 2024-02-09T08:04:10.193 INFO:tasks.workunit.client.0.smithi062.stderr:+++ return 2024-02-09T08:04:10.193 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.193 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-09T08:04:10.193 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.193 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-09T08:04:10.193 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export S_COLORS=auto 2024-02-09T08:04:10.193 INFO:tasks.workunit.client.0.smithi062.stderr:+++ S_COLORS=auto 2024-02-09T08:04:10.193 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.193 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-09T08:04:10.193 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:10.193 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-09T08:04:10.193 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.193 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:10.193 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-09T08:04:10.194 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.194 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-09T08:04:10.194 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-09T08:04:10.194 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-09T08:04:10.194 INFO:tasks.workunit.client.0.smithi062.stdout:equest method 2 preferred_modes [2,1] 2024-02-09T08:04:10.194 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.791+0000 7f6e871a2640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:04:10.194 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.791+0000 7f6e871a2640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:04:10.194 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.791+0000 7f6e881a4640 10 monclient(hunting): handle_auth_done global_id 4446 payload 824 2024-02-09T08:04:10.194 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.791+0000 7f6e881a4640 1 -- 172.21.15.62:0/4151497593 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55c0f27e2b80 msgr2=0x55c0f2866150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:04:10.194 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.791+0000 7f6e881a4640 1 --2- 172.21.15.62:0/4151497593 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55c0f27e2b80 0x55c0f2866150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:04:10.195 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.791+0000 7f6e881a4640 1 -- 172.21.15.62:0/4151497593 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c0f27e2590 msgr2=0x55c0f2865c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:04:10.195 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.791+0000 7f6e881a4640 1 --2- 172.21.15.62:0/4151497593 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c0f27e2590 0x55c0f2865c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:04:10.195 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.791+0000 7f6e881a4640 10 monclient: _finish_hunting 0 2024-02-09T08:04:10.195 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.791+0000 7f6e881a4640 1 monclient: found mon.noname-a 2024-02-09T08:04:10.195 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.791+0000 7f6e881a4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:04:10.195 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.791+0000 7f6e881a4640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-02-09T08:04:10.195 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.791+0000 7f6e881a4640 1 -- 172.21.15.62:0/4151497593 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c0f271e5a0 con 0x55c0f27e45f0 2024-02-09T08:04:10.195 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.828+0000 7f6e881a4640 1 --2- 172.21.15.62:0/4151497593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c0f27e45f0 0x55c0f2866690 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6e7800a4f0 tx=0x7f6e78002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:04:10.195 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.828+0000 7f6e8519e640 10 client.?.objecter ms_handle_connect 0x55c0f27e45f0 2024-02-09T08:04:10.195 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.828+0000 7f6e8519e640 10 client.?.objecter resend_mon_ops 2024-02-09T08:04:10.195 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.984+0000 7f6e8519e640 1 -- 172.21.15.62:0/4151497593 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e78052bb0 con 0x55c0f27e45f0 2024-02-09T08:04:10.195 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.984+0000 7f6e8519e640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:04:10.195 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.984+0000 7f6e8519e640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-09T08:04:10.195 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.984+0000 7f6e8519e640 10 monclient: dump: 2024-02-09T08:04:10.196 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: epoch 1 2024-02-09T08:04:10.196 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:04:10.196 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:04:10.196 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:04:10.196 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: min_mon_release 19 (squid) 2024-02-09T08:04:10.196 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: election_strategy: 1 2024-02-09T08:04:10.196 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:04:10.196 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:04:10.196 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:04:10.196 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:10.196 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.984+0000 7f6e8519e640 10 monclient: _finish_auth 0 2024-02-09T08:04:10.201 INFO:tasks.workunit.client.0.smithi062.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-09T08:04:10.201 INFO:tasks.workunit.client.0.smithi062.stderr:++++ export LANG=en_US.UTF-8 2024-02-09T08:04:10.201 INFO:tasks.workunit.client.0.smithi062.stderr:++++ LANG=en_US.UTF-8 2024-02-09T08:04:10.201 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:10.201 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-09T08:04:10.201 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:10.201 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG=en_US.UTF-8 2024-02-09T08:04:10.202 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup config 2024-02-09T08:04:10.202 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:10.202 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:10.202 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' dumb = linux ']' 2024-02-09T08:04:10.202 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.202 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-09T08:04:10.202 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.202 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/less.sh 2024-02-09T08:04:10.202 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-09T08:04:10.202 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.202 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-09T08:04:10.202 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.202 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/which2.sh 2024-02-09T08:04:10.202 INFO:tasks.workunit.client.0.smithi062.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-09T08:04:10.202 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-09T08:04:10.203 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-09T08:04:10.203 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-09T08:04:10.203 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.203 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-09T08:04:10.203 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.203 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-09T08:04:10.203 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-09T08:04:10.203 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.203 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_neorados_cls.log 2024-02-09T08:04:10.203 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-09T08:04:10.203 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-09T08:04:10.203 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-09T08:04:10.203 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-09T08:04:10.203 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.203 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-09T08:04:10.204 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.204 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-09T08:04:10.204 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-09T08:04:10.204 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.204 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-09T08:04:10.204 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.204 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/gawk.sh 2024-02-09T08:04:10.204 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.204 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-09T08:04:10.204 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.204 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/lang.sh 2024-02-09T08:04:10.204 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup 2024-02-09T08:04:10.204 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo ec_list 2024-02-09T08:04:10.204 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/locale 2024-02-09T08:04:10.204 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=ec_list 2024-02-09T08:04:10.205 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41812 2024-02-09T08:04:10.205 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09Ttest ec_list on pid 41812 2024-02-09T08:04:10.211 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test ec_list on pid 41812' 2024-02-09T08:04:10.211 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=41812 2024-02-09T08:04:10.212 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-02-09T08:04:10.212 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-09T08:04:10.212 INFO:tasks.workunit.client.0.smithi062.stderr:+++++ readlink /proc/41666/exe 2024-02-09T08:04:10.212 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-09T08:04:10.212 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-09T08:04:10.212 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-09T08:04:10.212 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.212 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-09T08:04:10.212 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.212 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-09T08:04:10.212 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-09T08:04:10.212 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.212 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-09T08:04:10.212 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.212 INFO:tasks.workunit.client.0.smithi062.stderr:++++ basename /usr/bin/bash 2024-02-09T08:04:10.213 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/gawk.sh 2024-02-09T08:04:10.213 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_ec_list 2>&1 | tee ceph_test_neorados_ec_list.log | sed "s/^/ ec_list: /"' 2024-02-09T08:04:10.213 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.213 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-09T08:04:10.213 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.213 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/lang.sh 2024-02-09T08:04:10.213 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup 2024-02-09T08:04:10.213 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_declare='declare -f' 2024-02-09T08:04:10.213 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_opt=-f 2024-02-09T08:04:10.213 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export which_declare 2024-02-09T08:04:10.213 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export -f which 2024-02-09T08:04:10.213 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -f /etc/bashrc ']' 2024-02-09T08:04:10.213 INFO:tasks.workunit.client.0.smithi062.stderr:+ . /etc/bashrc 2024-02-09T08:04:10.213 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset i 2024-02-09T08:04:10.213 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset -f pathmunge 2024-02-09T08:04:10.214 INFO:tasks.workunit.client.0.smithi062.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-09T08:04:10.214 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -z '' ']' 2024-02-09T08:04:10.215 INFO:tasks.workunit.client.0.smithi062.stderr:++ BASHRCSOURCED=Y 2024-02-09T08:04:10.215 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.215 INFO:tasks.workunit.client.0.smithi062.stderr:++ shopt -q login_shell 2024-02-09T08:04:10.215 INFO:tasks.workunit.client.0.smithi062.stderr:+ export PATH 2024-02-09T08:04:10.215 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-09T08:04:10.215 INFO:tasks.workunit.client.0.smithi062.stderr:+ unset rc 2024-02-09T08:04:10.215 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s misc 2024-02-09T08:04:10.215 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' misc' 2024-02-09T08:04:10.216 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_neorados_cmd 2024-02-09T08:04:10.216 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/locale 2024-02-09T08:04:10.216 INFO:tasks.workunit.client.0.smithi062.stderr:+++ umask 2024-02-09T08:04:10.216 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' 0022 -eq 0 ']' 2024-02-09T08:04:10.216 INFO:tasks.workunit.client.0.smithi062.stderr:++ SHELL=/bin/bash 2024-02-09T08:04:10.216 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.216 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-09T08:04:10.216 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.216 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-09T08:04:10.216 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-09T08:04:10.216 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-09T08:04:10.216 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.216 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-09T08:04:10.216 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.216 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-09T08:04:10.217 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-09T08:04:10.217 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.217 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-09T08:04:10.217 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo misc 2024-02-09T08:04:10.217 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-09T08:04:10.217 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-09T08:04:10.217 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.217 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-09T08:04:10.217 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.217 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-09T08:04:10.217 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:10.217 INFO:tasks.workunit.client.0.smithi062.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:10.217 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.217 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-09T08:04:10.217 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.218 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-09T08:04:10.218 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.218 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=misc 2024-02-09T08:04:10.218 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41846 2024-02-09T08:04:10.218 INFO:tasks.workunit.client.0.smithi062.stdout:test misc on pid 41846 2024-02-09T08:04:10.233 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test misc on pid 41846' 2024-02-09T08:04:10.234 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=41846 2024-02-09T08:04:10.234 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-02-09T08:04:10.234 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-09T08:04:10.234 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_neorados_cmd.log 2024-02-09T08:04:10.234 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ cmd: /' 2024-02-09T08:04:10.234 INFO:tasks.workunit.client.0.smithi062.stderr:+++++ readlink /proc/41737/exe 2024-02-09T08:04:10.234 INFO:tasks.workunit.client.0.smithi062.stderr:++++ basename /usr/bin/bash 2024-02-09T08:04:10.234 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s pool 2024-02-09T08:04:10.234 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_declare='declare -f' 2024-02-09T08:04:10.234 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_opt=-f 2024-02-09T08:04:10.234 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export which_declare 2024-02-09T08:04:10.234 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export -f which 2024-02-09T08:04:10.234 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset i 2024-02-09T08:04:10.235 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset -f pathmunge 2024-02-09T08:04:10.235 INFO:tasks.workunit.client.0.smithi062.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-09T08:04:10.235 INFO:tasks.workunit.client.0.smithi062.stderr:+ export PATH 2024-02-09T08:04:10.235 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-09T08:04:10.235 INFO:tasks.workunit.client.0.smithi062.stderr:+ unset rc 2024-02-09T08:04:10.235 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:10.235 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-09T08:04:10.235 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:10.235 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-09T08:04:10.235 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-09T08:04:10.235 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_neorados_ec_io.log 2024-02-09T08:04:10.235 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' pool' 2024-02-09T08:04:10.235 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ ec_io: /' 2024-02-09T08:04:10.235 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-09T08:04:10.235 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:10.236 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-09T08:04:10.236 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_misc 2>&1 | tee ceph_test_neorados_misc.log | sed "s/^/ misc: /"' 2024-02-09T08:04:10.236 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:10.236 INFO:tasks.workunit.client.0.smithi062.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-09T08:04:10.236 INFO:tasks.workunit.client.0.smithi062.stderr:++++ export LANG=en_US.UTF-8 2024-02-09T08:04:10.236 INFO:tasks.workunit.client.0.smithi062.stderr:++++ LANG=en_US.UTF-8 2024-02-09T08:04:10.236 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:10.236 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-09T08:04:10.236 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:10.236 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-09T08:04:10.236 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG=en_US.UTF-8 2024-02-09T08:04:10.236 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup config 2024-02-09T08:04:10.236 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:10.236 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-09T08:04:10.237 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:10.237 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' dumb = linux ']' 2024-02-09T08:04:10.237 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.237 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-09T08:04:10.237 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.237 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/less.sh 2024-02-09T08:04:10.237 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-09T08:04:10.237 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.237 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-09T08:04:10.237 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.237 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/which2.sh 2024-02-09T08:04:10.237 INFO:tasks.workunit.client.0.smithi062.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-09T08:04:10.237 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-09T08:04:10.237 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-09T08:04:10.238 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-09T08:04:10.238 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-09T08:04:10.238 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.238 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-09T08:04:10.238 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.238 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-09T08:04:10.238 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-09T08:04:10.238 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.238 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-09T08:04:10.238 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.238 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/gawk.sh 2024-02-09T08:04:10.238 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.238 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-09T08:04:10.238 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.238 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/lang.sh 2024-02-09T08:04:10.239 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup 2024-02-09T08:04:10.239 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/locale 2024-02-09T08:04:10.239 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_neorados_ec_io 2024-02-09T08:04:10.239 INFO:tasks.workunit.client.0.smithi062.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-09T08:04:10.239 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'grep=grep --color=auto' 2024-02-09T08:04:10.239 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-09T08:04:10.239 INFO:tasks.workunit.client.0.smithi062.stderr:++++ export LANG=en_US.UTF-8 2024-02-09T08:04:10.239 INFO:tasks.workunit.client.0.smithi062.stderr:++++ LANG=en_US.UTF-8 2024-02-09T08:04:10.239 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:10.239 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-09T08:04:10.239 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:10.239 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG=en_US.UTF-8 2024-02-09T08:04:10.239 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup config 2024-02-09T08:04:10.239 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:10.239 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-09T08:04:10.240 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.240 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-09T08:04:10.240 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.240 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorls.sh 2024-02-09T08:04:10.240 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' '!' -t 0 ']' 2024-02-09T08:04:10.240 INFO:tasks.workunit.client.0.smithi062.stderr:+++ return 2024-02-09T08:04:10.240 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.240 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-09T08:04:10.240 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.240 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-09T08:04:10.240 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export S_COLORS=auto 2024-02-09T08:04:10.240 INFO:tasks.workunit.client.0.smithi062.stderr:+++ S_COLORS=auto 2024-02-09T08:04:10.240 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.240 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-09T08:04:10.240 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.241 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-09T08:04:10.241 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:10.241 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.241 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' dumb = linux ']' 2024-02-09T08:04:10.241 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.241 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-09T08:04:10.241 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.241 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/less.sh 2024-02-09T08:04:10.241 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-09T08:04:10.241 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.241 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-09T08:04:10.241 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.241 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/which2.sh 2024-02-09T08:04:10.241 INFO:tasks.workunit.client.0.smithi062.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-09T08:04:10.242 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -f /etc/bashrc ']' 2024-02-09T08:04:10.242 INFO:tasks.workunit.client.0.smithi062.stderr:+ . /etc/bashrc 2024-02-09T08:04:10.242 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -z '' ']' 2024-02-09T08:04:10.242 INFO:tasks.workunit.client.0.smithi062.stderr:++ BASHRCSOURCED=Y 2024-02-09T08:04:10.242 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.242 INFO:tasks.workunit.client.0.smithi062.stderr:++ shopt -q login_shell 2024-02-09T08:04:10.242 INFO:tasks.workunit.client.0.smithi062.stderr:+++++ readlink /proc/41752/exe 2024-02-09T08:04:10.242 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:10.242 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-09T08:04:10.242 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:10.242 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-09T08:04:10.242 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-09T08:04:10.242 INFO:tasks.workunit.client.0.smithi062.stderr:++++ basename /usr/bin/bash 2024-02-09T08:04:10.242 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_declare='declare -f' 2024-02-09T08:04:10.243 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_opt=-f 2024-02-09T08:04:10.243 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export which_declare 2024-02-09T08:04:10.243 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export -f which 2024-02-09T08:04:10.243 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-09T08:04:10.243 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-09T08:04:10.243 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-09T08:04:10.243 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.243 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-09T08:04:10.243 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.243 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-09T08:04:10.243 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset i 2024-02-09T08:04:10.243 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-09T08:04:10.243 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.243 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset -f pathmunge 2024-02-09T08:04:10.244 INFO:tasks.workunit.client.0.smithi062.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-09T08:04:10.244 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-09T08:04:10.244 INFO:tasks.workunit.client.0.smithi062.stderr:+ export PATH 2024-02-09T08:04:10.244 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-09T08:04:10.244 INFO:tasks.workunit.client.0.smithi062.stderr:+ unset rc 2024-02-09T08:04:10.244 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_neorados_list 2024-02-09T08:04:10.244 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_neorados_list.log 2024-02-09T08:04:10.244 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo pool 2024-02-09T08:04:10.244 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-09T08:04:10.244 INFO:tasks.workunit.client.0.smithi062.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-09T08:04:10.244 INFO:tasks.workunit.client.0.smithi062.stderr:++++ export LANG=en_US.UTF-8 2024-02-09T08:04:10.244 INFO:tasks.workunit.client.0.smithi062.stderr:++++ LANG=en_US.UTF-8 2024-02-09T08:04:10.244 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:10.244 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-09T08:04:10.245 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:10.245 INFO:tasks.workunit.client.0.smithi062.stderr:+++++ readlink /proc/41724/exe 2024-02-09T08:04:10.245 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG=en_US.UTF-8 2024-02-09T08:04:10.245 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup config 2024-02-09T08:04:10.245 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:10.245 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:10.245 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' dumb = linux ']' 2024-02-09T08:04:10.245 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.245 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-09T08:04:10.245 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.245 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/less.sh 2024-02-09T08:04:10.245 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-09T08:04:10.245 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.245 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-09T08:04:10.245 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.246 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/which2.sh 2024-02-09T08:04:10.246 INFO:tasks.workunit.client.0.smithi062.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-09T08:04:10.246 INFO:tasks.workunit.client.0.smithi062.stderr:++++ basename /usr/bin/bash 2024-02-09T08:04:10.246 INFO:tasks.workunit.client.0.smithi062.stderr:+++++ readlink /proc/41706/exe 2024-02-09T08:04:10.246 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_declare='declare -f' 2024-02-09T08:04:10.246 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_opt=-f 2024-02-09T08:04:10.246 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export which_declare 2024-02-09T08:04:10.246 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=pool 2024-02-09T08:04:10.246 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export -f which 2024-02-09T08:04:10.246 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset i 2024-02-09T08:04:10.246 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41892 2024-02-09T08:04:10.246 INFO:tasks.workunit.client.0.smithi062.stdout:test pool on pid 41892 2024-02-09T08:04:10.251 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test pool on pid 41892' 2024-02-09T08:04:10.252 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=41892 2024-02-09T08:04:10.252 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-02-09T08:04:10.252 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-09T08:04:10.252 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset -f pathmunge 2024-02-09T08:04:10.252 INFO:tasks.workunit.client.0.smithi062.stderr:++++ basename /usr/bin/bash 2024-02-09T08:04:10.252 INFO:tasks.workunit.client.0.smithi062.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-09T08:04:10.252 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_pool 2>&1 | tee ceph_test_neorados_pool.log | sed "s/^/ pool: /"' 2024-02-09T08:04:10.252 INFO:tasks.workunit.client.0.smithi062.stderr:+ export PATH 2024-02-09T08:04:10.252 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-09T08:04:10.252 INFO:tasks.workunit.client.0.smithi062.stderr:+ unset rc 2024-02-09T08:04:10.252 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_declare='declare -f' 2024-02-09T08:04:10.252 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s read_operations 2024-02-09T08:04:10.252 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_opt=-f 2024-02-09T08:04:10.253 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export which_declare 2024-02-09T08:04:10.253 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export -f which 2024-02-09T08:04:10.253 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset i 2024-02-09T08:04:10.253 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset -f pathmunge 2024-02-09T08:04:10.253 INFO:tasks.workunit.client.0.smithi062.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-09T08:04:10.253 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ io: /' 2024-02-09T08:04:10.253 INFO:tasks.workunit.client.0.smithi062.stderr:+ export PATH 2024-02-09T08:04:10.253 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' read_operations' 2024-02-09T08:04:10.253 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-09T08:04:10.253 INFO:tasks.workunit.client.0.smithi062.stderr:+ unset rc 2024-02-09T08:04:10.253 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_neorados_io.log 2024-02-09T08:04:10.253 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ handler_error: /' 2024-02-09T08:04:10.253 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo read_operations 2024-02-09T08:04:10.253 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_neorados_io 2024-02-09T08:04:10.253 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -f /etc/bashrc ']' 2024-02-09T08:04:10.254 INFO:tasks.workunit.client.0.smithi062.stderr:+ . /etc/bashrc 2024-02-09T08:04:10.254 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -z '' ']' 2024-02-09T08:04:10.254 INFO:tasks.workunit.client.0.smithi062.stderr:++ BASHRCSOURCED=Y 2024-02-09T08:04:10.254 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.254 INFO:tasks.workunit.client.0.smithi062.stderr:++ shopt -q login_shell 2024-02-09T08:04:10.254 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_neorados_handler_error 2024-02-09T08:04:10.254 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_neorados_handler_error.log 2024-02-09T08:04:10.254 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-09T08:04:10.254 INFO:tasks.workunit.client.0.smithi062.stderr:+++ umask 2024-02-09T08:04:10.254 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' 0022 -eq 0 ']' 2024-02-09T08:04:10.254 INFO:tasks.workunit.client.0.smithi062.stderr:++ SHELL=/bin/bash 2024-02-09T08:04:10.254 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.254 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-09T08:04:10.254 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.254 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-09T08:04:10.255 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-09T08:04:10.255 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.255 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-09T08:04:10.255 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.255 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-09T08:04:10.255 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:10.255 INFO:tasks.workunit.client.0.smithi062.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:10.255 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.255 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-09T08:04:10.255 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.255 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-09T08:04:10.255 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.255 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=read_operations 2024-02-09T08:04:10.255 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41913 2024-02-09T08:04:10.255 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test read_operations on pid 41913' 2024-02-09T08:04:10.256 INFO:tasks.workunit.client.0.smithi062.stdout:test read_operations on pid 41913 2024-02-09T08:04:10.263 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=41913 2024-02-09T08:04:10.263 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-02-09T08:04:10.263 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-09T08:04:10.264 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s snapshots 2024-02-09T08:04:10.264 INFO:tasks.workunit.client.0.smithi062.stderr:+++ umask 2024-02-09T08:04:10.264 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' snapshots' 2024-02-09T08:04:10.264 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ list: /' 2024-02-09T08:04:10.264 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' 0022 -eq 0 ']' 2024-02-09T08:04:10.264 INFO:tasks.workunit.client.0.smithi062.stderr:++ SHELL=/bin/bash 2024-02-09T08:04:10.264 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.264 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-09T08:04:10.264 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.264 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-09T08:04:10.264 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo snapshots 2024-02-09T08:04:10.264 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-09T08:04:10.264 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.264 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-09T08:04:10.265 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.265 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-09T08:04:10.265 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:10.265 INFO:tasks.workunit.client.0.smithi062.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:10.265 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.265 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-09T08:04:10.265 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.265 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-09T08:04:10.265 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.265 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_read_operations 2>&1 | tee ceph_test_neorados_read_operations.log | sed "s/^/ read_operations: /"' 2024-02-09T08:04:10.265 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -f /etc/bashrc ']' 2024-02-09T08:04:10.265 INFO:tasks.workunit.client.0.smithi062.stderr:+ . /etc/bashrc 2024-02-09T08:04:10.265 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -z '' ']' 2024-02-09T08:04:10.265 INFO:tasks.workunit.client.0.smithi062.stderr:++ BASHRCSOURCED=Y 2024-02-09T08:04:10.265 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-09T08:04:10.266 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-09T08:04:10.266 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-09T08:04:10.266 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.266 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-09T08:04:10.266 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.266 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-09T08:04:10.266 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.266 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-09T08:04:10.266 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.266 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-09T08:04:10.266 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.266 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/gawk.sh 2024-02-09T08:04:10.266 INFO:tasks.workunit.client.0.smithi062.stderr:++ shopt -q login_shell 2024-02-09T08:04:10.266 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.266 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-09T08:04:10.267 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.267 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/lang.sh 2024-02-09T08:04:10.267 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup 2024-02-09T08:04:10.267 INFO:tasks.workunit.client.0.smithi062.stderr:+++ umask 2024-02-09T08:04:10.267 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/locale 2024-02-09T08:04:10.267 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' 0022 -eq 0 ']' 2024-02-09T08:04:10.267 INFO:tasks.workunit.client.0.smithi062.stderr:++ SHELL=/bin/bash 2024-02-09T08:04:10.267 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.267 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-09T08:04:10.267 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.267 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-09T08:04:10.267 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-09T08:04:10.267 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-09T08:04:10.267 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.267 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-09T08:04:10.268 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.268 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-09T08:04:10.268 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:10.268 INFO:tasks.workunit.client.0.smithi062.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:10.268 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.268 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-09T08:04:10.268 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.268 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-09T08:04:10.268 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.268 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'grep=grep --color=auto' 2024-02-09T08:04:10.268 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-09T08:04:10.268 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-09T08:04:10.268 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.268 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-09T08:04:10.269 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.269 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorls.sh 2024-02-09T08:04:10.269 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' '!' -t 0 ']' 2024-02-09T08:04:10.269 INFO:tasks.workunit.client.0.smithi062.stderr:+++ return 2024-02-09T08:04:10.269 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.269 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-09T08:04:10.269 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.269 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-09T08:04:10.269 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export S_COLORS=auto 2024-02-09T08:04:10.269 INFO:tasks.workunit.client.0.smithi062.stderr:+++ S_COLORS=auto 2024-02-09T08:04:10.269 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.269 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-09T08:04:10.269 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.269 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-09T08:04:10.270 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.270 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=snapshots 2024-02-09T08:04:10.270 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41946 2024-02-09T08:04:10.270 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test snapshots on pid 41946' 2024-02-09T08:04:10.270 INFO:tasks.workunit.client.0.smithi062.stdout:test snapshots on pid 41946 2024-02-09T08:04:10.277 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=41946 2024-02-09T08:04:10.277 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-02-09T08:04:10.277 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-09T08:04:10.278 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:10.278 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-09T08:04:10.278 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:10.278 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-09T08:04:10.278 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-09T08:04:10.278 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s watch_notify 2024-02-09T08:04:10.278 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-09T08:04:10.278 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' watch_notify' 2024-02-09T08:04:10.278 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_snapshots 2>&1 | tee ceph_test_neorados_snapshots.log | sed "s/^/ snapshots: /"' 2024-02-09T08:04:10.278 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'grep=grep --color=auto' 2024-02-09T08:04:10.278 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-09T08:04:10.278 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-09T08:04:10.278 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-09T08:04:10.278 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.279 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-09T08:04:10.279 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.279 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorls.sh 2024-02-09T08:04:10.279 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' '!' -t 0 ']' 2024-02-09T08:04:10.279 INFO:tasks.workunit.client.0.smithi062.stderr:+++ return 2024-02-09T08:04:10.279 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.279 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-09T08:04:10.279 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.279 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-09T08:04:10.279 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export S_COLORS=auto 2024-02-09T08:04:10.279 INFO:tasks.workunit.client.0.smithi062.stderr:+++ S_COLORS=auto 2024-02-09T08:04:10.279 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.279 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-09T08:04:10.279 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.279 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-09T08:04:10.280 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.280 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -f /etc/bashrc ']' 2024-02-09T08:04:10.280 INFO:tasks.workunit.client.0.smithi062.stderr:+ . /etc/bashrc 2024-02-09T08:04:10.280 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -z '' ']' 2024-02-09T08:04:10.280 INFO:tasks.workunit.client.0.smithi062.stderr:++ BASHRCSOURCED=Y 2024-02-09T08:04:10.280 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.280 INFO:tasks.workunit.client.0.smithi062.stderr:++ shopt -q login_shell 2024-02-09T08:04:10.280 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo watch_notify 2024-02-09T08:04:10.280 INFO:tasks.workunit.client.0.smithi062.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-09T08:04:10.280 INFO:tasks.workunit.client.0.smithi062.stderr:+++ umask 2024-02-09T08:04:10.280 INFO:tasks.workunit.client.0.smithi062.stderr:++++ export LANG=en_US.UTF-8 2024-02-09T08:04:10.280 INFO:tasks.workunit.client.0.smithi062.stderr:++++ LANG=en_US.UTF-8 2024-02-09T08:04:10.280 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:10.280 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' 0022 -eq 0 ']' 2024-02-09T08:04:10.280 INFO:tasks.workunit.client.0.smithi062.stderr:++ SHELL=/bin/bash 2024-02-09T08:04:10.281 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-09T08:04:10.281 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.281 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:10.281 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG=en_US.UTF-8 2024-02-09T08:04:10.281 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup config 2024-02-09T08:04:10.281 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:10.281 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-09T08:04:10.281 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.281 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-09T08:04:10.281 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:10.281 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-09T08:04:10.281 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.281 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-09T08:04:10.281 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.282 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-09T08:04:10.282 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:10.282 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' dumb = linux ']' 2024-02-09T08:04:10.282 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.282 INFO:tasks.workunit.client.0.smithi062.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:10.282 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.282 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-09T08:04:10.282 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.282 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-09T08:04:10.282 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.282 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-09T08:04:10.282 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.282 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/less.sh 2024-02-09T08:04:10.282 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-09T08:04:10.282 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.283 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-09T08:04:10.283 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.283 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/which2.sh 2024-02-09T08:04:10.283 INFO:tasks.workunit.client.0.smithi062.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-09T08:04:10.283 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-09T08:04:10.283 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-09T08:04:10.283 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-09T08:04:10.283 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.283 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-09T08:04:10.283 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.283 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-09T08:04:10.283 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-09T08:04:10.283 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.283 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=watch_notify 2024-02-09T08:04:10.283 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41962 2024-02-09T08:04:10.284 INFO:tasks.workunit.client.0.smithi062.stdout:test watch_notify on pid 41962 2024-02-09T08:04:10.297 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test watch_notify on pid 41962' 2024-02-09T08:04:10.297 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=41962 2024-02-09T08:04:10.297 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-02-09T08:04:10.297 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-09T08:04:10.297 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s write_operations 2024-02-09T08:04:10.297 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'grep=grep --color=auto' 2024-02-09T08:04:10.297 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-09T08:04:10.297 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-09T08:04:10.297 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.297 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-09T08:04:10.297 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' write_operations' 2024-02-09T08:04:10.298 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.298 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorls.sh 2024-02-09T08:04:10.298 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' '!' -t 0 ']' 2024-02-09T08:04:10.298 INFO:tasks.workunit.client.0.smithi062.stderr:+++ return 2024-02-09T08:04:10.298 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.298 INFO:tasks.workunit.client.0.smithi062.stderr:+++++ readlink /proc/41812/exe 2024-02-09T08:04:10.298 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-09T08:04:10.298 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.298 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_watch_notify 2>&1 | tee ceph_test_neorados_watch_notify.log | sed "s/^/ watch_notify: /"' 2024-02-09T08:04:10.298 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-09T08:04:10.298 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-09T08:04:10.298 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-09T08:04:10.298 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-09T08:04:10.298 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export S_COLORS=auto 2024-02-09T08:04:10.298 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.299 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-09T08:04:10.299 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.299 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-09T08:04:10.299 INFO:tasks.workunit.client.0.smithi062.stderr:+++ S_COLORS=auto 2024-02-09T08:04:10.299 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-09T08:04:10.299 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.299 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-09T08:04:10.299 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.299 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/gawk.sh 2024-02-09T08:04:10.299 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.299 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-09T08:04:10.299 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.299 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.299 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-09T08:04:10.299 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.300 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/lang.sh 2024-02-09T08:04:10.300 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup 2024-02-09T08:04:10.300 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-09T08:04:10.300 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.300 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/locale 2024-02-09T08:04:10.300 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-09T08:04:10.300 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-09T08:04:10.300 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-09T08:04:10.300 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.300 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'grep=grep --color=auto' 2024-02-09T08:04:10.300 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-09T08:04:10.300 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-09T08:04:10.300 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.300 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-09T08:04:10.301 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-09T08:04:10.301 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.301 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.301 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-09T08:04:10.301 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorls.sh 2024-02-09T08:04:10.301 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-09T08:04:10.301 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -f /etc/bashrc ']' 2024-02-09T08:04:10.301 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' '!' -t 0 ']' 2024-02-09T08:04:10.301 INFO:tasks.workunit.client.0.smithi062.stderr:+++ return 2024-02-09T08:04:10.301 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.301 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-09T08:04:10.301 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.301 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-09T08:04:10.301 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export S_COLORS=auto 2024-02-09T08:04:10.301 INFO:tasks.workunit.client.0.smithi062.stderr:+++ S_COLORS=auto 2024-02-09T08:04:10.302 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.302 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-09T08:04:10.302 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.302 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-09T08:04:10.302 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.302 INFO:tasks.workunit.client.0.smithi062.stderr:+ . /etc/bashrc 2024-02-09T08:04:10.302 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-09T08:04:10.302 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.302 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo write_operations 2024-02-09T08:04:10.302 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -z '' ']' 2024-02-09T08:04:10.302 INFO:tasks.workunit.client.0.smithi062.stderr:++ BASHRCSOURCED=Y 2024-02-09T08:04:10.302 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:10.302 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-09T08:04:10.302 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.302 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:10.303 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-09T08:04:10.303 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-09T08:04:10.303 INFO:tasks.workunit.client.0.smithi062.stderr:++ shopt -q login_shell 2024-02-09T08:04:10.303 INFO:tasks.workunit.client.0.smithi062.stderr:+++ umask 2024-02-09T08:04:10.303 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' 0022 -eq 0 ']' 2024-02-09T08:04:10.303 INFO:tasks.workunit.client.0.smithi062.stderr:++ SHELL=/bin/bash 2024-02-09T08:04:10.303 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.303 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-09T08:04:10.303 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.303 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-09T08:04:10.303 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-09T08:04:10.303 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.303 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-09T08:04:10.303 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.303 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-09T08:04:10.304 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:10.304 INFO:tasks.workunit.client.0.smithi062.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:10.304 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.304 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-09T08:04:10.304 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.304 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-09T08:04:10.304 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.304 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-09T08:04:10.304 INFO:tasks.workunit.client.0.smithi062.stderr:++++ basename /usr/bin/bash 2024-02-09T08:04:10.304 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-09T08:04:10.304 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-09T08:04:10.304 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-09T08:04:10.304 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.304 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-09T08:04:10.304 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.305 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-09T08:04:10.305 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-09T08:04:10.305 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.305 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_declare='declare -f' 2024-02-09T08:04:10.305 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_opt=-f 2024-02-09T08:04:10.305 INFO:tasks.workunit.client.0.smithi062.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-09T08:04:10.305 INFO:tasks.workunit.client.0.smithi062.stderr:++++ export LANG=en_US.UTF-8 2024-02-09T08:04:10.305 INFO:tasks.workunit.client.0.smithi062.stderr:++++ LANG=en_US.UTF-8 2024-02-09T08:04:10.305 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export which_declare 2024-02-09T08:04:10.305 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:10.305 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-09T08:04:10.305 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:10.305 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG=en_US.UTF-8 2024-02-09T08:04:10.305 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup config 2024-02-09T08:04:10.305 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:10.306 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export -f which 2024-02-09T08:04:10.306 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:10.306 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' dumb = linux ']' 2024-02-09T08:04:10.306 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.306 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset i 2024-02-09T08:04:10.306 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-09T08:04:10.306 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.306 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/less.sh 2024-02-09T08:04:10.306 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset -f pathmunge 2024-02-09T08:04:10.306 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-09T08:04:10.306 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.306 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-09T08:04:10.306 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.306 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/which2.sh 2024-02-09T08:04:10.306 INFO:tasks.workunit.client.0.smithi062.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-09T08:04:10.307 INFO:tasks.workunit.client.0.smithi062.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-09T08:04:10.307 INFO:tasks.workunit.client.0.smithi062.stderr:+ export PATH 2024-02-09T08:04:10.307 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-09T08:04:10.307 INFO:tasks.workunit.client.0.smithi062.stderr:+ unset rc 2024-02-09T08:04:10.307 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_neorados_ec_list 2024-02-09T08:04:10.307 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-09T08:04:10.307 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-09T08:04:10.307 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-09T08:04:10.307 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.307 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-09T08:04:10.307 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.307 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-09T08:04:10.307 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-09T08:04:10.307 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.307 INFO:tasks.workunit.client.0.smithi062.stderr:+++++ readlink /proc/41846/exe 2024-02-09T08:04:10.308 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_neorados_ec_list.log 2024-02-09T08:04:10.308 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ ec_list: /' 2024-02-09T08:04:10.308 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=write_operations 2024-02-09T08:04:10.308 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=42006 2024-02-09T08:04:10.308 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test write_operations on pid 42006' 2024-02-09T08:04:10.308 INFO:tasks.workunit.client.0.smithi062.stdout:test write_operations on pid 42006 2024-02-09T08:04:10.341 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=42006 2024-02-09T08:04:10.341 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'grep=grep --color=auto' 2024-02-09T08:04:10.341 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-09T08:04:10.341 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-09T08:04:10.341 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-09T08:04:10.341 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-09T08:04:10.341 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.341 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-09T08:04:10.341 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.341 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-09T08:04:10.341 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-09T08:04:10.341 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-09T08:04:10.342 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.342 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-09T08:04:10.342 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.342 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/gawk.sh 2024-02-09T08:04:10.342 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.342 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-09T08:04:10.342 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.342 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-09T08:04:10.342 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.342 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/lang.sh 2024-02-09T08:04:10.342 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup 2024-02-09T08:04:10.342 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.342 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorls.sh 2024-02-09T08:04:10.342 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' '!' -t 0 ']' 2024-02-09T08:04:10.343 INFO:tasks.workunit.client.0.smithi062.stderr:+++ return 2024-02-09T08:04:10.343 INFO:tasks.workunit.client.0.smithi062.stderr:+ ret=0 2024-02-09T08:04:10.343 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.343 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-09T08:04:10.343 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.343 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-09T08:04:10.343 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-09T08:04:10.343 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export S_COLORS=auto 2024-02-09T08:04:10.343 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-09T08:04:10.343 INFO:tasks.workunit.client.0.smithi062.stderr:++++ basename /usr/bin/bash 2024-02-09T08:04:10.343 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=40976 2024-02-09T08:04:10.343 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 40976 2024-02-09T08:04:10.343 INFO:tasks.workunit.client.0.smithi062.stderr:+++ S_COLORS=auto 2024-02-09T08:04:10.343 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-09T08:04:10.343 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-09T08:04:10.344 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/locale 2024-02-09T08:04:10.344 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.344 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-09T08:04:10.344 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.344 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-09T08:04:10.344 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.344 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-09T08:04:10.344 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.344 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-09T08:04:10.344 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.344 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-09T08:04:10.344 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-09T08:04:10.344 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.344 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-09T08:04:10.345 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.345 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/gawk.sh 2024-02-09T08:04:10.345 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.345 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-09T08:04:10.345 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.345 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/lang.sh 2024-02-09T08:04:10.345 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup 2024-02-09T08:04:10.345 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_declare='declare -f' 2024-02-09T08:04:10.345 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_opt=-f 2024-02-09T08:04:10.345 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export which_declare 2024-02-09T08:04:10.345 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export -f which 2024-02-09T08:04:10.345 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset i 2024-02-09T08:04:10.345 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset -f pathmunge 2024-02-09T08:04:10.345 INFO:tasks.workunit.client.0.smithi062.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-09T08:04:10.345 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/locale 2024-02-09T08:04:10.346 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_write_operations 2>&1 | tee ceph_test_neorados_write_operations.log | sed "s/^/ write_operations: /"' 2024-02-09T08:04:10.346 INFO:tasks.workunit.client.0.smithi062.stderr:+ export PATH 2024-02-09T08:04:10.346 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-09T08:04:10.346 INFO:tasks.workunit.client.0.smithi062.stderr:+ unset rc 2024-02-09T08:04:10.346 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ misc: /' 2024-02-09T08:04:10.346 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:10.346 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_neorados_misc.log 2024-02-09T08:04:10.346 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-09T08:04:10.346 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:10.346 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-09T08:04:10.346 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-09T08:04:10.346 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_neorados_misc 2024-02-09T08:04:10.346 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-09T08:04:10.346 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-09T08:04:10.347 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-09T08:04:10.347 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-09T08:04:10.347 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.347 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-09T08:04:10.347 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.347 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-09T08:04:10.347 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-09T08:04:10.347 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -f /etc/bashrc ']' 2024-02-09T08:04:10.347 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.347 INFO:tasks.workunit.client.0.smithi062.stderr:+ . /etc/bashrc 2024-02-09T08:04:10.347 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -z '' ']' 2024-02-09T08:04:10.347 INFO:tasks.workunit.client.0.smithi062.stderr:++ BASHRCSOURCED=Y 2024-02-09T08:04:10.347 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.347 INFO:tasks.workunit.client.0.smithi062.stderr:++ shopt -q login_shell 2024-02-09T08:04:10.348 INFO:tasks.workunit.client.0.smithi062.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-09T08:04:10.348 INFO:tasks.workunit.client.0.smithi062.stderr:++++ export LANG=en_US.UTF-8 2024-02-09T08:04:10.348 INFO:tasks.workunit.client.0.smithi062.stderr:++++ LANG=en_US.UTF-8 2024-02-09T08:04:10.348 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:10.348 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-09T08:04:10.348 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:10.348 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG=en_US.UTF-8 2024-02-09T08:04:10.348 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup config 2024-02-09T08:04:10.348 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:10.348 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:10.348 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' dumb = linux ']' 2024-02-09T08:04:10.348 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.348 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-09T08:04:10.348 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.349 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/less.sh 2024-02-09T08:04:10.349 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-09T08:04:10.349 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.349 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-09T08:04:10.349 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.349 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/which2.sh 2024-02-09T08:04:10.349 INFO:tasks.workunit.client.0.smithi062.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-09T08:04:10.349 INFO:tasks.workunit.client.0.smithi062.stderr:+++++ readlink /proc/41892/exe 2024-02-09T08:04:10.349 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-09T08:04:10.349 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-09T08:04:10.349 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-09T08:04:10.349 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.349 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-09T08:04:10.349 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-09T08:04:10.349 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-09T08:04:10.350 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-09T08:04:10.350 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.350 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.350 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-09T08:04:10.350 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.350 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-09T08:04:10.350 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-09T08:04:10.350 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:10.350 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-09T08:04:10.350 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-09T08:04:10.350 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.350 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-09T08:04:10.350 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.350 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/gawk.sh 2024-02-09T08:04:10.351 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:10.351 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-09T08:04:10.351 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-09T08:04:10.351 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.351 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-09T08:04:10.351 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.351 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/lang.sh 2024-02-09T08:04:10.351 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup 2024-02-09T08:04:10.351 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-09T08:04:10.351 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.351 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-09T08:04:10.351 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.351 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/gawk.sh 2024-02-09T08:04:10.351 INFO:tasks.workunit.client.0.smithi062.stderr:++++ basename /usr/bin/bash 2024-02-09T08:04:10.351 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.352 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-09T08:04:10.352 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.352 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/lang.sh 2024-02-09T08:04:10.352 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-09T08:04:10.352 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup 2024-02-09T08:04:10.352 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/locale 2024-02-09T08:04:10.352 INFO:tasks.workunit.client.0.smithi062.stderr:+++ umask 2024-02-09T08:04:10.352 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' 0022 -eq 0 ']' 2024-02-09T08:04:10.352 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_declare='declare -f' 2024-02-09T08:04:10.352 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_opt=-f 2024-02-09T08:04:10.352 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export which_declare 2024-02-09T08:04:10.352 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export -f which 2024-02-09T08:04:10.352 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset i 2024-02-09T08:04:10.352 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset -f pathmunge 2024-02-09T08:04:10.352 INFO:tasks.workunit.client.0.smithi062.stderr:++ SHELL=/bin/bash 2024-02-09T08:04:10.353 INFO:tasks.workunit.client.0.smithi062.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-09T08:04:10.353 INFO:tasks.workunit.client.0.smithi062.stderr:+ export PATH 2024-02-09T08:04:10.353 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-09T08:04:10.353 INFO:tasks.workunit.client.0.smithi062.stderr:+ unset rc 2024-02-09T08:04:10.353 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.353 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-09T08:04:10.353 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.353 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-09T08:04:10.353 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-09T08:04:10.353 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.353 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-09T08:04:10.353 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.353 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-09T08:04:10.353 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:10.353 INFO:tasks.workunit.client.0.smithi062.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-09T08:04:10.354 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.354 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-09T08:04:10.354 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.354 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-09T08:04:10.354 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:10.354 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-09T08:04:10.354 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.354 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:10.354 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-09T08:04:10.354 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-09T08:04:10.354 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_neorados_pool 2024-02-09T08:04:10.354 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ pool: /' 2024-02-09T08:04:10.354 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/locale 2024-02-09T08:04:10.354 INFO:tasks.workunit.client.0.smithi062.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-09T08:04:10.355 INFO:tasks.workunit.client.0.smithi062.stderr:++++ export LANG=en_US.UTF-8 2024-02-09T08:04:10.355 INFO:tasks.workunit.client.0.smithi062.stderr:++++ LANG=en_US.UTF-8 2024-02-09T08:04:10.355 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:10.355 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-09T08:04:10.355 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:10.355 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG=en_US.UTF-8 2024-02-09T08:04:10.355 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_neorados_pool.log 2024-02-09T08:04:10.355 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup config 2024-02-09T08:04:10.355 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:10.355 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:10.355 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' dumb = linux ']' 2024-02-09T08:04:10.355 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-09T08:04:10.355 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.355 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-09T08:04:10.355 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.355 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/less.sh 2024-02-09T08:04:10.356 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-09T08:04:10.356 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.356 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-09T08:04:10.356 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.356 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/which2.sh 2024-02-09T08:04:10.356 INFO:tasks.workunit.client.0.smithi062.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-09T08:04:10.356 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:10.356 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-09T08:04:10.356 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:10.356 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-09T08:04:10.356 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-09T08:04:10.356 INFO:tasks.workunit.client.0.smithi062.stderr:+++++ readlink /proc/41913/exe 2024-02-09T08:04:10.356 INFO:tasks.workunit.client.0.smithi062.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-09T08:04:10.356 INFO:tasks.workunit.client.0.smithi062.stderr:++++ export LANG=en_US.UTF-8 2024-02-09T08:04:10.357 INFO:tasks.workunit.client.0.smithi062.stderr:++++ LANG=en_US.UTF-8 2024-02-09T08:04:10.357 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:10.357 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-09T08:04:10.357 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:10.357 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG=en_US.UTF-8 2024-02-09T08:04:10.357 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup config 2024-02-09T08:04:10.357 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:10.357 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:10.357 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' dumb = linux ']' 2024-02-09T08:04:10.357 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.357 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-09T08:04:10.357 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.357 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/less.sh 2024-02-09T08:04:10.357 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-09T08:04:10.357 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.357 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-09T08:04:10.358 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.358 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/which2.sh 2024-02-09T08:04:10.358 INFO:tasks.workunit.client.0.smithi062.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-09T08:04:10.358 INFO:tasks.workunit.client.0.smithi062.stderr:++++ basename /usr/bin/bash 2024-02-09T08:04:10.358 INFO:tasks.workunit.client.0.smithi062.stderr:+++++ readlink /proc/41962/exe 2024-02-09T08:04:10.358 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'grep=grep --color=auto' 2024-02-09T08:04:10.358 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-09T08:04:10.358 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-09T08:04:10.358 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_declare='declare -f' 2024-02-09T08:04:10.358 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_opt=-f 2024-02-09T08:04:10.358 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export which_declare 2024-02-09T08:04:10.358 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.358 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-09T08:04:10.358 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.359 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorls.sh 2024-02-09T08:04:10.359 INFO:tasks.workunit.client.0.smithi062.stderr:++++ basename /usr/bin/bash 2024-02-09T08:04:10.359 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export -f which 2024-02-09T08:04:10.359 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' '!' -t 0 ']' 2024-02-09T08:04:10.359 INFO:tasks.workunit.client.0.smithi062.stderr:+++ return 2024-02-09T08:04:10.359 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.359 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset i 2024-02-09T08:04:10.359 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset -f pathmunge 2024-02-09T08:04:10.359 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-09T08:04:10.359 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.359 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-09T08:04:10.359 INFO:tasks.workunit.client.0.smithi062.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-09T08:04:10.359 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export S_COLORS=auto 2024-02-09T08:04:10.359 INFO:tasks.workunit.client.0.smithi062.stderr:+++ S_COLORS=auto 2024-02-09T08:04:10.359 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.360 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-09T08:04:10.360 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.360 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-09T08:04:10.360 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.360 INFO:tasks.workunit.client.0.smithi062.stderr:+ export PATH 2024-02-09T08:04:10.360 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-09T08:04:10.360 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-09T08:04:10.360 INFO:tasks.workunit.client.0.smithi062.stderr:+ unset rc 2024-02-09T08:04:10.360 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_declare='declare -f' 2024-02-09T08:04:10.360 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_opt=-f 2024-02-09T08:04:10.360 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export which_declare 2024-02-09T08:04:10.360 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export -f which 2024-02-09T08:04:10.360 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset i 2024-02-09T08:04:10.361 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset -f pathmunge 2024-02-09T08:04:10.361 INFO:tasks.workunit.client.0.smithi062.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-09T08:04:10.361 INFO:tasks.workunit.client.0.smithi062.stderr:+ export PATH 2024-02-09T08:04:10.361 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-09T08:04:10.361 INFO:tasks.workunit.client.0.smithi062.stderr:+ unset rc 2024-02-09T08:04:10.361 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ read_operations: /' 2024-02-09T08:04:10.361 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_neorados_read_operations.log 2024-02-09T08:04:10.361 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_neorados_watch_notify 2024-02-09T08:04:10.361 INFO:tasks.workunit.client.0.smithi062.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-09T08:04:10.361 INFO:tasks.workunit.client.0.smithi062.stderr:++++ export LANG=en_US.UTF-8 2024-02-09T08:04:10.361 INFO:tasks.workunit.client.0.smithi062.stderr:++++ LANG=en_US.UTF-8 2024-02-09T08:04:10.361 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:10.361 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-09T08:04:10.361 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:10.361 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG=en_US.UTF-8 2024-02-09T08:04:10.362 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup config 2024-02-09T08:04:10.362 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:10.362 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:10.362 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' dumb = linux ']' 2024-02-09T08:04:10.362 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.362 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_neorados_read_operations 2024-02-09T08:04:10.362 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-09T08:04:10.362 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.362 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/less.sh 2024-02-09T08:04:10.362 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-09T08:04:10.362 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.362 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-09T08:04:10.362 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.362 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/which2.sh 2024-02-09T08:04:10.362 INFO:tasks.workunit.client.0.smithi062.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-09T08:04:10.363 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_neorados_watch_notify.log 2024-02-09T08:04:10.363 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ watch_notify: /' 2024-02-09T08:04:10.363 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-09T08:04:10.363 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-09T08:04:10.363 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-09T08:04:10.363 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.363 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-09T08:04:10.363 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.363 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-09T08:04:10.363 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-09T08:04:10.363 INFO:tasks.workunit.client.0.smithi062.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-09T08:04:10.363 INFO:tasks.workunit.client.0.smithi062.stderr:+++++ readlink /proc/41946/exe 2024-02-09T08:04:10.363 INFO:tasks.workunit.client.0.smithi062.stderr:++++ basename /usr/bin/bash 2024-02-09T08:04:10.363 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_declare='declare -f' 2024-02-09T08:04:10.363 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_opt=-f 2024-02-09T08:04:10.364 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export which_declare 2024-02-09T08:04:10.364 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export -f which 2024-02-09T08:04:10.364 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset i 2024-02-09T08:04:10.364 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset -f pathmunge 2024-02-09T08:04:10.364 INFO:tasks.workunit.client.0.smithi062.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-09T08:04:10.364 INFO:tasks.workunit.client.0.smithi062.stderr:+ export PATH 2024-02-09T08:04:10.364 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-09T08:04:10.364 INFO:tasks.workunit.client.0.smithi062.stderr:+ unset rc 2024-02-09T08:04:10.364 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ snapshots: /' 2024-02-09T08:04:10.364 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_neorados_snapshots 2024-02-09T08:04:10.364 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-09T08:04:10.364 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-09T08:04:10.364 INFO:tasks.workunit.client.0.smithi062.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-09T08:04:10.364 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.365 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-09T08:04:10.365 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.365 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-09T08:04:10.365 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-09T08:04:10.365 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.365 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-09T08:04:10.365 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.365 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/gawk.sh 2024-02-09T08:04:10.365 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.365 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-09T08:04:10.365 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.365 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/lang.sh 2024-02-09T08:04:10.365 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup 2024-02-09T08:04:10.365 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/locale 2024-02-09T08:04:10.365 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:10.366 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-09T08:04:10.366 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:10.366 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-09T08:04:10.366 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-09T08:04:10.366 INFO:tasks.workunit.client.0.smithi062.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-09T08:04:10.366 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_neorados_snapshots.log 2024-02-09T08:04:10.366 INFO:tasks.workunit.client.0.smithi062.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-09T08:04:10.366 INFO:tasks.workunit.client.0.smithi062.stderr:++++ export LANG=en_US.UTF-8 2024-02-09T08:04:10.366 INFO:tasks.workunit.client.0.smithi062.stderr:++++ LANG=en_US.UTF-8 2024-02-09T08:04:10.366 INFO:tasks.workunit.client.0.smithi062.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-09T08:04:10.366 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-09T08:04:10.366 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:10.366 INFO:tasks.workunit.client.0.smithi062.stderr:+++ LANG=en_US.UTF-8 2024-02-09T08:04:10.366 INFO:tasks.workunit.client.0.smithi062.stderr:+++ unset LANG_backup config 2024-02-09T08:04:10.366 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n '' ']' 2024-02-09T08:04:10.367 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-09T08:04:10.367 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' dumb = linux ']' 2024-02-09T08:04:10.367 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.367 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-09T08:04:10.367 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.367 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/less.sh 2024-02-09T08:04:10.367 INFO:tasks.workunit.client.0.smithi062.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-09T08:04:10.367 INFO:tasks.workunit.client.0.smithi062.stderr:++ for i in /etc/profile.d/*.sh 2024-02-09T08:04:10.367 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-09T08:04:10.367 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '' ']' 2024-02-09T08:04:10.367 INFO:tasks.workunit.client.0.smithi062.stderr:++ . /etc/profile.d/which2.sh 2024-02-09T08:04:10.367 INFO:tasks.workunit.client.0.smithi062.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-09T08:04:10.367 INFO:tasks.workunit.client.0.smithi062.stderr:+++++ readlink /proc/42006/exe 2024-02-09T08:04:10.367 INFO:tasks.workunit.client.0.smithi062.stderr:++++ basename /usr/bin/bash 2024-02-09T08:04:10.367 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_declare='declare -f' 2024-02-09T08:04:10.368 INFO:tasks.workunit.client.0.smithi062.stderr:+++ which_opt=-f 2024-02-09T08:04:10.368 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export which_declare 2024-02-09T08:04:10.368 INFO:tasks.workunit.client.0.smithi062.stderr:+++ export -f which 2024-02-09T08:04:10.368 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset i 2024-02-09T08:04:10.368 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset -f pathmunge 2024-02-09T08:04:10.368 INFO:tasks.workunit.client.0.smithi062.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-09T08:04:10.368 INFO:tasks.workunit.client.0.smithi062.stderr:+ export PATH 2024-02-09T08:04:10.368 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-09T08:04:10.368 INFO:tasks.workunit.client.0.smithi062.stderr:+ unset rc 2024-02-09T08:04:10.368 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_neorados_write_operations 2024-02-09T08:04:10.368 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_neorados_write_operations.log 2024-02-09T08:04:10.368 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ write_operations: /' 2024-02-09T08:04:10.369 INFO:tasks.workunit.client.0.smithi062.stdout:08:04:09.984+0000 7f6e8519e640 10 monclient: _check_auth_tickets 2024-02-09T08:04:10.369 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.984+0000 7f6e8519e640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:04:10.369 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.984+0000 7f6e8519e640 1 -- 172.21.15.62:0/4151497593 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e7806a070 con 0x55c0f27e45f0 2024-02-09T08:04:10.369 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.984+0000 7f6e8a839780 5 monclient: authenticate success, global_id 4446 2024-02-09T08:04:10.369 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.984+0000 7f6e8a839780 10 monclient: _renew_subs 2024-02-09T08:04:10.369 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.984+0000 7f6e8a839780 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:04:10.369 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.984+0000 7f6e8a839780 1 -- 172.21.15.62:0/4151497593 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c0f27041c0 con 0x55c0f27e45f0 2024-02-09T08:04:10.369 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.985+0000 7f6e8a839780 10 client.4446.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:04:10.369 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.985+0000 7f6e8a839780 10 monclient: _renew_subs 2024-02-09T08:04:10.369 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.985+0000 7f6e8a839780 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:04:10.369 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.985+0000 7f6e8a839780 1 -- 172.21.15.62:0/4151497593 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c0f26f7370 con 0x55c0f27e45f0 2024-02-09T08:04:10.369 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.985+0000 7f6e8a839780 1 librados: init done 2024-02-09T08:04:10.369 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.985+0000 7f6e8a839780 10 librados: wait_for_osdmap waiting 2024-02-09T08:04:10.370 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.985+0000 7f6e8519e640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:04:10.370 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.985+0000 7f6e8519e640 1 -- 172.21.15.62:0/4151497593 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7805d420 con 0x55c0f27e45f0 2024-02-09T08:04:10.370 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.985+0000 7f6e8519e640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:04:10.370 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.985+0000 7f6e8519e640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-09T08:04:10.370 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.985+0000 7f6e8519e640 10 monclient: dump: 2024-02-09T08:04:10.370 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: epoch 1 2024-02-09T08:04:10.370 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:04:10.370 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:04:10.370 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:04:10.370 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: min_mon_release 19 (squid) 2024-02-09T08:04:10.370 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: election_strategy: 1 2024-02-09T08:04:10.370 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:04:10.370 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:04:10.370 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:04:10.370 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:10.371 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:09.985+0000 7f6e861a0640 4 set_mon_vals no callback set 2024-02-09T08:04:10.371 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:10.147+0000 7f6e8519e640 1 -- 172.21.15.62:0/4151497593 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f6e7805d580 con 0x55c0f27e45f0 2024-02-09T08:04:10.371 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:10.148+0000 7f6e8519e640 1 --2- 172.21.15.62:0/4151497593 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f6e7406b410 0x7f6e7406d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:04:10.371 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:10.148+0000 7f6e879a3640 1 --2- 172.21.15.62:0/4151497593 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f6e7406b410 0x7f6e7406d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:04:12.114 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:10.148+0000 7f6e879a3640 10 monclient: get_auth_request con 0x7f6e7406b410 auth_method 0 2024-02-09T08:04:12.115 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:10.149+0000 7f6e8519e640 10 client.4446.objecter ms_handle_connect 0x7f6e7406b410 2024-02-09T08:04:12.115 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:10.149+0000 7f6e879a3640 1 --2- 172.21.15.62:0/4151497593 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f6e7406b410 0x7f6e7406d8d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6e8000a2d0 tx=0x7f6e80005810 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:04:12.115 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:10.163+0000 7f6e8519e640 1 -- 172.21.15.62:0/4151497593 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6e7809ac20 con 0x55c0f27e45f0 2024-02-09T08:04:12.115 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:10.163+0000 7f6e8519e640 10 client.4446.objecter ms_dispatch 0x55c0f2751820 osd_map(26..26 src has 1..26) v4 2024-02-09T08:04:12.115 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:10.163+0000 7f6e8519e640 3 client.4446.objecter handle_osd_map got epochs [26,26] > 0 2024-02-09T08:04:12.115 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:10.163+0000 7f6e8519e640 3 client.4446.objecter handle_osd_map decoding full epoch 26 2024-02-09T08:04:12.115 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:10.163+0000 7f6e8519e640 20 client.4446.objecter dump_active .. 0 homeless 2024-02-09T08:04:12.115 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:10.163+0000 7f6e8a839780 10 librados: wait_for_osdmap done waiting 2024-02-09T08:04:12.115 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:10.163+0000 7f6e8a839780 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:04:12.115 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:10.163+0000 7f6e8a839780 1 -- 172.21.15.62:0/4151497593 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x55c0f2757c80 con 0x55c0f27e45f0 2024-02-09T08:04:12.115 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:10.293+0000 7f6e8519e640 1 -- 172.21.15.62:0/4151497593 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e7809a2f0 con 0x55c0f27e45f0 2024-02-09T08:04:12.115 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:10.293+0000 7f6e8519e640 10 monclient: handle_get_version_reply finishing 1 version 26 2024-02-09T08:04:12.115 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:10.293+0000 7f6e8599f640 10 client.4446.objecter _get_latest_version latest 26, have it 2024-02-09T08:04:12.115 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:10.293+0000 7f6e8a839780 10 client.4446.objecter create_pool name=ceph_test_rados_api_asio 2024-02-09T08:04:12.116 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:10.293+0000 7f6e8a839780 10 client.4446.objecter pool_op_submit 1 2024-02-09T08:04:12.116 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:10.293+0000 7f6e8a839780 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:04:12.116 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:10.293+0000 7f6e8a839780 1 -- 172.21.15.62:0/4151497593 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- pool_op(create pool 0 tid 1 name ceph_test_rados_api_asio v0) v4 -- 0x55c0f2769400 con 0x55c0f27e45f0 2024-02-09T08:04:12.116 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:12.112+0000 7f6e8519e640 1 -- 172.21.15.62:0/4151497593 <== mon.0 v2:172.21.15.62:3300/0 7 ==== pool_op_reply(tid 1 (0) Success v28) v1 ==== 43+0+0 (secure 0 0 0) 0x7f6e78057070 con 0x55c0f27e45f0 2024-02-09T08:04:12.116 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:12.112+0000 7f6e8519e640 10 client.4446.objecter ms_dispatch 0x55c0f2751820 pool_op_reply(tid 1 (0) Success v28) v1 2024-02-09T08:04:12.116 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:12.112+0000 7f6e8519e640 10 client.4446.objecter handle_pool_op_reply pool_op_reply(tid 1 (0) Success v28) v1 2024-02-09T08:04:12.116 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:12.112+0000 7f6e8519e640 10 client.4446.objecter have request 1 at 0x55c0f2915d70 Op: create 2024-02-09T08:04:12.116 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:12.112+0000 7f6e8519e640 20 client.4446.objecter waiting for client to reach epoch 28 before calling back 2024-02-09T08:04:12.116 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:12.112+0000 7f6e8519e640 10 client.4446.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:04:12.116 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:12.112+0000 7f6e8519e640 10 monclient: _renew_subs 2024-02-09T08:04:12.383 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:12.112+0000 7f6e8519e640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:04:12.383 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:12.112+0000 7f6e8519e640 1 -- 172.21.15.62:0/4151497593 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=27}) v3 -- 0x7f6e74071150 con 0x55c0f27e45f0 2024-02-09T08:04:12.383 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:12.112+0000 7f6e8519e640 10 client.4446.objecter done 2024-02-09T08:04:12.383 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:12.379+0000 7f6e8519e640 1 -- 172.21.15.62:0/4151497593 <== mon.0 v2:172.21.15.62:3300/0 8 ==== osd_map(27..28 src has 1..28) v4 ==== 15340+0+0 (secure 0 0 0) 0x7f6e780b2020 con 0x55c0f27e45f0 2024-02-09T08:04:12.383 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:12.379+0000 7f6e8519e640 10 client.4446.objecter ms_dispatch 0x55c0f2751820 osd_map(27..28 src has 1..28) v4 2024-02-09T08:04:12.384 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:12.379+0000 7f6e8519e640 3 client.4446.objecter handle_osd_map got epochs [27,28] > 26 2024-02-09T08:04:12.384 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:12.379+0000 7f6e8519e640 3 client.4446.objecter handle_osd_map decoding incremental epoch 27 2024-02-09T08:04:12.384 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:12.379+0000 7f6e8519e640 3 client.4446.objecter handle_osd_map decoding incremental epoch 28 2024-02-09T08:04:12.384 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:12.380+0000 7f6e8519e640 20 client.4446.objecter dump_active .. 0 homeless 2024-02-09T08:04:12.384 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:12.380+0000 7f6e8a839780 10 librados: set snap read head -> 1 2024-02-09T08:04:12.384 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:12.380+0000 7f6e8a839780 10 librados: writefull oid=exist nspace= 2024-02-09T08:04:12.384 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:12.380+0000 7f6e8a839780 10 client.4446.objecter _op_submit op 0x55c0f27a8050 2024-02-09T08:04:12.384 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:12.380+0000 7f6e8a839780 20 client.4446.objecter _calc_target epoch 28 base exist @11 precalc_pgid 0 pgid 0.0 is_write 2024-02-09T08:04:12.384 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:12.380+0000 7f6e8a839780 20 client.4446.objecter _calc_target target exist @11 -> pgid 11.d3a59201 2024-02-09T08:04:12.384 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:12.380+0000 7f6e8a839780 10 client.4446.objecter _calc_target raw pgid 11.d3a59201 -> actual 11.1 acting [0,1] primary 0 2024-02-09T08:04:12.384 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:12.380+0000 7f6e8a839780 1 --2- 172.21.15.62:0/4151497593 >> [v2:172.21.15.62:6808/3842068700,v1:172.21.15.62:6809/3842068700] conn(0x55c0f27a8a00 0x55c0f27a8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:04:12.384 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:12.380+0000 7f6e8a839780 20 client.4446.objecter _get_session s=0x55c0f27a7950 osd=0 3 2024-02-09T08:04:12.384 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:12.380+0000 7f6e8a839780 10 client.4446.objecter _op_submit oid exist '@11' '@11' [writefull 0~5 in=5b] tid 2 osd.0 2024-02-09T08:04:12.385 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:12.380+0000 7f6e8a839780 20 client.4446.objecter get_session s=0x55c0f27a7950 osd=0 3 2024-02-09T08:04:12.385 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:12.380+0000 7f6e8a839780 15 client.4446.objecter _session_op_assign 0 2 2024-02-09T08:04:12.385 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:12.380+0000 7f6e8a839780 15 client.4446.objecter _send_op 2 to 11.1 on osd.0 2024-02-09T08:04:12.385 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:12.380+0000 7f6e8a839780 1 -- 172.21.15.62:0/4151497593 --> [v2:172.21.15.62:6808/3842068700,v1:172.21.15.62:6809/3842068700] -- osd_op(unknown.0.0:2 11.1 11:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) v8 -- 0x55c0f286cf10 con 0x55c0f27a8a00 2024-02-09T08:04:12.385 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:12.380+0000 7f6e8a839780 20 client.4446.objecter put_session s=0x55c0f27a7950 osd=0 4 2024-02-09T08:04:12.385 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:12.380+0000 7f6e8a839780 5 client.4446.objecter 1 in flight 2024-02-09T08:04:12.385 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:12.380+0000 7f6e871a2640 1 --2- 172.21.15.62:0/4151497593 >> [v2:172.21.15.62:6808/3842068700,v1:172.21.15.62:6809/3842068700] conn(0x55c0f27a8a00 0x55c0f27a8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:04:21.344 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T0 api_service: [==========] Running 4 tests from 1 test suite. 2024-02-09T08:04:21.345 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: [----------] Global test environment set-up. 2024-02-09T08:04:21.345 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: [----------] 4 tests from LibRadosService 2024-02-09T08:04:21.345 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: [ RUN ] LibRadosService.RegisterEarly 2024-02-09T08:04:21.345 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: [ OK ] LibRadosService.RegisterEarly (5360 ms) 2024-02-09T08:04:21.345 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: [ RUN ] LibRadosService.RegisterLate 2024-02-09T08:04:21.345 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: [ OK ] LibRadosService.RegisterLate (402 ms) 2024-02-09T08:04:21.345 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: [ RUN ] LibRadosService.StatusFormat 2024-02-09T08:04:21.345 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: cluster: 2024-02-09T08:04:21.345 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: id: 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:04:21.345 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: health: HEALTH_WARN 2024-02-09T08:04:21.345 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 32 pool(s) do not have an application enabled 2024-02-09T08:04:21.345 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 2024-02-09T08:04:21.346 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: services: 2024-02-09T08:04:21.346 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 2m) 2024-02-09T08:04:21.346 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: mgr: x(active, since 2m), standbys: y 2024-02-09T08:04:21.346 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: osd: 8 osds: 8 up (since 70s), 8 in (since 2m) 2024-02-09T08:04:21.346 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: laundry: 2 daemons active (1 hosts) 2024-02-09T08:04:21.346 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 2024-02-09T08:04:21.346 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: data: 2024-02-09T08:04:21.346 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: pools: 37 pools, 1129 pgs 2024-02-09T08:04:21.346 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: objects: 2 objects, 449 KiB 2024-02-09T08:04:21.346 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: usage: 214 MiB used, 720 GiB / 720 GiB avail 2024-02-09T08:04:21.346 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: pgs: 94.774% pgs unknown 2024-02-09T08:04:21.346 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 4.429% pgs not active 2024-02-09T08:04:21.346 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 1070 unknown 2024-02-09T08:04:21.346 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 50 creating+peering 2024-02-09T08:04:21.346 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 9 active+clean 2024-02-09T08:04:21.347 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 2024-02-09T08:04:21.347 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 2024-02-09T08:04:21.347 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: cluster: 2024-02-09T08:04:21.347 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: id: 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:04:21.347 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: health: HEALTH_WARN 2024-02-09T08:04:21.347 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 19 pool(s) do not have an application enabled 2024-02-09T08:04:21.347 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 2024-02-09T08:04:21.347 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: services: 2024-02-09T08:04:21.347 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 2m) 2024-02-09T08:04:21.347 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: mgr: x(active, since 2m), standbys: y 2024-02-09T08:04:21.347 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: osd: 8 osds: 8 up (since 72s), 8 in (since 2m) 2024-02-09T08:04:21.347 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 2024-02-09T08:04:21.347 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: data: 2024-02-09T08:04:21.347 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: pools: 38 pools, 1089 pgs 2024-02-09T08:04:21.348 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: objects: 2 objects, 449 KiB 2024-02-09T08:04:21.348 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: usage: 214 MiB used, 720 GiB / 720 GiB avail 2024-02-09T08:04:21.348 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: pgs: 80.441% pgs unknown 2024-02-09T08:04:21.348 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 18.641% pgs not active 2024-02-09T08:04:21.348 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 876 unknown 2024-02-09T08:04:21.348 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 195 creating+peering 2024-02-09T08:04:21.348 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 10 active+clean 2024-02-09T08:04:21.348 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 8 creating+activating 2024-02-09T08:04:21.349 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 2024-02-09T08:04:21.349 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 2024-02-09T08:04:21.349 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: cluster: 2024-02-09T08:04:21.349 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: id: 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:04:21.349 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: health: HEALTH_WARN 2024-02-09T08:04:21.349 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 19 pool(s) do not have an application enabled 2024-02-09T08:04:21.349 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 2024-02-09T08:04:21.349 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: services: 2024-02-09T08:04:21.349 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 2m) 2024-02-09T08:04:21.349 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: mgr: x(active, since 2m), standbys: y 2024-02-09T08:04:21.349 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: osd: 8 osds: 8 up (since 75s), 8 in (since 2m) 2024-02-09T08:04:21.349 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: foo: 16 portals active (1 hosts, 3 zones) 2024-02-09T08:04:21.349 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: laundry: 1 daemon active (1 hosts) 2024-02-09T08:04:21.349 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 2024-02-09T08:04:21.350 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: data: 2024-02-09T08:04:21.350 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: pools: 38 pools, 1089 pgs 2024-02-09T08:04:21.350 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: objects: 2 objects, 449 KiB 2024-02-09T08:04:21.350 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: usage: 214 MiB used, 720 GiB / 720 GiB avail 2024-02-09T08:04:21.350 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: pgs: 50.781% pgs unknown 2024-02-09T08:04:21.350 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 47.291% pgs not active 2024-02-09T08:04:21.776 INFO:tasks.workunit.client.0.smithi062.stdout: 8:04:12.381+0000 7f6e871a2640 10 monclient: get_auth_request con 0x55c0f27a8a00 auth_method 0 2024-02-09T08:04:21.776 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:12.383+0000 7f6e8519e640 10 client.4446.objecter ms_handle_connect 0x55c0f27a8a00 2024-02-09T08:04:21.776 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:12.383+0000 7f6e871a2640 1 --2- 172.21.15.62:0/4151497593 >> [v2:172.21.15.62:6808/3842068700,v1:172.21.15.62:6809/3842068700] conn(0x55c0f27a8a00 0x55c0f27a8de0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:04:21.777 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:12.771+0000 7f6e6ffff640 10 monclient: tick 2024-02-09T08:04:21.777 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:12.771+0000 7f6e6ffff640 10 monclient: _check_auth_tickets 2024-02-09T08:04:21.777 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:12.771+0000 7f6e6ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:04:21.777 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:12.771+0000 7f6e6ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:04:21.777 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:13.771+0000 7f6e6ffff640 10 monclient: tick 2024-02-09T08:04:21.777 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:13.771+0000 7f6e6ffff640 10 monclient: _check_auth_tickets 2024-02-09T08:04:21.777 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:13.771+0000 7f6e6ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:04:21.777 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:14.771+0000 7f6e6ffff640 10 monclient: tick 2024-02-09T08:04:21.777 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:14.771+0000 7f6e6ffff640 10 monclient: _check_auth_tickets 2024-02-09T08:04:21.777 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:14.771+0000 7f6e6ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:04:21.777 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:14.986+0000 7f6e89c07640 10 client.4446.objecter tick 2024-02-09T08:04:21.778 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:15.773+0000 7f6e6ffff640 10 monclient: tick 2024-02-09T08:04:21.778 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:15.773+0000 7f6e6ffff640 10 monclient: _check_auth_tickets 2024-02-09T08:04:21.778 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:15.773+0000 7f6e6ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:04:21.778 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:16.773+0000 7f6e6ffff640 10 monclient: tick 2024-02-09T08:04:21.778 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:16.773+0000 7f6e6ffff640 10 monclient: _check_auth_tickets 2024-02-09T08:04:21.778 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:16.773+0000 7f6e6ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:04:21.778 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:17.773+0000 7f6e6ffff640 10 monclient: tick 2024-02-09T08:04:21.778 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:17.773+0000 7f6e6ffff640 10 monclient: _check_auth_tickets 2024-02-09T08:04:21.778 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:17.773+0000 7f6e6ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:04:21.778 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:18.774+0000 7f6e6ffff640 10 monclient: tick 2024-02-09T08:04:21.778 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:18.774+0000 7f6e6ffff640 10 monclient: _check_auth_tickets 2024-02-09T08:04:21.778 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:18.774+0000 7f6e6ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:04:21.779 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:19.774+0000 7f6e6ffff640 10 monclient: tick 2024-02-09T08:04:21.779 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:19.774+0000 7f6e6ffff640 10 monclient: _check_auth_tickets 2024-02-09T08:04:21.779 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:19.774+0000 7f6e6ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:04:21.779 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:19.987+0000 7f6e89c07640 10 client.4446.objecter tick 2024-02-09T08:04:21.779 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:20.774+0000 7f6e6ffff640 10 monclient: tick 2024-02-09T08:04:21.779 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:20.774+0000 7f6e6ffff640 10 monclient: _check_auth_tickets 2024-02-09T08:04:21.779 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:20.774+0000 7f6e6ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:04:21.779 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:21.774+0000 7f6e6ffff640 10 monclient: tick 2024-02-09T08:04:21.779 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:21.774+0000 7f6e6ffff640 10 monclient: _check_auth_tickets 2024-02-09T08:04:25.165 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:21.774+0000 7f6e6ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:04:25.165 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:22.774+0000 7f6e6ffff640 10 monclient: tick 2024-02-09T08:04:25.165 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:22.774+0000 7f6e6ffff640 10 monclient: _check_auth_tickets 2024-02-09T08:04:25.165 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:22.774+0000 7f6e6ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:04:25.165 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:22.774+0000 7f6e6ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:04:25.165 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:23.774+0000 7f6e6ffff640 10 monclient: tick 2024-02-09T08:04:25.165 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:23.774+0000 7f6e6ffff640 10 monclient: _check_auth_tickets 2024-02-09T08:04:25.165 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:23.774+0000 7f6e6ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:04:25.165 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:24.774+0000 7f6e6ffff640 10 monclient: tick 2024-02-09T08:04:25.165 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:24.774+0000 7f6e6ffff640 10 monclient: _check_auth_tickets 2024-02-09T08:04:25.165 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:24.774+0000 7f6e6ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:04:25.165 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:24.988+0000 7f6e89c07640 10 client.4446.objecter tick 2024-02-09T08:04:25.166 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:24.988+0000 7f6e89c07640 2 client.4446.objecter tid 2 on osd.0 is laggy 2024-02-09T08:04:25.166 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:24.988+0000 7f6e89c07640 10 client.4446.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:04:25.166 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:24.988+0000 7f6e89c07640 10 monclient: _renew_subs 2024-02-09T08:04:25.166 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:24.988+0000 7f6e89c07640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:04:25.166 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:24.988+0000 7f6e89c07640 1 -- 172.21.15.62:0/4151497593 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=29}) v3 -- 0x7f6e58002f90 con 0x55c0f27e45f0 2024-02-09T08:04:25.166 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:24.988+0000 7f6e89c07640 1 -- 172.21.15.62:0/4151497593 --> [v2:172.21.15.62:6808/3842068700,v1:172.21.15.62:6809/3842068700] -- ping magic: 0 v1 -- 0x7f6e58003320 con 0x55c0f27a8a00 2024-02-09T08:04:25.166 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:25.161+0000 7f6e8519e640 1 -- 172.21.15.62:0/4151497593 <== mon.0 v2:172.21.15.62:3300/0 9 ==== osd_map(29..36 src has 1..36) v4 ==== 20052+0+0 (secure 0 0 0) 0x7f6e7809e670 con 0x55c0f27e45f0 2024-02-09T08:04:25.166 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:25.161+0000 7f6e8519e640 10 client.4446.objecter ms_dispatch 0x55c0f2751820 osd_map(29..36 src has 1..36) v4 2024-02-09T08:04:25.166 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:25.162+0000 7f6e8519e640 3 client.4446.objecter handle_osd_map got epochs [29,36] > 28 2024-02-09T08:04:25.166 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:25.162+0000 7f6e8519e640 3 client.4446.objecter handle_osd_map decoding incremental epoch 29 2024-02-09T08:04:25.166 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:25.162+0000 7f6e8519e640 10 client.4446.objecter checking op 2 2024-02-09T08:04:25.166 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:25.162+0000 7f6e8519e640 20 client.4446.objecter _calc_target epoch 29 base exist @11 precalc_pgid 0 pgid 0.0 is_write 2024-02-09T08:04:25.166 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:25.162+0000 7f6e8519e640 20 client.4446.objecter _calc_target target exist @11 -> pgid 11.d3a59201 2024-02-09T08:04:25.166 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:25.162+0000 7f6e8519e640 3 client.4446.objecter handle_osd_map decoding incremental epoch 30 2024-02-09T08:04:25.167 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:25.162+0000 7f6e8519e640 10 client.4446.objecter checking op 2 2024-02-09T08:04:25.167 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:25.162+0000 7f6e8519e640 20 client.4446.objecter _calc_target epoch 30 base exist @11 precalc_pgid 0 pgid 0.0 is_write 2024-02-09T08:04:25.167 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:25.162+0000 7f6e8519e640 20 client.4446.objecter _calc_target target exist @11 -> pgid 11.d3a59201 2024-02-09T08:04:25.167 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:25.162+0000 7f6e8519e640 3 client.4446.objecter handle_osd_map decoding incremental epoch 31 2024-02-09T08:04:25.167 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:25.162+0000 7f6e8519e640 10 client.4446.objecter checking op 2 2024-02-09T08:04:26.196 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:25.162+0000 7f6e8519e640 20 client.4446.objecter _calc_target epoch 31 base exist @11 precalc_pgid 0 pgid 0.0 is_write 2024-02-09T08:04:26.196 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:25.162+0000 7f6e8519e640 20 client.4446.objecter _calc_target target exist @11 -> pgid 11.d3a59201 2024-02-09T08:04:26.197 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:25.162+0000 7f6e8519e640 3 client.4446.objecter handle_osd_map decoding incremental epoch 32 2024-02-09T08:04:26.197 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:25.162+0000 7f6e8519e640 10 client.4446.objecter checking op 2 2024-02-09T08:04:26.197 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:25.162+0000 7f6e8519e640 20 client.4446.objecter _calc_target epoch 32 base exist @11 precalc_pgid 0 pgid 0.0 is_write 2024-02-09T08:04:26.197 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:25.162+0000 7f6e8519e640 20 client.4446.objecter _calc_target target exist @11 -> pgid 11.d3a59201 2024-02-09T08:04:26.197 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:25.162+0000 7f6e8519e640 3 client.4446.objecter handle_osd_map decoding incremental epoch 33 2024-02-09T08:04:26.197 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:25.162+0000 7f6e8519e640 10 client.4446.objecter checking op 2 2024-02-09T08:04:26.197 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:25.162+0000 7f6e8519e640 20 client.4446.objecter _calc_target epoch 33 base exist @11 precalc_pgid 0 pgid 0.0 is_write 2024-02-09T08:04:26.197 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:25.162+0000 7f6e8519e640 20 client.4446.objecter _calc_target target exist @11 -> pgid 11.d3a59201 2024-02-09T08:04:26.197 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:25.162+0000 7f6e8519e640 3 client.4446.objecter handle_osd_map decoding incremental epoch 34 2024-02-09T08:04:26.197 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:25.162+0000 7f6e8519e640 10 client.4446.objecter checking op 2 2024-02-09T08:04:26.197 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:25.162+0000 7f6e8519e640 20 client.4446.objecter _calc_target epoch 34 base exist @11 precalc_pgid 0 pgid 0.0 is_write 2024-02-09T08:04:26.197 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:25.162+0000 7f6e8519e640 20 client.4446.objecter _calc_target target exist @11 -> pgid 11.d3a59201 2024-02-09T08:04:26.198 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:25.162+0000 7f6e8519e640 3 client.4446.objecter handle_osd_map decoding incremental epoch 35 2024-02-09T08:04:26.198 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:25.162+0000 7f6e8519e640 10 client.4446.objecter checking op 2 2024-02-09T08:04:26.198 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:25.162+0000 7f6e8519e640 20 client.4446.objecter _calc_target epoch 35 base exist @11 precalc_pgid 0 pgid 0.0 is_write 2024-02-09T08:04:26.198 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:25.162+0000 7f6e8519e640 20 client.4446.objecter _calc_target target exist @11 -> pgid 11.d3a59201 2024-02-09T08:04:26.198 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:25.162+0000 7f6e8519e640 3 client.4446.objecter handle_osd_map decoding incremental epoch 36 2024-02-09T08:04:26.198 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:25.162+0000 7f6e8519e640 10 client.4446.objecter checking op 2 2024-02-09T08:04:26.198 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:25.162+0000 7f6e8519e640 20 client.4446.objecter _calc_target epoch 36 base exist @11 precalc_pgid 0 pgid 0.0 is_write 2024-02-09T08:04:26.198 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:25.162+0000 7f6e8519e640 20 client.4446.objecter _calc_target target exist @11 -> pgid 11.d3a59201 2024-02-09T08:04:26.198 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:25.162+0000 7f6e8519e640 20 client.4446.objecter dump_active .. 0 homeless 2024-02-09T08:04:26.198 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:25.162+0000 7f6e8519e640 20 client.4446.objecter 2 11.d3a59201 osd.0 exist [writefull 0~5 in=5b] 2024-02-09T08:04:26.198 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:25.774+0000 7f6e6ffff640 10 monclient: tick 2024-02-09T08:04:26.199 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:25.774+0000 7f6e6ffff640 10 monclient: _check_auth_tickets 2024-02-09T08:04:26.199 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:25.774+0000 7f6e6ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:04:26.199 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:26.194+0000 7f6e8519e640 1 -- 172.21.15.62:0/4151497593 <== osd.0 v2:172.21.15.62:6808/3842068700 1 ==== osd_map(29..32 src has 1..32) v4 ==== 13076+0+0 (crc 0 0 0) 0x7f6e7c006da0 con 0x55c0f27a8a00 2024-02-09T08:04:26.199 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:26.194+0000 7f6e8519e640 10 client.4446.objecter ms_dispatch 0x55c0f2751820 osd_map(29..32 src has 1..32) v4 2024-02-09T08:04:26.824 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:02:36.230 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:04:26.837 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:02:36.243 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:04:26.846 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:02:36.251 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:04:26.901 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:02:36.297 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:04:26.902 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:02:36.309 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:04:26.911 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:02:36.308 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:04:27.084 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:02:36.491 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:04:27.102 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:02:36.499 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:04:27.117 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:02:36.524 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:04:29.482 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:26.194+0000 7f6e8519e640 3 client.4446.objecter handle_osd_map ignoring epochs [29,32] <= 36 2024-02-09T08:04:29.482 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:26.194+0000 7f6e8519e640 20 client.4446.objecter dump_active .. 0 homeless 2024-02-09T08:04:29.482 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:26.194+0000 7f6e8519e640 20 client.4446.objecter 2 11.d3a59201 osd.0 exist [writefull 0~5 in=5b] 2024-02-09T08:04:29.482 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:26.774+0000 7f6e6ffff640 10 monclient: tick 2024-02-09T08:04:29.482 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:26.774+0000 7f6e6ffff640 10 monclient: _check_auth_tickets 2024-02-09T08:04:29.482 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:26.774+0000 7f6e6ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:04:29.482 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:27.774+0000 7f6e6ffff640 10 monclient: tick 2024-02-09T08:04:29.482 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:27.774+0000 7f6e6ffff640 10 monclient: _check_auth_tickets 2024-02-09T08:04:29.482 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:27.774+0000 7f6e6ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:04:29.482 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:28.774+0000 7f6e6ffff640 10 monclient: tick 2024-02-09T08:04:29.482 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:28.774+0000 7f6e6ffff640 10 monclient: _check_auth_tickets 2024-02-09T08:04:29.483 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:28.774+0000 7f6e6ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:04:29.483 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:29.479+0000 7f6e871a2640 1 -- 172.21.15.62:0/4151497593 <== osd.0 v2:172.21.15.62:6808/3842068700 2 ==== osd_op_reply(2 exist [writefull 0~5] v32'1 uv1 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6e7c007720 con 0x55c0f27a8a00 2024-02-09T08:04:29.483 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:29.479+0000 7f6e871a2640 10 client.4446.objecter ms_dispatch 0x55c0f2751820 osd_op_reply(2 exist [writefull 0~5] v32'1 uv1 ondisk = 0) v8 2024-02-09T08:04:29.483 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [ RUN ] AsioRados.AsyncReadCallback 2024-02-09T08:04:29.483 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:29.479+0000 7f6e871a2640 10 client.4446.objecter in handle_osd_op_reply 2024-02-09T08:04:29.483 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:29.479+0000 7f6e871a2640 7 client.4446.objecter handle_osd_op_reply 2 ondisk uv 1 in 11.1 attempt 0 2024-02-09T08:04:29.483 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:29.479+0000 7f6e871a2640 10 client.4446.objecter op 0 rval 0 len 0 2024-02-09T08:04:29.483 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:29.479+0000 7f6e871a2640 15 client.4446.objecter handle_osd_op_reply completed tid 2 2024-02-09T08:04:29.483 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:29.479+0000 7f6e871a2640 15 client.4446.objecter _finish_op 2 2024-02-09T08:04:29.483 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:29.479+0000 7f6e871a2640 20 client.4446.objecter put_session s=0x55c0f27a7950 osd=0 4 2024-02-09T08:04:29.483 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:29.479+0000 7f6e871a2640 15 client.4446.objecter _session_op_remove 0 2 2024-02-09T08:04:29.483 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:29.479+0000 7f6e871a2640 5 client.4446.objecter 0 in flight 2024-02-09T08:04:29.483 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:29.479+0000 7f6e8a839780 10 librados: Objecter returned from writefull r=0 2024-02-09T08:04:29.483 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:29.479+0000 7f6e8a839780 10 client.4446.objecter _op_submit op 0x55c0f27a8050 2024-02-09T08:04:29.484 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:29.479+0000 7f6e8a839780 20 client.4446.objecter _calc_target epoch 36 base exist @11 precalc_pgid 0 pgid 0.0 is_read 2024-02-09T08:04:29.484 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:29.479+0000 7f6e8a839780 20 client.4446.objecter _calc_target target exist @11 -> pgid 11.d3a59201 2024-02-09T08:04:29.484 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:29.479+0000 7f6e8a839780 10 client.4446.objecter _calc_target raw pgid 11.d3a59201 -> actual 11.1 acting [0,1] primary 0 2024-02-09T08:04:29.484 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:29.479+0000 7f6e8a839780 20 client.4446.objecter _get_session s=0x55c0f27a7950 osd=0 3 2024-02-09T08:04:29.484 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:29.479+0000 7f6e8a839780 10 client.4446.objecter _op_submit oid exist '@11' '@11' [read 0~256] tid 3 osd.0 2024-02-09T08:04:29.484 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:29.479+0000 7f6e8a839780 20 client.4446.objecter get_session s=0x55c0f27a7950 osd=0 3 2024-02-09T08:04:29.484 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:29.479+0000 7f6e8a839780 15 client.4446.objecter _session_op_assign 0 3 2024-02-09T08:04:29.484 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:29.479+0000 7f6e8a839780 15 client.4446.objecter _send_op 3 to 11.1 on osd.0 2024-02-09T08:04:30.678 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:29.479+0000 7f6e8a839780 1 -- 172.21.15.62:0/4151497593 --> [v2:172.21.15.62:6808/3842068700,v1:172.21.15.62:6809/3842068700] -- osd_op(unknown.0.0:3 11.1 11:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x55c0f27a5b10 con 0x55c0f27a8a00 2024-02-09T08:04:30.678 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:29.479+0000 7f6e8a839780 20 client.4446.objecter put_session s=0x55c0f27a7950 osd=0 4 2024-02-09T08:04:30.678 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:29.479+0000 7f6e8a839780 5 client.4446.objecter 1 in flight 2024-02-09T08:04:30.678 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:29.479+0000 7f6e8a839780 10 client.4446.objecter _op_submit op 0x55c0f27a5e70 2024-02-09T08:04:30.678 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:29.479+0000 7f6e8a839780 20 client.4446.objecter _calc_target epoch 36 base noexist @11 precalc_pgid 0 pgid 0.0 is_read 2024-02-09T08:04:30.678 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:29.479+0000 7f6e8a839780 20 client.4446.objecter _calc_target target noexist @11 -> pgid 11.a7bbaa1 2024-02-09T08:04:30.678 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:29.479+0000 7f6e8a839780 10 client.4446.objecter _calc_target raw pgid 11.a7bbaa1 -> actual 11.1 acting [0,1] primary 0 2024-02-09T08:04:30.679 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:29.479+0000 7f6e8a839780 20 client.4446.objecter _get_session s=0x55c0f27a7950 osd=0 4 2024-02-09T08:04:30.679 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:29.479+0000 7f6e8a839780 10 client.4446.objecter _op_submit oid noexist '@11' '@11' [read 0~256] tid 4 osd.0 2024-02-09T08:04:30.679 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:29.479+0000 7f6e8a839780 20 client.4446.objecter get_session s=0x55c0f27a7950 osd=0 4 2024-02-09T08:04:30.679 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:29.479+0000 7f6e8a839780 15 client.4446.objecter _session_op_assign 0 4 2024-02-09T08:04:30.679 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:29.479+0000 7f6e8a839780 15 client.4446.objecter _send_op 4 to 11.1 on osd.0 2024-02-09T08:04:30.679 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:29.479+0000 7f6e8a839780 1 -- 172.21.15.62:0/4151497593 --> [v2:172.21.15.62:6808/3842068700,v1:172.21.15.62:6809/3842068700] -- osd_op(unknown.0.0:4 11.1 11:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x55c0f27a6310 con 0x55c0f27a8a00 2024-02-09T08:04:30.679 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:29.479+0000 7f6e8a839780 20 client.4446.objecter put_session s=0x55c0f27a7950 osd=0 5 2024-02-09T08:04:30.679 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:29.479+0000 7f6e8a839780 5 client.4446.objecter 2 in flight 2024-02-09T08:04:30.679 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:29.775+0000 7f6e6ffff640 10 monclient: tick 2024-02-09T08:04:30.679 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:29.775+0000 7f6e6ffff640 10 monclient: _check_auth_tickets 2024-02-09T08:04:30.679 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:29.775+0000 7f6e6ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:04:30.679 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:29.989+0000 7f6e89c07640 10 client.4446.objecter tick 2024-02-09T08:04:30.679 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e8519e640 1 -- 172.21.15.62:0/4151497593 <== osd.0 v2:172.21.15.62:6808/3842068700 3 ==== osd_map(37..37 src has 1..37) v4 ==== 1405+0+0 (crc 0 0 0) 0x7f6e7c005320 con 0x55c0f27a8a00 2024-02-09T08:04:30.680 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e871a2640 1 -- 172.21.15.62:0/4151497593 <== osd.0 v2:172.21.15.62:6808/3842068700 4 ==== osd_op_reply(3 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7f6e7c011040 con 0x55c0f27a8a00 2024-02-09T08:04:30.680 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e8519e640 10 client.4446.objecter ms_dispatch 0x55c0f2751820 osd_map(37..37 src has 1..37) v4 2024-02-09T08:04:30.680 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e871a2640 10 client.4446.objecter ms_dispatch 0x55c0f2751820 osd_op_reply(3 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) v8 2024-02-09T08:04:30.680 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e871a2640 10 client.4446.objecter in handle_osd_op_reply 2024-02-09T08:04:30.680 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e8519e640 3 client.4446.objecter handle_osd_map got epochs [37,37] > 36 2024-02-09T08:04:30.680 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e8519e640 3 client.4446.objecter handle_osd_map decoding incremental epoch 37 2024-02-09T08:04:30.680 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e8519e640 10 client.4446.objecter checking op 3 2024-02-09T08:04:30.680 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e8519e640 20 client.4446.objecter _calc_target epoch 37 base exist @11 precalc_pgid 0 pgid 0.0 is_read 2024-02-09T08:04:30.680 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e8519e640 20 client.4446.objecter _calc_target target exist @11 -> pgid 11.d3a59201 2024-02-09T08:04:30.680 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e8519e640 10 client.4446.objecter checking op 4 2024-02-09T08:04:30.680 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e8519e640 20 client.4446.objecter _calc_target epoch 37 base noexist @11 precalc_pgid 0 pgid 0.0 is_read 2024-02-09T08:04:30.680 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e8519e640 20 client.4446.objecter _calc_target target noexist @11 -> pgid 11.a7bbaa1 2024-02-09T08:04:30.680 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e8519e640 20 client.4446.objecter dump_active .. 0 homeless 2024-02-09T08:04:30.680 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e8519e640 20 client.4446.objecter 3 11.d3a59201 osd.0 exist [read 0~256] 2024-02-09T08:04:30.681 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e8519e640 20 client.4446.objecter 4 11.a7bbaa1 osd.0 noexist [read 0~256] 2024-02-09T08:04:30.681 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e871a2640 7 client.4446.objecter handle_osd_op_reply 3 ondisk uv 1 in 11.1 attempt 0 2024-02-09T08:04:30.681 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e871a2640 10 client.4446.objecter op 0 rval 0 len 5 2024-02-09T08:04:30.681 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e871a2640 15 client.4446.objecter handle_osd_op_reply completed tid 3 2024-02-09T08:04:30.681 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e871a2640 15 client.4446.objecter _finish_op 3 2024-02-09T08:04:30.681 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e871a2640 20 client.4446.objecter put_session s=0x55c0f27a7950 osd=0 5 2024-02-09T08:04:30.681 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e871a2640 15 client.4446.objecter _session_op_remove 0 3 2024-02-09T08:04:30.681 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e871a2640 5 client.4446.objecter 1 in flight 2024-02-09T08:04:30.681 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [ OK ] AsioRados.AsyncReadCallback (1196 ms) 2024-02-09T08:04:30.681 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [ RUN ] AsioRados.AsyncReadFuture 2024-02-09T08:04:30.681 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e871a2640 1 -- 172.21.15.62:0/4151497593 <== osd.0 v2:172.21.15.62:6808/3842068700 5 ==== osd_op_reply(4 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f6e7c011040 con 0x55c0f27a8a00 2024-02-09T08:04:30.681 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e871a2640 10 client.4446.objecter ms_dispatch 0x55c0f2751820 osd_op_reply(4 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 2024-02-09T08:04:30.681 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e871a2640 10 client.4446.objecter in handle_osd_op_reply 2024-02-09T08:04:30.681 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e871a2640 7 client.4446.objecter handle_osd_op_reply 4 ondisk uv 0 in 11.1 attempt 0 2024-02-09T08:04:30.682 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e871a2640 10 client.4446.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2024-02-09T08:04:30.682 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e871a2640 10 client.4446.objecter op 0 rval 0 len 0 2024-02-09T08:04:30.682 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e871a2640 15 client.4446.objecter handle_osd_op_reply completed tid 4 2024-02-09T08:04:30.682 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e871a2640 15 client.4446.objecter _finish_op 4 2024-02-09T08:04:30.682 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e871a2640 20 client.4446.objecter put_session s=0x55c0f27a7950 osd=0 4 2024-02-09T08:04:30.682 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e871a2640 15 client.4446.objecter _session_op_remove 0 4 2024-02-09T08:04:30.682 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e871a2640 5 client.4446.objecter 0 in flight 2024-02-09T08:04:30.682 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e8a839780 10 client.4446.objecter _op_submit op 0x55c0f27a5e70 2024-02-09T08:04:30.682 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e8a839780 20 client.4446.objecter _calc_target epoch 37 base exist @11 precalc_pgid 0 pgid 0.0 is_read 2024-02-09T08:04:32.137 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e8a839780 20 client.4446.objecter _calc_target target exist @11 -> pgid 11.d3a59201 2024-02-09T08:04:32.137 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e8a839780 10 client.4446.objecter _calc_target raw pgid 11.d3a59201 -> actual 11.1 acting [0,1] primary 0 2024-02-09T08:04:32.137 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e8a839780 20 client.4446.objecter _get_session s=0x55c0f27a7950 osd=0 3 2024-02-09T08:04:32.137 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e8a839780 10 client.4446.objecter _op_submit oid exist '@11' '@11' [read 0~256] tid 5 osd.0 2024-02-09T08:04:32.137 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e8a839780 20 client.4446.objecter get_session s=0x55c0f27a7950 osd=0 3 2024-02-09T08:04:32.137 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e8a839780 15 client.4446.objecter _session_op_assign 0 5 2024-02-09T08:04:32.137 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e8a839780 15 client.4446.objecter _send_op 5 to 11.1 on osd.0 2024-02-09T08:04:32.137 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e8a839780 1 -- 172.21.15.62:0/4151497593 --> [v2:172.21.15.62:6808/3842068700,v1:172.21.15.62:6809/3842068700] -- osd_op(unknown.0.0:5 11.1 11:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55c0f27a66a0 con 0x55c0f27a8a00 2024-02-09T08:04:32.137 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e8a839780 20 client.4446.objecter put_session s=0x55c0f27a7950 osd=0 4 2024-02-09T08:04:32.137 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e8a839780 5 client.4446.objecter 1 in flight 2024-02-09T08:04:32.137 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e8a839780 10 client.4446.objecter _op_submit op 0x55c0f27a8050 2024-02-09T08:04:32.137 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e8a839780 20 client.4446.objecter _calc_target epoch 37 base noexist @11 precalc_pgid 0 pgid 0.0 is_read 2024-02-09T08:04:32.138 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e8a839780 20 client.4446.objecter _calc_target target noexist @11 -> pgid 11.a7bbaa1 2024-02-09T08:04:32.138 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e8a839780 10 client.4446.objecter _calc_target raw pgid 11.a7bbaa1 -> actual 11.1 acting [0,1] primary 0 2024-02-09T08:04:32.138 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e8a839780 20 client.4446.objecter _get_session s=0x55c0f27a7950 osd=0 4 2024-02-09T08:04:32.138 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e8a839780 10 client.4446.objecter _op_submit oid noexist '@11' '@11' [read 0~256] tid 6 osd.0 2024-02-09T08:04:32.138 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e8a839780 20 client.4446.objecter get_session s=0x55c0f27a7950 osd=0 4 2024-02-09T08:04:32.138 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e8a839780 15 client.4446.objecter _session_op_assign 0 6 2024-02-09T08:04:32.138 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e8a839780 15 client.4446.objecter _send_op 6 to 11.1 on osd.0 2024-02-09T08:04:32.138 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e8a839780 1 -- 172.21.15.62:0/4151497593 --> [v2:172.21.15.62:6808/3842068700,v1:172.21.15.62:6809/3842068700] -- osd_op(unknown.0.0:6 11.1 11:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55c0f2929230 con 0x55c0f27a8a00 2024-02-09T08:04:32.138 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e8a839780 20 client.4446.objecter put_session s=0x55c0f27a7950 osd=0 5 2024-02-09T08:04:32.138 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.675+0000 7f6e8a839780 5 client.4446.objecter 2 in flight 2024-02-09T08:04:32.138 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.775+0000 7f6e6ffff640 10 monclient: tick 2024-02-09T08:04:32.138 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.775+0000 7f6e6ffff640 10 monclient: _check_auth_tickets 2024-02-09T08:04:32.138 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:30.775+0000 7f6e6ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:04:32.138 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:31.775+0000 7f6e6ffff640 10 monclient: tick 2024-02-09T08:04:32.139 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:31.775+0000 7f6e6ffff640 10 monclient: _check_auth_tickets 2024-02-09T08:04:32.139 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:31.775+0000 7f6e6ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:04:32.139 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e8519e640 1 -- 172.21.15.62:0/4151497593 <== osd.0 v2:172.21.15.62:6808/3842068700 6 ==== osd_map(38..39 src has 1..39) v4 ==== 1299+0+0 (crc 0 0 0) 0x7f6e7c0054e0 con 0x55c0f27a8a00 2024-02-09T08:04:32.139 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e871a2640 1 -- 172.21.15.62:0/4151497593 <== osd.0 v2:172.21.15.62:6808/3842068700 7 ==== osd_op_reply(5 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7f6e7c011040 con 0x55c0f27a8a00 2024-02-09T08:04:32.139 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e871a2640 10 client.4446.objecter ms_dispatch 0x55c0f2751820 osd_op_reply(5 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) v8 2024-02-09T08:04:32.139 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e8519e640 10 client.4446.objecter ms_dispatch 0x55c0f2751820 osd_map(38..39 src has 1..39) v4 2024-02-09T08:04:32.139 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e871a2640 10 client.4446.objecter in handle_osd_op_reply 2024-02-09T08:04:32.139 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e8519e640 3 client.4446.objecter handle_osd_map got epochs [38,39] > 37 2024-02-09T08:04:32.139 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e8519e640 3 client.4446.objecter handle_osd_map decoding incremental epoch 38 2024-02-09T08:04:32.139 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e8519e640 10 client.4446.objecter checking op 5 2024-02-09T08:04:32.139 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e8519e640 20 client.4446.objecter _calc_target epoch 38 base exist @11 precalc_pgid 0 pgid 0.0 is_read 2024-02-09T08:04:32.139 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e8519e640 20 client.4446.objecter _calc_target target exist @11 -> pgid 11.d3a59201 2024-02-09T08:04:32.139 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e8519e640 10 client.4446.objecter checking op 6 2024-02-09T08:04:32.139 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e8519e640 20 client.4446.objecter _calc_target epoch 38 base noexist @11 precalc_pgid 0 pgid 0.0 is_read 2024-02-09T08:04:32.139 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e8519e640 20 client.4446.objecter _calc_target target noexist @11 -> pgid 11.a7bbaa1 2024-02-09T08:04:32.140 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e8519e640 3 client.4446.objecter handle_osd_map decoding incremental epoch 39 2024-02-09T08:04:32.140 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e8519e640 10 client.4446.objecter checking op 5 2024-02-09T08:04:32.140 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e8519e640 20 client.4446.objecter _calc_target epoch 39 base exist @11 precalc_pgid 0 pgid 0.0 is_read 2024-02-09T08:04:32.140 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e8519e640 20 client.4446.objecter _calc_target target exist @11 -> pgid 11.d3a59201 2024-02-09T08:04:32.140 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e8519e640 10 client.4446.objecter checking op 6 2024-02-09T08:04:32.140 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e8519e640 20 client.4446.objecter _calc_target epoch 39 base noexist @11 precalc_pgid 0 pgid 0.0 is_read 2024-02-09T08:04:32.140 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e8519e640 20 client.4446.objecter _calc_target target noexist @11 -> pgid 11.a7bbaa1 2024-02-09T08:04:32.140 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e8519e640 20 client.4446.objecter dump_active .. 0 homeless 2024-02-09T08:04:32.140 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e8519e640 20 client.4446.objecter 5 11.d3a59201 osd.0 exist [read 0~256] 2024-02-09T08:04:32.140 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e8519e640 20 client.4446.objecter 6 11.a7bbaa1 osd.0 noexist [read 0~256] 2024-02-09T08:04:32.140 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e871a2640 7 client.4446.objecter handle_osd_op_reply 5 ondisk uv 1 in 11.1 attempt 0 2024-02-09T08:04:32.140 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e871a2640 10 client.4446.objecter op 0 rval 0 len 5 2024-02-09T08:04:32.140 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e871a2640 15 client.4446.objecter handle_osd_op_reply completed tid 5 2024-02-09T08:04:32.140 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e871a2640 15 client.4446.objecter _finish_op 5 2024-02-09T08:04:32.140 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e871a2640 20 client.4446.objecter put_session s=0x55c0f27a7950 osd=0 5 2024-02-09T08:04:32.141 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e871a2640 15 client.4446.objecter _session_op_remove 0 5 2024-02-09T08:04:32.141 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e871a2640 5 client.4446.objecter 1 in flight 2024-02-09T08:04:32.141 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e871a2640 1 -- 172.21.15.62:0/4151497593 <== osd.0 v2:172.21.15.62:6808/3842068700 8 ==== osd_op_reply(6 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f6e7c011040 con 0x55c0f27a8a00 2024-02-09T08:04:32.141 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e871a2640 10 client.4446.objecter ms_dispatch 0x55c0f2751820 osd_op_reply(6 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 2024-02-09T08:04:32.141 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e871a2640 10 client.4446.objecter in handle_osd_op_reply 2024-02-09T08:04:32.141 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e871a2640 7 client.4446.objecter handle_osd_op_reply 6 ondisk uv 0 in 11.1 attempt 0 2024-02-09T08:04:32.141 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e871a2640 10 client.4446.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2024-02-09T08:04:32.141 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e871a2640 10 client.4446.objecter op 0 rval 0 len 0 2024-02-09T08:04:32.141 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e871a2640 15 client.4446.objecter handle_osd_op_reply completed tid 6 2024-02-09T08:04:32.141 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e871a2640 15 client.4446.objecter _finish_op 6 2024-02-09T08:04:32.141 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e871a2640 20 client.4446.objecter put_session s=0x55c0f27a7950 osd=0 4 2024-02-09T08:04:32.141 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e871a2640 15 client.4446.objecter _session_op_remove 0 6 2024-02-09T08:04:32.141 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e871a2640 5 client.4446.objecter 0 in flight 2024-02-09T08:04:32.141 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [ OK ] AsioRados.AsyncReadFuture (1459 ms) 2024-02-09T08:04:32.142 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [ RUN ] AsioRados.AsyncReadYield 2024-02-09T08:04:32.142 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e8a839780 10 client.4446.objecter _op_submit op 0x55c0f27a8050 2024-02-09T08:04:32.142 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e8a839780 20 client.4446.objecter _calc_target epoch 39 base exist @11 precalc_pgid 0 pgid 0.0 is_read 2024-02-09T08:04:32.142 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e8a839780 20 client.4446.objecter _calc_target target exist @11 -> pgid 11.d3a59201 2024-02-09T08:04:32.142 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e8a839780 10 client.4446.objecter _calc_target raw pgid 11.d3a59201 -> actual 11.1 acting [0,1] primary 0 2024-02-09T08:04:32.142 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e8a839780 20 client.4446.objecter _get_session s=0x55c0f27a7950 osd=0 3 2024-02-09T08:04:32.142 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e8a839780 10 client.4446.objecter _op_submit oid exist '@11' '@11' [read 0~256] tid 7 osd.0 2024-02-09T08:04:32.142 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e8a839780 20 client.4446.objecter get_session s=0x55c0f27a7950 osd=0 3 2024-02-09T08:04:32.142 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e8a839780 15 client.4446.objecter _session_op_assign 0 7 2024-02-09T08:04:32.142 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e8a839780 15 client.4446.objecter _send_op 7 to 11.1 on osd.0 2024-02-09T08:04:32.142 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e8a839780 1 -- 172.21.15.62:0/4151497593 --> [v2:172.21.15.62:6808/3842068700,v1:172.21.15.62:6809/3842068700] -- osd_op(unknown.0.0:7 11.1 11:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39) v8 -- 0x55c0f27a5e70 con 0x55c0f27a8a00 2024-02-09T08:04:32.142 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e8a839780 20 client.4446.objecter put_session s=0x55c0f27a7950 osd=0 4 2024-02-09T08:04:32.142 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e8a839780 5 client.4446.objecter 1 in flight 2024-02-09T08:04:32.142 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e8a839780 10 client.4446.objecter _op_submit op 0x55c0f2969c20 2024-02-09T08:04:32.143 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e8a839780 20 client.4446.objecter _calc_target epoch 39 base noexist @11 precalc_pgid 0 pgid 0.0 is_read 2024-02-09T08:04:32.155 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e8a839780 20 client.4446.objecter _calc_target target noexist @11 -> pgid 11.a7bbaa1 2024-02-09T08:04:32.155 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e8a839780 10 client.4446.objecter _calc_target raw pgid 11.a7bbaa1 -> actual 11.1 acting [0,1] primary 0 2024-02-09T08:04:32.155 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e8a839780 20 client.4446.objecter _get_session s=0x55c0f27a7950 osd=0 4 2024-02-09T08:04:32.155 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e8a839780 10 client.4446.objecter _op_submit oid noexist '@11' '@11' [read 0~256] tid 8 osd.0 2024-02-09T08:04:32.155 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e8a839780 20 client.4446.objecter get_session s=0x55c0f27a7950 osd=0 4 2024-02-09T08:04:32.155 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e8a839780 15 client.4446.objecter _session_op_assign 0 8 2024-02-09T08:04:32.156 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e8a839780 15 client.4446.objecter _send_op 8 to 11.1 on osd.0 2024-02-09T08:04:32.156 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e8a839780 1 -- 172.21.15.62:0/4151497593 --> [v2:172.21.15.62:6808/3842068700,v1:172.21.15.62:6809/3842068700] -- osd_op(unknown.0.0:8 11.1 11:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39) v8 -- 0x55c0f296a0c0 con 0x55c0f27a8a00 2024-02-09T08:04:32.156 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e8a839780 20 client.4446.objecter put_session s=0x55c0f27a7950 osd=0 5 2024-02-09T08:04:32.156 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.134+0000 7f6e8a839780 5 client.4446.objecter 2 in flight 2024-02-09T08:04:32.156 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.147+0000 7f6e871a2640 1 -- 172.21.15.62:0/4151497593 <== osd.0 v2:172.21.15.62:6808/3842068700 9 ==== osd_op_reply(7 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7f6e7c011040 con 0x55c0f27a8a00 2024-02-09T08:04:32.156 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.147+0000 7f6e871a2640 10 client.4446.objecter ms_dispatch 0x55c0f2751820 osd_op_reply(7 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) v8 2024-02-09T08:04:32.156 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.147+0000 7f6e871a2640 10 client.4446.objecter in handle_osd_op_reply 2024-02-09T08:04:32.156 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.147+0000 7f6e871a2640 7 client.4446.objecter handle_osd_op_reply 7 ondisk uv 1 in 11.1 attempt 0 2024-02-09T08:04:32.156 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.147+0000 7f6e871a2640 10 client.4446.objecter op 0 rval 0 len 5 2024-02-09T08:04:32.156 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.147+0000 7f6e871a2640 15 client.4446.objecter handle_osd_op_reply completed tid 7 2024-02-09T08:04:32.156 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.147+0000 7f6e871a2640 15 client.4446.objecter _finish_op 7 2024-02-09T08:04:32.156 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.147+0000 7f6e871a2640 20 client.4446.objecter put_session s=0x55c0f27a7950 osd=0 5 2024-02-09T08:04:32.156 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.147+0000 7f6e871a2640 15 client.4446.objecter _session_op_remove 0 7 2024-02-09T08:04:32.156 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.147+0000 7f6e871a2640 5 client.4446.objecter 1 in flight 2024-02-09T08:04:32.157 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.153+0000 7f6e871a2640 1 -- 172.21.15.62:0/4151497593 <== osd.0 v2:172.21.15.62:6808/3842068700 10 ==== osd_op_reply(8 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f6e7c011040 con 0x55c0f27a8a00 2024-02-09T08:04:32.157 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.153+0000 7f6e871a2640 10 client.4446.objecter ms_dispatch 0x55c0f2751820 osd_op_reply(8 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 2024-02-09T08:04:32.157 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.153+0000 7f6e871a2640 10 client.4446.objecter in handle_osd_op_reply 2024-02-09T08:04:32.157 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.153+0000 7f6e871a2640 7 client.4446.objecter handle_osd_op_reply 8 ondisk uv 0 in 11.1 attempt 0 2024-02-09T08:04:32.157 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.153+0000 7f6e871a2640 10 client.4446.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2024-02-09T08:04:32.157 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.153+0000 7f6e871a2640 10 client.4446.objecter op 0 rval 0 len 0 2024-02-09T08:04:32.157 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.153+0000 7f6e871a2640 15 client.4446.objecter handle_osd_op_reply completed tid 8 2024-02-09T08:04:32.661 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.153+0000 7f6e871a2640 15 client.4446.objecter _finish_op 8 2024-02-09T08:04:32.661 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.153+0000 7f6e871a2640 20 client.4446.objecter put_session s=0x55c0f27a7950 osd=0 4 2024-02-09T08:04:32.662 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.153+0000 7f6e871a2640 15 client.4446.objecter _session_op_remove 0 8 2024-02-09T08:04:32.662 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.153+0000 7f6e871a2640 5 client.4446.objecter 0 in flight 2024-02-09T08:04:32.662 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [ OK ] AsioRados.AsyncReadYield (19 ms) 2024-02-09T08:04:32.662 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteCallback 2024-02-09T08:04:32.662 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.153+0000 7f6e8a839780 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2024-02-09T08:04:32.662 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.153+0000 7f6e8a839780 20 librados: queue_aio_write 0x55c0f26f8330 completion 0x55c0f26f6790 write_seq 1 2024-02-09T08:04:32.662 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.153+0000 7f6e8a839780 10 client.4446.objecter _op_submit op 0x55c0f27a8050 2024-02-09T08:04:32.662 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.153+0000 7f6e8a839780 20 client.4446.objecter _calc_target epoch 39 base exist @11 precalc_pgid 0 pgid 0.0 is_write 2024-02-09T08:04:32.662 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.153+0000 7f6e8a839780 20 client.4446.objecter _calc_target target exist @11 -> pgid 11.d3a59201 2024-02-09T08:04:32.662 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.153+0000 7f6e8a839780 10 client.4446.objecter _calc_target raw pgid 11.d3a59201 -> actual 11.1 acting [0,1] primary 0 2024-02-09T08:04:32.663 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.153+0000 7f6e8a839780 20 client.4446.objecter _get_session s=0x55c0f27a7950 osd=0 3 2024-02-09T08:04:32.663 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.153+0000 7f6e8a839780 10 client.4446.objecter _op_submit oid exist '@11' '@11' [write 0~5 in=5b] tid 9 osd.0 2024-02-09T08:04:32.663 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.153+0000 7f6e8a839780 20 client.4446.objecter get_session s=0x55c0f27a7950 osd=0 3 2024-02-09T08:04:32.663 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.153+0000 7f6e8a839780 15 client.4446.objecter _session_op_assign 0 9 2024-02-09T08:04:32.663 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.153+0000 7f6e8a839780 15 client.4446.objecter _send_op 9 to 11.1 on osd.0 2024-02-09T08:04:32.663 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.153+0000 7f6e8a839780 1 -- 172.21.15.62:0/4151497593 --> [v2:172.21.15.62:6808/3842068700,v1:172.21.15.62:6809/3842068700] -- osd_op(unknown.0.0:9 11.1 11:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39) v8 -- 0x55c0f292a5a0 con 0x55c0f27a8a00 2024-02-09T08:04:32.663 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.153+0000 7f6e8a839780 20 client.4446.objecter put_session s=0x55c0f27a7950 osd=0 4 2024-02-09T08:04:32.663 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.153+0000 7f6e8a839780 5 client.4446.objecter 1 in flight 2024-02-09T08:04:32.663 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.153+0000 7f6e8a839780 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2024-02-09T08:04:32.663 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.656+0000 7f6e871a2640 1 -- 172.21.15.62:0/4151497593 <== osd.0 v2:172.21.15.62:6808/3842068700 11 ==== osd_op_reply(9 exist [write 0~5] v39'2 uv2 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6e7c011040 con 0x55c0f27a8a00 2024-02-09T08:04:32.664 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.656+0000 7f6e871a2640 10 client.4446.objecter ms_dispatch 0x55c0f2751820 osd_op_reply(9 exist [write 0~5] v39'2 uv2 ondisk = 0) v8 2024-02-09T08:04:32.664 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.656+0000 7f6e871a2640 10 client.4446.objecter in handle_osd_op_reply 2024-02-09T08:04:32.664 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.656+0000 7f6e871a2640 7 client.4446.objecter handle_osd_op_reply 9 ondisk uv 2 in 11.1 attempt 0 2024-02-09T08:04:32.664 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.656+0000 7f6e871a2640 10 client.4446.objecter op 0 rval 0 len 0 2024-02-09T08:04:32.664 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.656+0000 7f6e871a2640 15 client.4446.objecter handle_osd_op_reply completed tid 9 2024-02-09T08:04:32.664 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.656+0000 7f6e871a2640 15 client.4446.objecter _finish_op 9 2024-02-09T08:04:32.664 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.656+0000 7f6e871a2640 20 client.4446.objecter put_session s=0x55c0f27a7950 osd=0 4 2024-02-09T08:04:32.664 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.656+0000 7f6e871a2640 15 client.4446.objecter _session_op_remove 0 9 2024-02-09T08:04:32.980 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.656+0000 7f6e871a2640 5 client.4446.objecter 0 in flight 2024-02-09T08:04:32.980 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.656+0000 7f6e871a2640 20 librados: complete_aio_write 0x55c0f26f6790 2024-02-09T08:04:32.980 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [ OK ] AsioRados.AsyncWriteCallback (503 ms) 2024-02-09T08:04:32.980 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteFuture 2024-02-09T08:04:32.980 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.656+0000 7f6e8a839780 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2024-02-09T08:04:32.980 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.656+0000 7f6e8a839780 20 librados: queue_aio_write 0x55c0f26f8330 completion 0x55c0f26ff0b0 write_seq 2 2024-02-09T08:04:32.980 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.656+0000 7f6e8a839780 10 client.4446.objecter _op_submit op 0x55c0f27a8050 2024-02-09T08:04:32.980 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.656+0000 7f6e8a839780 20 client.4446.objecter _calc_target epoch 39 base exist @11 precalc_pgid 0 pgid 0.0 is_write 2024-02-09T08:04:32.981 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.656+0000 7f6e8a839780 20 client.4446.objecter _calc_target target exist @11 -> pgid 11.d3a59201 2024-02-09T08:04:32.981 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.656+0000 7f6e8a839780 10 client.4446.objecter _calc_target raw pgid 11.d3a59201 -> actual 11.1 acting [0,1] primary 0 2024-02-09T08:04:32.981 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.656+0000 7f6e8a839780 20 client.4446.objecter _get_session s=0x55c0f27a7950 osd=0 3 2024-02-09T08:04:32.981 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.656+0000 7f6e8a839780 10 client.4446.objecter _op_submit oid exist '@11' '@11' [write 0~5 in=5b] tid 10 osd.0 2024-02-09T08:04:32.981 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.656+0000 7f6e8a839780 20 client.4446.objecter get_session s=0x55c0f27a7950 osd=0 3 2024-02-09T08:04:32.981 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.656+0000 7f6e8a839780 15 client.4446.objecter _session_op_assign 0 10 2024-02-09T08:04:32.981 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.656+0000 7f6e8a839780 15 client.4446.objecter _send_op 10 to 11.1 on osd.0 2024-02-09T08:04:32.981 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.656+0000 7f6e8a839780 1 -- 172.21.15.62:0/4151497593 --> [v2:172.21.15.62:6808/3842068700,v1:172.21.15.62:6809/3842068700] -- osd_op(unknown.0.0:10 11.1 11:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39) v8 -- 0x55c0f292a5a0 con 0x55c0f27a8a00 2024-02-09T08:04:32.981 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.656+0000 7f6e8a839780 20 client.4446.objecter put_session s=0x55c0f27a7950 osd=0 4 2024-02-09T08:04:32.981 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.656+0000 7f6e8a839780 5 client.4446.objecter 1 in flight 2024-02-09T08:04:32.981 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.656+0000 7f6e8a839780 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2024-02-09T08:04:32.981 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.775+0000 7f6e6ffff640 10 monclient: tick 2024-02-09T08:04:32.981 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.775+0000 7f6e6ffff640 10 monclient: _check_auth_tickets 2024-02-09T08:04:32.981 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.775+0000 7f6e6ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:04:32.981 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.775+0000 7f6e6ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:04:32.982 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.971+0000 7f6e8519e640 1 -- 172.21.15.62:0/4151497593 <== osd.0 v2:172.21.15.62:6808/3842068700 12 ==== osd_map(40..40 src has 1..41) v4 ==== 664+0+0 (crc 0 0 0) 0x7f6e7c007ca0 con 0x55c0f27a8a00 2024-02-09T08:04:32.982 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.971+0000 7f6e8519e640 10 client.4446.objecter ms_dispatch 0x55c0f2751820 osd_map(40..40 src has 1..41) v4 2024-02-09T08:04:32.982 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.971+0000 7f6e8519e640 3 client.4446.objecter handle_osd_map got epochs [40,40] > 39 2024-02-09T08:04:32.982 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.971+0000 7f6e8519e640 3 client.4446.objecter handle_osd_map decoding incremental epoch 40 2024-02-09T08:04:32.982 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.972+0000 7f6e8519e640 10 client.4446.objecter checking op 10 2024-02-09T08:04:32.982 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.972+0000 7f6e8519e640 20 client.4446.objecter _calc_target epoch 40 base exist @11 precalc_pgid 0 pgid 0.0 is_write 2024-02-09T08:04:32.982 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.972+0000 7f6e8519e640 20 client.4446.objecter _calc_target target exist @11 -> pgid 11.d3a59201 2024-02-09T08:04:33.931 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.972+0000 7f6e8519e640 20 client.4446.objecter dump_active .. 0 homeless 2024-02-09T08:04:33.931 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:32.972+0000 7f6e8519e640 20 client.4446.objecter 10 11.d3a59201 osd.0 exist [write 0~5 in=5b] 2024-02-09T08:04:33.931 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:33.775+0000 7f6e6ffff640 10 monclient: tick 2024-02-09T08:04:33.931 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:33.775+0000 7f6e6ffff640 10 monclient: _check_auth_tickets 2024-02-09T08:04:33.931 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:33.775+0000 7f6e6ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:04:33.931 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:33.928+0000 7f6e871a2640 1 -- 172.21.15.62:0/4151497593 <== osd.0 v2:172.21.15.62:6808/3842068700 13 ==== osd_op_reply(10 exist [write 0~5] v40'3 uv3 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6e7c011040 con 0x55c0f27a8a00 2024-02-09T08:04:33.931 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:33.928+0000 7f6e871a2640 10 client.4446.objecter ms_dispatch 0x55c0f2751820 osd_op_reply(10 exist [write 0~5] v40'3 uv3 ondisk = 0) v8 2024-02-09T08:04:33.931 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:33.928+0000 7f6e871a2640 10 client.4446.objecter in handle_osd_op_reply 2024-02-09T08:04:33.931 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:33.928+0000 7f6e871a2640 7 client.4446.objecter handle_osd_op_reply 10 ondisk uv 3 in 11.1 attempt 0 2024-02-09T08:04:33.931 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:33.928+0000 7f6e871a2640 10 client.4446.objecter op 0 rval 0 len 0 2024-02-09T08:04:33.931 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:33.928+0000 7f6e871a2640 15 client.4446.objecter handle_osd_op_reply completed tid 10 2024-02-09T08:04:33.931 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:33.928+0000 7f6e871a2640 15 client.4446.objecter _finish_op 10 2024-02-09T08:04:33.932 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:33.928+0000 7f6e871a2640 20 client.4446.objecter put_session s=0x55c0f27a7950 osd=0 4 2024-02-09T08:04:33.932 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:33.928+0000 7f6e871a2640 15 client.4446.objecter _session_op_remove 0 10 2024-02-09T08:04:33.932 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:33.928+0000 7f6e871a2640 5 client.4446.objecter 0 in flight 2024-02-09T08:04:33.933 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:33.928+0000 7f6e871a2640 20 librados: complete_aio_write 0x55c0f26ff0b0 2024-02-09T08:04:33.933 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [ OK ] AsioRados.AsyncWriteFuture (1272 ms) 2024-02-09T08:04:33.933 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteYield 2024-02-09T08:04:33.933 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:33.928+0000 7f6e8a839780 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2024-02-09T08:04:33.933 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:33.928+0000 7f6e8a839780 20 librados: queue_aio_write 0x55c0f26f8330 completion 0x55c0f27a8050 write_seq 3 2024-02-09T08:04:33.933 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:33.928+0000 7f6e8a839780 10 client.4446.objecter _op_submit op 0x55c0f294d0e0 2024-02-09T08:04:33.933 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:33.928+0000 7f6e8a839780 20 client.4446.objecter _calc_target epoch 40 base exist @11 precalc_pgid 0 pgid 0.0 is_write 2024-02-09T08:04:33.933 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:33.928+0000 7f6e8a839780 20 client.4446.objecter _calc_target target exist @11 -> pgid 11.d3a59201 2024-02-09T08:04:33.933 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:33.928+0000 7f6e8a839780 10 client.4446.objecter _calc_target raw pgid 11.d3a59201 -> actual 11.1 acting [0,1] primary 0 2024-02-09T08:04:33.933 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:33.928+0000 7f6e8a839780 20 client.4446.objecter _get_session s=0x55c0f27a7950 osd=0 3 2024-02-09T08:04:33.934 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:33.928+0000 7f6e8a839780 10 client.4446.objecter _op_submit oid exist '@11' '@11' [write 0~5 in=5b] tid 11 osd.0 2024-02-09T08:04:33.934 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:33.928+0000 7f6e8a839780 20 client.4446.objecter get_session s=0x55c0f27a7950 osd=0 3 2024-02-09T08:04:33.934 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:33.928+0000 7f6e8a839780 15 client.4446.objecter _session_op_assign 0 11 2024-02-09T08:04:33.934 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:33.928+0000 7f6e8a839780 15 client.4446.objecter _send_op 11 to 11.1 on osd.0 2024-02-09T08:04:34.290 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:33.928+0000 7f6e8a839780 1 -- 172.21.15.62:0/4151497593 --> [v2:172.21.15.62:6808/3842068700,v1:172.21.15.62:6809/3842068700] -- osd_op(unknown.0.0:11 11.1 11:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40) v8 -- 0x55c0f294d580 con 0x55c0f27a8a00 2024-02-09T08:04:34.290 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:33.928+0000 7f6e8a839780 20 client.4446.objecter put_session s=0x55c0f27a7950 osd=0 4 2024-02-09T08:04:34.290 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:33.928+0000 7f6e8a839780 5 client.4446.objecter 1 in flight 2024-02-09T08:04:34.290 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:33.928+0000 7f6e8a839780 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2024-02-09T08:04:34.291 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:33.956+0000 7f6e8519e640 1 -- 172.21.15.62:0/4151497593 <== osd.0 v2:172.21.15.62:6808/3842068700 14 ==== osd_map(41..41 src has 1..41) v4 ==== 1023+0+0 (crc 0 0 0) 0x7f6e7c005ba0 con 0x55c0f27a8a00 2024-02-09T08:04:34.291 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:33.956+0000 7f6e8519e640 10 client.4446.objecter ms_dispatch 0x55c0f2751820 osd_map(41..41 src has 1..41) v4 2024-02-09T08:04:34.291 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:33.956+0000 7f6e8519e640 3 client.4446.objecter handle_osd_map got epochs [41,41] > 40 2024-02-09T08:04:34.291 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:33.956+0000 7f6e8519e640 3 client.4446.objecter handle_osd_map decoding incremental epoch 41 2024-02-09T08:04:34.291 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:33.956+0000 7f6e8519e640 10 client.4446.objecter checking op 11 2024-02-09T08:04:34.291 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:33.956+0000 7f6e8519e640 20 client.4446.objecter _calc_target epoch 41 base exist @11 precalc_pgid 0 pgid 0.0 is_write 2024-02-09T08:04:34.291 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:33.956+0000 7f6e8519e640 20 client.4446.objecter _calc_target target exist @11 -> pgid 11.d3a59201 2024-02-09T08:04:34.291 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:33.956+0000 7f6e8519e640 20 client.4446.objecter dump_active .. 0 homeless 2024-02-09T08:04:34.291 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:33.956+0000 7f6e8519e640 20 client.4446.objecter 11 11.d3a59201 osd.0 exist [write 0~5 in=5b] 2024-02-09T08:04:34.291 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [ OK ] AsioRados.AsyncWriteYield (359 ms) 2024-02-09T08:04:34.291 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCallback 2024-02-09T08:04:34.291 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.287+0000 7f6e871a2640 1 -- 172.21.15.62:0/4151497593 <== osd.0 v2:172.21.15.62:6808/3842068700 15 ==== osd_op_reply(11 exist [write 0~5] v41'4 uv4 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6e7c011040 con 0x55c0f27a8a00 2024-02-09T08:04:34.291 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.287+0000 7f6e871a2640 10 client.4446.objecter ms_dispatch 0x55c0f2751820 osd_op_reply(11 exist [write 0~5] v41'4 uv4 ondisk = 0) v8 2024-02-09T08:04:34.291 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.287+0000 7f6e871a2640 10 client.4446.objecter in handle_osd_op_reply 2024-02-09T08:04:34.292 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.287+0000 7f6e871a2640 7 client.4446.objecter handle_osd_op_reply 11 ondisk uv 4 in 11.1 attempt 0 2024-02-09T08:04:34.292 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.287+0000 7f6e871a2640 10 client.4446.objecter op 0 rval 0 len 0 2024-02-09T08:04:34.292 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.287+0000 7f6e871a2640 15 client.4446.objecter handle_osd_op_reply completed tid 11 2024-02-09T08:04:34.292 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.287+0000 7f6e871a2640 15 client.4446.objecter _finish_op 11 2024-02-09T08:04:34.292 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.287+0000 7f6e871a2640 20 client.4446.objecter put_session s=0x55c0f27a7950 osd=0 4 2024-02-09T08:04:34.292 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.287+0000 7f6e871a2640 15 client.4446.objecter _session_op_remove 0 11 2024-02-09T08:04:34.292 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.287+0000 7f6e871a2640 5 client.4446.objecter 0 in flight 2024-02-09T08:04:34.292 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.287+0000 7f6e871a2640 20 librados: complete_aio_write 0x55c0f27a8050 2024-02-09T08:04:34.292 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.287+0000 7f6e8a839780 10 client.4446.objecter _op_submit op 0x55c0f2929590 2024-02-09T08:04:34.292 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.287+0000 7f6e8a839780 20 client.4446.objecter _calc_target epoch 41 base exist @11 precalc_pgid 0 pgid 0.0 is_read 2024-02-09T08:04:34.292 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.287+0000 7f6e8a839780 20 client.4446.objecter _calc_target target exist @11 -> pgid 11.d3a59201 2024-02-09T08:04:34.292 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.287+0000 7f6e8a839780 10 client.4446.objecter _calc_target raw pgid 11.d3a59201 -> actual 11.1 acting [0,1] primary 0 2024-02-09T08:04:34.317 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.287+0000 7f6e8a839780 20 client.4446.objecter _get_session s=0x55c0f27a7950 osd=0 3 2024-02-09T08:04:34.317 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.287+0000 7f6e8a839780 10 client.4446.objecter _op_submit oid exist '@11' '@11' [read 0~0] tid 12 osd.0 2024-02-09T08:04:34.317 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.287+0000 7f6e8a839780 20 client.4446.objecter get_session s=0x55c0f27a7950 osd=0 3 2024-02-09T08:04:34.317 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.287+0000 7f6e8a839780 15 client.4446.objecter _session_op_assign 0 12 2024-02-09T08:04:34.318 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.287+0000 7f6e8a839780 15 client.4446.objecter _send_op 12 to 11.1 on osd.0 2024-02-09T08:04:34.318 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.287+0000 7f6e8a839780 1 -- 172.21.15.62:0/4151497593 --> [v2:172.21.15.62:6808/3842068700,v1:172.21.15.62:6809/3842068700] -- osd_op(unknown.0.0:12 11.1 11:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55c0f2929a30 con 0x55c0f27a8a00 2024-02-09T08:04:34.318 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.287+0000 7f6e8a839780 20 client.4446.objecter put_session s=0x55c0f27a7950 osd=0 4 2024-02-09T08:04:34.318 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.287+0000 7f6e8a839780 5 client.4446.objecter 1 in flight 2024-02-09T08:04:34.318 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.287+0000 7f6e8a839780 10 client.4446.objecter _op_submit op 0x55c0f2929d90 2024-02-09T08:04:34.318 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.287+0000 7f6e8a839780 20 client.4446.objecter _calc_target epoch 41 base noexist @11 precalc_pgid 0 pgid 0.0 is_read 2024-02-09T08:04:34.318 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.287+0000 7f6e8a839780 20 client.4446.objecter _calc_target target noexist @11 -> pgid 11.a7bbaa1 2024-02-09T08:04:34.318 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.287+0000 7f6e8a839780 10 client.4446.objecter _calc_target raw pgid 11.a7bbaa1 -> actual 11.1 acting [0,1] primary 0 2024-02-09T08:04:34.318 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.287+0000 7f6e8a839780 20 client.4446.objecter _get_session s=0x55c0f27a7950 osd=0 4 2024-02-09T08:04:34.318 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.287+0000 7f6e8a839780 10 client.4446.objecter _op_submit oid noexist '@11' '@11' [read 0~0] tid 13 osd.0 2024-02-09T08:04:34.318 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.287+0000 7f6e8a839780 20 client.4446.objecter get_session s=0x55c0f27a7950 osd=0 4 2024-02-09T08:04:34.318 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.287+0000 7f6e8a839780 15 client.4446.objecter _session_op_assign 0 13 2024-02-09T08:04:34.318 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.287+0000 7f6e8a839780 15 client.4446.objecter _send_op 13 to 11.1 on osd.0 2024-02-09T08:04:34.318 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.287+0000 7f6e8a839780 1 -- 172.21.15.62:0/4151497593 --> [v2:172.21.15.62:6808/3842068700,v1:172.21.15.62:6809/3842068700] -- osd_op(unknown.0.0:13 11.1 11:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55c0f292a230 con 0x55c0f27a8a00 2024-02-09T08:04:34.319 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.287+0000 7f6e8a839780 20 client.4446.objecter put_session s=0x55c0f27a7950 osd=0 5 2024-02-09T08:04:34.319 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.287+0000 7f6e8a839780 5 client.4446.objecter 2 in flight 2024-02-09T08:04:34.319 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.314+0000 7f6e871a2640 1 -- 172.21.15.62:0/4151497593 <== osd.0 v2:172.21.15.62:6808/3842068700 16 ==== osd_op_reply(12 exist [read 0~5 out=5b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7f6e7c011040 con 0x55c0f27a8a00 2024-02-09T08:04:34.319 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.314+0000 7f6e871a2640 10 client.4446.objecter ms_dispatch 0x55c0f2751820 osd_op_reply(12 exist [read 0~5 out=5b] v0'0 uv4 ondisk = 0) v8 2024-02-09T08:04:34.319 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.314+0000 7f6e871a2640 10 client.4446.objecter in handle_osd_op_reply 2024-02-09T08:04:34.319 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.314+0000 7f6e871a2640 7 client.4446.objecter handle_osd_op_reply 12 ondisk uv 4 in 11.1 attempt 0 2024-02-09T08:04:34.319 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.314+0000 7f6e871a2640 10 client.4446.objecter op 0 rval 0 len 5 2024-02-09T08:04:34.319 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.314+0000 7f6e871a2640 15 client.4446.objecter handle_osd_op_reply completed tid 12 2024-02-09T08:04:34.319 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.314+0000 7f6e871a2640 15 client.4446.objecter _finish_op 12 2024-02-09T08:04:34.319 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.314+0000 7f6e871a2640 20 client.4446.objecter put_session s=0x55c0f27a7950 osd=0 5 2024-02-09T08:04:34.319 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.314+0000 7f6e871a2640 15 client.4446.objecter _session_op_remove 0 12 2024-02-09T08:04:34.319 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.314+0000 7f6e871a2640 5 client.4446.objecter 1 in flight 2024-02-09T08:04:34.319 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.315+0000 7f6e871a2640 1 -- 172.21.15.62:0/4151497593 <== osd.0 v2:172.21.15.62:6808/3842068700 17 ==== osd_op_reply(13 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f6e7c011040 con 0x55c0f27a8a00 2024-02-09T08:04:34.319 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.315+0000 7f6e871a2640 10 client.4446.objecter ms_dispatch 0x55c0f2751820 osd_op_reply(13 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 2024-02-09T08:04:34.320 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.315+0000 7f6e871a2640 10 client.4446.objecter in handle_osd_op_reply 2024-02-09T08:04:34.320 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.315+0000 7f6e871a2640 7 client.4446.objecter handle_osd_op_reply 13 ondisk uv 0 in 11.1 attempt 0 2024-02-09T08:04:34.320 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.315+0000 7f6e871a2640 10 client.4446.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2024-02-09T08:04:34.320 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.315+0000 7f6e871a2640 10 client.4446.objecter op 0 rval 0 len 0 2024-02-09T08:04:34.320 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.315+0000 7f6e871a2640 15 client.4446.objecter handle_osd_op_reply completed tid 13 2024-02-09T08:04:34.320 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.315+0000 7f6e871a2640 15 client.4446.objecter _finish_op 13 2024-02-09T08:04:34.320 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.315+0000 7f6e871a2640 20 client.4446.objecter put_session s=0x55c0f27a7950 osd=0 4 2024-02-09T08:04:34.320 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCallback (28 ms) 2024-02-09T08:04:34.320 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.315+0000 7f6e871a2640 15 client.4446.objecter _session_op_remove 0 13 2024-02-09T08:04:34.320 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.315+0000 7f6e871a2640 5 client.4446.objecter 0 in flight 2024-02-09T08:04:34.320 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationFuture 2024-02-09T08:04:34.320 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.315+0000 7f6e8a839780 10 client.4446.objecter _op_submit op 0x55c0f29296a0 2024-02-09T08:04:34.320 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.315+0000 7f6e8a839780 20 client.4446.objecter _calc_target epoch 41 base exist @11 precalc_pgid 0 pgid 0.0 is_read 2024-02-09T08:04:34.320 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.315+0000 7f6e8a839780 20 client.4446.objecter _calc_target target exist @11 -> pgid 11.d3a59201 2024-02-09T08:04:34.321 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.315+0000 7f6e8a839780 10 client.4446.objecter _calc_target raw pgid 11.d3a59201 -> actual 11.1 acting [0,1] primary 0 2024-02-09T08:04:34.321 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.315+0000 7f6e8a839780 20 client.4446.objecter _get_session s=0x55c0f27a7950 osd=0 3 2024-02-09T08:04:34.321 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.315+0000 7f6e8a839780 10 client.4446.objecter _op_submit oid exist '@11' '@11' [read 0~0] tid 14 osd.0 2024-02-09T08:04:34.321 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.315+0000 7f6e8a839780 20 client.4446.objecter get_session s=0x55c0f27a7950 osd=0 3 2024-02-09T08:04:34.321 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.315+0000 7f6e8a839780 15 client.4446.objecter _session_op_assign 0 14 2024-02-09T08:04:34.321 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.315+0000 7f6e8a839780 15 client.4446.objecter _send_op 14 to 11.1 on osd.0 2024-02-09T08:04:34.321 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.315+0000 7f6e8a839780 1 -- 172.21.15.62:0/4151497593 --> [v2:172.21.15.62:6808/3842068700,v1:172.21.15.62:6809/3842068700] -- osd_op(unknown.0.0:14 11.1 11:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55c0f2929b40 con 0x55c0f27a8a00 2024-02-09T08:04:34.321 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.315+0000 7f6e8a839780 20 client.4446.objecter put_session s=0x55c0f27a7950 osd=0 4 2024-02-09T08:04:34.321 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.315+0000 7f6e8a839780 5 client.4446.objecter 1 in flight 2024-02-09T08:04:34.321 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.315+0000 7f6e8a839780 10 client.4446.objecter _op_submit op 0x55c0f294d970 2024-02-09T08:04:34.340 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.315+0000 7f6e8a839780 20 client.4446.objecter _calc_target epoch 41 base noexist @11 precalc_pgid 0 pgid 0.0 is_read 2024-02-09T08:04:34.340 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.315+0000 7f6e8a839780 20 client.4446.objecter _calc_target target noexist @11 -> pgid 11.a7bbaa1 2024-02-09T08:04:34.340 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.315+0000 7f6e8a839780 10 client.4446.objecter _calc_target raw pgid 11.a7bbaa1 -> actual 11.1 acting [0,1] primary 0 2024-02-09T08:04:34.340 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.315+0000 7f6e8a839780 20 client.4446.objecter _get_session s=0x55c0f27a7950 osd=0 4 2024-02-09T08:04:34.340 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.315+0000 7f6e8a839780 10 client.4446.objecter _op_submit oid noexist '@11' '@11' [read 0~0] tid 15 osd.0 2024-02-09T08:04:34.340 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.315+0000 7f6e8a839780 20 client.4446.objecter get_session s=0x55c0f27a7950 osd=0 4 2024-02-09T08:04:34.341 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.315+0000 7f6e8a839780 15 client.4446.objecter _session_op_assign 0 15 2024-02-09T08:04:34.341 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.315+0000 7f6e8a839780 15 client.4446.objecter _send_op 15 to 11.1 on osd.0 2024-02-09T08:04:34.341 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.315+0000 7f6e8a839780 1 -- 172.21.15.62:0/4151497593 --> [v2:172.21.15.62:6808/3842068700,v1:172.21.15.62:6809/3842068700] -- osd_op(unknown.0.0:15 11.1 11:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55c0f294de10 con 0x55c0f27a8a00 2024-02-09T08:04:34.341 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.315+0000 7f6e8a839780 20 client.4446.objecter put_session s=0x55c0f27a7950 osd=0 5 2024-02-09T08:04:34.341 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.315+0000 7f6e8a839780 5 client.4446.objecter 2 in flight 2024-02-09T08:04:34.341 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.334+0000 7f6e871a2640 1 -- 172.21.15.62:0/4151497593 <== osd.0 v2:172.21.15.62:6808/3842068700 18 ==== osd_op_reply(14 exist [read 0~5 out=5b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7f6e7c01e040 con 0x55c0f27a8a00 2024-02-09T08:04:34.341 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.334+0000 7f6e871a2640 10 client.4446.objecter ms_dispatch 0x55c0f2751820 osd_op_reply(14 exist [read 0~5 out=5b] v0'0 uv4 ondisk = 0) v8 2024-02-09T08:04:34.341 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.334+0000 7f6e871a2640 10 client.4446.objecter in handle_osd_op_reply 2024-02-09T08:04:34.341 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.334+0000 7f6e871a2640 7 client.4446.objecter handle_osd_op_reply 14 ondisk uv 4 in 11.1 attempt 0 2024-02-09T08:04:34.342 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.334+0000 7f6e871a2640 10 client.4446.objecter op 0 rval 0 len 5 2024-02-09T08:04:34.342 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.334+0000 7f6e871a2640 15 client.4446.objecter handle_osd_op_reply completed tid 14 2024-02-09T08:04:34.342 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.334+0000 7f6e871a2640 15 client.4446.objecter _finish_op 14 2024-02-09T08:04:34.342 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.334+0000 7f6e871a2640 20 client.4446.objecter put_session s=0x55c0f27a7950 osd=0 5 2024-02-09T08:04:34.342 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.334+0000 7f6e871a2640 15 client.4446.objecter _session_op_remove 0 14 2024-02-09T08:04:34.342 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.334+0000 7f6e871a2640 5 client.4446.objecter 1 in flight 2024-02-09T08:04:34.342 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.334+0000 7f6e871a2640 1 -- 172.21.15.62:0/4151497593 <== osd.0 v2:172.21.15.62:6808/3842068700 19 ==== osd_op_reply(15 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f6e7c01e040 con 0x55c0f27a8a00 2024-02-09T08:04:34.342 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.334+0000 7f6e871a2640 10 client.4446.objecter ms_dispatch 0x55c0f2751820 osd_op_reply(15 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 2024-02-09T08:04:34.342 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.334+0000 7f6e871a2640 10 client.4446.objecter in handle_osd_op_reply 2024-02-09T08:04:34.342 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.334+0000 7f6e871a2640 7 client.4446.objecter handle_osd_op_reply 15 ondisk uv 0 in 11.1 attempt 0 2024-02-09T08:04:34.342 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.334+0000 7f6e871a2640 10 client.4446.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2024-02-09T08:04:34.345 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.334+0000 7f6e871a2640 10 client.4446.objecter op 0 rval 0 len 0 2024-02-09T08:04:34.345 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.334+0000 7f6e871a2640 15 client.4446.objecter handle_osd_op_reply completed tid 15 2024-02-09T08:04:34.345 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.334+0000 7f6e871a2640 15 client.4446.objecter _finish_op 15 2024-02-09T08:04:34.346 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.334+0000 7f6e871a2640 20 client.4446.objecter put_session s=0x55c0f27a7950 osd=0 4 2024-02-09T08:04:34.346 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.334+0000 7f6e871a2640 15 client.4446.objecter _session_op_remove 0 15 2024-02-09T08:04:34.346 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.334+0000 7f6e871a2640 5 client.4446.objecter 0 in flight 2024-02-09T08:04:34.346 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationFuture (28 ms) 2024-02-09T08:04:34.346 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationYield 2024-02-09T08:04:34.346 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.343+0000 7f6e8a839780 10 client.4446.objecter _op_submit op 0x55c0f294ca70 2024-02-09T08:04:34.346 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.343+0000 7f6e8a839780 20 client.4446.objecter _calc_target epoch 41 base exist @11 precalc_pgid 0 pgid 0.0 is_read 2024-02-09T08:04:34.346 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.343+0000 7f6e8a839780 20 client.4446.objecter _calc_target target exist @11 -> pgid 11.d3a59201 2024-02-09T08:04:34.346 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.343+0000 7f6e8a839780 10 client.4446.objecter _calc_target raw pgid 11.d3a59201 -> actual 11.1 acting [0,1] primary 0 2024-02-09T08:04:34.346 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.343+0000 7f6e8a839780 20 client.4446.objecter _get_session s=0x55c0f27a7950 osd=0 3 2024-02-09T08:04:34.346 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.343+0000 7f6e8a839780 10 client.4446.objecter _op_submit oid exist '@11' '@11' [read 0~0] tid 16 osd.0 2024-02-09T08:04:34.346 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.343+0000 7f6e8a839780 20 client.4446.objecter get_session s=0x55c0f27a7950 osd=0 3 2024-02-09T08:04:34.346 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.343+0000 7f6e8a839780 15 client.4446.objecter _session_op_assign 0 16 2024-02-09T08:04:34.346 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.343+0000 7f6e8a839780 15 client.4446.objecter _send_op 16 to 11.1 on osd.0 2024-02-09T08:04:34.347 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.343+0000 7f6e8a839780 1 -- 172.21.15.62:0/4151497593 --> [v2:172.21.15.62:6808/3842068700,v1:172.21.15.62:6809/3842068700] -- osd_op(unknown.0.0:16 11.1 11:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55c0f294cf10 con 0x55c0f27a8a00 2024-02-09T08:04:34.347 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.343+0000 7f6e8a839780 20 client.4446.objecter put_session s=0x55c0f27a7950 osd=0 4 2024-02-09T08:04:34.347 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.343+0000 7f6e8a839780 5 client.4446.objecter 1 in flight 2024-02-09T08:04:34.347 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.343+0000 7f6e8a839780 10 client.4446.objecter _op_submit op 0x55c0f294d430 2024-02-09T08:04:34.347 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.343+0000 7f6e8a839780 20 client.4446.objecter _calc_target epoch 41 base noexist @11 precalc_pgid 0 pgid 0.0 is_read 2024-02-09T08:04:34.347 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.343+0000 7f6e8a839780 20 client.4446.objecter _calc_target target noexist @11 -> pgid 11.a7bbaa1 2024-02-09T08:04:34.347 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.343+0000 7f6e8a839780 10 client.4446.objecter _calc_target raw pgid 11.a7bbaa1 -> actual 11.1 acting [0,1] primary 0 2024-02-09T08:04:34.347 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.343+0000 7f6e8a839780 20 client.4446.objecter _get_session s=0x55c0f27a7950 osd=0 4 2024-02-09T08:04:34.347 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.343+0000 7f6e8a839780 10 client.4446.objecter _op_submit oid noexist '@11' '@11' [read 0~0] tid 17 osd.0 2024-02-09T08:04:34.347 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.343+0000 7f6e8a839780 20 client.4446.objecter get_session s=0x55c0f27a7950 osd=0 4 2024-02-09T08:04:34.347 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.343+0000 7f6e8a839780 15 client.4446.objecter _session_op_assign 0 17 2024-02-09T08:04:34.348 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.343+0000 7f6e8a839780 15 client.4446.objecter _send_op 17 to 11.1 on osd.0 2024-02-09T08:04:34.364 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.343+0000 7f6e8a839780 1 -- 172.21.15.62:0/4151497593 --> [v2:172.21.15.62:6808/3842068700,v1:172.21.15.62:6809/3842068700] -- osd_op(unknown.0.0:17 11.1 11:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55c0f294d970 con 0x55c0f27a8a00 2024-02-09T08:04:34.364 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.343+0000 7f6e8a839780 20 client.4446.objecter put_session s=0x55c0f27a7950 osd=0 5 2024-02-09T08:04:34.365 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.343+0000 7f6e8a839780 5 client.4446.objecter 2 in flight 2024-02-09T08:04:34.365 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationYield (18 ms) 2024-02-09T08:04:34.365 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCallback 2024-02-09T08:04:34.365 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.361+0000 7f6e871a2640 1 -- 172.21.15.62:0/4151497593 <== osd.0 v2:172.21.15.62:6808/3842068700 20 ==== osd_op_reply(16 exist [read 0~5 out=5b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7f6e7c01e040 con 0x55c0f27a8a00 2024-02-09T08:04:34.366 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.361+0000 7f6e871a2640 10 client.4446.objecter ms_dispatch 0x55c0f2751820 osd_op_reply(16 exist [read 0~5 out=5b] v0'0 uv4 ondisk = 0) v8 2024-02-09T08:04:34.366 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.361+0000 7f6e871a2640 10 client.4446.objecter in handle_osd_op_reply 2024-02-09T08:04:34.366 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.361+0000 7f6e871a2640 7 client.4446.objecter handle_osd_op_reply 16 ondisk uv 4 in 11.1 attempt 0 2024-02-09T08:04:34.366 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.361+0000 7f6e871a2640 10 client.4446.objecter op 0 rval 0 len 5 2024-02-09T08:04:34.366 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.361+0000 7f6e871a2640 15 client.4446.objecter handle_osd_op_reply completed tid 16 2024-02-09T08:04:34.366 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.361+0000 7f6e871a2640 15 client.4446.objecter _finish_op 16 2024-02-09T08:04:34.366 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.361+0000 7f6e871a2640 20 client.4446.objecter put_session s=0x55c0f27a7950 osd=0 5 2024-02-09T08:04:34.366 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.361+0000 7f6e871a2640 15 client.4446.objecter _session_op_remove 0 16 2024-02-09T08:04:34.367 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.361+0000 7f6e871a2640 5 client.4446.objecter 1 in flight 2024-02-09T08:04:34.367 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.361+0000 7f6e871a2640 1 -- 172.21.15.62:0/4151497593 <== osd.0 v2:172.21.15.62:6808/3842068700 21 ==== osd_op_reply(17 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f6e7c01e040 con 0x55c0f27a8a00 2024-02-09T08:04:34.367 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.361+0000 7f6e871a2640 10 client.4446.objecter ms_dispatch 0x55c0f2751820 osd_op_reply(17 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 2024-02-09T08:04:34.367 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.361+0000 7f6e871a2640 10 client.4446.objecter in handle_osd_op_reply 2024-02-09T08:04:34.367 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.361+0000 7f6e871a2640 7 client.4446.objecter handle_osd_op_reply 17 ondisk uv 0 in 11.1 attempt 0 2024-02-09T08:04:34.367 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.361+0000 7f6e871a2640 10 client.4446.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2024-02-09T08:04:34.367 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.361+0000 7f6e871a2640 10 client.4446.objecter op 0 rval 0 len 0 2024-02-09T08:04:34.367 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.361+0000 7f6e871a2640 15 client.4446.objecter handle_osd_op_reply completed tid 17 2024-02-09T08:04:34.368 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.361+0000 7f6e871a2640 15 client.4446.objecter _finish_op 17 2024-02-09T08:04:34.368 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.361+0000 7f6e871a2640 20 client.4446.objecter put_session s=0x55c0f27a7950 osd=0 4 2024-02-09T08:04:34.369 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.361+0000 7f6e871a2640 15 client.4446.objecter _session_op_remove 0 17 2024-02-09T08:04:34.369 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.361+0000 7f6e871a2640 5 client.4446.objecter 0 in flight 2024-02-09T08:04:34.369 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.361+0000 7f6e8a839780 20 librados: queue_aio_write 0x55c0f26f8330 completion 0x55c0f27a83e0 write_seq 4 2024-02-09T08:04:34.369 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.361+0000 7f6e8a839780 10 client.4446.objecter _op_submit op 0x55c0f294d430 2024-02-09T08:04:34.369 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.361+0000 7f6e8a839780 20 client.4446.objecter _calc_target epoch 41 base exist @11 precalc_pgid 0 pgid 0.0 is_write 2024-02-09T08:04:34.883 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.361+0000 7f6e8a839780 20 client.4446.objecter _calc_target target exist @11 -> pgid 11.d3a59201 2024-02-09T08:04:34.884 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.361+0000 7f6e8a839780 10 client.4446.objecter _calc_target raw pgid 11.d3a59201 -> actual 11.1 acting [0,1] primary 0 2024-02-09T08:04:34.884 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.361+0000 7f6e8a839780 20 client.4446.objecter _get_session s=0x55c0f27a7950 osd=0 3 2024-02-09T08:04:34.884 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.361+0000 7f6e8a839780 10 client.4446.objecter _op_submit oid exist '@11' '@11' [writefull 0~5 in=5b] tid 18 osd.0 2024-02-09T08:04:34.884 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.361+0000 7f6e8a839780 20 client.4446.objecter get_session s=0x55c0f27a7950 osd=0 3 2024-02-09T08:04:34.884 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.361+0000 7f6e8a839780 15 client.4446.objecter _session_op_assign 0 18 2024-02-09T08:04:34.884 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.361+0000 7f6e8a839780 15 client.4446.objecter _send_op 18 to 11.1 on osd.0 2024-02-09T08:04:34.884 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.361+0000 7f6e8a839780 1 -- 172.21.15.62:0/4151497593 --> [v2:172.21.15.62:6808/3842068700,v1:172.21.15.62:6809/3842068700] -- osd_op(unknown.0.0:18 11.1 11:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55c0f29296a0 con 0x55c0f27a8a00 2024-02-09T08:04:34.884 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.361+0000 7f6e8a839780 20 client.4446.objecter put_session s=0x55c0f27a7950 osd=0 4 2024-02-09T08:04:34.884 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.361+0000 7f6e8a839780 5 client.4446.objecter 1 in flight 2024-02-09T08:04:34.884 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.775+0000 7f6e6ffff640 10 monclient: tick 2024-02-09T08:04:34.884 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.775+0000 7f6e6ffff640 10 monclient: _check_auth_tickets 2024-02-09T08:04:34.884 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.775+0000 7f6e6ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:04:34.885 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.881+0000 7f6e871a2640 1 -- 172.21.15.62:0/4151497593 <== osd.0 v2:172.21.15.62:6808/3842068700 22 ==== osd_op_reply(18 exist [writefull 0~5] v41'5 uv5 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6e7c01e040 con 0x55c0f27a8a00 2024-02-09T08:04:34.885 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCallback (520 ms) 2024-02-09T08:04:34.885 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.881+0000 7f6e871a2640 10 client.4446.objecter ms_dispatch 0x55c0f2751820 osd_op_reply(18 exist [writefull 0~5] v41'5 uv5 ondisk = 0) v8 2024-02-09T08:04:34.885 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationFuture 2024-02-09T08:04:34.885 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.881+0000 7f6e871a2640 10 client.4446.objecter in handle_osd_op_reply 2024-02-09T08:04:34.885 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.881+0000 7f6e871a2640 7 client.4446.objecter handle_osd_op_reply 18 ondisk uv 5 in 11.1 attempt 0 2024-02-09T08:04:34.885 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.881+0000 7f6e871a2640 10 client.4446.objecter op 0 rval 0 len 0 2024-02-09T08:04:34.885 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.881+0000 7f6e871a2640 15 client.4446.objecter handle_osd_op_reply completed tid 18 2024-02-09T08:04:34.885 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.881+0000 7f6e871a2640 15 client.4446.objecter _finish_op 18 2024-02-09T08:04:34.885 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.881+0000 7f6e871a2640 20 client.4446.objecter put_session s=0x55c0f27a7950 osd=0 4 2024-02-09T08:04:34.885 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.881+0000 7f6e871a2640 15 client.4446.objecter _session_op_remove 0 18 2024-02-09T08:04:34.885 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.881+0000 7f6e871a2640 5 client.4446.objecter 0 in flight 2024-02-09T08:04:34.885 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.881+0000 7f6e871a2640 20 librados: complete_aio_write 0x55c0f27a83e0 2024-02-09T08:04:34.885 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.881+0000 7f6e8a839780 20 librados: queue_aio_write 0x55c0f26f8330 completion 0x55c0f27a82d0 write_seq 5 2024-02-09T08:04:34.886 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.881+0000 7f6e8a839780 10 client.4446.objecter _op_submit op 0x55c0f294d430 2024-02-09T08:04:34.886 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.881+0000 7f6e8a839780 20 client.4446.objecter _calc_target epoch 41 base exist @11 precalc_pgid 0 pgid 0.0 is_write 2024-02-09T08:04:34.886 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.881+0000 7f6e8a839780 20 client.4446.objecter _calc_target target exist @11 -> pgid 11.d3a59201 2024-02-09T08:04:35.885 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04 pool: Running main() from gmock_main.cc 2024-02-09T08:04:35.885 INFO:tasks.workunit.client.0.smithi062.stdout: pool: [==========] Running 6 tests from 1 test suite. 2024-02-09T08:04:35.886 INFO:tasks.workunit.client.0.smithi062.stdout: pool: [----------] Global test environment set-up. 2024-02-09T08:04:35.886 INFO:tasks.workunit.client.0.smithi062.stdout: pool: [----------] 6 tests from NeoRadosPools 2024-02-09T08:04:35.886 INFO:tasks.workunit.client.0.smithi062.stdout: pool: [ RUN ] NeoRadosPools.PoolList 2024-02-09T08:04:35.886 INFO:tasks.workunit.client.0.smithi062.stdout: pool: [ OK ] NeoRadosPools.PoolList (3922 ms) 2024-02-09T08:04:35.886 INFO:tasks.workunit.client.0.smithi062.stdout: pool: [ RUN ] NeoRadosPools.PoolLookup 2024-02-09T08:04:35.886 INFO:tasks.workunit.client.0.smithi062.stdout: pool: [ OK ] NeoRadosPools.PoolLookup (3133 ms) 2024-02-09T08:04:35.887 INFO:tasks.workunit.client.0.smithi062.stdout: pool: [ RUN ] NeoRadosPools.PoolLookupOtherInstance 2024-02-09T08:04:35.887 INFO:tasks.workunit.client.0.smithi062.stdout: pool: [ OK ] NeoRadosPools.PoolLookupOtherInstance (3016 ms) 2024-02-09T08:04:35.887 INFO:tasks.workunit.client.0.smithi062.stdout: pool: [ RUN ] NeoRadosPools.PoolDelete 2024-02-09T08:04:35.887 INFO:tasks.workunit.client.0.smithi062.stdout: pool: [ OK ] NeoRadosPools.PoolDelete (9073 ms) 2024-02-09T08:04:35.887 INFO:tasks.workunit.client.0.smithi062.stdout: pool: [ RUN ] NeoRadosPools.PoolCreateDelete 2024-02-09T08:04:35.887 INFO:tasks.workunit.client.0.smithi062.stdout: pool: [ OK ] NeoRadosPools.PoolCreateDelete (3946 ms) 2024-02-09T08:04:35.888 INFO:tasks.workunit.client.0.smithi062.stdout: pool: [ RUN ] NeoRadosPools.PoolCreateWithCrushRule 2024-02-09T08:04:35.888 INFO:tasks.workunit.client.0.smithi062.stdout: pool: [ OK ] NeoRadosPools.PoolCreateWithCrushRule (2687 ms) 2024-02-09T08:04:35.888 INFO:tasks.workunit.client.0.smithi062.stdout: pool: [----------] 6 tests from NeoRadosPools (25777 ms total) 2024-02-09T08:04:35.888 INFO:tasks.workunit.client.0.smithi062.stdout: pool: 2024-02-09T08:04:35.888 INFO:tasks.workunit.client.0.smithi062.stdout: pool: [----------] Global test environment tear-down 2024-02-09T08:04:35.888 INFO:tasks.workunit.client.0.smithi062.stdout: pool: [==========] 6 tests from 1 test suite ran. (25777 ms total) 2024-02-09T08:04:35.889 INFO:tasks.workunit.client.0.smithi062.stdout: pool: [ PASSED ] 6 tests. 2024-02-09T08:04:35.908 INFO:tasks.workunit.client.0.smithi062.stdout::34.881+0000 7f6e8a839780 10 client.4446.objecter _calc_target raw pgid 11.d3a59201 -> actual 11.1 acting [0,1] primary 0 2024-02-09T08:04:35.908 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.881+0000 7f6e8a839780 20 client.4446.objecter _get_session s=0x55c0f27a7950 osd=0 3 2024-02-09T08:04:35.908 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.881+0000 7f6e8a839780 10 client.4446.objecter _op_submit oid exist '@11' '@11' [writefull 0~5 in=5b] tid 19 osd.0 2024-02-09T08:04:35.908 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.881+0000 7f6e8a839780 20 client.4446.objecter get_session s=0x55c0f27a7950 osd=0 3 2024-02-09T08:04:35.909 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.881+0000 7f6e8a839780 15 client.4446.objecter _session_op_assign 0 19 2024-02-09T08:04:35.909 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.881+0000 7f6e8a839780 15 client.4446.objecter _send_op 19 to 11.1 on osd.0 2024-02-09T08:04:35.909 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.881+0000 7f6e8a839780 1 -- 172.21.15.62:0/4151497593 --> [v2:172.21.15.62:6808/3842068700,v1:172.21.15.62:6809/3842068700] -- osd_op(unknown.0.0:19 11.1 11:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55c0f29296a0 con 0x55c0f27a8a00 2024-02-09T08:04:35.909 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.881+0000 7f6e8a839780 20 client.4446.objecter put_session s=0x55c0f27a7950 osd=0 4 2024-02-09T08:04:35.909 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.881+0000 7f6e8a839780 5 client.4446.objecter 1 in flight 2024-02-09T08:04:35.909 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:34.990+0000 7f6e89c07640 10 client.4446.objecter tick 2024-02-09T08:04:35.909 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:35.775+0000 7f6e6ffff640 10 monclient: tick 2024-02-09T08:04:35.910 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:35.775+0000 7f6e6ffff640 10 monclient: _check_auth_tickets 2024-02-09T08:04:35.910 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:35.775+0000 7f6e6ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:04:35.910 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:35.905+0000 7f6e871a2640 1 -- 172.21.15.62:0/4151497593 <== osd.0 v2:172.21.15.62:6808/3842068700 23 ==== osd_op_reply(19 exist [writefull 0~5] v41'6 uv6 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6e7c01e040 con 0x55c0f27a8a00 2024-02-09T08:04:35.910 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:35.905+0000 7f6e871a2640 10 client.4446.objecter ms_dispatch 0x55c0f2751820 osd_op_reply(19 exist [writefull 0~5] v41'6 uv6 ondisk = 0) v8 2024-02-09T08:04:35.910 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:35.905+0000 7f6e871a2640 10 client.4446.objecter in handle_osd_op_reply 2024-02-09T08:04:35.910 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:35.905+0000 7f6e871a2640 7 client.4446.objecter handle_osd_op_reply 19 ondisk uv 6 in 11.1 attempt 0 2024-02-09T08:04:35.911 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:35.905+0000 7f6e871a2640 10 client.4446.objecter op 0 rval 0 len 0 2024-02-09T08:04:35.911 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:35.905+0000 7f6e871a2640 15 client.4446.objecter handle_osd_op_reply completed tid 19 2024-02-09T08:04:35.911 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:35.905+0000 7f6e871a2640 15 client.4446.objecter _finish_op 19 2024-02-09T08:04:35.911 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:35.905+0000 7f6e871a2640 20 client.4446.objecter put_session s=0x55c0f27a7950 osd=0 4 2024-02-09T08:04:35.911 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:35.905+0000 7f6e871a2640 15 client.4446.objecter _session_op_remove 0 19 2024-02-09T08:04:35.911 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:35.905+0000 7f6e871a2640 5 client.4446.objecter 0 in flight 2024-02-09T08:04:35.912 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:35.905+0000 7f6e871a2640 20 librados: complete_aio_write 0x55c0f27a82d0 2024-02-09T08:04:35.912 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationFuture (1024 ms) 2024-02-09T08:04:35.912 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationYield 2024-02-09T08:04:35.912 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:35.905+0000 7f6e8a839780 20 librados: queue_aio_write 0x55c0f26f8330 completion 0x55c0f29296a0 write_seq 6 2024-02-09T08:04:35.912 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:35.905+0000 7f6e8a839780 10 client.4446.objecter _op_submit op 0x55c0f294d410 2024-02-09T08:04:35.912 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:35.905+0000 7f6e8a839780 20 client.4446.objecter _calc_target epoch 41 base exist @11 precalc_pgid 0 pgid 0.0 is_write 2024-02-09T08:04:35.913 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:35.905+0000 7f6e8a839780 20 client.4446.objecter _calc_target target exist @11 -> pgid 11.d3a59201 2024-02-09T08:04:36.751 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:35.905+0000 7f6e8a839780 10 client.4446.objecter _calc_target raw pgid 11.d3a59201 -> actual 11.1 acting [0,1] primary 0 2024-02-09T08:04:36.751 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:35.905+0000 7f6e8a839780 20 client.4446.objecter _get_session s=0x55c0f27a7950 osd=0 3 2024-02-09T08:04:36.751 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:35.905+0000 7f6e8a839780 10 client.4446.objecter _op_submit oid exist '@11' '@11' [writefull 0~5 in=5b] tid 20 osd.0 2024-02-09T08:04:36.751 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:35.905+0000 7f6e8a839780 20 client.4446.objecter get_session s=0x55c0f27a7950 osd=0 3 2024-02-09T08:04:36.751 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:35.905+0000 7f6e8a839780 15 client.4446.objecter _session_op_assign 0 20 2024-02-09T08:04:36.751 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:35.905+0000 7f6e8a839780 15 client.4446.objecter _send_op 20 to 11.1 on osd.0 2024-02-09T08:04:36.751 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:35.905+0000 7f6e8a839780 1 -- 172.21.15.62:0/4151497593 --> [v2:172.21.15.62:6808/3842068700,v1:172.21.15.62:6809/3842068700] -- osd_op(unknown.0.0:20 11.1 11:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55c0f294ca70 con 0x55c0f27a8a00 2024-02-09T08:04:36.752 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:35.905+0000 7f6e8a839780 20 client.4446.objecter put_session s=0x55c0f27a7950 osd=0 4 2024-02-09T08:04:36.752 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:35.905+0000 7f6e8a839780 5 client.4446.objecter 1 in flight 2024-02-09T08:04:36.752 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:36.748+0000 7f6e871a2640 1 -- 172.21.15.62:0/4151497593 <== osd.0 v2:172.21.15.62:6808/3842068700 24 ==== osd_op_reply(20 exist [writefull 0~5] v41'7 uv7 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6e7c01e040 con 0x55c0f27a8a00 2024-02-09T08:04:36.752 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:36.748+0000 7f6e871a2640 10 client.4446.objecter ms_dispatch 0x55c0f2751820 osd_op_reply(20 exist [writefull 0~5] v41'7 uv7 ondisk = 0) v8 2024-02-09T08:04:36.752 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:36.748+0000 7f6e871a2640 10 client.4446.objecter in handle_osd_op_reply 2024-02-09T08:04:36.752 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:36.748+0000 7f6e871a2640 7 client.4446.objecter handle_osd_op_reply 20 ondisk uv 7 in 11.1 attempt 0 2024-02-09T08:04:36.752 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:36.748+0000 7f6e871a2640 10 client.4446.objecter op 0 rval 0 len 0 2024-02-09T08:04:36.752 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:36.748+0000 7f6e871a2640 15 client.4446.objecter handle_osd_op_reply completed tid 20 2024-02-09T08:04:36.752 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:36.748+0000 7f6e871a2640 15 client.4446.objecter _finish_op 20 2024-02-09T08:04:36.752 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:36.748+0000 7f6e871a2640 20 client.4446.objecter put_session s=0x55c0f27a7950 osd=0 4 2024-02-09T08:04:36.752 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:36.748+0000 7f6e871a2640 15 client.4446.objecter _session_op_remove 0 20 2024-02-09T08:04:36.752 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:36.748+0000 7f6e871a2640 5 client.4446.objecter 0 in flight 2024-02-09T08:04:36.752 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:36.748+0000 7f6e871a2640 20 librados: complete_aio_write 0x55c0f29296a0 2024-02-09T08:04:36.752 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationYield (844 ms) 2024-02-09T08:04:36.753 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:36.748+0000 7f6e8a839780 10 librados: watch_flush enter 2024-02-09T08:04:36.753 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:36.749+0000 7f6e8a839780 10 librados: watch_flush exit 2024-02-09T08:04:36.753 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:36.749+0000 7f6e8a839780 10 client.4446.objecter close_session for osd.0 2024-02-09T08:04:36.753 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:36.749+0000 7f6e8a839780 1 -- 172.21.15.62:0/4151497593 >> [v2:172.21.15.62:6808/3842068700,v1:172.21.15.62:6809/3842068700] conn(0x55c0f27a8a00 msgr2=0x55c0f27a8de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:04:36.753 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:36.749+0000 7f6e8a839780 1 --2- 172.21.15.62:0/4151497593 >> [v2:172.21.15.62:6808/3842068700,v1:172.21.15.62:6809/3842068700] conn(0x55c0f27a8a00 0x55c0f27a8de0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:04:36.753 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:36.749+0000 7f6e8a839780 20 client.4446.objecter put_session s=0x55c0f27a7950 osd=0 1 2024-02-09T08:04:36.755 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:36.749+0000 7f6e8a839780 20 client.4446.objecter shutdown clearing up homeless session... 2024-02-09T08:04:36.755 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:36.749+0000 7f6e8a839780 10 client.4446.objecter successfully canceled tick 2024-02-09T08:04:36.755 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:36.749+0000 7f6e8a839780 1 -- 172.21.15.62:0/4151497593 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f6e7406b410 msgr2=0x7f6e7406d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:04:36.756 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:36.749+0000 7f6e8a839780 1 --2- 172.21.15.62:0/4151497593 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f6e7406b410 0x7f6e7406d8d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6e8000a2d0 tx=0x7f6e80005810 comp rx=0 tx=0).stop 2024-02-09T08:04:36.756 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:36.749+0000 7f6e8a839780 10 monclient: shutdown 2024-02-09T08:04:36.756 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:36.749+0000 7f6e8a839780 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:04:36.756 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:36.749+0000 7f6e8a839780 1 -- 172.21.15.62:0/4151497593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c0f27e45f0 msgr2=0x55c0f2866690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:04:36.756 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:36.749+0000 7f6e8a839780 1 --2- 172.21.15.62:0/4151497593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c0f27e45f0 0x55c0f2866690 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6e7800a4f0 tx=0x7f6e78002fb0 comp rx=0 tx=0).stop 2024-02-09T08:04:36.756 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:36.749+0000 7f6e881a4640 1 -- 172.21.15.62:0/4151497593 reap_dead start 2024-02-09T08:04:36.756 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:36.749+0000 7f6e8a839780 1 -- 172.21.15.62:0/4151497593 shutdown_connections 2024-02-09T08:04:36.756 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:36.749+0000 7f6e8a839780 1 -- 172.21.15.62:0/4151497593 >> 172.21.15.62:0/4151497593 conn(0x55c0f27e5550 msgr2=0x55c0f286d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:04:36.756 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:36.749+0000 7f6e8a839780 1 -- 172.21.15.62:0/4151497593 shutdown_connections 2024-02-09T08:04:36.756 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:36.749+0000 7f6e8a839780 1 -- 172.21.15.62:0/4151497593 wait complete. 2024-02-09T08:04:36.756 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:36.749+0000 7f6e8a839780 1 librados: shutdown 2024-02-09T08:04:36.756 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [----------] 12 tests from AsioRados (7270 ms total) 2024-02-09T08:04:36.756 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-09T08:04:36.756 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [----------] Global test environment tear-down 2024-02-09T08:04:36.757 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [==========] 12 tests from 1 test suite ran. (27051 ms total) 2024-02-09T08:04:36.757 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [ PASSED ] 12 tests. 2024-02-09T08:04:41.061 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: [==========] Running 4 tests from 1 test suite. 2024-02-09T08:04:41.062 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: [----------] Global test environment set-up. 2024-02-09T08:04:41.062 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP 2024-02-09T08:04:41.062 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterEarly 2024-02-09T08:04:41.062 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterEarly (5310 ms) 2024-02-09T08:04:41.062 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterLate 2024-02-09T08:04:41.062 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterLate (444 ms) 2024-02-09T08:04:41.062 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Status 2024-02-09T08:04:41.062 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: [ OK ] LibRadosServicePP.Status (20166 ms) 2024-02-09T08:04:41.062 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Close 2024-02-09T08:04:41.062 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: attempt 0 of 20 2024-02-09T08:04:41.062 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: failed to deregister: 2024-02-09T08:04:41.062 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: { 2024-02-09T08:04:41.062 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "epoch": 14, 2024-02-09T08:04:41.063 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "modified": "2024-02-09T08:04:37.817574+0000", 2024-02-09T08:04:41.063 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "services": { 2024-02-09T08:04:41.063 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "laundry": { 2024-02-09T08:04:41.063 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "daemons": { 2024-02-09T08:04:41.063 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "summary": "", 2024-02-09T08:04:41.063 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "close-test-pid41528": { 2024-02-09T08:04:41.063 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "start_epoch": 14, 2024-02-09T08:04:41.063 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "start_stamp": "2024-02-09T08:04:35.931610+0000", 2024-02-09T08:04:41.063 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "gid": 4744, 2024-02-09T08:04:41.063 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "addr": "172.21.15.62:0/460291089", 2024-02-09T08:04:41.063 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "metadata": { 2024-02-09T08:04:41.063 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "arch": "x86_64", 2024-02-09T08:04:41.063 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "ceph_release": "squid", 2024-02-09T08:04:41.063 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "ceph_version": "ceph version 19.0.0-1310-g0089f33e (0089f33ec7e39da1a9e0f281bf62a5b44e1951f6) squid (dev)", 2024-02-09T08:04:41.063 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "ceph_version_short": "19.0.0-1310-g0089f33e", 2024-02-09T08:04:41.064 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", 2024-02-09T08:04:41.064 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "distro": "centos", 2024-02-09T08:04:41.064 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "distro_description": "CentOS Stream 9", 2024-02-09T08:04:41.064 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "distro_version": "9", 2024-02-09T08:04:41.064 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "foo": "bar", 2024-02-09T08:04:41.064 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "hostname": "smithi062", 2024-02-09T08:04:41.064 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Jan 24 21:50:18 UTC 2024", 2024-02-09T08:04:41.064 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "kernel_version": "5.14.0-412.el9.x86_64", 2024-02-09T08:04:41.064 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "mem_swap_kb": "0", 2024-02-09T08:04:41.064 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "mem_total_kb": "32488536", 2024-02-09T08:04:41.064 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "os": "Linux", 2024-02-09T08:04:41.064 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "this": "that" 2024-02-09T08:04:41.064 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: }, 2024-02-09T08:04:41.064 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "task_status": {} 2024-02-09T08:04:41.065 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: }, 2024-02-09T08:04:41.065 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "pid41533": { 2024-02-09T08:04:41.065 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "start_epoch": 13, 2024-02-09T08:04:41.065 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "start_stamp": "2024-02-09T08:04:21.591809+0000", 2024-02-09T08:04:41.065 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "gid": 4714, 2024-02-09T08:04:41.065 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "addr": "172.21.15.62:0/2130934685", 2024-02-09T08:04:41.065 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "metadata": { 2024-02-09T08:04:41.065 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "arch": "x86_64", 2024-02-09T08:04:41.065 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "ceph_release": "squid", 2024-02-09T08:04:41.065 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "ceph_version": "ceph version 19.0.0-1310-g0089f33e (0089f33ec7e39da1a9e0f281bf62a5b44e1951f6) squid (dev)", 2024-02-09T08:04:41.065 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "ceph_version_short": "19.0.0-1310-g0089f33e", 2024-02-09T08:04:41.065 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", 2024-02-09T08:04:41.586 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 553 unknown 2024-02-09T08:04:41.586 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 506 creating+peering 2024-02-09T08:04:41.586 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 21 active+clean 2024-02-09T08:04:41.586 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 9 creating+activating 2024-02-09T08:04:41.586 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 2024-02-09T08:04:41.586 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 2024-02-09T08:04:41.586 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: [ OK ] LibRadosService.StatusFormat (5717 ms) 2024-02-09T08:04:41.586 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: [ RUN ] LibRadosService.Status 2024-02-09T08:04:41.586 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: [ OK ] LibRadosService.Status (20191 ms) 2024-02-09T08:04:41.586 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: [----------] 4 tests from LibRadosService (31670 ms total) 2024-02-09T08:04:41.586 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 2024-02-09T08:04:41.586 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: [----------] Global test environment tear-down 2024-02-09T08:04:41.587 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: [==========] 4 tests from 1 test suite ran. (31670 ms total) 2024-02-09T08:04:41.587 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: [ PASSED ] 4 tests. 2024-02-09T08:04:43.386 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:04:43.178+0000 ec49640 -1 osd.0 47 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4515.0:2 20.15 20.40e8aab5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:04:43.588 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:04:43.560+0000 ec49640 -1 osd.2 47 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4512.0:2 21.6 21:602f83fe:::foo:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:04:44.359 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:04:44.349+0000 ec49640 -1 osd.0 48 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4515.0:2 20.15 20.40e8aab5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:04:44.485 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:04:44.462+0000 12c51640 -1 osd.3 47 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4481.0:2 33.1 33.aabc5e21 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:04:44.865 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:04:44.852+0000 ec49640 -1 osd.2 47 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4512.0:2 21.6 21:602f83fe:::foo:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:04:44.867 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-02-09T08:04:44.853+0000 ec49640 -1 osd.5 48 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4450.0:2 7.8 7.fb1dc768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e29) 2024-02-09T08:04:45.463 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:04:45.432+0000 ec49640 -1 osd.0 48 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4515.0:2 20.15 20.40e8aab5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:04:45.780 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:04:45.747+0000 ec49640 -1 osd.1 48 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4496.0:2 27.1b 27.780569b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:04:45.996 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:04:45.911+0000 12c51640 -1 osd.3 49 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4481.0:2 33.1 33.aabc5e21 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:04:46.101 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-02-09T08:04:46.088+0000 ec49640 -1 osd.5 49 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4450.0:2 7.8 7.fb1dc768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e29) 2024-02-09T08:04:46.616 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:04:46.581+0000 ec49640 -1 osd.0 49 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4515.0:2 20.15 20.40e8aab5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:04:46.754 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:04:46.735+0000 ec49640 -1 osd.1 48 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4496.0:2 27.1b 27.780569b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:04:46.828 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:04:46.772+0000 ec49640 -1 osd.2 49 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4512.0:2 21.6 21:602f83fe:::foo:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:04:46.932 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:04:46.924+0000 12c51640 -1 osd.3 49 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4481.0:2 33.1 33.aabc5e21 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:04:47.461 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-02-09T08:04:47.415+0000 ec49640 -1 osd.6 50 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4487.0:2 32.1a 32:5c6776db:::0.obj:head [write 0~189 in=189b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:04:47.750 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-02-09T08:04:47.727+0000 ec49640 -1 osd.5 50 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4450.0:2 7.8 7.fb1dc768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e29) 2024-02-09T08:04:47.910 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:04:47.806+0000 ec49640 -1 osd.0 50 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4515.0:2 20.15 20.40e8aab5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:04:48.000 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:04:47.989+0000 12c51640 -1 osd.3 49 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4481.0:2 33.1 33:847a3d55:::obj:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:04:48.138 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:04:48.098+0000 ec49640 -1 osd.2 51 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4512.0:2 21.6 21:602f83fe:::foo:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:04:48.323 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:04:48.228+0000 ec49640 -1 osd.7 53 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4567.0:2 30.1 30.aabc5e21 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:04:48.404 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:04:48.290+0000 ec49640 -1 osd.1 51 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4496.0:2 27.1b 27:d96a01e0:::testobj:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:04:48.638 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-02-09T08:04:48.593+0000 ec49640 -1 osd.6 51 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4487.0:2 32.1a 32:5c6776db:::0.obj:head [write 0~189 in=189b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:04:49.001 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-02-09T08:04:48.905+0000 ec49640 -1 osd.5 51 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4450.0:2 7.8 7.fb1dc768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e29) 2024-02-09T08:04:49.175 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:04:49.162+0000 12c51640 -1 osd.3 50 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4481.0:2 33.1 33:847a3d55:::obj:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:04:49.199 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:04:49.194+0000 ec49640 -1 osd.7 53 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4567.0:2 30.1 30.aabc5e21 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:04:49.255 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:04:49.175+0000 ec49640 -1 osd.0 51 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4546.0:2 22.1e 22:7a7d4169:::src_object.1:head [writefull 0~4096 in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) 2024-02-09T08:04:49.345 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:04:49.250+0000 ec49640 -1 osd.2 51 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4512.0:2 21.6 21:602f83fe:::foo:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:04:50.026 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-02-09T08:04:50.004+0000 ec49640 -1 osd.5 51 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4450.0:2 7.8 7.fb1dc768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e29) 2024-02-09T08:04:50.172 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-02-09T08:04:50.144+0000 ec49640 -1 osd.6 53 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4487.0:2 32.1a 32:5c6776db:::0.obj:head [write 0~189 in=189b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:04:50.178 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:04:50.173+0000 ec49640 -1 osd.7 54 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4567.0:2 30.1 30.aabc5e21 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:04:50.938 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:04:50.790+0000 12c51640 -1 osd.3 51 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4481.0:2 33.1 33:847a3d55:::obj:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:04:51.001 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:04:50.852+0000 ec49640 -1 osd.0 53 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4546.0:2 22.1e 22:7a7d4169:::src_object.1:head [writefull 0~4096 in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) 2024-02-09T08:04:51.077 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:04:51.055+0000 ec49640 -1 osd.2 53 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4512.0:2 21.6 21:602f83fe:::foo:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:04:51.327 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:04:51.137+0000 ec49640 -1 osd.1 51 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4496.0:2 27.1b 27:d96a01e0:::testobj:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:04:51.419 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "distro": "centos", 2024-02-09T08:04:51.420 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "distro_description": "CentOS Stream 9", 2024-02-09T08:04:51.420 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "distro_version": "9", 2024-02-09T08:04:51.420 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "foo": "bar", 2024-02-09T08:04:51.420 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "hostname": "smithi062", 2024-02-09T08:04:51.420 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Jan 24 21:50:18 UTC 2024", 2024-02-09T08:04:51.420 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "kernel_version": "5.14.0-412.el9.x86_64", 2024-02-09T08:04:51.420 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "mem_swap_kb": "0", 2024-02-09T08:04:51.421 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "mem_total_kb": "32488536", 2024-02-09T08:04:51.421 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "os": "Linux", 2024-02-09T08:04:51.421 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "this": "that" 2024-02-09T08:04:51.421 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: }, 2024-02-09T08:04:51.421 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "task_status": {} 2024-02-09T08:04:51.421 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: } 2024-02-09T08:04:51.421 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: } 2024-02-09T08:04:51.421 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: } 2024-02-09T08:04:51.422 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: } 2024-02-09T08:04:51.422 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: } 2024-02-09T08:04:51.422 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: 2024-02-09T08:04:51.422 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: attempt 1 of 20 2024-02-09T08:04:51.422 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: failed to deregister: 2024-02-09T08:04:51.422 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: { 2024-02-09T08:04:51.422 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "epoch": 16, 2024-02-09T08:04:51.422 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "modified": "2024-02-09T08:04:41.820215+0000", 2024-02-09T08:04:51.423 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "services": { 2024-02-09T08:04:51.423 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "laundry": { 2024-02-09T08:04:51.423 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "daemons": { 2024-02-09T08:04:51.423 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "summary": "", 2024-02-09T08:04:51.423 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "close-test-pid41528": { 2024-02-09T08:04:51.423 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "start_epoch": 16, 2024-02-09T08:04:51.423 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "start_stamp": "2024-02-09T08:04:41.340208+0000", 2024-02-09T08:04:51.423 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "gid": 4762, 2024-02-09T08:04:51.423 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "addr": "172.21.15.62:0/3219201399", 2024-02-09T08:04:51.424 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "metadata": { 2024-02-09T08:04:51.424 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "arch": "x86_64", 2024-02-09T08:04:51.424 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "ceph_release": "squid", 2024-02-09T08:04:51.424 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "ceph_version": "ceph version 19.0.0-1310-g0089f33e (0089f33ec7e39da1a9e0f281bf62a5b44e1951f6) squid (dev)", 2024-02-09T08:04:51.424 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "ceph_version_short": "19.0.0-1310-g0089f33e", 2024-02-09T08:04:51.424 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", 2024-02-09T08:04:51.424 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "distro": "centos", 2024-02-09T08:04:51.424 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "distro_description": "CentOS Stream 9", 2024-02-09T08:04:51.425 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "distro_version": "9", 2024-02-09T08:04:51.425 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "foo": "bar", 2024-02-09T08:04:51.425 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "hostname": "smithi062", 2024-02-09T08:04:51.425 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Jan 24 21:50:18 UTC 2024", 2024-02-09T08:04:51.425 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "kernel_version": "5.14.0-412.el9.x86_64", 2024-02-09T08:04:51.425 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "mem_swap_kb": "0", 2024-02-09T08:04:51.425 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "mem_total_kb": "32488536", 2024-02-09T08:04:51.425 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "os": "Linux", 2024-02-09T08:04:51.425 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "this": "that" 2024-02-09T08:04:51.426 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: }, 2024-02-09T08:04:51.426 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "task_status": {} 2024-02-09T08:04:51.426 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: } 2024-02-09T08:04:51.426 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: } 2024-02-09T08:04:51.426 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: } 2024-02-09T08:04:51.426 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: } 2024-02-09T08:04:51.426 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: } 2024-02-09T08:04:51.426 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: 2024-02-09T08:04:51.427 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: attempt 2 of 20 2024-02-09T08:04:51.427 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: failed to deregister: 2024-02-09T08:04:51.427 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: { 2024-02-09T08:04:51.427 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "epoch": 18, 2024-02-09T08:04:51.427 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "modified": "2024-02-09T08:04:47.823698+0000", 2024-02-09T08:04:51.427 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "services": { 2024-02-09T08:04:51.428 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-02-09T08:04:51.244+0000 ec49640 -1 osd.6 54 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4487.0:2 32.1a 32:5c6776db:::0.obj:head [write 0~189 in=189b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:04:51.454 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:04:51.310+0000 ec49640 -1 osd.7 55 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4567.0:2 30.1 30.aabc5e21 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:04:52.062 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:04:51.988+0000 ec49640 -1 osd.0 54 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4546.0:2 22.1e 22:7a7d4169:::src_object.1:head [writefull 0~4096 in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) 2024-02-09T08:04:52.152 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-02-09T08:04:52.052+0000 ec49640 -1 osd.5 53 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4450.0:2 7.8 7.fb1dc768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e29) 2024-02-09T08:04:52.436 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:04:52.231+0000 ec49640 -1 osd.2 54 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4512.0:2 21.6 21:602f83fe:::foo:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:04:52.437 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:04:52.427+0000 12c51640 -1 osd.3 52 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4481.0:2 33.1 33:847a3d55:::obj:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:04:52.651 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:03:02.058 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:04:52.654 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:03:02.061 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:04:52.713 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:04:52.577+0000 ec49640 -1 osd.1 52 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4496.0:2 27.1b 27:d96a01e0:::testobj:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:04:52.726 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:03:02.133 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:04:52.743 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:03:02.139 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:04:52.743 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:03:02.150 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:04:52.781 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:03:02.178 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:04:52.997 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:03:02.404 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:04:53.058 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:03:02.454 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:04:53.093 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:04:53.022+0000 ec49640 -1 osd.0 55 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4546.0:2 22.1e 22:7a7d4169:::src_object.1:head [writefull 0~4096 in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) 2024-02-09T08:04:53.174 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:04:53.113+0000 ec49640 -1 osd.7 56 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4567.0:2 30.1 30.aabc5e21 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:04:53.264 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-02-09T08:04:53.226+0000 ec49640 -1 osd.5 53 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4450.0:2 7.8 7:16e3b8df:test-rados-api-smithi062-41096-2::foo:head [undirty] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) 2024-02-09T08:04:53.336 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:03:02.740 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:04:54.335 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-02-09T08:04:54.220+0000 ec49640 -1 osd.5 54 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4450.0:2 7.8 7:16e3b8df:test-rados-api-smithi062-41096-2::foo:head [undirty] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) 2024-02-09T08:04:54.339 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:04:54.168+0000 ec49640 -1 osd.7 56 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4567.0:2 30.1 30.aabc5e21 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:04:54.357 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:04:54.234+0000 ec49640 -1 osd.1 53 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4496.0:2 27.1b 27:d96a01e0:::testobj:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:04:54.541 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:04:54.364+0000 12c51640 -1 osd.3 53 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4481.0:2 33.1 33:847a3d55:::obj:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:04:54.907 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-02-09T08:04:54.863+0000 ec49640 -1 osd.6 56 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4564.0:2 23.0 23.71d521c0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:04:55.266 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:04:55.199+0000 ec49640 -1 osd.7 56 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4567.0:2 30.1 30:847a3d55:::obj:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:04:55.398 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:04:55.356+0000 12c51640 -1 osd.3 53 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4481.0:2 33.1 33:847a3d55:::obj:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:04:55.567 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:04:55.529+0000 ec49640 -1 osd.1 54 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4496.0:2 27.1b 27:d96a01e0:::testobj:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:04:55.908 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-02-09T08:04:55.896+0000 ec49640 -1 osd.6 56 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4564.0:2 23.0 23.71d521c0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:04:56.228 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:04:56.221+0000 ec49640 -1 osd.7 58 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4567.0:2 30.1 30:847a3d55:::obj:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:04:56.382 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:04:56.363+0000 12c51640 -1 osd.4 56 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4514.0:3 37.14 37.2b3e2654 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e31) 2024-02-09T08:04:56.657 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "laundry": { 2024-02-09T08:04:56.658 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "daemons": { 2024-02-09T08:04:56.658 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "summary": "", 2024-02-09T08:04:56.658 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "close-test-pid41528": { 2024-02-09T08:04:56.658 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "start_epoch": 18, 2024-02-09T08:04:56.658 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "start_stamp": "2024-02-09T08:04:46.321094+0000", 2024-02-09T08:04:56.658 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "gid": 4650, 2024-02-09T08:04:56.658 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "addr": "172.21.15.62:0/421107167", 2024-02-09T08:04:56.658 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "metadata": { 2024-02-09T08:04:56.658 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "arch": "x86_64", 2024-02-09T08:04:56.658 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "ceph_release": "squid", 2024-02-09T08:04:56.658 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "ceph_version": "ceph version 19.0.0-1310-g0089f33e (0089f33ec7e39da1a9e0f281bf62a5b44e1951f6) squid (dev)", 2024-02-09T08:04:56.658 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "ceph_version_short": "19.0.0-1310-g0089f33e", 2024-02-09T08:04:56.658 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", 2024-02-09T08:04:56.659 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "distro": "centos", 2024-02-09T08:04:56.659 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "distro_description": "CentOS Stream 9", 2024-02-09T08:04:56.659 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "distro_version": "9", 2024-02-09T08:04:56.659 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "foo": "bar", 2024-02-09T08:04:56.659 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "hostname": "smithi062", 2024-02-09T08:04:56.659 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Jan 24 21:50:18 UTC 2024", 2024-02-09T08:04:56.659 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "kernel_version": "5.14.0-412.el9.x86_64", 2024-02-09T08:04:56.659 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "mem_swap_kb": "0", 2024-02-09T08:04:56.659 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "mem_total_kb": "32488536", 2024-02-09T08:04:56.659 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "os": "Linux", 2024-02-09T08:04:56.659 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "this": "that" 2024-02-09T08:04:56.659 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: }, 2024-02-09T08:04:56.659 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "task_status": {} 2024-02-09T08:04:56.659 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: } 2024-02-09T08:04:56.659 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: } 2024-02-09T08:04:56.660 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: } 2024-02-09T08:04:56.660 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: } 2024-02-09T08:04:56.660 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: } 2024-02-09T08:04:56.660 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: 2024-02-09T08:04:56.660 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: attempt 3 of 20 2024-02-09T08:04:56.660 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: failed to deregister: 2024-02-09T08:04:56.660 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: { 2024-02-09T08:04:56.660 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "epoch": 20, 2024-02-09T08:04:56.660 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "modified": "2024-02-09T08:04:51.826556+0000", 2024-02-09T08:04:56.660 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "services": { 2024-02-09T08:04:56.660 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "laundry": { 2024-02-09T08:04:56.660 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "daemons": { 2024-02-09T08:04:56.660 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "summary": "", 2024-02-09T08:04:56.660 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "close-test-pid41528": { 2024-02-09T08:04:56.661 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "start_epoch": 20, 2024-02-09T08:04:56.661 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "start_stamp": "2024-02-09T08:04:51.616484+0000", 2024-02-09T08:04:56.661 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "gid": 4665, 2024-02-09T08:04:56.661 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "addr": "172.21.15.62:0/154603220", 2024-02-09T08:04:56.661 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "metadata": { 2024-02-09T08:04:56.661 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "arch": "x86_64", 2024-02-09T08:04:56.661 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "ceph_release": "squid", 2024-02-09T08:04:56.661 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "ceph_version": "ceph version 19.0.0-1310-g0089f33e (0089f33ec7e39da1a9e0f281bf62a5b44e1951f6) squid (dev)", 2024-02-09T08:04:56.661 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "ceph_version_short": "19.0.0-1310-g0089f33e", 2024-02-09T08:04:56.661 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", 2024-02-09T08:04:56.661 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "distro": "centos", 2024-02-09T08:04:56.661 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "distro_description": "CentOS Stream 9", 2024-02-09T08:04:56.661 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "distro_version": "9", 2024-02-09T08:04:56.661 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "foo": "bar", 2024-02-09T08:04:56.661 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "hostname": "smithi062", 2024-02-09T08:04:56.871 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:04:56.706+0000 12c51640 -1 osd.3 54 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4481.0:2 33.1 33:847a3d55:::obj:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:04:57.031 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:04:56.866+0000 ec49640 -1 osd.1 55 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4496.0:2 27.1b 27:d96a01e0:::testobj:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:04:57.455 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:04:57.440+0000 12c51640 -1 osd.4 56 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4514.0:3 37.14 37.2b3e2654 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e31) 2024-02-09T08:04:57.518 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:04:57.362+0000 ec49640 -1 osd.7 58 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4567.0:2 30.1 30:847a3d55:::obj:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:04:57.648 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-02-09T08:04:57.625+0000 ec49640 -1 osd.6 58 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4564.0:2 23.0 23.71d521c0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:04:58.072 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-02-09T08:04:58.037+0000 ec49640 -1 osd.5 57 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4450.0:2 7.8 7:16e3b8df:test-rados-api-smithi062-41096-2::foo:head [undirty] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) 2024-02-09T08:04:58.107 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:04:57.981+0000 12c51640 -1 osd.3 55 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4481.0:2 33.1 33:847a3d55:::obj:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:04:58.470 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:04:58.326+0000 ec49640 -1 osd.1 56 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4496.0:2 27.1b 27:d96a01e0:::testobj:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:04:58.526 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:04:58.517+0000 ec49640 -1 osd.7 59 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4567.0:2 30.1 30:847a3d55:::obj:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:04:59.101 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:04:59.053+0000 12c51640 -1 osd.3 56 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4481.0:2 33.1 33:847a3d55:::obj:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:04:59.144 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-02-09T08:04:59.019+0000 ec49640 -1 osd.6 59 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4564.0:2 23.0 23.71d521c0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:04:59.317 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-02-09T08:04:59.291+0000 ec49640 -1 osd.5 58 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4450.0:2 7.8 7:16e3b8df:test-rados-api-smithi062-41096-2::foo:head [undirty] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) 2024-02-09T08:04:59.350 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:04:59.340+0000 ec49640 -1 osd.1 56 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4496.0:2 27.1b 27:d96a01e0:::testobj:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:04:59.356 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:04:59.318+0000 12c51640 -1 osd.4 58 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4514.0:3 37.14 37.2b3e2654 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e31) 2024-02-09T08:04:59.684 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:04:59.670+0000 ec49640 -1 osd.7 60 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4567.0:2 30.1 30:847a3d55:::obj:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:00.070 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-02-09T08:05:00.056+0000 ec49640 -1 osd.6 59 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4564.0:2 23.0 23.71d521c0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:00.274 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:05:00.238+0000 12c51640 -1 osd.3 57 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4481.0:2 33.1 33:847a3d55:::obj:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:00.781 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:05:00.754+0000 ec49640 -1 osd.7 61 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4567.0:2 30.1 30:847a3d55:::obj:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:00.846 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:05:00.794+0000 ec49640 -1 osd.1 58 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4496.0:2 27.1b 27:d96a01e0:::testobj:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:01.191 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:05:01.064+0000 12c51640 -1 osd.4 60 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4514.0:3 37.14 37.2b3e2654 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e31) 2024-02-09T08:05:01.216 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-02-09T08:05:01.108+0000 ec49640 -1 osd.6 60 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4564.0:2 23.0 23.71d521c0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:01.894 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:05:01.792+0000 12c51640 -1 osd.3 58 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4481.0:2 33.1 33:847a3d55:::obj:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:02.031 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:05:02.023+0000 ec49640 -1 osd.7 62 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4567.0:2 30.1 30:847a3d55:::obj:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:02.165 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:05:02.074+0000 ec49640 -1 osd.1 59 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4496.0:2 27.1b 27:d96a01e0:::testobj:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:02.663 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-02-09T08:05:02.627+0000 ec49640 -1 osd.6 61 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4564.0:2 23.0 23.71d521c0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:02.890 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:05:02.809+0000 12c51640 -1 osd.3 59 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4481.0:2 33.1 33:847a3d55:::obj:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:03.182 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:05:03.097+0000 ec49640 -1 osd.7 63 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4567.0:2 30.1 30:847a3d55:::obj:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:03.205 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:05:03.189+0000 12c51640 -1 osd.4 62 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4514.0:3 37.14 37.2b3e2654 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e31) 2024-02-09T08:05:03.384 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:05:03.353+0000 ec49640 -1 osd.1 60 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4496.0:2 27.1b 27:d96a01e0:::testobj:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:04.095 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:05:04.089+0000 ec49640 -1 osd.7 63 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4567.0:2 30.1 30:847a3d55:::obj:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:04.096 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:05:04.084+0000 12c51640 -1 osd.3 60 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4481.0:2 33.1 33:847a3d55:::obj:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:04.137 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-02-09T08:05:04.118+0000 ec49640 -1 osd.6 62 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4564.0:2 23.0 23:0384ab8e:::oid:head [write 18446744073709551615~0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:04.288 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:05:04.278+0000 12c51640 -1 osd.4 63 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4514.0:3 37.14 37.2b3e2654 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e31) 2024-02-09T08:05:04.507 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:05:04.484+0000 ec49640 -1 osd.1 60 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4496.0:2 27.1b 27:d96a01e0:::testobj:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:05.182 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-02-09T08:05:05.172+0000 ec49640 -1 osd.6 62 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4564.0:2 23.0 23:0384ab8e:::oid:head [write 18446744073709551615~0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:05.365 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:05:05.350+0000 12c51640 -1 osd.4 63 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4506.0:1 39.6s0 39.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-02-09T08:05:05.602 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:05:05.524+0000 ec49640 -1 osd.7 64 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4567.0:2 30.1 30:847a3d55:::obj:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:05.642 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:05:05.627+0000 12c51640 -1 osd.3 62 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4481.0:2 33.1 33:847a3d55:::obj:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:05.967 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:05:05.780+0000 ec49640 -1 osd.1 62 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4496.0:2 27.1b 27:d96a01e0:::testobj:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:06.232 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-02-09T08:05:06.223+0000 ec49640 -1 osd.6 63 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4564.0:2 23.0 23:0384ab8e:::oid:head [write 18446744073709551615~0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:06.628 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:05:06.621+0000 ec49640 -1 osd.7 64 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4567.0:2 30.1 30:847a3d55:::obj:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:06.652 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:05:06.641+0000 12c51640 -1 osd.3 62 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4481.0:2 33.1 33:847a3d55:::obj:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:06.730 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:05:06.638+0000 12c51640 -1 osd.4 64 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4506.0:1 39.6s0 39.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-02-09T08:05:06.851 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:05:06.847+0000 ec49640 -1 osd.1 62 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4496.0:2 27.1b 27:d96a01e0:::testobj:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:07.662 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-02-09T08:05:07.567+0000 ec49640 -1 osd.6 64 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4564.0:2 23.0 23:0384ab8e:::oid:head [write 18446744073709551615~0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:07.768 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp api_misc: [==========] Running 12 tests from 4 test suites. 2024-02-09T08:05:07.769 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [----------] Global test environment set-up. 2024-02-09T08:05:07.769 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion 2024-02-09T08:05:07.769 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [ RUN ] LibRadosMiscVersion.Version 2024-02-09T08:05:07.769 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [ OK ] LibRadosMiscVersion.Version (0 ms) 2024-02-09T08:05:07.769 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-02-09T08:05:07.769 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: 2024-02-09T08:05:07.769 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure 2024-02-09T08:05:07.769 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2024-02-09T08:05:07.769 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: unable to get monitor info from DNS SRV with service name: ceph-mon 2024-02-09T08:05:07.769 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: 2024-02-09T08:04:09.942+0000 7f75b703c780 -1 failed for service _ceph-mon._tcp 2024-02-09T08:05:07.769 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: 2024-02-09T08:04:09.942+0000 7f75b703c780 -1 monclient: get_monmap_and_config cannot identify monitors to contact 2024-02-09T08:05:07.769 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectFailure (242 ms) 2024-02-09T08:05:07.769 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectTimeout 2024-02-09T08:05:07.769 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectTimeout (2031 ms) 2024-02-09T08:05:07.770 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure (2273 ms total) 2024-02-09T08:05:07.770 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: 2024-02-09T08:05:07.770 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [----------] 1 test from LibRadosMiscPool 2024-02-09T08:05:07.770 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [ RUN ] LibRadosMiscPool.PoolCreationRace 2024-02-09T08:05:07.770 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26a7dff0 2024-02-09T08:05:07.770 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a2678e790 2024-02-09T08:05:07.770 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a27476aa0 2024-02-09T08:05:07.770 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b13f50 2024-02-09T08:05:07.770 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b1d360 2024-02-09T08:05:07.770 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b1de50 2024-02-09T08:05:07.770 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b1e920 2024-02-09T08:05:07.770 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b1f440 2024-02-09T08:05:07.770 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b1ff30 2024-02-09T08:05:07.770 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b20990 2024-02-09T08:05:07.771 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b1fcf0 2024-02-09T08:05:07.771 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b21870 2024-02-09T08:05:07.771 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b206b0 2024-02-09T08:05:07.771 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a268df700 2024-02-09T08:05:07.771 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a268e0160 2024-02-09T08:05:07.771 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b21640 2024-02-09T08:05:07.771 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a268e1020 2024-02-09T08:05:07.771 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a268dfe80 2024-02-09T08:05:07.771 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a268e1e90 2024-02-09T08:05:07.771 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a268e0dd0 2024-02-09T08:05:07.771 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a268e2d50 2024-02-09T08:05:07.771 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a268e34a0 2024-02-09T08:05:07.771 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a268e1c00 2024-02-09T08:05:07.771 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a268ec460 2024-02-09T08:05:07.771 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a268ece60 2024-02-09T08:05:07.772 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a268e2ab0 2024-02-09T08:05:07.772 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a268edcb0 2024-02-09T08:05:07.772 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a268ecc20 2024-02-09T08:05:07.772 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a268eeb50 2024-02-09T08:05:07.772 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a268edae0 2024-02-09T08:05:07.772 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a268efa60 2024-02-09T08:05:07.772 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a268ee8d0 2024-02-09T08:05:07.772 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a268f08e0 2024-02-09T08:05:07.772 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a268ef810 2024-02-09T08:05:07.772 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a268f17a0 2024-02-09T08:05:07.772 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a268f06b0 2024-02-09T08:05:07.772 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a268f2660 2024-02-09T08:05:07.772 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a268f1510 2024-02-09T08:05:07.772 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a268f34e0 2024-02-09T08:05:07.773 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a268f22f0 2024-02-09T08:05:07.773 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a268f24a0 2024-02-09T08:05:07.773 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a268f48c0 2024-02-09T08:05:07.773 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a268f32f0 2024-02-09T08:05:07.773 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a268f5810 2024-02-09T08:05:07.773 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a268f46a0 2024-02-09T08:05:07.773 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a268f6740 2024-02-09T08:05:07.773 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a268f55e0 2024-02-09T08:05:07.773 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a268f7630 2024-02-09T08:05:07.773 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a268f64f0 2024-02-09T08:05:07.773 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a268f8560 2024-02-09T08:05:07.773 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a268f73f0 2024-02-09T08:05:08.142 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:05:07.976+0000 ec49640 -1 osd.1 65 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4496.0:2 27.1b 27:d96a01e0:::testobj:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:08.161 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: starte: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Jan 24 21:50:18 UTC 2024", 2024-02-09T08:05:08.161 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "kernel_version": "5.14.0-412.el9.x86_64", 2024-02-09T08:05:08.162 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "mem_swap_kb": "0", 2024-02-09T08:05:08.162 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "mem_total_kb": "32488536", 2024-02-09T08:05:08.162 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "os": "Linux", 2024-02-09T08:05:08.162 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "this": "that" 2024-02-09T08:05:08.162 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: }, 2024-02-09T08:05:08.162 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "task_status": {} 2024-02-09T08:05:08.162 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: } 2024-02-09T08:05:08.162 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: } 2024-02-09T08:05:08.162 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: } 2024-02-09T08:05:08.162 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: } 2024-02-09T08:05:08.162 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: } 2024-02-09T08:05:08.163 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: 2024-02-09T08:05:08.163 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: attempt 4 of 20 2024-02-09T08:05:08.163 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: failed to deregister: 2024-02-09T08:05:08.163 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: { 2024-02-09T08:05:08.163 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "epoch": 22, 2024-02-09T08:05:08.163 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "modified": "2024-02-09T08:04:57.830753+0000", 2024-02-09T08:05:08.163 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "services": { 2024-02-09T08:05:08.163 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "laundry": { 2024-02-09T08:05:08.163 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "daemons": { 2024-02-09T08:05:08.163 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "summary": "", 2024-02-09T08:05:08.163 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "close-test-pid41528": { 2024-02-09T08:05:08.164 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "start_epoch": 22, 2024-02-09T08:05:08.164 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "start_stamp": "2024-02-09T08:04:57.189415+0000", 2024-02-09T08:05:08.164 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "gid": 4671, 2024-02-09T08:05:08.164 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "addr": "172.21.15.62:0/344250231", 2024-02-09T08:05:08.164 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "metadata": { 2024-02-09T08:05:08.164 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "arch": "x86_64", 2024-02-09T08:05:08.164 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "ceph_release": "squid", 2024-02-09T08:05:08.164 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "ceph_version": "ceph version 19.0.0-1310-g0089f33e (0089f33ec7e39da1a9e0f281bf62a5b44e1951f6) squid (dev)", 2024-02-09T08:05:08.164 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "ceph_version_short": "19.0.0-1310-g0089f33e", 2024-02-09T08:05:08.164 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", 2024-02-09T08:05:08.164 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "distro": "centos", 2024-02-09T08:05:08.164 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "distro_description": "CentOS Stream 9", 2024-02-09T08:05:08.164 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "distro_version": "9", 2024-02-09T08:05:08.165 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "foo": "bar", 2024-02-09T08:05:08.165 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "hostname": "smithi062", 2024-02-09T08:05:08.165 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Jan 24 21:50:18 UTC 2024", 2024-02-09T08:05:08.165 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "kernel_version": "5.14.0-412.el9.x86_64", 2024-02-09T08:05:08.165 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "mem_swap_kb": "0", 2024-02-09T08:05:08.165 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "mem_total_kb": "32488536", 2024-02-09T08:05:08.165 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "os": "Linux", 2024-02-09T08:05:08.165 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "this": "that" 2024-02-09T08:05:08.165 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: }, 2024-02-09T08:05:08.165 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: "task_status": {} 2024-02-09T08:05:08.165 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: } 2024-02-09T08:05:08.165 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: } 2024-02-09T08:05:08.166 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: } 2024-02-09T08:05:08.166 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: } 2024-02-09T08:05:08.166 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: } 2024-02-09T08:05:08.166 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: 2024-02-09T08:05:08.166 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: attempt 5 of 20 2024-02-09T08:05:08.166 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: [ OK ] LibRadosServicePP.Close (32323 ms) 2024-02-09T08:05:08.166 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP (58243 ms total) 2024-02-09T08:05:08.166 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: 2024-02-09T08:05:08.166 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: [----------] Global test environment tear-down 2024-02-09T08:05:08.166 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: [==========] 4 tests from 1 test suite ran. (58243 ms total) 2024-02-09T08:05:08.166 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: [ PASSED ] 4 tests. 2024-02-09T08:05:08.508 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:05:08.465+0000 ec49640 -1 osd.7 66 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4567.0:2 30.1 30:847a3d55:::obj:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:08.685 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-02-09T08:05:08.575+0000 ec49640 -1 osd.6 65 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4564.0:2 23.0 23:0384ab8e:::oid:head [write 18446744073709551615~0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:08.822 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:05:08.797+0000 12c51640 -1 osd.4 66 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4506.0:1 39.6s0 39.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-02-09T08:05:09.665 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:05:09.453+0000 ec49640 -1 osd.1 65 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4496.0:2 27.1b 27:d96a01e0:::testobj:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:09.691 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:05:09.629+0000 ec49640 -1 osd.7 67 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4567.0:2 30.1 30:847a3d55:::obj:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:09.712 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-02-09T08:05:09.673+0000 ec49640 -1 osd.6 65 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4564.0:2 23.0 23:0384ab8e:::oid:head [write 18446744073709551615~0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:09.927 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:05:09.913+0000 12c51640 -1 osd.4 66 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4506.0:1 39.6s0 39.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-02-09T08:05:10.700 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:05:10.540+0000 ec49640 -1 osd.1 66 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4496.0:2 27.1b 27:d96a01e0:::testobj:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:10.836 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:05:10.724+0000 ec49640 -1 osd.7 68 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4567.0:2 30.1 30:847a3d55:::obj:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:10.862 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-02-09T08:05:10.784+0000 ec49640 -1 osd.6 66 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4564.0:2 23.0 23:0384ab8e:::oid:head [write 18446744073709551615~0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:10.957 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:05:10.945+0000 12c51640 -1 osd.4 66 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4506.0:1 39.6s0 39.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-02-09T08:05:11.628 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:05:11.610+0000 ec49640 -1 osd.1 66 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4496.0:2 27.1b 27:d96a01e0:::testobj:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:12.038 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:05:11.989+0000 ec49640 -1 osd.7 69 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4567.0:2 30.1 30:847a3d55:::obj:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:12.043 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-02-09T08:05:11.934+0000 ec49640 -1 osd.6 68 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4564.0:2 23.0 23:0384ab8e:::oid:head [write 18446744073709551615~0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:12.066 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:05:11.987+0000 12c51640 -1 osd.4 67 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4506.0:1 39.6s0 39.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-02-09T08:05:12.608 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:05:12.592+0000 ec49640 -1 osd.1 66 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4496.0:2 27.1b 27:d96a01e0:::testobj:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:13.045 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:05:13.036+0000 12c51640 -1 osd.4 67 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4506.0:1 39.6s0 39.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-02-09T08:05:13.383 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-02-09T08:05:13.280+0000 ec49640 -1 osd.6 69 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4564.0:2 23.0 23:0384ab8e:::oid:head [write 18446744073709551615~0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:13.412 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:05:13.364+0000 ec49640 -1 osd.7 70 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4567.0:2 30.1 30:847a3d55:::obj:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:13.532 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:03:22.939 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:05:13.563 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:03:22.970 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:05:13.573 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:03:22.980 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:05:13.579 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:03:22.986 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:05:13.637 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:03:23.033 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:05:13.642 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:03:23.039 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:05:13.844 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:03:23.251 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:05:13.850 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:03:23.256 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:05:14.071 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:03:23.468 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:05:14.100 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:05:14.096+0000 ec49640 -1 osd.1 67 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4496.0:2 27.1b 27:d96a01e0:::testobj:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:14.370 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-02-09T08:05:14.326+0000 ec49640 -1 osd.6 70 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4564.0:2 23.0 23:0384ab8e:::oid:head [write 18446744073709551615~0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:14.521 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:05:14.379+0000 12c51640 -1 osd.4 68 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4506.0:1 39.6s0 39.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-02-09T08:05:14.688 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:05:14.617+0000 ec49640 -1 osd.7 71 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4567.0:2 30.1 30:847a3d55:::obj:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:15.458 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:05:15.433+0000 ec49640 -1 osd.1 68 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4496.0:2 27.1b 27:d96a01e0:::testobj:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:15.725 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-02-09T08:05:15.710+0000 ec49640 -1 osd.6 71 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4564.0:2 23.0 23:0384ab8e:::oid:head [write 18446744073709551615~0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:15.757 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:05:15.714+0000 ec49640 -1 osd.7 72 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4567.0:2 30.1 30:847a3d55:::obj:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:15.836 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: Running main() from gmock_main.cc 2024-02-09T08:05:15.837 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: [==========] Running 9 tests from 1 test suite. 2024-02-09T08:05:15.837 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: [----------] Global test environment set-up. 2024-02-09T08:05:15.837 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: [----------] 9 tests from LibRadosPools 2024-02-09T08:05:15.837 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: [ RUN ] LibRadosPools.PoolList 2024-02-09T08:05:15.837 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: [ OK ] LibRadosPools.PoolList (5991 ms) 2024-02-09T08:05:15.837 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup 2024-02-09T08:05:15.837 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup (5687 ms) 2024-02-09T08:05:15.837 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup2 2024-02-09T08:05:15.837 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup2 (7828 ms) 2024-02-09T08:05:15.837 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookupOtherInstance 2024-02-09T08:05:15.837 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: [ OK ] LibRadosPools.PoolLookupOtherInstance (4936 ms) 2024-02-09T08:05:15.837 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: [ RUN ] LibRadosPools.PoolReverseLookupOtherInstance 2024-02-09T08:05:15.837 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: [ OK ] LibRadosPools.PoolReverseLookupOtherInstance (4832 ms) 2024-02-09T08:05:15.837 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: [ RUN ] LibRadosPools.PoolDelete 2024-02-09T08:05:15.838 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: [ OK ] LibRadosPools.PoolDelete (8129 ms) 2024-02-09T08:05:15.838 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateDelete 2024-02-09T08:05:15.838 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateDelete (8975 ms) 2024-02-09T08:05:15.838 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateWithCrushRule 2024-02-09T08:05:15.838 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateWithCrushRule (8529 ms) 2024-02-09T08:05:15.838 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: [ RUN ] LibRadosPools.PoolGetBaseTier 2024-02-09T08:05:15.838 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: [ OK ] LibRadosPools.PoolGetBaseTier (11184 ms) 2024-02-09T08:05:15.838 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: [----------] 9 tests from LibRadosPools (66091 ms total) 2024-02-09T08:05:15.838 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: 2024-02-09T08:05:15.838 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: [----------] Global test environment tear-down 2024-02-09T08:05:15.838 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: [==========] 9 tests from 1 test suite ran. (66091 ms total) 2024-02-09T08:05:15.838 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: [ PASSED ] 9 tests. 2024-02-09T08:05:16.192 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:05:16.070+0000 12c51640 -1 osd.4 69 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4506.0:1 39.6s0 39.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-02-09T08:05:16.774 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:05:16.756+0000 ec49640 -1 osd.7 72 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4567.0:2 30.1 30:847a3d55:::obj:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:16.910 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:05:16.884+0000 ec49640 -1 osd.1 70 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4496.0:2 27.1b 27:d96a01e0:::testobj:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:17.002 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-02-09T08:05:16.922+0000 ec49640 -1 osd.6 72 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4564.0:2 23.0 23:0384ab8e:::oid:head [write 18446744073709551615~0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:17.632 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:05:17.493+0000 12c51640 -1 osd.4 70 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4506.0:1 39.6s0 39.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-02-09T08:05:17.977 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-02-09T08:05:17.965+0000 ec49640 -1 osd.6 72 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4564.0:2 23.0 23:0384ab8e:::oid:head [write 18446744073709551615~0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:18.515 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:05:18.319+0000 ec49640 -1 osd.7 75 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4567.0:2 30.1 30:847a3d55:::obj:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:18.886 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:05:18.838+0000 ec49640 -1 osd.1 70 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4496.0:2 27.1b 27:d96a01e0:::testobj:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:18.993 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-02-09T08:05:18.973+0000 ec49640 -1 osd.6 75 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4564.0:2 23.0 23:0384ab8e:::oid:head [write 18446744073709551615~0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:19.199 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:05:19.057+0000 12c51640 -1 osd.4 71 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4506.0:1 39.6s0 39.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-02-09T08:05:19.496 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:05:19.472+0000 ec49640 -1 osd.7 75 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4567.0:2 30.1 30:847a3d55:::obj:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:20.208 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-02-09T08:05:20.180+0000 ec49640 -1 osd.6 75 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4564.0:2 23.0 23:0384ab8e:::oid:head [write 18446744073709551615~0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:20.513 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:05:20.495+0000 ec49640 -1 osd.7 75 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4567.0:2 30.1 30:847a3d55:::obj:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:20.557 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:05:20.353+0000 ec49640 -1 osd.1 72 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4456.0:2 8.5 8:a1a1377e:test-rados-api-smithi062-41275-2::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) 2024-02-09T08:05:20.721 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:05:20.645+0000 12c51640 -1 osd.4 72 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4506.0:1 39.6s0 39.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-02-09T08:05:21.896 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:05:21.775+0000 ec49640 -1 osd.7 78 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4567.0:2 30.1 30:847a3d55:::obj:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:21.923 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-02-09T08:05:21.777+0000 ec49640 -1 osd.6 78 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4564.0:2 23.0 23:0384ab8e:::oid:head [write 18446744073709551615~0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:22.001 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:05:21.926+0000 ec49640 -1 osd.1 75 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4456.0:2 8.5 8:a1a1377e:test-rados-api-smithi062-41275-2::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) 2024-02-09T08:05:22.941 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-02-09T08:05:22.907+0000 ec49640 -1 osd.6 78 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4564.0:2 23.0 23:0384ab8e:::oid:head [write 18446744073709551615~0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:22.942 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:05:22.856+0000 12c51640 -1 osd.4 73 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4506.0:1 39.6s0 39.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-02-09T08:05:23.289 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:05:23.140+0000 ec49640 -1 osd.1 75 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4456.0:2 8.5 8:a1a1377e:test-rados-api-smithi062-41275-2::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) 2024-02-09T08:05:23.329 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:05:23.312+0000 ec49640 -1 osd.7 79 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4567.0:2 30.1 30:847a3d55:::obj:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:24.252 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:05:24.221+0000 12c51640 -1 osd.4 76 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4506.0:1 39.6s0 39.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-02-09T08:05:24.397 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:05:24.379+0000 ec49640 -1 osd.7 80 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4567.0:2 30.1 30:847a3d55:::obj:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:24.855 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:05:24.730+0000 ec49640 -1 osd.1 76 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4456.0:2 8.5 8:a1a1377e:test-rados-api-smithi062-41275-2::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) 2024-02-09T08:05:24.941 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-02-09T08:05:24.886+0000 ec49640 -1 osd.6 79 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4564.0:2 23.0 23:0384ab8e:::oid:head [write 18446744073709551615~0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:25.409 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:05:25.305+0000 ec49640 -1 osd.0 78 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:05:25.562 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:05:25.546+0000 ec49640 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4567.0:2 30.1 30:847a3d55:::obj:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:25.919 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:05:25.849+0000 12c51640 -1 osd.4 77 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4506.0:1 39.6s0 39.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-02-09T08:05:26.074 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:05:26.065+0000 ec49640 -1 osd.1 78 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4456.0:2 8.5 8:a1a1377e:test-rados-api-smithi062-41275-2::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) 2024-02-09T08:05:26.492 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:05:26.350+0000 ec49640 -1 osd.0 78 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:05:26.574 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-02-09T08:05:26.559+0000 ec49640 -1 osd.6 79 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4564.0:2 23.0 23:0384ab8e:::oid:head [write 18446744073709551615~0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:27.193 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:05:27.181+0000 ec49640 -1 osd.1 81 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4456.0:2 8.5 8:a1a1377e:test-rados-api-smithi062-41275-2::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) 2024-02-09T08:05:27.520 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:05:27.422+0000 12c51640 -1 osd.4 79 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4506.0:1 39.6s0 39.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-02-09T08:05:27.556 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:05:27.456+0000 ec49640 -1 osd.0 79 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:05:28.667 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-02-09T08:05:28.648+0000 ec49640 -1 osd.6 82 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4564.0:2 23.0 23:0384ab8e:::oid:head [write 18446744073709551615~0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:29.147 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:05:29.016+0000 ec49640 -1 osd.0 80 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:05:29.794 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-02-09T08:05:29.782+0000 ec49640 -1 osd.5 82 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4486.0:2 40.2s0 40:40e86408:test-rados-api-smithi062-41351-2::foo:head [watch watch cookie 94097242353072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) 2024-02-09T08:05:29.869 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-02-09T08:05:29.778+0000 ec49640 -1 osd.6 83 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4564.0:2 23.0 23:0384ab8e:::oid:head [write 18446744073709551615~0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:30.246 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:05:30.218+0000 ec49640 -1 osd.0 81 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:05:30.457 INFO:tasks.workunit.client.0.smithi062.stdout: handler_error: Running main() from gmock_main.cc 2024-02-09T08:05:30.458 INFO:tasks.workunit.client.0.smithi062.stdout: handler_error: [==========] Running 1 test from 1 test suite. 2024-02-09T08:05:30.458 INFO:tasks.workunit.client.0.smithi062.stdout: handler_error: [----------] Global test environment set-up. 2024-02-09T08:05:30.458 INFO:tasks.workunit.client.0.smithi062.stdout: handler_error: [----------] 1 test from neocls_handler_error 2024-02-09T08:05:30.458 INFO:tasks.workunit.client.0.smithi062.stdout: handler_error: [ RUN ] neocls_handler_error.test_handler_error 2024-02-09T08:05:30.458 INFO:tasks.workunit.client.0.smithi062.stdout: handler_error: [ OK ] neocls_handler_error.test_handler_error (80398 ms) 2024-02-09T08:05:30.458 INFO:tasks.workunit.client.0.smithi062.stdout: handler_error: [----------] 1 test from neocls_handler_error (80398 ms total) 2024-02-09T08:05:30.458 INFO:tasks.workunit.client.0.smithi062.stdout: handler_error: 2024-02-09T08:05:30.458 INFO:tasks.workunit.client.0.smithi062.stdout: handler_error: [----------] Global test environment tear-down 2024-02-09T08:05:30.458 INFO:tasks.workunit.client.0.smithi062.stdout: handler_error: [==========] 1 test from 1 test suite ran. (80399 ms total) 2024-02-09T08:05:30.458 INFO:tasks.workunit.client.0.smithi062.stdout: handler_error: [ PASSED ] 1 test. 2024-02-09T08:05:30.698 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:05:30.560+0000 ec49640 -1 osd.1 82 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4456.0:2 8.5 8:a1a1377e:test-rados-api-smithi062-41275-2::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) 2024-02-09T08:05:30.912 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-02-09T08:05:30.883+0000 ec49640 -1 osd.6 83 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4564.0:2 23.0 23:0384ab8e:::oid:head [write 18446744073709551615~0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:31.463 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:05:31.321+0000 12c51640 -1 osd.4 82 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4506.0:1 39.6s0 39:602f83fe:::foo:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-02-09T08:05:31.523 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:05:31.390+0000 ec49640 -1 osd.0 82 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:05:31.696 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:05:31.675+0000 ec49640 -1 osd.1 82 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4456.0:2 8.5 8:a1a1377e:test-rados-api-smithi062-41275-2::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) 2024-02-09T08:05:32.745 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:05:32.595+0000 12c51640 -1 osd.4 84 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4506.0:1 39.6s0 39:602f83fe:::foo:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-02-09T08:05:32.909 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:05:32.752+0000 ec49640 -1 osd.0 83 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:05:32.967 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:05:32.861+0000 ec49640 -1 osd.1 83 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4456.0:2 8.5 8:a1a1377e:test-rados-api-smithi062-41275-2::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) 2024-02-09T08:05:33.267 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-02-09T08:05:33.135+0000 ec49640 -1 osd.6 85 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4564.0:2 23.0 23:0384ab8e:::oid:head [write 18446744073709551615~0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:33.958 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:03:43.364 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:05:33.961 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:03:43.368 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:05:34.022 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:05:33.948+0000 ec49640 -1 osd.1 84 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4456.0:2 8.5 8:a1a1377e:test-rados-api-smithi062-41275-2::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) 2024-02-09T08:05:34.039 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:03:43.446 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:05:34.043 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:03:43.440 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:05:34.046 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:03:43.443 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:05:34.053 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:03:43.460 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:05:34.184 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:03:43.581 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:05:34.208 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:03:43.614 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:05:34.217 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:05:34.162+0000 ec49640 -1 osd.0 84 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:05:34.260 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:03:43.667 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:05:34.263 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-02-09T08:05:34.240+0000 ec49640 -1 osd.6 86 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4564.0:2 23.0 23:0384ab8e:::oid:head [write 18446744073709551615~0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:34.910 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:05:34.878+0000 12c51640 -1 osd.4 85 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4506.0:1 39.6s0 39:602f83fe:::foo:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-02-09T08:05:35.200 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:05:35.132+0000 ec49640 -1 osd.1 84 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4456.0:2 8.5 8:a1a1377e:test-rados-api-smithi062-41275-2::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) 2024-02-09T08:05:35.398 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:05:35.250+0000 ec49640 -1 osd.0 85 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:05:35.480 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-02-09T08:05:35.340+0000 ec49640 -1 osd.6 87 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4564.0:2 23.0 23:0384ab8e:::oid:head [write 18446744073709551615~0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:35.796 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:05:35.772+0000 ec49640 -1 osd.2 86 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4487.0:3 32.f 32:f4b50b61:::1.obj:head [write 0~112 in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55) 2024-02-09T08:05:36.201 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:05:36.190+0000 ec49640 -1 osd.1 85 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4456.0:2 8.5 8:a1a1377e:test-rados-api-smithi062-41275-2::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) 2024-02-09T08:05:36.438 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:05:36.353+0000 ec49640 -1 osd.0 86 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:05:36.461 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-02-09T08:05:36.367+0000 ec49640 -1 osd.6 88 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4564.0:2 23.0 23:0384ab8e:::oid:head [write 18446744073709551615~0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:36.545 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:05:36.449+0000 12c51640 -1 osd.4 87 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4506.0:1 39.6s0 39:602f83fe:::foo:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-02-09T08:05:37.032 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:05:36.999+0000 ec49640 -1 osd.2 87 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4487.0:3 32.f 32:f4b50b61:::1.obj:head [write 0~112 in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55) 2024-02-09T08:05:37.514 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:05:37.504+0000 12c51640 -1 osd.4 87 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4506.0:1 39.6s0 39:602f83fe:::foo:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-02-09T08:05:37.979 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:05:37.958+0000 ec49640 -1 osd.0 87 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:05:38.067 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-02-09T08:05:38.048+0000 ec49640 -1 osd.6 89 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4564.0:2 23.0 23:0384ab8e:::oid:head [write 18446744073709551615~0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:38.368 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:05:38.349+0000 ec49640 -1 osd.1 87 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4456.0:2 8.5 8:a1a1377e:test-rados-api-smithi062-41275-2::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) 2024-02-09T08:05:38.540 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:05:38.415+0000 ec49640 -1 osd.2 88 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4487.0:3 32.f 32:f4b50b61:::1.obj:head [write 0~112 in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55) 2024-02-09T08:05:38.765 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:05:38.755+0000 12c51640 -1 osd.4 88 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4506.0:1 39.6s0 39:602f83fe:::foo:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-02-09T08:05:39.148 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:05:39.128+0000 ec49640 -1 osd.0 91 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:05:39.552 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:05:39.530+0000 ec49640 -1 osd.1 88 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4456.0:2 8.5 8:a1a1377e:test-rados-api-smithi062-41275-2::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) 2024-02-09T08:05:39.555 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-02-09T08:05:39.542+0000 ec49640 -1 osd.6 90 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4564.0:2 23.0 23:0384ab8e:::oid:head [write 18446744073709551615~0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:39.709 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:05:39.683+0000 ec49640 -1 osd.2 89 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4487.0:3 32.f 32:f4b50b61:::1.obj:head [write 0~112 in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55) 2024-02-09T08:05:39.766 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:05:39.754+0000 12c51640 -1 osd.4 89 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4506.0:1 39.6s0 39:602f83fe:::foo:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-02-09T08:05:40.271 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:05:40.228+0000 ec49640 -1 osd.0 91 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:05:40.764 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:05:40.602+0000 ec49640 -1 osd.1 89 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4456.0:2 8.5 8:a1a1377e:test-rados-api-smithi062-41275-2::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) 2024-02-09T08:05:41.027 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:05:40.835+0000 ec49640 -1 osd.2 90 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4487.0:3 32.f 32:f4b50b61:::1.obj:head [write 0~112 in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55) 2024-02-09T08:05:41.092 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:05:40.956+0000 12c51640 -1 osd.4 91 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4506.0:1 39.6s0 39:602f83fe:::foo:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-02-09T08:05:41.472 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:05:41.449+0000 ec49640 -1 osd.0 92 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:05:41.773 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:05:41.709+0000 ec49640 -1 osd.1 90 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4456.0:2 8.5 8:a1a1377e:test-rados-api-smithi062-41275-2::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) 2024-02-09T08:05:42.068 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:05:42.062+0000 12c51640 -1 osd.4 92 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4506.0:1 39.6s0 39:602f83fe:::foo:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-02-09T08:05:42.221 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:05:42.101+0000 ec49640 -1 osd.2 91 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4487.0:3 32.f 32:f4b50b61:::1.obj:head [write 0~112 in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55) 2024-02-09T08:05:42.304 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-02-09T08:05:42.252+0000 ec49640 -1 osd.6 93 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4564.0:2 23.0 23:0384ab8e:::oid:head [write 18446744073709551615~0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:42.665 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:05:42.653+0000 ec49640 -1 osd.0 93 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:05:42.786 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:05:42.737+0000 ec49640 -1 osd.1 91 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4456.0:2 8.5 8:a1a1377e:test-rados-api-smithi062-41275-2::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) 2024-02-09T08:05:43.120 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:05:43.096+0000 12c51640 -1 osd.4 93 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4506.0:1 39.6s0 39:602f83fe:::foo:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-02-09T08:05:43.804 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:05:43.697+0000 ec49640 -1 osd.0 94 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:05:43.848 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-02-09T08:05:43.739+0000 ec49640 -1 osd.6 94 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4564.0:2 23.0 23:0384ab8e:::oid:head [write 18446744073709551615~0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:43.989 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:05:43.982+0000 ec49640 -1 osd.1 92 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4456.0:2 8.5 8:a1a1377e:test-rados-api-smithi062-41275-2::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) 2024-02-09T08:05:44.103 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:05:43.993+0000 ec49640 -1 osd.2 93 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4487.0:3 32.f 32:f4b50b61:::1.obj:head [write 0~112 in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55) 2024-02-09T08:05:44.630 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:05:44.484+0000 12c51640 -1 osd.4 94 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4506.0:1 39.6s0 39:602f83fe:::foo:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-02-09T08:05:44.824 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-02-09T08:05:44.794+0000 ec49640 -1 osd.6 95 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4564.0:2 23.0 23:0384ab8e:::oid:head [write 18446744073709551615~0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:45.099 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:05:45.091+0000 ec49640 -1 osd.0 96 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:05:45.540 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:05:45.412+0000 ec49640 -1 osd.1 93 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4456.0:2 8.5 8:a1a1377e:test-rados-api-smithi062-41275-2::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) 2024-02-09T08:05:45.603 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:05:45.524+0000 12c51640 -1 osd.4 95 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4506.0:1 39.6s0 39:602f83fe:::foo:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-02-09T08:05:45.732 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:05:45.651+0000 ec49640 -1 osd.2 94 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4487.0:3 32.f 32:f4b50b61:::1.obj:head [write 0~112 in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55) 2024-02-09T08:05:46.033 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-02-09T08:05:45.936+0000 ec49640 -1 osd.6 96 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4564.0:2 23.0 23:0384ab8e:::oid:head [write 18446744073709551615~0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:46.954 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:05:46.756+0000 ec49640 -1 osd.0 98 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:05:47.003 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:05:46.973+0000 ec49640 -1 osd.1 94 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4456.0:2 8.5 8:a1a1377e:test-rados-api-smithi062-41275-2::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) 2024-02-09T08:05:47.239 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:05:47.134+0000 12c51640 -1 osd.4 96 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4506.0:1 39.6s0 39:602f83fe:::foo:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-02-09T08:05:47.441 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:05:47.301+0000 ec49640 -1 osd.2 96 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4487.0:3 32.f 32:f4b50b61:::1.obj:head [write 0~112 in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55) 2024-02-09T08:05:47.484 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-02-09T08:05:47.472+0000 ec49640 -1 osd.6 97 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4564.0:2 23.0 23:0384ab8e:::oid:head [write 18446744073709551615~0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-02-09T08:05:47.827 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:05:47.818+0000 ec49640 -1 osd.0 98 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:05:48.319 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:05:48.298+0000 ec49640 -1 osd.2 98 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2024-02-09T08:04:12.154434+0000 front 2024-02-09T08:05:43.101687+0000 (oldest deadline 2024-02-09T08:05:48.183361+0000) 2024-02-09T08:05:48.626 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:05:48.615+0000 ec49640 -1 osd.1 95 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4456.0:2 8.5 8:a1a1377e:test-rados-api-smithi062-41275-2::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) 2024-02-09T08:05:48.928 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:05:48.883+0000 12c51640 -1 osd.4 98 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4506.0:1 39.6s0 39:602f83fe:::foo:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-02-09T08:05:48.974 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:05:48.824+0000 ec49640 -1 osd.2 98 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4487.0:3 32.f 32:f4b50b61:::1.obj:head [write 0~112 in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55) 2024-02-09T08:05:49.073 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:05:49.021+0000 ec49640 -1 osd.0 99 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:05:50.011 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:05:50.001+0000 ec49640 -1 osd.1 97 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4456.0:2 8.5 8:a1a1377e:test-rados-api-smithi062-41275-2::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) 2024-02-09T08:05:50.072 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:05:49.824+0000 ec49640 -1 osd.2 98 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2024-02-09T08:04:12.154434+0000 front 2024-02-09T08:05:43.101687+0000 (oldest deadline 2024-02-09T08:05:48.183361+0000) 2024-02-09T08:05:50.116 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:05:50.088+0000 ec49640 -1 osd.0 100 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:05:50.252 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:05:50.201+0000 12c51640 -1 osd.4 99 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4506.0:1 39.6s0 39:602f83fe:::foo:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-02-09T08:05:50.479 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:05:50.394+0000 ec49640 -1 osd.2 98 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4487.0:3 32.f 32:f4b50b61:::1.obj:head [write 0~112 in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55) 2024-02-09T08:05:51.127 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:05:51.120+0000 ec49640 -1 osd.1 97 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4456.0:2 8.5 8:a1a1377e:test-rados-api-smithi062-41275-2::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) 2024-02-09T08:05:51.461 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:05:51.378+0000 12c51640 -1 osd.4 100 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4506.0:1 39.6s0 39:602f83fe:::foo:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-02-09T08:05:51.678 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:05:51.578+0000 ec49640 -1 osd.2 99 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2024-02-09T08:04:12.154434+0000 front 2024-02-09T08:05:49.987889+0000 (oldest deadline 2024-02-09T08:05:48.183361+0000) 2024-02-09T08:05:51.683 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:05:51.587+0000 ec49640 -1 osd.2 99 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4487.0:3 32.f 32:f4b50b61:::1.obj:head [write 0~112 in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55) 2024-02-09T08:05:51.896 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:05:51.853+0000 ec49640 -1 osd.0 101 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:05:52.290 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:05:52.204+0000 ec49640 -1 osd.1 98 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4456.0:2 8.5 8:a1a1377e:test-rados-api-smithi062-41275-2::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) 2024-02-09T08:05:52.565 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:05:52.489+0000 12c51640 -1 osd.4 101 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4506.0:1 39.6s0 39:602f83fe:::foo:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-02-09T08:05:52.906 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:05:52.687+0000 ec49640 -1 osd.2 99 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2024-02-09T08:04:12.154434+0000 front 2024-02-09T08:05:49.987889+0000 (oldest deadline 2024-02-09T08:05:48.183361+0000) 2024-02-09T08:05:53.222 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:05:53.092+0000 ec49640 -1 osd.0 102 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:05:53.560 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:05:53.466+0000 ec49640 -1 osd.1 99 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4456.0:2 8.5 8:a1a1377e:test-rados-api-smithi062-41275-2::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) 2024-02-09T08:05:53.700 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:05:53.648+0000 12c51640 -1 osd.4 103 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4506.0:1 39.6s0 39:602f83fe:::foo:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-02-09T08:05:54.075 INFO:tasks.workunit.client.0.smithi062.stdout: api_cls_remote_reads: [==========] Running 1 test from 1 test suite. 2024-02-09T08:05:54.076 INFO:tasks.workunit.client.0.smithi062.stdout: api_cls_remote_reads: [----------] Global test environment set-up. 2024-02-09T08:05:54.076 INFO:tasks.workunit.client.0.smithi062.stdout: api_cls_remote_reads: [----------] 1 test from ClsTestRemoteReads 2024-02-09T08:05:54.076 INFO:tasks.workunit.client.0.smithi062.stdout: api_cls_remote_reads: [ RUN ] ClsTestRemoteReads.TestGather 2024-02-09T08:05:54.076 INFO:tasks.workunit.client.0.smithi062.stdout: api_cls_remote_reads: [ OK ] ClsTestRemoteReads.TestGather (104127 ms) 2024-02-09T08:05:54.076 INFO:tasks.workunit.client.0.smithi062.stdout: api_cls_remote_reads: [----------] 1 test from ClsTestRemoteReads (104127 ms total) 2024-02-09T08:05:54.076 INFO:tasks.workunit.client.0.smithi062.stdout: api_cls_remote_reads: 2024-02-09T08:05:54.076 INFO:tasks.workunit.client.0.smithi062.stdout: api_cls_remote_reads: [----------] Global test environment tear-down 2024-02-09T08:05:54.076 INFO:tasks.workunit.client.0.smithi062.stdout: api_cls_remote_reads: [==========] 1 test from 1 test suite ran. (104127 ms total) 2024-02-09T08:05:54.076 INFO:tasks.workunit.client.0.smithi062.stdout: api_cls_remote_reads: [ PASSED ] 1 test. 2024-02-09T08:05:54.291 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:04:03.698 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:05:54.296 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:04:03.703 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:05:54.357 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:04:03.753 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:05:54.359 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:04:03.756 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:05:54.364 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:04:03.771 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:05:54.366 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:04:03.772 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:05:54.368 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:05:54.226+0000 ec49640 -1 osd.0 103 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:05:54.471 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:04:03.878 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:05:54.478 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:05:54.315+0000 ec49640 -1 osd.2 101 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2024-02-09T08:04:12.154434+0000 front 2024-02-09T08:05:49.987889+0000 (oldest deadline 2024-02-09T08:05:48.183361+0000) 2024-02-09T08:05:54.492 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:05:54.315+0000 ec49640 -1 osd.2 101 heartbeat_check: no reply from 172.21.15.103:6806 osd.5 since back 2024-02-09T08:05:43.637300+0000 front 2024-02-09T08:05:01.511001+0000 (oldest deadline 2024-02-09T08:05:53.540089+0000) 2024-02-09T08:05:54.503 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:04:03.900 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:05:54.506 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:04:03.913 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:05:55.189 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:05:55.085+0000 ec49640 -1 osd.1 101 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4456.0:2 8.5 8:a1a1377e:test-rados-api-smithi062-41275-2::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) 2024-02-09T08:05:55.343 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:05:55.261+0000 12c51640 -1 osd.4 104 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4506.0:1 39.6s0 39:602f83fe:::foo:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-02-09T08:05:55.553 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:05:55.525+0000 ec49640 -1 osd.0 104 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:05:55.789 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:05:55.745+0000 ec49640 -1 osd.2 102 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2024-02-09T08:04:12.154434+0000 front 2024-02-09T08:05:55.127026+0000 (oldest deadline 2024-02-09T08:05:48.183361+0000) 2024-02-09T08:05:55.918 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:05:55.745+0000 ec49640 -1 osd.2 102 heartbeat_check: no reply from 172.21.15.103:6806 osd.5 since back 2024-02-09T08:05:54.478308+0000 front 2024-02-09T08:05:01.511001+0000 (oldest deadline 2024-02-09T08:05:53.540089+0000) 2024-02-09T08:05:56.777 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:05:56.737+0000 ec49640 -1 osd.0 106 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:05:57.034 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:05:56.927+0000 12c51640 -1 osd.4 105 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4506.0:1 39.6s0 39:602f83fe:::foo:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-02-09T08:05:57.369 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:05:57.318+0000 ec49640 -1 osd.2 103 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2024-02-09T08:04:12.154434+0000 front 2024-02-09T08:05:55.127026+0000 (oldest deadline 2024-02-09T08:05:48.183361+0000) 2024-02-09T08:05:57.370 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:05:57.318+0000 ec49640 -1 osd.2 103 heartbeat_check: no reply from 172.21.15.103:6806 osd.5 since back 2024-02-09T08:05:54.478308+0000 front 2024-02-09T08:05:01.511001+0000 (oldest deadline 2024-02-09T08:05:53.540089+0000) 2024-02-09T08:05:58.331 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:05:58.157+0000 ec49640 -1 osd.0 106 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:05:58.546 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:05:58.501+0000 ec49640 -1 osd.2 103 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2024-02-09T08:04:12.154434+0000 front 2024-02-09T08:05:55.127026+0000 (oldest deadline 2024-02-09T08:05:48.183361+0000) 2024-02-09T08:05:58.556 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:05:58.501+0000 ec49640 -1 osd.2 103 heartbeat_check: no reply from 172.21.15.103:6806 osd.5 since back 2024-02-09T08:05:54.478308+0000 front 2024-02-09T08:05:01.511001+0000 (oldest deadline 2024-02-09T08:05:53.540089+0000) 2024-02-09T08:05:58.657 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:05:58.648+0000 12c51640 -1 osd.4 107 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4506.0:1 39.6s0 39:602f83fe:::foo:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-02-09T08:05:59.618 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:05:59.486+0000 ec49640 -1 osd.0 107 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:05:59.688 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:05:59.541+0000 ec49640 -1 osd.2 104 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2024-02-09T08:04:12.154434+0000 front 2024-02-09T08:05:55.127026+0000 (oldest deadline 2024-02-09T08:05:48.183361+0000) 2024-02-09T08:05:59.917 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:05:59.816+0000 12c51640 -1 osd.4 108 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4506.0:1 39.6s0 39:602f83fe:::foo:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-02-09T08:06:00.926 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:06:00.909+0000 ec49640 -1 osd.0 108 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:06:00.934 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:06:00.695+0000 ec49640 -1 osd.2 105 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2024-02-09T08:04:12.154434+0000 front 2024-02-09T08:05:55.127026+0000 (oldest deadline 2024-02-09T08:05:48.183361+0000) 2024-02-09T08:06:01.482 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:06:01.434+0000 12c51640 -1 osd.4 109 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4506.0:1 39.6s0 39:602f83fe:::foo:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-02-09T08:06:01.775 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:06:01.763+0000 ec49640 -1 osd.2 105 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2024-02-09T08:04:12.154434+0000 front 2024-02-09T08:05:55.127026+0000 (oldest deadline 2024-02-09T08:05:48.183361+0000) 2024-02-09T08:06:02.292 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:06:02.280+0000 ec49640 -1 osd.0 109 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:06:02.971 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:06:02.910+0000 12c51640 -1 osd.4 111 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4506.0:1 39.6s0 39:602f83fe:::foo:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-02-09T08:06:03.215 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:06:02.972+0000 ec49640 -1 osd.2 107 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2024-02-09T08:04:12.154434+0000 front 2024-02-09T08:05:55.127026+0000 (oldest deadline 2024-02-09T08:05:48.183361+0000) 2024-02-09T08:06:03.494 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:06:03.476+0000 ec49640 -1 osd.0 110 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:06:04.078 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:06:04.064+0000 12c51640 -1 osd.4 112 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4506.0:1 39.6s0 39:602f83fe:::foo:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-02-09T08:06:04.233 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:06:04.229+0000 ec49640 -1 osd.2 108 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2024-02-09T08:04:12.154434+0000 front 2024-02-09T08:05:55.127026+0000 (oldest deadline 2024-02-09T08:05:48.183361+0000) 2024-02-09T08:06:04.666 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:06:04.550+0000 ec49640 -1 osd.0 111 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:06:05.253 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:06:05.248+0000 ec49640 -1 osd.2 108 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2024-02-09T08:04:12.154434+0000 front 2024-02-09T08:06:05.178392+0000 (oldest deadline 2024-02-09T08:05:48.183361+0000) 2024-02-09T08:06:05.305 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:06:05.289+0000 12c51640 -1 osd.4 113 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4506.0:1 39.6s0 39:602f83fe:::foo:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-02-09T08:06:05.642 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:06:05.635+0000 ec49640 -1 osd.0 112 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:06:06.676 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:06:06.573+0000 12c51640 -1 osd.4 115 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4506.0:1 39.6s0 39:602f83fe:::foo:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-02-09T08:06:06.807 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:06:06.759+0000 ec49640 -1 osd.0 113 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:06:06.919 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:06:06.900+0000 ec49640 -1 osd.2 109 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2024-02-09T08:04:12.154434+0000 front 2024-02-09T08:06:05.178392+0000 (oldest deadline 2024-02-09T08:05:48.183361+0000) 2024-02-09T08:06:07.709 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:06:07.586+0000 12c51640 -1 osd.4 116 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4506.0:1 39.6s0 39:602f83fe:::foo:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-02-09T08:06:08.024 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:06:08.005+0000 ec49640 -1 osd.0 114 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:06:08.122 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:06:08.061+0000 ec49640 -1 osd.2 114 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2024-02-09T08:04:12.154434+0000 front 2024-02-09T08:06:05.178392+0000 (oldest deadline 2024-02-09T08:05:48.183361+0000) 2024-02-09T08:06:08.901 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:06:08.775+0000 12c51640 -1 osd.4 117 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4506.0:1 39.6s0 39:602f83fe:::foo:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-02-09T08:06:09.419 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:06:09.329+0000 ec49640 -1 osd.0 115 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:06:09.942 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:06:09.920+0000 12c51640 -1 osd.4 118 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4506.0:1 39.6s0 39:602f83fe:::foo:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-02-09T08:06:10.399 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:06:10.388+0000 ec49640 -1 osd.0 117 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:06:11.535 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:06:11.484+0000 ec49640 -1 osd.0 118 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:06:12.628 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:06:12.611+0000 ec49640 -1 osd.0 118 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:06:13.737 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:06:13.724+0000 ec49640 -1 osd.0 119 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:06:15.430 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:06:15.342+0000 ec49640 -1 osd.0 120 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:06:16.529 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:06:16.405+0000 ec49640 -1 osd.0 121 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:06:17.933 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:06:17.885+0000 ec49640 -1 osd.0 122 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:06:19.258 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:06:19.126+0000 ec49640 -1 osd.0 123 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:06:20.551 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:06:20.515+0000 ec49640 -1 osd.0 124 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:06:21.681 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:06:21.559+0000 ec49640 -1 osd.0 125 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:06:23.125 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:06:23.093+0000 ec49640 -1 osd.0 127 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:06:24.374 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:06:24.366+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:06:24.596 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:06:24.559+0000 ec49640 -1 osd.0 128 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:06:25.782 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:06:25.693+0000 ec49640 -1 osd.1 125 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4695.0:2 72.1e 72:7a7d4169:::src_object.1:head [writefull 0~4096 in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71) 2024-02-09T08:06:25.893 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:06:25.818+0000 ec49640 -1 osd.0 129 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:06:27.104 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:06:27.092+0000 ec49640 -1 osd.0 131 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:06:27.211 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:06:27.131+0000 ec49640 -1 osd.1 128 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4831.0:3 74.1 74:877403b2:test-rados-api-smithi062-41242-8::foo:head [write 0~128 in=128b] snapc 2=[2] ondisk+write+known_if_redirected+supports_pool_eio e86) 2024-02-09T08:06:28.093 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:06:28.076+0000 ec49640 -1 osd.0 131 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:06:28.964 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:06:28.836+0000 ec49640 -1 osd.1 129 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4831.0:3 74.1 74:877403b2:test-rados-api-smithi062-41242-8::foo:head [write 0~128 in=128b] snapc 2=[2] ondisk+write+known_if_redirected+supports_pool_eio e86) 2024-02-09T08:06:29.159 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:06:29.143+0000 ec49640 -1 osd.0 132 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:06:29.397 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:06:29.389+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:06:29.782 INFO:tasks.workunit.client.0.smithi062.stdout:d 0x560a268f93f0 2024-02-09T08:06:29.782 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a268f8290 2024-02-09T08:06:29.782 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a268f9f80 2024-02-09T08:06:29.782 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a268faa40 2024-02-09T08:06:29.783 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a268f91f0 2024-02-09T08:06:29.783 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a268fb900 2024-02-09T08:06:29.783 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a268fa780 2024-02-09T08:06:29.783 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a268fc780 2024-02-09T08:06:29.783 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a268fc910 2024-02-09T08:06:29.783 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a268fb6d0 2024-02-09T08:06:29.783 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b230e0 2024-02-09T08:06:29.783 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a268fc500 2024-02-09T08:06:29.783 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b23f30 2024-02-09T08:06:29.783 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b22e30 2024-02-09T08:06:29.783 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b24dd0 2024-02-09T08:06:29.783 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b23d20 2024-02-09T08:06:29.783 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a2690e850 2024-02-09T08:06:29.783 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a2690f270 2024-02-09T08:06:29.783 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b24b60 2024-02-09T08:06:29.784 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26910100 2024-02-09T08:06:29.784 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a2690f090 2024-02-09T08:06:29.784 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26910ff0 2024-02-09T08:06:29.784 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a2690fee0 2024-02-09T08:06:29.784 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26911eb0 2024-02-09T08:06:29.784 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26910dc0 2024-02-09T08:06:29.784 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26912d70 2024-02-09T08:06:29.784 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26911c20 2024-02-09T08:06:29.784 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26913c10 2024-02-09T08:06:29.784 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26912b20 2024-02-09T08:06:29.784 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26914ad0 2024-02-09T08:06:29.784 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26913990 2024-02-09T08:06:29.784 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26915950 2024-02-09T08:06:29.784 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26914860 2024-02-09T08:06:29.785 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26916490 2024-02-09T08:06:29.785 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26916ec0 2024-02-09T08:06:29.785 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26915790 2024-02-09T08:06:29.785 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26917dd0 2024-02-09T08:06:29.785 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26916c20 2024-02-09T08:06:29.785 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26918c50 2024-02-09T08:06:29.785 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26917bf0 2024-02-09T08:06:29.785 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26919b80 2024-02-09T08:06:29.785 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a269189e0 2024-02-09T08:06:29.785 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a2691aa20 2024-02-09T08:06:29.785 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26919880 2024-02-09T08:06:29.785 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a2691b510 2024-02-09T08:06:29.785 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a2691bf30 2024-02-09T08:06:29.785 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a2691a7f0 2024-02-09T08:06:29.785 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a2691ce40 2024-02-09T08:06:29.786 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a2691bd00 2024-02-09T08:06:29.786 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a2691dd70 2024-02-09T08:06:29.786 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a2691cb90 2024-02-09T08:06:29.786 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a2691da00 2024-02-09T08:06:29.786 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a2691dbb0 2024-02-09T08:06:29.786 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b267b0 2024-02-09T08:06:29.786 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b27220 2024-02-09T08:06:29.786 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a2691e530 2024-02-09T08:06:29.786 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b280c0 2024-02-09T08:06:29.786 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b26ff0 2024-02-09T08:06:29.786 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b28fd0 2024-02-09T08:06:29.786 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b27de0 2024-02-09T08:06:29.786 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b27ef0 2024-02-09T08:06:29.786 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26a70ba0 2024-02-09T08:06:29.787 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26a70cd0 2024-02-09T08:06:29.787 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26a70e20 2024-02-09T08:06:29.787 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b15440 2024-02-09T08:06:29.787 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b15e60 2024-02-09T08:06:29.787 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b28d10 2024-02-09T08:06:29.787 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b169a0 2024-02-09T08:06:29.787 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b17440 2024-02-09T08:06:29.787 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b15c00 2024-02-09T08:06:29.787 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b182b0 2024-02-09T08:06:29.787 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b17240 2024-02-09T08:06:29.787 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b19230 2024-02-09T08:06:29.787 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b180d0 2024-02-09T08:06:29.787 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b1a110 2024-02-09T08:06:29.787 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b18f40 2024-02-09T08:06:29.787 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b19da0 2024-02-09T08:06:29.788 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b2a400 2024-02-09T08:06:29.788 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b13a10 2024-02-09T08:06:29.788 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b1ab30 2024-02-09T08:06:29.788 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b1b5f0 2024-02-09T08:06:29.788 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b1c0e0 2024-02-09T08:06:30.279 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:06:30.192+0000 ec49640 -1 osd.1 130 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4831.0:3 74.1 74:877403b2:test-rados-api-smithi062-41242-8::foo:head [write 0~128 in=128b] snapc 2=[2] ondisk+write+known_if_redirected+supports_pool_eio e86) 2024-02-09T08:06:30.620 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:06:30.497+0000 ec49640 -1 osd.0 133 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:06:30.681 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:06:30.666+0000 ec49640 -1 osd.2 131 heartbeat_check: no reply from 172.21.15.62:6812 osd.0 since back 2024-02-09T08:05:49.817176+0000 front 2024-02-09T08:06:28.348008+0000 (oldest deadline 2024-02-09T08:06:29.926195+0000) 2024-02-09T08:06:31.245 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:06:31.203+0000 ec49640 -1 osd.1 131 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4486.0:8 40.5s0 40:bc4e0a1c:test-rados-api-smithi062-41351-3::foo:head [watch watch cookie 94097242353072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) 2024-02-09T08:06:31.763 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:06:31.728+0000 ec49640 -1 osd.2 132 heartbeat_check: no reply from 172.21.15.62:6812 osd.0 since back 2024-02-09T08:05:49.817176+0000 front 2024-02-09T08:06:28.348008+0000 (oldest deadline 2024-02-09T08:06:29.926195+0000) 2024-02-09T08:06:32.071 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:06:32.016+0000 ec49640 -1 osd.0 133 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:06:32.654 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:06:32.550+0000 ec49640 -1 osd.1 132 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4486.0:8 40.5s0 40:bc4e0a1c:test-rados-api-smithi062-41351-3::foo:head [watch watch cookie 94097242353072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) 2024-02-09T08:06:33.204 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:06:33.087+0000 ec49640 -1 osd.0 135 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:06:33.468 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:06:33.255+0000 ec49640 -1 osd.2 134 heartbeat_check: no reply from 172.21.15.62:6812 osd.0 since back 2024-02-09T08:05:49.817176+0000 front 2024-02-09T08:06:28.348008+0000 (oldest deadline 2024-02-09T08:06:29.926195+0000) 2024-02-09T08:06:33.743 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:06:33.612+0000 ec49640 -1 osd.1 132 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4486.0:8 40.5s0 40:bc4e0a1c:test-rados-api-smithi062-41351-3::foo:head [watch watch cookie 94097242353072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) 2024-02-09T08:06:34.328 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:06:34.292+0000 ec49640 -1 osd.0 136 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:06:34.449 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:06:34.445+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:06:34.576 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:06:34.451+0000 ec49640 -1 osd.2 135 heartbeat_check: no reply from 172.21.15.62:6812 osd.0 since back 2024-02-09T08:05:49.817176+0000 front 2024-02-09T08:06:28.348008+0000 (oldest deadline 2024-02-09T08:06:29.926195+0000) 2024-02-09T08:06:35.066 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:06:34.949+0000 ec49640 -1 osd.1 134 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4486.0:8 40.5s0 40:bc4e0a1c:test-rados-api-smithi062-41351-3::foo:head [watch watch cookie 94097242353072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) 2024-02-09T08:06:36.066 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:06:35.799+0000 ec49640 -1 osd.0 138 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:06:36.153 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:06:36.102+0000 ec49640 -1 osd.1 135 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4486.0:8 40.5s0 40:bc4e0a1c:test-rados-api-smithi062-41351-3::foo:head [watch watch cookie 94097242353072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) 2024-02-09T08:06:36.312 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:06:36.259+0000 ec49640 -1 osd.2 136 heartbeat_check: no reply from 172.21.15.62:6812 osd.0 since back 2024-02-09T08:05:49.817176+0000 front 2024-02-09T08:06:28.348008+0000 (oldest deadline 2024-02-09T08:06:29.926195+0000) 2024-02-09T08:06:37.118 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:06:37.080+0000 ec49640 -1 osd.0 138 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:06:37.334 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:06:37.299+0000 ec49640 -1 osd.2 138 heartbeat_check: no reply from 172.21.15.62:6812 osd.0 since back 2024-02-09T08:05:49.817176+0000 front 2024-02-09T08:06:36.812296+0000 (oldest deadline 2024-02-09T08:06:29.926195+0000) 2024-02-09T08:06:38.943 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:06:38.898+0000 ec49640 -1 osd.0 140 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:06:39.071 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:06:39.012+0000 ec49640 -1 osd.2 138 heartbeat_check: no reply from 172.21.15.62:6812 osd.0 since back 2024-02-09T08:05:49.817176+0000 front 2024-02-09T08:06:38.663482+0000 (oldest deadline 2024-02-09T08:06:29.926195+0000) 2024-02-09T08:06:39.512 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:06:39.509+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:06:39.787 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:04:49.193 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:06:39.852 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:04:49.259 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:06:39.867 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:04:49.263 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:06:39.873 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:04:49.270 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:06:39.933 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:04:49.340 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:06:39.942 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:04:49.349 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:06:40.084 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:06:40.006+0000 ec49640 -1 osd.0 141 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:06:40.120 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:04:49.517 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:06:40.232 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:04:49.639 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:06:40.340 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:04:49.747 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:06:40.398 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:06:40.262+0000 ec49640 -1 osd.2 141 heartbeat_check: no reply from 172.21.15.62:6812 osd.0 since back 2024-02-09T08:05:49.817176+0000 front 2024-02-09T08:06:38.663482+0000 (oldest deadline 2024-02-09T08:06:29.926195+0000) 2024-02-09T08:06:41.026 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:06:40.989+0000 ec49640 -1 osd.0 142 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:06:41.782 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:06:41.689+0000 ec49640 -1 osd.2 144 heartbeat_check: no reply from 172.21.15.62:6812 osd.0 since back 2024-02-09T08:05:49.817176+0000 front 2024-02-09T08:06:38.663482+0000 (oldest deadline 2024-02-09T08:06:29.926195+0000) 2024-02-09T08:06:42.275 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:06:42.114+0000 ec49640 -1 osd.0 143 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:06:43.230 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:06:43.166+0000 ec49640 -1 osd.0 143 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:06:43.463 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:06:43.357+0000 ec49640 -1 osd.2 144 heartbeat_check: no reply from 172.21.15.62:6812 osd.0 since back 2024-02-09T08:05:49.817176+0000 front 2024-02-09T08:06:41.718011+0000 (oldest deadline 2024-02-09T08:06:29.926195+0000) 2024-02-09T08:06:44.507 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:06:44.487+0000 ec49640 -1 osd.0 145 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:06:44.536 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:06:44.529+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:06:44.577 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:06:44.557+0000 ec49640 -1 osd.2 145 heartbeat_check: no reply from 172.21.15.62:6812 osd.0 since back 2024-02-09T08:05:49.817176+0000 front 2024-02-09T08:06:41.718011+0000 (oldest deadline 2024-02-09T08:06:29.926195+0000) 2024-02-09T08:06:45.780 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:06:45.752+0000 ec49640 -1 osd.0 146 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:06:46.354 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:06:46.210+0000 ec49640 -1 osd.2 146 heartbeat_check: no reply from 172.21.15.62:6812 osd.0 since back 2024-02-09T08:05:49.817176+0000 front 2024-02-09T08:06:41.718011+0000 (oldest deadline 2024-02-09T08:06:29.926195+0000) 2024-02-09T08:06:47.473 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:06:47.437+0000 ec49640 -1 osd.2 148 heartbeat_check: no reply from 172.21.15.62:6812 osd.0 since back 2024-02-09T08:05:49.817176+0000 front 2024-02-09T08:06:41.718011+0000 (oldest deadline 2024-02-09T08:06:29.926195+0000) 2024-02-09T08:06:47.606 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:06:47.572+0000 ec49640 -1 osd.0 148 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:06:49.038 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:06:49.009+0000 ec49640 -1 osd.2 148 heartbeat_check: no reply from 172.21.15.62:6812 osd.0 since back 2024-02-09T08:05:49.817176+0000 front 2024-02-09T08:06:48.089208+0000 (oldest deadline 2024-02-09T08:06:29.926195+0000) 2024-02-09T08:06:49.373 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:06:49.309+0000 ec49640 -1 osd.0 149 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:06:49.550 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:06:49.548+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:06:50.397 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:06:50.386+0000 ec49640 -1 osd.0 150 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:06:51.553 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:06:51.539+0000 ec49640 -1 osd.0 151 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:06:52.164 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:06:52.127+0000 ec49640 -1 osd.2 150 heartbeat_check: no reply from 172.21.15.62:6812 osd.0 since back 2024-02-09T08:05:49.817176+0000 front 2024-02-09T08:06:48.089208+0000 (oldest deadline 2024-02-09T08:06:29.926195+0000) 2024-02-09T08:06:52.266 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:06:52.218+0000 ec49640 -1 osd.2 150 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4514.0:11 37.5 37:a557efb1:::obj8:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82) 2024-02-09T08:06:52.799 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:06:52.692+0000 ec49640 -1 osd.0 152 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:06:53.364 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:06:53.308+0000 ec49640 -1 osd.2 150 heartbeat_check: no reply from 172.21.15.62:6812 osd.0 since back 2024-02-09T08:05:49.817176+0000 front 2024-02-09T08:06:53.305266+0000 (oldest deadline 2024-02-09T08:06:29.926195+0000) 2024-02-09T08:06:53.372 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:06:53.317+0000 ec49640 -1 osd.2 150 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4514.0:11 37.5 37:a557efb1:::obj8:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82) 2024-02-09T08:06:54.133 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:06:53.933+0000 ec49640 -1 osd.0 154 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:06:54.388 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:06:54.300+0000 ec49640 -1 osd.2 151 heartbeat_check: no reply from 172.21.15.62:6812 osd.0 since back 2024-02-09T08:05:49.817176+0000 front 2024-02-09T08:06:53.305266+0000 (oldest deadline 2024-02-09T08:06:29.926195+0000) 2024-02-09T08:06:54.393 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:06:54.310+0000 ec49640 -1 osd.2 151 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4514.0:11 37.5 37:a557efb1:::obj8:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82) 2024-02-09T08:06:54.566 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:06:54.562+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:06:55.479 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:06:55.422+0000 ec49640 -1 osd.2 153 heartbeat_check: no reply from 172.21.15.62:6812 osd.0 since back 2024-02-09T08:05:49.817176+0000 front 2024-02-09T08:06:53.305266+0000 (oldest deadline 2024-02-09T08:06:29.926195+0000) 2024-02-09T08:06:55.521 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:06:55.406+0000 ec49640 -1 osd.0 155 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:06:55.584 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:06:55.488+0000 ec49640 -1 osd.2 153 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4514.0:11 37.5 37:a557efb1:::obj8:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82) 2024-02-09T08:06:56.620 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:06:56.511+0000 ec49640 -1 osd.2 154 heartbeat_check: no reply from 172.21.15.62:6812 osd.0 since back 2024-02-09T08:05:49.817176+0000 front 2024-02-09T08:06:56.009090+0000 (oldest deadline 2024-02-09T08:06:29.926195+0000) 2024-02-09T08:06:56.628 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:06:56.530+0000 ec49640 -1 osd.0 156 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:06:56.704 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:06:56.664+0000 ec49640 -1 osd.2 154 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4514.0:11 37.5 37:a557efb1:::obj8:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82) 2024-02-09T08:06:57.674 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:06:57.666+0000 ec49640 -1 osd.0 157 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:06:57.856 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:06:57.674+0000 ec49640 -1 osd.2 155 heartbeat_check: no reply from 172.21.15.62:6812 osd.0 since back 2024-02-09T08:05:49.817176+0000 front 2024-02-09T08:06:56.009090+0000 (oldest deadline 2024-02-09T08:06:29.926195+0000) 2024-02-09T08:06:58.214 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:06:58.063+0000 ec49640 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4514.0:11 37.5 37:a557efb1:::obj8:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82) 2024-02-09T08:06:59.269 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:06:59.259+0000 ec49640 -1 osd.2 156 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4514.0:11 37.5 37:a557efb1:::obj8:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82) 2024-02-09T08:06:59.589 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:06:59.585+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:06:59.655 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:05:09.062 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:06:59.658 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:05:09.065 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:06:59.692 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:06:59.518+0000 ec49640 -1 osd.0 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:06:59.730 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:05:09.126 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:06:59.734 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:05:09.130 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:06:59.749 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:05:09.156 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:06:59.754 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:05:09.161 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:06:59.770 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:05:09.176 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:06:59.824 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:05:09.221 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:06:59.871 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:05:09.278 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:07:00.981 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:07:00.945+0000 ec49640 -1 osd.0 159 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:07:02.288 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:07:02.249+0000 ec49640 -1 osd.0 160 get_health_metrics reporting 41 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:07:03.627 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:07:03.608+0000 ec49640 -1 osd.0 161 get_health_metrics reporting 41 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:07:04.600 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:07:04.597+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:07:04.782 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:07:04.664+0000 ec49640 -1 osd.0 162 get_health_metrics reporting 200 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:07:07.641 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:07:07.560+0000 ec49640 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:07:08.689 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:07:08.617+0000 ec49640 -1 osd.0 165 get_health_metrics reporting 206 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:07:09.751 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:07:09.748+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:07:09.843 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:07:09.711+0000 ec49640 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:07:11.112 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:07:11.059+0000 ec49640 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:07:12.640 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:07:12.511+0000 ec49640 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:07:13.886 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:07:13.867+0000 ec49640 -1 osd.0 168 get_health_metrics reporting 214 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:07:14.768 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:07:14.761+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:07:15.055 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:07:14.918+0000 ec49640 -1 osd.0 169 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:07:17.082 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:07:17.035+0000 ec49640 -1 osd.0 173 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:07:17.663 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:07:17.567+0000 ec49640 -1 osd.1 167 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4831.0:5 74.1 74:877403b2:test-rados-api-smithi062-41242-8::foo:head [write 0~128 in=128b] snapc 3=[3,2] ondisk+write+known_if_redirected+supports_pool_eio e137) 2024-02-09T08:07:18.556 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:07:18.357+0000 ec49640 -1 osd.0 174 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:07:19.005 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:07:18.993+0000 ec49640 -1 osd.1 171 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4831.0:5 74.1 74:877403b2:test-rados-api-smithi062-41242-8::foo:head [write 0~128 in=128b] snapc 3=[3,2] ondisk+write+known_if_redirected+supports_pool_eio e137) 2024-02-09T08:07:19.509 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:07:19.411+0000 ec49640 -1 osd.0 175 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:07:19.793 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:07:19.789+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:07:19.891 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:05:29.297 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:07:19.899 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:05:29.306 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:07:19.941 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:05:29.347 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:07:19.968 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:05:29.365 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:07:19.970 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:05:29.366 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:07:19.974 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:05:29.380 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:07:20.068 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:05:29.464 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:07:20.093 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:05:29.499 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:07:20.165 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:05:29.571 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:07:20.520 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:07:20.334+0000 ec49640 -1 osd.1 171 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4831.0:5 74.1 74:877403b2:test-rados-api-smithi062-41242-8::foo:head [write 0~128 in=128b] snapc 3=[3,2] ondisk+write+known_if_redirected+supports_pool_eio e137) 2024-02-09T08:07:20.546 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:07:20.510+0000 ec49640 -1 osd.0 175 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:07:21.638 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:07:21.560+0000 ec49640 -1 osd.1 172 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4831.0:5 74.1 74:877403b2:test-rados-api-smithi062-41242-8::foo:head [write 0~128 in=128b] snapc 3=[3,2] ondisk+write+known_if_redirected+supports_pool_eio e137) 2024-02-09T08:07:21.902 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:07:21.885+0000 ec49640 -1 osd.0 176 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:07:22.771 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:07:22.751+0000 ec49640 -1 osd.1 173 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4831.0:5 74.1 74:877403b2:test-rados-api-smithi062-41242-8::foo:head [write 0~128 in=128b] snapc 3=[3,2] ondisk+write+known_if_redirected+supports_pool_eio e137) 2024-02-09T08:07:23.165 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:07:23.035+0000 ec49640 -1 osd.0 177 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:07:23.863 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:07:23.847+0000 ec49640 -1 osd.1 173 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4831.0:5 74.1 74:877403b2:test-rados-api-smithi062-41242-8::foo:head [write 0~128 in=128b] snapc 3=[3,2] ondisk+write+known_if_redirected+supports_pool_eio e137) 2024-02-09T08:07:24.405 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:07:24.228+0000 ec49640 -1 osd.0 178 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:07:24.815 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:07:24.810+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:07:25.262 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:07:25.149+0000 ec49640 -1 osd.1 175 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4831.0:5 74.1 74:877403b2:test-rados-api-smithi062-41242-8::foo:head [write 0~128 in=128b] snapc 3=[3,2] ondisk+write+known_if_redirected+supports_pool_eio e137) 2024-02-09T08:07:25.387 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:07:25.333+0000 ec49640 -1 osd.0 179 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:07:26.169 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:07:26.157+0000 ec49640 -1 osd.1 176 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4831.0:5 74.1 74:877403b2:test-rados-api-smithi062-41242-8::foo:head [write 0~128 in=128b] snapc 3=[3,2] ondisk+write+known_if_redirected+supports_pool_eio e137) 2024-02-09T08:07:26.480 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:07:26.460+0000 ec49640 -1 osd.0 179 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:07:27.613 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:07:27.543+0000 ec49640 -1 osd.1 177 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4831.0:5 74.1 74:877403b2:test-rados-api-smithi062-41242-8::foo:head [write 0~128 in=128b] snapc 3=[3,2] ondisk+write+known_if_redirected+supports_pool_eio e137) 2024-02-09T08:07:27.733 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: st watch_notify: Running main() from gmock_main.cc 2024-02-09T08:07:27.733 INFO:tasks.workunit.client.0.smithi062.stdout: watch_notify: [==========] Running 2 tests from 1 test suite. 2024-02-09T08:07:27.733 INFO:tasks.workunit.client.0.smithi062.stdout: watch_notify: [----------] Global test environment set-up. 2024-02-09T08:07:27.733 INFO:tasks.workunit.client.0.smithi062.stdout: watch_notify: [----------] 2 tests from NeoRadosWatchNotify 2024-02-09T08:07:27.733 INFO:tasks.workunit.client.0.smithi062.stdout: watch_notify: [ RUN ] NeoRadosWatchNotify.WatchNotify 2024-02-09T08:07:27.733 INFO:tasks.workunit.client.0.smithi062.stdout: watch_notify: handle_notify cookie 94282298872320 notify_id 459561500673 notifier_gid 4512 2024-02-09T08:07:27.733 INFO:tasks.workunit.client.0.smithi062.stdout: watch_notify: [ OK ] NeoRadosWatchNotify.WatchNotify (165053 ms) 2024-02-09T08:07:27.733 INFO:tasks.workunit.client.0.smithi062.stdout: watch_notify: [ RUN ] NeoRadosWatchNotify.WatchNotifyTimeout 2024-02-09T08:07:27.733 INFO:tasks.workunit.client.0.smithi062.stdout: watch_notify: Trying... 2024-02-09T08:07:27.733 INFO:tasks.workunit.client.0.smithi062.stdout: watch_notify: handle_notify cookie 94282311506320 notify_id 751619276801 notifier_gid 4778 2024-02-09T08:07:27.734 INFO:tasks.workunit.client.0.smithi062.stdout: watch_notify: Waiting for 3.000000000s 2024-02-09T08:07:27.734 INFO:tasks.workunit.client.0.smithi062.stdout: watch_notify: Timed out. 2024-02-09T08:07:27.734 INFO:tasks.workunit.client.0.smithi062.stdout: watch_notify: Flushing... 2024-02-09T08:07:27.734 INFO:tasks.workunit.client.0.smithi062.stdout: watch_notify: Flushed... 2024-02-09T08:07:27.734 INFO:tasks.workunit.client.0.smithi062.stdout: watch_notify: [ OK ] NeoRadosWatchNotify.WatchNotifyTimeout (32566 ms) 2024-02-09T08:07:27.734 INFO:tasks.workunit.client.0.smithi062.stdout: watch_notify: [----------] 2 tests from NeoRadosWatchNotify (197619 ms total) 2024-02-09T08:07:27.734 INFO:tasks.workunit.client.0.smithi062.stdout: watch_notify: 2024-02-09T08:07:27.734 INFO:tasks.workunit.client.0.smithi062.stdout: watch_notify: [----------] Global test environment tear-down 2024-02-09T08:07:27.734 INFO:tasks.workunit.client.0.smithi062.stdout: watch_notify: [==========] 2 tests from 1 test suite ran. (197619 ms total) 2024-02-09T08:07:27.734 INFO:tasks.workunit.client.0.smithi062.stdout: watch_notify: [ PASSED ] 2 tests. 2024-02-09T08:07:27.903 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:07:27.834+0000 ec49640 -1 osd.0 181 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:07:28.825 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:07:28.735+0000 ec49640 -1 osd.1 177 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4831.0:5 74.1 74:877403b2:test-rados-api-smithi062-41242-8::foo:head [write 0~128 in=128b] snapc 3=[3,2] ondisk+write+known_if_redirected+supports_pool_eio e137) 2024-02-09T08:07:28.972 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:07:28.887+0000 ec49640 -1 osd.0 182 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:07:29.893 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:07:29.881+0000 ec49640 -1 osd.1 178 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4831.0:5 74.1 74:877403b2:test-rados-api-smithi062-41242-8::foo:head [write 0~128 in=128b] snapc 3=[3,2] ondisk+write+known_if_redirected+supports_pool_eio e137) 2024-02-09T08:07:29.908 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:07:29.900+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:07:29.988 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:07:29.957+0000 ec49640 -1 osd.0 182 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:07:31.098 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:07:30.984+0000 ec49640 -1 osd.1 179 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4831.0:5 74.1 74:877403b2:test-rados-api-smithi062-41242-8::foo:head [write 0~128 in=128b] snapc 3=[3,2] ondisk+write+known_if_redirected+supports_pool_eio e137) 2024-02-09T08:07:31.860 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:07:31.739+0000 ec49640 -1 osd.0 183 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:07:32.295 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:07:32.174+0000 ec49640 -1 osd.1 180 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4831.0:5 74.1 74:877403b2:test-rados-api-smithi062-41242-8::foo:head [write 0~128 in=128b] snapc 3=[3,2] ondisk+write+known_if_redirected+supports_pool_eio e137) 2024-02-09T08:07:32.926 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:07:32.886+0000 ec49640 -1 osd.0 185 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:07:34.170 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:07:34.093+0000 ec49640 -1 osd.1 182 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4831.0:5 74.1 74:877403b2:test-rados-api-smithi062-41242-8::foo:head [write 0~128 in=128b] snapc 3=[3,2] ondisk+write+known_if_redirected+supports_pool_eio e137) 2024-02-09T08:07:34.919 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:07:34.916+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:07:35.053 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:07:35.025+0000 ec49640 -1 osd.2 185 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4514.0:11 37.5 37:a557efb1:::obj8:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82) 2024-02-09T08:07:35.083 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:07:35.011+0000 ec49640 -1 osd.0 186 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:07:35.143 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:07:35.087+0000 ec49640 -1 osd.1 183 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4831.0:5 74.1 74:877403b2:test-rados-api-smithi062-41242-8::foo:head [write 0~128 in=128b] snapc 3=[3,2] ondisk+write+known_if_redirected+supports_pool_eio e137) 2024-02-09T08:07:36.218 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:07:36.096+0000 ec49640 -1 osd.1 183 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4831.0:5 74.1 74:877403b2:test-rados-api-smithi062-41242-8::foo:head [write 0~128 in=128b] snapc 3=[3,2] ondisk+write+known_if_redirected+supports_pool_eio e137) 2024-02-09T08:07:36.515 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:07:36.379+0000 ec49640 -1 osd.2 187 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4514.0:11 37.5 37:a557efb1:::obj8:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82) 2024-02-09T08:07:36.657 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:07:36.576+0000 ec49640 -1 osd.0 188 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:07:37.600 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:07:37.499+0000 ec49640 -1 osd.1 184 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4831.0:5 74.1 74:877403b2:test-rados-api-smithi062-41242-8::foo:head [write 0~128 in=128b] snapc 3=[3,2] ondisk+write+known_if_redirected+supports_pool_eio e137) 2024-02-09T08:07:37.862 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:07:37.820+0000 ec49640 -1 osd.0 189 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:07:38.346 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:07:38.149+0000 ec49640 -1 osd.2 190 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4514.0:11 37.5 37:a557efb1:::obj8:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82) 2024-02-09T08:07:38.753 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:07:38.667+0000 ec49640 -1 osd.1 185 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4831.0:5 74.1 74:877403b2:test-rados-api-smithi062-41242-8::foo:head [write 0~128 in=128b] snapc 3=[3,2] ondisk+write+known_if_redirected+supports_pool_eio e137) 2024-02-09T08:07:38.977 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:07:38.919+0000 ec49640 -1 osd.0 190 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:07:39.283 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:07:39.215+0000 ec49640 -1 osd.2 192 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4514.0:11 37.5 37:a557efb1:::obj8:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82) 2024-02-09T08:07:39.941 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:07:39.937+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:07:40.002 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:05:49.408 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:07:40.006 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:05:49.413 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:07:40.057 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:05:49.454 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:07:40.062 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:05:49.459 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:07:40.082 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:05:49.489 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:07:40.100 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:05:49.507 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:07:40.145 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:05:49.542 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:07:40.223 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:05:49.630 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:07:40.270 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:07:40.165+0000 ec49640 -1 osd.0 191 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:07:40.288 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:05:49.695 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:07:40.300 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:07:40.273+0000 ec49640 -1 osd.1 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4831.0:5 74.1 74:877403b2:test-rados-api-smithi062-41242-8::foo:head [write 0~128 in=128b] snapc 3=[3,2] ondisk+write+known_if_redirected+supports_pool_eio e137) 2024-02-09T08:07:40.579 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:07:40.566+0000 ec49640 -1 osd.2 192 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4514.0:11 37.5 37:a557efb1:::obj8:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82) 2024-02-09T08:07:41.332 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:07:41.189+0000 ec49640 -1 osd.0 191 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:07:41.366 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:07:41.354+0000 ec49640 -1 osd.7 197 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4909.0:3 92.10 92:0e609fda:test-rados-api-smithi062-41096-8::foo:head [writefull 0~4 in=4b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e169) 2024-02-09T08:07:41.577 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:07:41.557+0000 ec49640 -1 osd.1 189 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4831.0:5 74.1 74:877403b2:test-rados-api-smithi062-41242-8::foo:head [write 0~128 in=128b] snapc 3=[3,2] ondisk+write+known_if_redirected+supports_pool_eio e137) 2024-02-09T08:07:41.792 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:07:41.682+0000 ec49640 -1 osd.2 193 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4514.0:11 37.5 37:a557efb1:::obj8:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82) 2024-02-09T08:07:41.875 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:07:41.781+0000 12c51640 -1 osd.3 194 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4695.0:5 72.2 72:41780a1c:::tgt_object:head [call test_remote_reads.test_gather in=233b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e138) 2024-02-09T08:07:42.690 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:07:42.633+0000 ec49640 -1 osd.0 192 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:07:42.737 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:07:42.727+0000 ec49640 -1 osd.7 198 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4909.0:3 92.10 92:0e609fda:test-rados-api-smithi062-41096-8::foo:head [writefull 0~4 in=4b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e169) 2024-02-09T08:07:43.044 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:07:42.970+0000 ec49640 -1 osd.2 195 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4514.0:11 37.5 37:a557efb1:::obj8:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82) 2024-02-09T08:07:43.207 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:07:43.195+0000 12c51640 -1 osd.3 197 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4695.0:5 72.2 72:41780a1c:::tgt_object:head [call test_remote_reads.test_gather in=233b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e138) 2024-02-09T08:07:43.252 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:07:43.153+0000 ec49640 -1 osd.1 189 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4831.0:5 74.1 74:877403b2:test-rados-api-smithi062-41242-8::foo:head [write 0~128 in=128b] snapc 3=[3,2] ondisk+write+known_if_redirected+supports_pool_eio e137) 2024-02-09T08:07:43.741 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:07:43.705+0000 ec49640 -1 osd.7 199 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4909.0:3 92.10 92:0e609fda:test-rados-api-smithi062-41096-8::foo:head [writefull 0~4 in=4b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e169) 2024-02-09T08:07:44.133 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:07:44.063+0000 ec49640 -1 osd.2 196 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4514.0:11 37.5 37:a557efb1:::obj8:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82) 2024-02-09T08:07:44.266 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:07:44.233+0000 ec49640 -1 osd.0 193 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:07:44.380 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:07:44.341+0000 ec49640 -1 osd.1 191 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4831.0:5 74.1 74:877403b2:test-rados-api-smithi062-41242-8::foo:head [write 0~128 in=128b] snapc 3=[3,2] ondisk+write+known_if_redirected+supports_pool_eio e137) 2024-02-09T08:07:44.463 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:07:44.448+0000 12c51640 -1 osd.3 197 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4695.0:5 72.2 72:41780a1c:::tgt_object:head [call test_remote_reads.test_gather in=233b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e138) 2024-02-09T08:07:44.766 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:07:44.740+0000 ec49640 -1 osd.7 200 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4909.0:3 92.10 92:0e609fda:test-rados-api-smithi062-41096-8::foo:head [writefull 0~4 in=4b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e169) 2024-02-09T08:07:45.025 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:07:45.021+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:07:45.094 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:07:45.087+0000 ec49640 -1 osd.2 197 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4514.0:11 37.5 37:a557efb1:::obj8:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82) 2024-02-09T08:07:45.672 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:07:45.581+0000 12c51640 -1 osd.3 198 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4695.0:5 72.2 72:41780a1c:::tgt_object:head [call test_remote_reads.test_gather in=233b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e138) 2024-02-09T08:07:45.746 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:07:45.734+0000 ec49640 -1 osd.7 200 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4909.0:3 92.10 92:0e609fda:test-rados-api-smithi062-41096-8::foo:head [writefull 0~4 in=4b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e169) 2024-02-09T08:07:45.973 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:07:45.897+0000 ec49640 -1 osd.1 194 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4831.0:5 74.1 74:877403b2:test-rados-api-smithi062-41242-8::foo:head [write 0~128 in=128b] snapc 3=[3,2] ondisk+write+known_if_redirected+supports_pool_eio e137) 2024-02-09T08:07:46.068 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:07:45.891+0000 ec49640 -1 osd.0 196 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:07:46.280 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:07:46.195+0000 ec49640 -1 osd.2 198 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4514.0:11 37.5 37:a557efb1:::obj8:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82) 2024-02-09T08:07:46.994 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:07:46.877+0000 ec49640 -1 osd.7 201 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4909.0:3 92.10 92:0e609fda:test-rados-api-smithi062-41096-8::foo:head [writefull 0~4 in=4b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e169) 2024-02-09T08:07:47.079 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:07:46.939+0000 ec49640 -1 osd.1 194 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4831.0:5 74.1 74:877403b2:test-rados-api-smithi062-41242-8::foo:head [write 0~128 in=128b] snapc 3=[3,2] ondisk+write+known_if_redirected+supports_pool_eio e137) 2024-02-09T08:07:47.190 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:07:47.080+0000 12c51640 -1 osd.3 200 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4695.0:5 72.2 72:41780a1c:::tgt_object:head [call test_remote_reads.test_gather in=233b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e138) 2024-02-09T08:07:47.341 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:07:47.273+0000 ec49640 -1 osd.2 199 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4514.0:11 37.5 37:a557efb1:::obj8:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82) 2024-02-09T08:07:47.353 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:07:47.274+0000 ec49640 -1 osd.0 197 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:07:48.221 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:07:48.120+0000 ec49640 -1 osd.1 195 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4831.0:5 74.1 74:877403b2:test-rados-api-smithi062-41242-8::foo:head [write 0~128 in=128b] snapc 3=[3,2] ondisk+write+known_if_redirected+supports_pool_eio e137) 2024-02-09T08:07:48.357 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:07:48.294+0000 12c51640 -1 osd.3 201 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4695.0:5 72.2 72:41780a1c:::tgt_object:head [call test_remote_reads.test_gather in=233b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e138) 2024-02-09T08:07:48.580 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:07:48.565+0000 ec49640 -1 osd.7 202 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4909.0:3 92.10 92:0e609fda:test-rados-api-smithi062-41096-8::foo:head [writefull 0~4 in=4b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e169) 2024-02-09T08:07:48.891 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:07:48.838+0000 ec49640 -1 osd.0 199 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:07:48.894 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:07:48.880+0000 ec49640 -1 osd.2 200 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4514.0:11 37.5 37:a557efb1:::obj8:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82) 2024-02-09T08:07:49.427 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:07:49.393+0000 12c51640 -1 osd.3 202 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4695.0:5 72.2 72:41780a1c:::tgt_object:head [call test_remote_reads.test_gather in=233b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e138) 2024-02-09T08:07:50.041 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:07:49.996+0000 ec49640 -1 osd.0 199 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:07:50.059 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:07:50.053+0000 ec49640 -1 osd.2 201 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4514.0:11 37.5 37:a557efb1:::obj8:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82) 2024-02-09T08:07:50.129 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:07:50.124+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:07:50.749 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:07:50.700+0000 12c51640 -1 osd.3 203 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4695.0:5 72.2 72:41780a1c:::tgt_object:head [call test_remote_reads.test_gather in=233b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e138) 2024-02-09T08:07:51.144 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:07:51.066+0000 ec49640 -1 osd.2 202 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4514.0:11 37.5 37:a557efb1:::obj8:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82) 2024-02-09T08:07:51.188 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:07:51.073+0000 ec49640 -1 osd.0 200 get_health_metrics reporting 231 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:07:51.796 INFO:tasks.workunit.client.0.smithi062.stdout:arted 0x560a26b2b2a0 2024-02-09T08:07:51.797 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b2bca0 2024-02-09T08:07:51.797 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b2c6a0 2024-02-09T08:07:51.797 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b2ccf0 2024-02-09T08:07:51.797 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b1a2c0 2024-02-09T08:07:51.797 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b1a4f0 2024-02-09T08:07:51.797 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b2c440 2024-02-09T08:07:51.797 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b2b960 2024-02-09T08:07:51.797 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b2aef0 2024-02-09T08:07:51.797 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b2b130 2024-02-09T08:07:51.797 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b1bef0 2024-02-09T08:07:51.797 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b1b2f0 2024-02-09T08:07:51.797 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b2f880 2024-02-09T08:07:51.797 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b30330 2024-02-09T08:07:51.797 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b13cb0 2024-02-09T08:07:51.797 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b311d0 2024-02-09T08:07:51.798 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b300c0 2024-02-09T08:07:51.798 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b32080 2024-02-09T08:07:51.798 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b30f50 2024-02-09T08:07:51.798 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b32f00 2024-02-09T08:07:51.798 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b31e60 2024-02-09T08:07:51.798 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b33dc0 2024-02-09T08:07:51.798 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b32cc0 2024-02-09T08:07:51.798 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b34c60 2024-02-09T08:07:51.798 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b33b30 2024-02-09T08:07:51.798 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b35b00 2024-02-09T08:07:51.798 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b34a00 2024-02-09T08:07:51.798 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b369c0 2024-02-09T08:07:51.798 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b35890 2024-02-09T08:07:51.798 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b37840 2024-02-09T08:07:51.799 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b36770 2024-02-09T08:07:51.799 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b38700 2024-02-09T08:07:51.799 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b37610 2024-02-09T08:07:51.799 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b395b0 2024-02-09T08:07:51.799 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b38460 2024-02-09T08:07:51.799 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b3a440 2024-02-09T08:07:51.799 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b39310 2024-02-09T08:07:51.799 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b3af50 2024-02-09T08:07:51.799 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b3b9c0 2024-02-09T08:07:51.799 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b3a200 2024-02-09T08:07:51.799 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b3c860 2024-02-09T08:07:51.799 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b3b750 2024-02-09T08:07:51.799 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b3d700 2024-02-09T08:07:51.799 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b3c5e0 2024-02-09T08:07:51.799 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b3e580 2024-02-09T08:07:51.800 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b3d490 2024-02-09T08:07:51.800 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b3f070 2024-02-09T08:07:51.800 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b3fae0 2024-02-09T08:07:51.800 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b3e330 2024-02-09T08:07:51.800 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b40960 2024-02-09T08:07:51.800 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b3f880 2024-02-09T08:07:51.800 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b414f0 2024-02-09T08:07:51.800 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b41f50 2024-02-09T08:07:51.800 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b40700 2024-02-09T08:07:51.800 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b42dc0 2024-02-09T08:07:51.800 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b41d30 2024-02-09T08:07:51.800 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b43c80 2024-02-09T08:07:51.800 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b42ba0 2024-02-09T08:07:51.800 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b44b20 2024-02-09T08:07:51.801 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b439e0 2024-02-09T08:07:51.801 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b459b0 2024-02-09T08:07:51.801 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b448a0 2024-02-09T08:07:51.801 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b46840 2024-02-09T08:07:51.801 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b45760 2024-02-09T08:07:51.801 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b476c0 2024-02-09T08:07:51.801 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b46600 2024-02-09T08:07:51.801 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b48230 2024-02-09T08:07:51.801 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b48ca0 2024-02-09T08:07:51.801 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b47460 2024-02-09T08:07:51.801 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b49b20 2024-02-09T08:07:51.801 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b48a50 2024-02-09T08:07:51.801 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b4a9e0 2024-02-09T08:07:51.801 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b498d0 2024-02-09T08:07:51.801 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b4b880 2024-02-09T08:07:51.801 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b4a740 2024-02-09T08:07:51.802 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b4c720 2024-02-09T08:07:51.802 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b4b5c0 2024-02-09T08:07:51.802 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b4d240 2024-02-09T08:07:51.802 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b4dc60 2024-02-09T08:07:51.802 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b4c460 2024-02-09T08:07:51.802 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b4e7a0 2024-02-09T08:07:51.802 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b4f210 2024-02-09T08:07:52.163 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:07:52.148+0000 ec49640 -1 osd.2 203 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4514.0:11 37.5 37:a557efb1:::obj8:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82) 2024-02-09T08:07:52.181 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:07:52.129+0000 12c51640 -1 osd.3 204 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4695.0:5 72.2 72:41780a1c:::tgt_object:head [call test_remote_reads.test_gather in=233b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e138) 2024-02-09T08:07:52.929 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:07:52.866+0000 ec49640 -1 osd.0 201 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:07:53.468 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:07:53.458+0000 12c51640 -1 osd.3 206 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4695.0:5 72.2 72:41780a1c:::tgt_object:head [call test_remote_reads.test_gather in=233b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e138) 2024-02-09T08:07:53.697 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:07:53.589+0000 ec49640 -1 osd.2 204 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4514.0:11 37.5 37:a557efb1:::obj8:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82) 2024-02-09T08:07:54.542 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:07:54.513+0000 ec49640 -1 osd.0 203 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:07:54.938 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:07:54.927+0000 ec49640 -1 osd.2 205 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4514.0:11 37.5 37:a557efb1:::obj8:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82) 2024-02-09T08:07:55.174 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:07:55.170+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:07:56.258 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:07:56.242+0000 ec49640 -1 osd.2 207 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4514.0:11 37.5 37:a557efb1:::obj8:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82) 2024-02-09T08:07:56.397 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:07:56.384+0000 ec49640 -1 osd.0 204 get_health_metrics reporting 240 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:07:57.286 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:07:57.269+0000 ec49640 -1 osd.2 207 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4514.0:11 37.5 37:a557efb1:::obj8:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82) 2024-02-09T08:07:57.635 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:07:57.555+0000 ec49640 -1 osd.0 205 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:07:58.492 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:07:58.478+0000 ec49640 -1 osd.2 209 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4514.0:11 37.5 37:a557efb1:::obj8:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82) 2024-02-09T08:07:58.713 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:07:58.595+0000 ec49640 -1 osd.0 206 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:07:59.764 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:07:59.754+0000 ec49640 -1 osd.2 210 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4514.0:11 37.5 37:a557efb1:::obj8:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82) 2024-02-09T08:08:00.306 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:08:00.303+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:08:00.435 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:08:00.375+0000 ec49640 -1 osd.0 208 get_health_metrics reporting 248 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:08:00.895 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:08:00.802+0000 ec49640 -1 osd.2 211 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4514.0:11 37.5 37:a557efb1:::obj8:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82) 2024-02-09T08:08:01.779 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:08:01.665+0000 ec49640 -1 osd.0 209 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:08:02.197 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:08:02.188+0000 ec49640 -1 osd.2 212 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4514.0:11 37.5 37:a557efb1:::obj8:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82) 2024-02-09T08:08:02.827 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:08:02.740+0000 ec49640 -1 osd.0 209 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:08:03.367 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:08:03.342+0000 ec49640 -1 osd.2 213 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4514.0:11 37.5 37:a557efb1:::obj8:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82) 2024-02-09T08:08:04.002 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:08:03.871+0000 ec49640 -1 osd.0 210 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:08:04.243 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:08:04.177+0000 12c51640 -1 osd.3 214 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4695.0:5 72.2 72:41780a1c:::tgt_object:head [call test_remote_reads.test_gather in=233b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e138) 2024-02-09T08:08:04.712 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:08:04.626+0000 ec49640 -1 osd.2 214 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4514.0:11 37.5 37:a557efb1:::obj8:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82) 2024-02-09T08:08:05.308 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:08:05.290+0000 12c51640 -1 osd.3 215 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4695.0:5 72.2 72:41780a1c:::tgt_object:head [call test_remote_reads.test_gather in=233b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e138) 2024-02-09T08:08:05.308 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:08:05.246+0000 ec49640 -1 osd.0 211 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:08:05.347 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:08:05.340+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:08:05.454 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:06:14.860 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:08:05.458 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:06:14.864 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:08:05.517 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:06:14.913 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:08:05.518 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:06:14.914 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:08:05.520 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:06:14.927 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:08:05.551 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:06:14.958 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:08:05.589 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:06:14.996 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:08:05.653 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:06:15.049 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:08:05.689 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:06:15.096 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:08:05.793 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:08:05.675+0000 ec49640 -1 osd.2 215 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4514.0:11 37.5 37:a557efb1:::obj8:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82) 2024-02-09T08:08:06.428 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:08:06.329+0000 12c51640 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4695.0:5 72.2 72:41780a1c:::tgt_object:head [call test_remote_reads.test_gather in=233b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e138) 2024-02-09T08:08:06.692 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:08:06.489+0000 ec49640 -1 osd.0 212 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:08:06.791 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:08:06.766+0000 ec49640 -1 osd.2 216 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4514.0:11 37.5 37:a557efb1:::obj8:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82) 2024-02-09T08:08:07.308 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:08:07.297+0000 12c51640 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4695.0:5 72.2 72:41780a1c:::tgt_object:head [call test_remote_reads.test_gather in=233b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e138) 2024-02-09T08:08:07.943 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:08:07.736+0000 ec49640 -1 osd.0 213 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:08:08.069 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:08:08.043+0000 ec49640 -1 osd.2 217 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4514.0:11 37.5 37:a557efb1:::obj8:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82) 2024-02-09T08:08:08.439 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:08:08.385+0000 12c51640 -1 osd.3 217 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4695.0:5 72.2 72:41780a1c:::tgt_object:head [call test_remote_reads.test_gather in=233b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e138) 2024-02-09T08:08:09.130 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:08:09.118+0000 ec49640 -1 osd.2 218 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4514.0:11 37.5 37:a557efb1:::obj8:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82) 2024-02-09T08:08:09.524 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:08:09.509+0000 12c51640 -1 osd.3 218 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4695.0:5 72.2 72:41780a1c:::tgt_object:head [call test_remote_reads.test_gather in=233b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e138) 2024-02-09T08:08:09.629 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:08:09.462+0000 ec49640 -1 osd.0 214 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:08:10.152 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:08:10.136+0000 ec49640 -1 osd.2 219 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4514.0:11 37.5 37:a557efb1:::obj8:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82) 2024-02-09T08:08:10.393 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:08:10.390+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:08:10.582 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:08:10.571+0000 12c51640 -1 osd.3 219 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4695.0:5 72.2 72:41780a1c:::tgt_object:head [call test_remote_reads.test_gather in=233b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e138) 2024-02-09T08:08:10.772 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:08:10.654+0000 ec49640 -1 osd.0 215 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:08:11.184 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:08:11.176+0000 ec49640 -1 osd.2 220 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4514.0:11 37.5 37:a557efb1:::obj8:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82) 2024-02-09T08:08:11.611 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:08:11.600+0000 12c51640 -1 osd.3 220 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4695.0:5 72.2 72:41780a1c:::tgt_object:head [call test_remote_reads.test_gather in=233b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e138) 2024-02-09T08:08:11.970 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:08:11.872+0000 ec49640 -1 osd.0 216 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:08:12.227 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:08:12.220+0000 ec49640 -1 osd.2 220 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4514.0:11 37.5 37:a557efb1:::obj8:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82) 2024-02-09T08:08:12.619 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:08:12.612+0000 12c51640 -1 osd.3 220 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4695.0:5 72.2 72:41780a1c:::tgt_object:head [call test_remote_reads.test_gather in=233b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e138) 2024-02-09T08:08:12.987 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:08:12.970+0000 ec49640 -1 osd.0 217 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:08:13.227 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:08:13.221+0000 ec49640 -1 osd.2 220 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4514.0:11 37.5 37:a557efb1:::obj8:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82) 2024-02-09T08:08:13.640 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:08:13.629+0000 12c51640 -1 osd.3 220 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4695.0:5 72.2 72:41780a1c:::tgt_object:head [call test_remote_reads.test_gather in=233b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e138) 2024-02-09T08:08:14.212 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:08:14.182+0000 ec49640 -1 osd.0 219 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:08:14.249 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:08:14.241+0000 ec49640 -1 osd.2 220 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4514.0:11 37.5 37:a557efb1:::obj8:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82) 2024-02-09T08:08:14.847 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:08:14.784+0000 12c51640 -1 osd.3 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4695.0:5 72.2 72:41780a1c:::tgt_object:head [call test_remote_reads.test_gather in=233b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e138) 2024-02-09T08:08:15.288 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:08:15.280+0000 ec49640 -1 osd.2 221 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4506.0:8 39.3s0 39:c0000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) 2024-02-09T08:08:15.409 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:08:15.403+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:08:15.664 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:08:15.560+0000 ec49640 -1 osd.0 220 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:08:15.829 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:08:15.822+0000 12c51640 -1 osd.3 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4695.0:5 72.2 72:41780a1c:::tgt_object:head [call test_remote_reads.test_gather in=233b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e138) 2024-02-09T08:08:16.296 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:08:16.286+0000 ec49640 -1 osd.2 222 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4514.0:11 37.5 37:a557efb1:::obj8:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82) 2024-02-09T08:08:16.844 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:08:16.832+0000 12c51640 -1 osd.3 222 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4695.0:5 72.2 72:41780a1c:::tgt_object:head [call test_remote_reads.test_gather in=233b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e138) 2024-02-09T08:08:16.935 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:08:16.875+0000 ec49640 -1 osd.0 221 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:08:17.526 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:08:17.514+0000 ec49640 -1 osd.2 222 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4506.0:8 39.3s0 39:c0000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) 2024-02-09T08:08:18.393 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:08:18.269+0000 ec49640 -1 osd.0 222 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:08:18.561 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:08:18.501+0000 ec49640 -1 osd.2 223 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4506.0:8 39.3s0 39:c0000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) 2024-02-09T08:08:19.047 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:08:18.892+0000 ec49640 -1 osd.1 223 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4948.0:7 100.e 100.7366660e (undecoded) ondisk+write+known_if_redirected+returnvec+supports_pool_eio e201) 2024-02-09T08:08:19.600 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:08:19.589+0000 ec49640 -1 osd.2 224 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4514.0:11 37.5 37:a557efb1:::obj8:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82) 2024-02-09T08:08:19.761 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:08:19.684+0000 ec49640 -1 osd.0 223 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:08:20.068 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:08:20.059+0000 12c51640 -1 osd.3 224 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4695.0:5 72.2 72:41780a1c:::tgt_object:head [call test_remote_reads.test_gather in=233b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e138) 2024-02-09T08:08:20.205 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:08:20.038+0000 ec49640 -1 osd.1 224 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4948.0:7 100.e 100:706666ce:::test_0:head [cmpext 0~0 in=4b,write 0~4 in=4b] snapc 0=[] ondisk+write+known_if_redirected+returnvec+supports_pool_eio e201) 2024-02-09T08:08:20.444 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:08:20.441+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:08:21.157 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:08:21.067+0000 ec49640 -1 osd.2 225 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4514.0:11 37.5 37:a557efb1:::obj8:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82) 2024-02-09T08:08:21.240 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:08:21.197+0000 ec49640 -1 osd.0 224 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:08:21.541 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:08:21.389+0000 12c51640 -1 osd.3 226 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4695.0:5 72.2 72:41780a1c:::tgt_object:head [call test_remote_reads.test_gather in=233b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e138) 2024-02-09T08:08:22.279 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:08:22.197+0000 ec49640 -1 osd.2 226 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4514.0:11 37.5 37:a557efb1:::obj8:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82) 2024-02-09T08:08:22.431 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:08:22.424+0000 12c51640 -1 osd.3 226 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4695.0:5 72.2 72:41780a1c:::tgt_object:head [call test_remote_reads.test_gather in=233b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e138) 2024-02-09T08:08:22.432 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:08:22.387+0000 ec49640 -1 osd.0 225 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:08:23.251 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:08:23.240+0000 ec49640 -1 osd.2 226 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4514.0:11 37.5 37:a557efb1:::obj8:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82) 2024-02-09T08:08:23.504 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:08:23.464+0000 ec49640 -1 osd.0 226 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:08:23.791 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:08:23.779+0000 12c51640 -1 osd.3 227 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4695.0:5 72.2 72:41780a1c:::tgt_object:head [call test_remote_reads.test_gather in=233b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e138) 2024-02-09T08:08:24.244 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:08:24.235+0000 ec49640 -1 osd.2 227 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4514.0:11 37.5 37:a557efb1:::obj8:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82) 2024-02-09T08:08:24.793 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:08:24.758+0000 ec49640 -1 osd.0 227 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4597.0:13 38.17 38.b262ca77 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37) 2024-02-09T08:08:25.174 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:08:25.112+0000 12c51640 -1 osd.3 228 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4695.0:5 72.2 72:41780a1c:::tgt_object:head [call test_remote_reads.test_gather in=233b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e138) 2024-02-09T08:08:25.486 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:08:25.482+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:08:25.766 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:08:25.635+0000 ec49640 -1 osd.2 228 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4514.0:11 37.5 37:a557efb1:::obj8:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82) 2024-02-09T08:08:25.812 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:06:35.219 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:08:25.818 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:06:35.223 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:08:25.882 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:06:35.279 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:08:25.885 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:06:35.281 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:08:25.885 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:06:35.291 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:08:25.898 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:06:35.304 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:08:25.898 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:06:35.305 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:08:25.957 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:06:35.353 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:08:26.000 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:06:35.406 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:08:26.127 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:08:26.008+0000 ec49640 -1 osd.0 228 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:08:26.481 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:08:26.461+0000 12c51640 -1 osd.3 229 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4695.0:5 72.2 72:41780a1c:::tgt_object:head [call test_remote_reads.test_gather in=233b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e138) 2024-02-09T08:08:26.981 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:08:26.851+0000 ec49640 -1 osd.2 229 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4514.0:11 37.5 37:a557efb1:::obj8:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82) 2024-02-09T08:08:27.094 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:08:27.083+0000 ec49640 -1 osd.0 228 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4430.0:4 16.1f 16:fdfc0838:test-rados-api-smithi062-41131-3::foo:head [call lock.lock in=60b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) 2024-02-09T08:08:27.642 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:08:27.541+0000 12c51640 -1 osd.3 230 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4695.0:5 72.2 72:41780a1c:::tgt_object:head [call test_remote_reads.test_gather in=233b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e138) 2024-02-09T08:08:28.059 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:08:28.026+0000 ec49640 -1 osd.2 230 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4514.0:11 37.5 37:a557efb1:::obj8:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82) 2024-02-09T08:08:28.461 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc cls: Running main() from gmock_main.cc 2024-02-09T08:08:28.462 INFO:tasks.workunit.client.0.smithi062.stdout: cls: [==========] Running 2 tests from 1 test suite. 2024-02-09T08:08:28.462 INFO:tasks.workunit.client.0.smithi062.stdout: cls: [----------] Global test environment set-up. 2024-02-09T08:08:28.462 INFO:tasks.workunit.client.0.smithi062.stdout: cls: [----------] 2 tests from NeoRadosCls 2024-02-09T08:08:28.462 INFO:tasks.workunit.client.0.smithi062.stdout: cls: [ RUN ] NeoRadosCls.DNE 2024-02-09T08:08:28.462 INFO:tasks.workunit.client.0.smithi062.stdout: cls: [ OK ] NeoRadosCls.DNE (61624 ms) 2024-02-09T08:08:28.462 INFO:tasks.workunit.client.0.smithi062.stdout: cls: [ RUN ] NeoRadosCls.RemoteReads 2024-02-09T08:08:28.462 INFO:tasks.workunit.client.0.smithi062.stdout: cls: [ OK ] NeoRadosCls.RemoteReads (196844 ms) 2024-02-09T08:08:28.462 INFO:tasks.workunit.client.0.smithi062.stdout: cls: [----------] 2 tests from NeoRadosCls (258468 ms total) 2024-02-09T08:08:28.462 INFO:tasks.workunit.client.0.smithi062.stdout: cls: 2024-02-09T08:08:28.462 INFO:tasks.workunit.client.0.smithi062.stdout: cls: [----------] Global test environment tear-down 2024-02-09T08:08:28.462 INFO:tasks.workunit.client.0.smithi062.stdout: cls: [==========] 2 tests from 1 test suite ran. (258468 ms total) 2024-02-09T08:08:28.463 INFO:tasks.workunit.client.0.smithi062.stdout: cls: [ PASSED ] 2 tests. 2024-02-09T08:08:29.015 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:08:29.006+0000 ec49640 -1 osd.2 230 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4514.0:11 37.5 37:a557efb1:::obj8:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82) 2024-02-09T08:08:30.110 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:08:30.101+0000 ec49640 -1 osd.2 231 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4514.0:11 37.5 37:a557efb1:::obj8:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82) 2024-02-09T08:08:30.242 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:08:30.154+0000 ec49640 -1 osd.0 230 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4597.0:12 38.17 38:ee53464d:::PoolCreationRaceObj:head [read 0~100] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e128) 2024-02-09T08:08:30.503 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:08:30.496+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:08:31.243 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:08:31.216+0000 ec49640 -1 osd.0 231 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4597.0:12 38.17 38:ee53464d:::PoolCreationRaceObj:head [read 0~100] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e128) 2024-02-09T08:08:32.368 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:08:32.323+0000 ec49640 -1 osd.0 231 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4597.0:12 38.17 38:ee53464d:::PoolCreationRaceObj:head [read 0~100] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e128) 2024-02-09T08:08:32.711 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:08:32.685+0000 ec49640 -1 osd.2 231 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4514.0:11 37.5 37:a557efb1:::obj8:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82) 2024-02-09T08:08:32.887 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: Running main() from gmock_main.cc 2024-02-09T08:08:32.887 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [==========] Running 37 tests from 2 test suites. 2024-02-09T08:08:32.887 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [----------] Global test environment set-up. 2024-02-09T08:08:32.887 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [----------] 20 tests from LibRadosIoPP 2024-02-09T08:08:32.887 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: seed 40943 2024-02-09T08:08:32.887 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TooBigPP 2024-02-09T08:08:32.887 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoPP.TooBigPP (0 ms) 2024-02-09T08:08:32.888 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SimpleWritePP 2024-02-09T08:08:32.888 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoPP.SimpleWritePP (75992 ms) 2024-02-09T08:08:32.888 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadOpPP 2024-02-09T08:08:32.888 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadOpPP (18981 ms) 2024-02-09T08:08:32.888 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SparseReadOpPP 2024-02-09T08:08:32.888 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoPP.SparseReadOpPP (5904 ms) 2024-02-09T08:08:32.888 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP 2024-02-09T08:08:32.888 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP (17346 ms) 2024-02-09T08:08:32.888 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP2 2024-02-09T08:08:32.888 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP2 (2085 ms) 2024-02-09T08:08:32.888 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoPP.Checksum 2024-02-09T08:08:32.888 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoPP.Checksum (4098 ms) 2024-02-09T08:08:32.888 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadIntoBufferlist 2024-02-09T08:08:32.888 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadIntoBufferlist (12679 ms) 2024-02-09T08:08:32.888 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoPP.OverlappingWriteRoundTripPP 2024-02-09T08:08:32.889 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoPP.OverlappingWriteRoundTripPP (11164 ms) 2024-02-09T08:08:32.889 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP 2024-02-09T08:08:32.889 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP (8410 ms) 2024-02-09T08:08:32.889 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP2 2024-02-09T08:08:32.889 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP2 (3290 ms) 2024-02-09T08:08:32.889 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoPP.AppendRoundTripPP 2024-02-09T08:08:32.889 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoPP.AppendRoundTripPP (2731 ms) 2024-02-09T08:08:32.889 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TruncTestPP 2024-02-09T08:08:32.889 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoPP.TruncTestPP (5455 ms) 2024-02-09T08:08:32.889 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RemoveTestPP 2024-02-09T08:08:32.889 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoPP.RemoveTestPP (78 ms) 2024-02-09T08:08:32.889 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrsRoundTripPP 2024-02-09T08:08:32.889 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrsRoundTripPP (3474 ms) 2024-02-09T08:08:32.889 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RmXattrPP 2024-02-09T08:08:32.890 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoPP.RmXattrPP (22179 ms) 2024-02-09T08:08:32.890 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrListPP 2024-02-09T08:08:32.890 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrListPP (30320 ms) 2024-02-09T08:08:32.890 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtPP 2024-02-09T08:08:32.890 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtPP (2217 ms) 2024-02-09T08:08:32.890 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtDNEPP 2024-02-09T08:08:32.890 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtDNEPP (661 ms) 2024-02-09T08:08:32.890 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtMismatchPP 2024-02-09T08:08:32.890 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtMismatchPP (129 ms) 2024-02-09T08:08:32.890 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [----------] 20 tests from LibRadosIoPP (227193 ms total) 2024-02-09T08:08:32.890 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: 2024-02-09T08:08:32.890 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [----------] 17 tests from LibRadosIoECPP 2024-02-09T08:08:32.890 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SimpleWritePP 2024-02-09T08:08:32.890 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SimpleWritePP (10731 ms) 2024-02-09T08:08:32.891 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.ReadOpPP 2024-02-09T08:08:32.891 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoECPP.ReadOpPP (6154 ms) 2024-02-09T08:08:32.891 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SparseReadOpPP 2024-02-09T08:08:32.891 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SparseReadOpPP (6603 ms) 2024-02-09T08:08:32.891 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP 2024-02-09T08:08:32.891 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP (3736 ms) 2024-02-09T08:08:32.891 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP2 2024-02-09T08:08:34.148 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:08:34.117+0000 ec49640 -1 osd.2 233 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4852.0:21 79.b 79.2fc1dc8b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e148) 2024-02-09T08:08:34.392 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:08:34.378+0000 ec49640 -1 osd.0 233 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4597.0:12 38.17 38:ee53464d:::PoolCreationRaceObj:head [read 0~100] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e128) 2024-02-09T08:08:35.104 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:08:35.094+0000 ec49640 -1 osd.2 234 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4897.0:3 89.0 89.71d521c0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e149) 2024-02-09T08:08:35.427 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:08:35.419+0000 ec49640 -1 osd.0 234 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4597.0:12 38.17 38:ee53464d:::PoolCreationRaceObj:head [read 0~100] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e128) 2024-02-09T08:08:35.544 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:08:35.540+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:08:36.133 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:08:36.121+0000 ec49640 -1 osd.2 235 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4897.0:3 89.0 89.71d521c0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e149) 2024-02-09T08:08:36.564 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:08:36.552+0000 ec49640 -1 osd.0 234 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4597.0:12 38.17 38:ee53464d:::PoolCreationRaceObj:head [read 0~100] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e128) 2024-02-09T08:08:37.331 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:08:37.249+0000 ec49640 -1 osd.2 236 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4897.0:3 89.0 89.71d521c0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e149) 2024-02-09T08:08:37.791 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:08:37.684+0000 ec49640 -1 osd.0 234 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4597.0:12 38.17 38:ee53464d:::PoolCreationRaceObj:head [read 0~100] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e128) 2024-02-09T08:08:38.505 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:08:38.494+0000 ec49640 -1 osd.2 237 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4897.0:3 89.0 89.71d521c0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e149) 2024-02-09T08:08:39.523 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:08:39.504+0000 ec49640 -1 osd.2 238 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4897.0:3 89.0 89.71d521c0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e149) 2024-02-09T08:08:40.053 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:08:39.979+0000 ec49640 -1 osd.0 234 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4930.0:2 96.1b 96.780569b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e176) 2024-02-09T08:08:40.583 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:08:40.567+0000 ec49640 -1 osd.2 238 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4897.0:3 89.0 89.71d521c0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e149) 2024-02-09T08:08:40.599 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:08:40.594+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:08:40.804 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRad: started 0x560a26b4d9e0 2024-02-09T08:08:40.804 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b50090 2024-02-09T08:08:40.804 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b4ef50 2024-02-09T08:08:40.804 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b50f30 2024-02-09T08:08:40.804 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b4fe40 2024-02-09T08:08:40.805 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b51dd0 2024-02-09T08:08:40.805 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b50cc0 2024-02-09T08:08:40.805 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b52c50 2024-02-09T08:08:40.805 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b51b80 2024-02-09T08:08:40.805 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b53b10 2024-02-09T08:08:40.805 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b52a00 2024-02-09T08:08:40.805 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b549b0 2024-02-09T08:08:40.805 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b53880 2024-02-09T08:08:40.805 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b55850 2024-02-09T08:08:40.805 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b54730 2024-02-09T08:08:40.805 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b566f0 2024-02-09T08:08:40.805 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b555d0 2024-02-09T08:08:40.805 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b57540 2024-02-09T08:08:40.805 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b56490 2024-02-09T08:08:40.805 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b580d0 2024-02-09T08:08:40.806 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b58b40 2024-02-09T08:08:40.806 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b57310 2024-02-09T08:08:40.806 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b599c0 2024-02-09T08:08:40.806 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b588f0 2024-02-09T08:08:40.806 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b5a880 2024-02-09T08:08:40.806 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b59770 2024-02-09T08:08:40.806 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b5b720 2024-02-09T08:08:40.806 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b5a5e0 2024-02-09T08:08:40.806 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b5c5c0 2024-02-09T08:08:40.806 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b5b4a0 2024-02-09T08:08:40.806 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b5d460 2024-02-09T08:08:40.806 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b5c350 2024-02-09T08:08:40.806 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b5e2d0 2024-02-09T08:08:40.806 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b5d200 2024-02-09T08:08:40.807 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b5ee60 2024-02-09T08:08:40.807 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b5f8d0 2024-02-09T08:08:40.807 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b5e080 2024-02-09T08:08:40.807 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b603c0 2024-02-09T08:08:40.807 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b60d70 2024-02-09T08:08:40.807 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b5f670 2024-02-09T08:08:40.807 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b61890 2024-02-09T08:08:40.807 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b622e0 2024-02-09T08:08:40.807 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b60b40 2024-02-09T08:08:40.807 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b62e20 2024-02-09T08:08:40.807 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b638e0 2024-02-09T08:08:40.807 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b62080 2024-02-09T08:08:40.808 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b647a0 2024-02-09T08:08:40.808 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b63610 2024-02-09T08:08:40.808 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b65620 2024-02-09T08:08:40.808 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x560a26b64550 2024-02-09T08:08:40.808 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 265 aios 2024-02-09T08:08:40.808 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26a7dff0 2024-02-09T08:08:40.808 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a2678e790 2024-02-09T08:08:40.808 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a27476aa0 2024-02-09T08:08:40.808 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b13f50 2024-02-09T08:08:40.808 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b1d360 2024-02-09T08:08:40.808 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b1de50 2024-02-09T08:08:40.808 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b1e920 2024-02-09T08:08:40.808 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b1f440 2024-02-09T08:08:40.808 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b1ff30 2024-02-09T08:08:40.809 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b20990 2024-02-09T08:08:40.809 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b1fcf0 2024-02-09T08:08:40.809 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b21870 2024-02-09T08:08:40.809 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b206b0 2024-02-09T08:08:40.809 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a268df700 2024-02-09T08:08:40.809 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a268e0160 2024-02-09T08:08:40.809 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b21640 2024-02-09T08:08:40.809 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a268e1020 2024-02-09T08:08:40.809 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a268dfe80 2024-02-09T08:08:40.809 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a268e1e90 2024-02-09T08:08:40.809 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a268e0dd0 2024-02-09T08:08:40.809 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a268e2d50 2024-02-09T08:08:40.809 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a268e34a0 2024-02-09T08:08:40.809 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a268e1c00 2024-02-09T08:08:40.810 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a268ec460 2024-02-09T08:08:40.810 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a268ece60 2024-02-09T08:08:40.810 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a268e2ab0 2024-02-09T08:08:40.810 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a268edcb0 2024-02-09T08:08:40.810 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a268ecc20 2024-02-09T08:08:40.810 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a268eeb50 2024-02-09T08:08:40.810 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a268edae0 2024-02-09T08:08:40.810 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a268efa60 2024-02-09T08:08:40.982 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a268ee8d0 2024-02-09T08:08:40.982 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a268f08e0 2024-02-09T08:08:40.982 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a268ef810 2024-02-09T08:08:40.982 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a268f17a0 2024-02-09T08:08:40.982 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a268f06b0 2024-02-09T08:08:40.982 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a268f2660 2024-02-09T08:08:40.982 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a268f1510 2024-02-09T08:08:40.982 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a268f34e0 2024-02-09T08:08:40.982 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a268f22f0 2024-02-09T08:08:40.982 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a268f24a0 2024-02-09T08:08:40.982 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a268f48c0 2024-02-09T08:08:40.983 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a268f32f0 2024-02-09T08:08:40.983 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a268f5810 2024-02-09T08:08:40.983 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a268f46a0 2024-02-09T08:08:40.983 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a268f6740 2024-02-09T08:08:40.983 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a268f55e0 2024-02-09T08:08:40.983 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a268f7630 2024-02-09T08:08:40.983 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a268f64f0 2024-02-09T08:08:40.983 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a268f8560 2024-02-09T08:08:40.983 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a268f73f0 2024-02-09T08:08:40.983 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a268f93f0 2024-02-09T08:08:40.983 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a268f8290 2024-02-09T08:08:40.983 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a268f9f80 2024-02-09T08:08:40.983 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a268faa40 2024-02-09T08:08:40.983 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a268f91f0 2024-02-09T08:08:40.983 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a268fb900 2024-02-09T08:08:40.984 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a268fa780 2024-02-09T08:08:40.984 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a268fc780 2024-02-09T08:08:40.984 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a268fc910 2024-02-09T08:08:40.984 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a268fb6d0 2024-02-09T08:08:40.984 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b230e0 2024-02-09T08:08:40.984 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a268fc500 2024-02-09T08:08:40.984 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b23f30 2024-02-09T08:08:40.984 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b22e30 2024-02-09T08:08:40.984 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b24dd0 2024-02-09T08:08:40.984 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b23d20 2024-02-09T08:08:40.984 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a2690e850 2024-02-09T08:08:40.984 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a2690f270 2024-02-09T08:08:40.984 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b24b60 2024-02-09T08:08:40.984 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26910100 2024-02-09T08:08:40.984 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a2690f090 2024-02-09T08:08:40.985 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26910ff0 2024-02-09T08:08:40.985 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a2690fee0 2024-02-09T08:08:40.985 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26911eb0 2024-02-09T08:08:40.985 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26910dc0 2024-02-09T08:08:40.985 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26912d70 2024-02-09T08:08:40.985 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26911c20 2024-02-09T08:08:40.985 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26913c10 2024-02-09T08:08:40.985 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26912b20 2024-02-09T08:08:40.985 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26914ad0 2024-02-09T08:08:40.985 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26913990 2024-02-09T08:08:40.985 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26915950 2024-02-09T08:08:40.985 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26914860 2024-02-09T08:08:40.985 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26916490 2024-02-09T08:08:40.985 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26916ec0 2024-02-09T08:08:40.986 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26915790 2024-02-09T08:08:40.986 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26917dd0 2024-02-09T08:08:40.986 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26916c20 2024-02-09T08:08:40.986 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26918c50 2024-02-09T08:08:40.986 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26917bf0 2024-02-09T08:08:40.986 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26919b80 2024-02-09T08:08:40.986 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a269189e0 2024-02-09T08:08:40.986 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a2691aa20 2024-02-09T08:08:40.986 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26919880 2024-02-09T08:08:40.986 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a2691b510 2024-02-09T08:08:40.986 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a2691bf30 2024-02-09T08:08:40.986 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a2691a7f0 2024-02-09T08:08:40.986 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a2691ce40 2024-02-09T08:08:40.986 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a2691bd00 2024-02-09T08:08:40.986 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a2691dd70 2024-02-09T08:08:40.987 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a2691cb90 2024-02-09T08:08:40.987 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a2691da00 2024-02-09T08:08:40.987 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a2691dbb0 2024-02-09T08:08:40.987 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b267b0 2024-02-09T08:08:40.987 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b27220 2024-02-09T08:08:40.987 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a2691e530 2024-02-09T08:08:40.987 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b280c0 2024-02-09T08:08:40.987 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b26ff0 2024-02-09T08:08:40.987 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b28fd0 2024-02-09T08:08:40.987 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b27de0 2024-02-09T08:08:40.987 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b27ef0 2024-02-09T08:08:40.987 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26a70ba0 2024-02-09T08:08:41.758 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:08:41.659+0000 ec49640 -1 osd.2 240 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4897.0:3 89.0 89:0384ab8e:::oid:head [write 0~128 in=128b] snapc 2=[2] ondisk+write+known_if_redirected+supports_pool_eio e149) 2024-02-09T08:08:43.306 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:08:43.232+0000 ec49640 -1 osd.2 242 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4852.0:21 79.b 79.2fc1dc8b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e148) 2024-02-09T08:08:45.419 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:08:45.407+0000 ec49640 -1 osd.2 243 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4852.0:21 79.b 79.2fc1dc8b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e148) 2024-02-09T08:08:45.648 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:08:45.645+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:08:45.939 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:06:55.345 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:08:45.946 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:06:55.352 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:08:46.008 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:06:55.405 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:08:46.027 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:06:55.424 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:08:46.031 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:06:55.438 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:08:46.033 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:06:55.440 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:08:46.103 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:06:55.499 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:08:46.142 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:06:55.548 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:08:46.239 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:06:55.646 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:08:46.675 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:08:46.493+0000 ec49640 -1 osd.2 244 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4852.0:21 79.b 79:d13b83f4:test-rados-api-smithi062-41231-9::foo:head [write 0~128 in=128b] snapc 6=[6] ondisk+write+known_if_redirected+supports_pool_eio e148) 2024-02-09T08:08:47.548 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:08:47.521+0000 ec49640 -1 osd.2 245 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4852.0:21 79.b 79:d13b83f4:test-rados-api-smithi062-41231-9::foo:head [write 0~128 in=128b] snapc 6=[6] ondisk+write+known_if_redirected+supports_pool_eio e148) 2024-02-09T08:08:48.906 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:08:48.859+0000 ec49640 -1 osd.2 246 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4852.0:21 79.b 79:d13b83f4:test-rados-api-smithi062-41231-9::foo:head [write 0~128 in=128b] snapc 6=[6] ondisk+write+known_if_redirected+supports_pool_eio e148) 2024-02-09T08:08:50.688 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:08:50.685+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:08:52.920 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26a70cd0 2024-02-09T08:08:52.921 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26a70e20 2024-02-09T08:08:52.921 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b15440 2024-02-09T08:08:52.921 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b15e60 2024-02-09T08:08:52.921 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b28d10 2024-02-09T08:08:52.921 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b169a0 2024-02-09T08:08:52.921 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b17440 2024-02-09T08:08:52.921 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b15c00 2024-02-09T08:08:52.921 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b182b0 2024-02-09T08:08:52.921 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b17240 2024-02-09T08:08:52.921 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b19230 2024-02-09T08:08:52.921 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b180d0 2024-02-09T08:08:52.922 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b1a110 2024-02-09T08:08:52.922 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b18f40 2024-02-09T08:08:52.922 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b19da0 2024-02-09T08:08:52.922 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b2a400 2024-02-09T08:08:52.922 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b13a10 2024-02-09T08:08:52.922 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b1ab30 2024-02-09T08:08:52.922 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b1b5f0 2024-02-09T08:08:52.922 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b1c0e0 2024-02-09T08:08:52.922 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b2b2a0 2024-02-09T08:08:52.922 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b2bca0 2024-02-09T08:08:52.922 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b2c6a0 2024-02-09T08:08:52.922 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b2ccf0 2024-02-09T08:08:52.922 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b1a2c0 2024-02-09T08:08:52.922 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b1a4f0 2024-02-09T08:08:52.923 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b2c440 2024-02-09T08:08:52.923 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b2b960 2024-02-09T08:08:52.923 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b2aef0 2024-02-09T08:08:52.923 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b2b130 2024-02-09T08:08:52.923 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b1bef0 2024-02-09T08:08:52.923 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b1b2f0 2024-02-09T08:08:52.923 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b2f880 2024-02-09T08:08:52.923 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b30330 2024-02-09T08:08:52.923 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b13cb0 2024-02-09T08:08:52.924 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b311d0 2024-02-09T08:08:52.924 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b300c0 2024-02-09T08:08:52.924 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b32080 2024-02-09T08:08:52.924 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b30f50 2024-02-09T08:08:52.924 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b32f00 2024-02-09T08:08:52.924 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b31e60 2024-02-09T08:08:52.924 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b33dc0 2024-02-09T08:08:52.924 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b32cc0 2024-02-09T08:08:52.924 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b34c60 2024-02-09T08:08:52.924 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b33b30 2024-02-09T08:08:52.924 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b35b00 2024-02-09T08:08:52.924 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b34a00 2024-02-09T08:08:52.924 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b369c0 2024-02-09T08:08:52.925 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b35890 2024-02-09T08:08:52.925 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b37840 2024-02-09T08:08:52.925 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b36770 2024-02-09T08:08:52.925 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b38700 2024-02-09T08:08:52.925 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b37610 2024-02-09T08:08:52.925 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b395b0 2024-02-09T08:08:52.925 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b38460 2024-02-09T08:08:52.925 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b3a440 2024-02-09T08:08:52.925 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b39310 2024-02-09T08:08:52.925 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b3af50 2024-02-09T08:08:52.925 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b3b9c0 2024-02-09T08:08:52.925 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b3a200 2024-02-09T08:08:52.925 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b3c860 2024-02-09T08:08:52.925 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b3b750 2024-02-09T08:08:52.926 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b3d700 2024-02-09T08:08:52.926 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b3c5e0 2024-02-09T08:08:52.926 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b3e580 2024-02-09T08:08:52.926 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b3d490 2024-02-09T08:08:52.926 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b3f070 2024-02-09T08:08:52.926 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b3fae0 2024-02-09T08:08:52.926 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b3e330 2024-02-09T08:08:52.926 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b40960 2024-02-09T08:08:52.926 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b3f880 2024-02-09T08:08:52.926 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b414f0 2024-02-09T08:08:52.926 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b41f50 2024-02-09T08:08:52.926 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b40700 2024-02-09T08:08:52.926 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b42dc0 2024-02-09T08:08:52.927 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b41d30 2024-02-09T08:08:52.927 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b43c80 2024-02-09T08:08:52.927 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b42ba0 2024-02-09T08:08:52.927 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b44b20 2024-02-09T08:08:52.927 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b439e0 2024-02-09T08:08:52.927 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b459b0 2024-02-09T08:08:52.927 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b448a0 2024-02-09T08:08:55.784 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:08:55.778+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:09:00.794 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:09:00.788+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:09:05.810 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:09:05.807+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:09:05.891 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:07:15.297 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:09:05.894 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:07:15.301 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:09:05.964 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:07:15.361 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:09:05.974 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:07:15.381 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:09:05.979 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:07:15.385 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:09:05.985 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:07:15.391 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:09:06.003 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:07:15.400 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:09:06.070 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:07:15.477 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:09:06.092 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:07:15.488 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:09:08.892 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b46840 2024-02-09T08:09:08.892 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b45760 2024-02-09T08:09:08.892 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b476c0 2024-02-09T08:09:08.892 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b46600 2024-02-09T08:09:08.892 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b48230 2024-02-09T08:09:08.893 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b48ca0 2024-02-09T08:09:08.893 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b47460 2024-02-09T08:09:08.893 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b49b20 2024-02-09T08:09:08.893 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b48a50 2024-02-09T08:09:08.893 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b4a9e0 2024-02-09T08:09:08.893 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b498d0 2024-02-09T08:09:08.893 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b4b880 2024-02-09T08:09:08.893 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b4a740 2024-02-09T08:09:08.893 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b4c720 2024-02-09T08:09:08.893 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b4b5c0 2024-02-09T08:09:08.893 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b4d240 2024-02-09T08:09:08.893 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b4dc60 2024-02-09T08:09:08.893 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b4c460 2024-02-09T08:09:08.893 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b4e7a0 2024-02-09T08:09:08.894 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b4f210 2024-02-09T08:09:08.894 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b4d9e0 2024-02-09T08:09:08.894 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b50090 2024-02-09T08:09:08.894 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b4ef50 2024-02-09T08:09:08.894 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b50f30 2024-02-09T08:09:08.894 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b4fe40 2024-02-09T08:09:08.894 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b51dd0 2024-02-09T08:09:08.894 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b50cc0 2024-02-09T08:09:08.894 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b52c50 2024-02-09T08:09:08.894 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b51b80 2024-02-09T08:09:08.894 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b53b10 2024-02-09T08:09:08.894 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b52a00 2024-02-09T08:09:08.894 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b549b0 2024-02-09T08:09:08.894 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b53880 2024-02-09T08:09:08.894 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b55850 2024-02-09T08:09:08.895 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b54730 2024-02-09T08:09:08.895 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b566f0 2024-02-09T08:09:08.895 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b555d0 2024-02-09T08:09:08.895 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b57540 2024-02-09T08:09:08.895 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b56490 2024-02-09T08:09:08.895 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b580d0 2024-02-09T08:09:08.895 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b58b40 2024-02-09T08:09:08.895 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b57310 2024-02-09T08:09:08.895 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b599c0 2024-02-09T08:09:08.895 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b588f0 2024-02-09T08:09:08.895 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b5a880 2024-02-09T08:09:08.895 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b59770 2024-02-09T08:09:08.895 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b5b720 2024-02-09T08:09:08.895 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b5a5e0 2024-02-09T08:09:08.896 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b5c5c0 2024-02-09T08:09:08.896 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b5b4a0 2024-02-09T08:09:08.896 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b5d460 2024-02-09T08:09:08.896 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b5c350 2024-02-09T08:09:08.896 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b5e2d0 2024-02-09T08:09:08.896 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b5d200 2024-02-09T08:09:08.896 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b5ee60 2024-02-09T08:09:08.896 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b5f8d0 2024-02-09T08:09:08.896 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b5e080 2024-02-09T08:09:08.896 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b603c0 2024-02-09T08:09:08.896 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b60d70 2024-02-09T08:09:08.896 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b5f670 2024-02-09T08:09:08.896 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b61890 2024-02-09T08:09:08.896 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b622e0 2024-02-09T08:09:08.897 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b60b40 2024-02-09T08:09:08.897 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b62e20 2024-02-09T08:09:08.897 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b638e0 2024-02-09T08:09:08.897 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b62080 2024-02-09T08:09:08.897 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b647a0 2024-02-09T08:09:08.897 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b63610 2024-02-09T08:09:08.897 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b65620 2024-02-09T08:09:08.897 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x560a26b64550 2024-02-09T08:09:08.897 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: done. 2024-02-09T08:09:08.897 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [ OK ] LibRadosMiscPool.PoolCreationRace (284029 ms) 2024-02-09T08:09:08.897 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [----------] 1 test from LibRadosMiscPool (284029 ms total) 2024-02-09T08:09:08.897 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: 2024-02-09T08:09:08.898 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [----------] 8 tests from LibRadosMisc 2024-02-09T08:09:08.898 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [ RUN ] LibRadosMisc.ClusterFSID 2024-02-09T08:09:08.898 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [ OK ] LibRadosMisc.ClusterFSID (0 ms) 2024-02-09T08:09:08.898 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [ RUN ] LibRadosMisc.Exec 2024-02-09T08:09:08.898 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [ OK ] LibRadosMisc.Exec (10749 ms) 2024-02-09T08:09:10.903 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:09:10.898+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:09:15.936 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:09:15.915+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:09:19.270 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:07:28.676 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:09:19.284 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:07:28.691 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:09:19.341 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:07:28.738 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:09:19.343 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:07:28.739 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:09:19.379 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:07:28.785 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:09:19.396 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:07:28.802 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:09:19.402 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:07:28.808 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:09:19.411 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:07:28.807 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:09:19.499 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:07:28.905 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:09:20.949 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:09:20.944+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:09:21.312 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:09:21.200+0000 ec49640 -1 osd.0 264 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4960.0:5 103.0s0 103:1165fbcf:ns1::foo4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e247) 2024-02-09T08:09:25.992 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:09:25.988+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:09:26.283 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:07:35.689 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:09:26.287 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:07:35.694 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:09:26.345 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:07:35.742 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:09:26.348 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:07:35.755 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:09:26.349 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:07:35.746 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:09:26.352 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:07:35.758 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:09:26.353 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:07:35.760 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:09:26.384 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:07:35.781 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:09:26.389 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:07:35.796 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:09:31.130 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:09:31.127+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:09:33.341 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [ RUN ] LibRadosMi api_watch_notify_pp: Running main() from gmock_main.cc 2024-02-09T08:09:33.341 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [==========] Running 16 tests from 2 test suites. 2024-02-09T08:09:33.342 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [----------] Global test environment set-up. 2024-02-09T08:09:33.342 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP 2024-02-09T08:09:33.342 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotify 2024-02-09T08:09:33.342 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: notify 2024-02-09T08:09:33.342 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotify (82349 ms) 2024-02-09T08:09:33.342 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2024-02-09T08:09:33.342 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotifyTimeout (86931 ms) 2024-02-09T08:09:33.342 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP (169280 ms total) 2024-02-09T08:09:33.342 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: 2024-02-09T08:09:33.342 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP 2024-02-09T08:09:33.342 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 2024-02-09T08:09:33.342 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: notify 2024-02-09T08:09:33.342 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 (51981 ms) 2024-02-09T08:09:33.342 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 2024-02-09T08:09:33.343 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: notify 2024-02-09T08:09:33.343 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: notify 2024-02-09T08:09:33.343 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 (7912 ms) 2024-02-09T08:09:33.343 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 2024-02-09T08:09:33.343 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 (117 ms) 2024-02-09T08:09:33.343 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 2024-02-09T08:09:33.343 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 (129 ms) 2024-02-09T08:09:33.343 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 2024-02-09T08:09:33.343 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: handle_notify cookie 94097242158400 notify_id 974957576192 notifier_gid 4793 2024-02-09T08:09:33.343 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 (13487 ms) 2024-02-09T08:09:33.343 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 2024-02-09T08:09:33.343 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: handle_notify cookie 94097242167760 notify_id 987842478082 notifier_gid 4793 2024-02-09T08:09:33.343 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 (4397 ms) 2024-02-09T08:09:33.343 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 2024-02-09T08:09:33.344 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: handle_notify cookie 94097242167760 notify_id 1056561954819 notifier_gid 4793 2024-02-09T08:09:33.344 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 (19078 ms) 2024-02-09T08:09:33.344 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 2024-02-09T08:09:33.344 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: handle_notify cookie 94097242179792 notify_id 1129576398852 notifier_gid 4793 2024-02-09T08:09:33.344 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 (21308 ms) 2024-02-09T08:09:33.344 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 2024-02-09T08:09:33.344 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: handle_notify cookie 94097242167760 notify_id 1168231104515 notifier_gid 4793 2024-02-09T08:09:33.344 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 (10241 ms) 2024-02-09T08:09:33.344 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 2024-02-09T08:09:33.344 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: handle_notify cookie 94097242167760 notify_id 1189705940996 notifier_gid 4793 2024-02-09T08:09:33.344 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 (4651 ms) 2024-02-09T08:09:33.344 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 2024-02-09T08:09:33.344 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: trying... 2024-02-09T08:09:33.344 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: handle_notify cookie 94097242183696 notify_id 1224065679361 notifier_gid 4793 2024-02-09T08:09:33.711 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify api_stat: Running main() from gmock_main.cc 2024-02-09T08:09:33.711 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [==========] Running 9 tests from 2 test suites. 2024-02-09T08:09:33.711 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [----------] Global test environment set-up. 2024-02-09T08:09:33.711 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [----------] 5 tests from LibRadosStat 2024-02-09T08:09:33.711 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [ RUN ] LibRadosStat.Stat 2024-02-09T08:09:33.711 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [ OK ] LibRadosStat.Stat (114745 ms) 2024-02-09T08:09:33.711 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [ RUN ] LibRadosStat.Stat2 2024-02-09T08:09:33.711 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [ OK ] LibRadosStat.Stat2 (6404 ms) 2024-02-09T08:09:33.711 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [ RUN ] LibRadosStat.StatNS 2024-02-09T08:09:33.711 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [ OK ] LibRadosStat.StatNS (162785 ms) 2024-02-09T08:09:33.711 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [ RUN ] LibRadosStat.ClusterStat 2024-02-09T08:09:33.711 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [ OK ] LibRadosStat.ClusterStat (3 ms) 2024-02-09T08:09:33.712 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [ RUN ] LibRadosStat.PoolStat 2024-02-09T08:09:33.712 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [ OK ] LibRadosStat.PoolStat (1417 ms) 2024-02-09T08:09:33.712 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [----------] 5 tests from LibRadosStat (285354 ms total) 2024-02-09T08:09:33.712 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: 2024-02-09T08:09:33.712 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [----------] 4 tests from LibRadosStatEC 2024-02-09T08:09:33.712 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [ RUN ] LibRadosStatEC.Stat 2024-02-09T08:09:33.712 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [ OK ] LibRadosStatEC.Stat (11098 ms) 2024-02-09T08:09:33.712 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [ RUN ] LibRadosStatEC.StatNS 2024-02-09T08:09:33.712 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [ OK ] LibRadosStatEC.StatNS (13547 ms) 2024-02-09T08:09:33.712 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [ RUN ] LibRadosStatEC.ClusterStat 2024-02-09T08:09:33.712 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [ OK ] LibRadosStatEC.ClusterStat (103 ms) 2024-02-09T08:09:33.712 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [ RUN ] LibRadosStatEC.PoolStat 2024-02-09T08:09:33.712 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [ OK ] LibRadosStatEC.PoolStat (1495 ms) 2024-02-09T08:09:33.713 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [----------] 4 tests from LibRadosStatEC (26243 ms total) 2024-02-09T08:09:33.713 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: 2024-02-09T08:09:33.713 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [----------] Global test environment tear-down 2024-02-09T08:09:33.713 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [==========] 9 tests from 2 test suites ran. (323928 ms total) 2024-02-09T08:09:33.713 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [ PASSED ] 9 tests. 2024-02-09T08:09:36.284 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:09:36.281+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:09:41.367 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:09:41.364+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:09:46.393 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:09:46.390+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:09:46.459 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:07:55.866 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:09:46.468 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:07:55.874 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:09:46.526 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:07:55.932 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:09:46.531 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:07:55.937 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:09:46.549 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:07:55.945 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:09:46.551 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:07:55.948 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:09:46.606 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:07:56.012 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:09:46.621 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:07:56.028 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:09:46.655 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:07:56.051 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:09:51.411 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:09:51.408+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:09:51.605 INFO:tasks.workunit.client.0.smithi062.stdout: ec_io: Running main() from gmock_main.cc 2024-02-09T08:09:51.605 INFO:tasks.workunit.client.0.smithi062.stdout: ec_io: [==========] Running 2 tests from 1 test suite. 2024-02-09T08:09:51.605 INFO:tasks.workunit.client.0.smithi062.stdout: ec_io: [----------] Global test environment set-up. 2024-02-09T08:09:51.605 INFO:tasks.workunit.client.0.smithi062.stdout: ec_io: [----------] 2 tests from NeoRadosECIo 2024-02-09T08:09:51.605 INFO:tasks.workunit.client.0.smithi062.stdout: ec_io: [ RUN ] NeoRadosECIo.SimpleWrite 2024-02-09T08:09:51.605 INFO:tasks.workunit.client.0.smithi062.stdout: ec_io: [ OK ] NeoRadosECIo.SimpleWrite (11168 ms) 2024-02-09T08:09:51.605 INFO:tasks.workunit.client.0.smithi062.stdout: ec_io: [ RUN ] NeoRadosECIo.ReadOp 2024-02-09T08:09:51.605 INFO:tasks.workunit.client.0.smithi062.stdout: ec_io: [ OK ] NeoRadosECIo.ReadOp (330393 ms) 2024-02-09T08:09:51.605 INFO:tasks.workunit.client.0.smithi062.stdout: ec_io: [----------] 2 tests from NeoRadosECIo (341561 ms total) 2024-02-09T08:09:51.606 INFO:tasks.workunit.client.0.smithi062.stdout: ec_io: 2024-02-09T08:09:51.606 INFO:tasks.workunit.client.0.smithi062.stdout: ec_io: [----------] Global test environment tear-down 2024-02-09T08:09:51.606 INFO:tasks.workunit.client.0.smithi062.stdout: ec_io: [==========] 2 tests from 1 test suite ran. (341562 ms total) 2024-02-09T08:09:51.606 INFO:tasks.workunit.client.0.smithi062.stdout: ec_io: [ PASSED ] 2 tests. 2024-02-09T08:09:53.620 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:09:53.611+0000 ec49640 -1 osd.0 294 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4948.0:25 100.1b 100:da60249f:::test_18:head [cmpext 0~0 in=4b,write 0~4 in=4b] snapc 0=[] ondisk+write+known_if_redirected+returnvec+supports_pool_eio e275) 2024-02-09T08:09:55.067 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:09:55.033+0000 ec49640 -1 osd.2 307 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4987.0:8 107.1f 107:fa174bd7:test-rados-api-smithi062-41051-5::cmpextpp:head [write 0~11 in=11b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e275) 2024-02-09T08:09:55.144 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:09:55.132+0000 ec49640 -1 osd.0 296 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4948.0:25 100.1b 100:da60249f:::test_18:head [cmpext 0~0 in=4b,write 0~4 in=4b] snapc 0=[] ondisk+write+known_if_redirected+returnvec+supports_pool_eio e275) 2024-02-09T08:09:56.070 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:09:56.057+0000 ec49640 -1 osd.2 308 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4987.0:8 107.1f 107:fa174bd7:test-rados-api-smithi062-41051-5::cmpextpp:head [write 0~11 in=11b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e275) 2024-02-09T08:09:56.460 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:09:56.454+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:09:56.467 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:09:56.421+0000 ec49640 -1 osd.0 298 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4948.0:25 100.1b 100:da60249f:::test_18:head [cmpext 0~0 in=4b,write 0~4 in=4b] snapc 0=[] ondisk+write+known_if_redirected+returnvec+supports_pool_eio e275) 2024-02-09T08:09:57.705 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:09:57.681+0000 ec49640 -1 osd.7 311 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4811.0:7 105.6s0 105:602f83fe:::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e279) 2024-02-09T08:09:57.790 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:09:57.718+0000 ec49640 -1 osd.0 299 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4948.0:25 100.1b 100:da60249f:::test_18:head [cmpext 0~0 in=4b,write 0~4 in=4b] snapc 0=[] ondisk+write+known_if_redirected+returnvec+supports_pool_eio e275) 2024-02-09T08:09:58.687 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:09:58.672+0000 ec49640 -1 osd.7 311 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4811.0:7 105.6s0 105:602f83fe:::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e279) 2024-02-09T08:09:58.946 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:09:58.883+0000 ec49640 -1 osd.0 300 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4948.0:25 100.1b 100:da60249f:::test_18:head [cmpext 0~0 in=4b,write 0~4 in=4b] snapc 0=[] ondisk+write+known_if_redirected+returnvec+supports_pool_eio e275) 2024-02-09T08:09:59.671 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:09:59.663+0000 ec49640 -1 osd.7 312 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4811.0:7 105.6s0 105:602f83fe:::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e279) 2024-02-09T08:09:59.685 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:09:59.667+0000 ec49640 -1 osd.2 312 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4987.0:8 107.1f 107:fa174bd7:test-rados-api-smithi062-41051-5::cmpextpp:head [write 0~11 in=11b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e275) 2024-02-09T08:10:00.071 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:10:00.004+0000 ec49640 -1 osd.0 301 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4948.0:25 100.1b 100:da60249f:::test_18:head [cmpext 0~0 in=4b,write 0~4 in=4b] snapc 0=[] ondisk+write+known_if_redirected+returnvec+supports_pool_eio e275) 2024-02-09T08:10:00.723 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:10:00.712+0000 ec49640 -1 osd.2 313 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4987.0:8 107.1f 107:fa174bd7:test-rados-api-smithi062-41051-5::cmpextpp:head [write 0~11 in=11b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e275) 2024-02-09T08:10:00.739 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:10:00.673+0000 ec49640 -1 osd.7 313 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4811.0:7 105.6s0 105:602f83fe:::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e279) 2024-02-09T08:10:01.472 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:10:01.468+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:10:01.746 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:10:01.740+0000 ec49640 -1 osd.7 314 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4811.0:7 105.6s0 105:602f83fe:::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e279) 2024-02-09T08:10:01.759 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:10:01.747+0000 ec49640 -1 osd.2 314 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4987.0:8 107.1f 107:fa174bd7:test-rados-api-smithi062-41051-5::cmpextpp:head [write 0~11 in=11b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e275) 2024-02-09T08:10:01.793 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:10:01.770+0000 ec49640 -1 osd.0 302 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4948.0:25 100.1b 100:da60249f:::test_18:head [cmpext 0~0 in=4b,write 0~4 in=4b] snapc 0=[] ondisk+write+known_if_redirected+returnvec+supports_pool_eio e275) 2024-02-09T08:10:02.782 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:10:02.776+0000 ec49640 -1 osd.7 315 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4811.0:7 105.6s0 105:602f83fe:::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e279) 2024-02-09T08:10:03.148 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:10:03.131+0000 ec49640 -1 osd.0 303 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4948.0:25 100.1b 100:da60249f:::test_18:head [cmpext 0~0 in=4b,write 0~4 in=4b] snapc 0=[] ondisk+write+known_if_redirected+returnvec+supports_pool_eio e275) 2024-02-09T08:10:03.345 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:10:03.320+0000 ec49640 -1 osd.2 315 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4987.0:8 107.1f 107:fa174bd7:test-rados-api-smithi062-41051-5::cmpextpp:head [write 0~11 in=11b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e275) 2024-02-09T08:10:03.812 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:10:03.806+0000 ec49640 -1 osd.7 316 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4811.0:7 105.6s0 105:602f83fe:::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e279) 2024-02-09T08:10:04.274 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:10:04.234+0000 ec49640 -1 osd.0 305 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4948.0:25 100.1b 100:da60249f:::test_18:head [cmpext 0~0 in=4b,write 0~4 in=4b] snapc 0=[] ondisk+write+known_if_redirected+returnvec+supports_pool_eio e275) 2024-02-09T08:10:04.373 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:10:04.367+0000 ec49640 -1 osd.2 316 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4987.0:8 107.1f 107:fa174bd7:test-rados-api-smithi062-41051-5::cmpextpp:head [write 0~11 in=11b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e275) 2024-02-09T08:10:05.209 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:10:05.111+0000 ec49640 -1 osd.7 317 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4811.0:7 105.6s0 105:602f83fe:::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e279) 2024-02-09T08:10:05.524 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:10:05.496+0000 ec49640 -1 osd.2 317 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4987.0:8 107.1f 107:fa174bd7:test-rados-api-smithi062-41051-5::cmpextpp:head [write 0~11 in=11b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e275) 2024-02-09T08:10:06.496 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:10:06.492+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:10:06.540 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:08:15.947 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:10:06.593 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:08:15.999 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:10:06.611 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:08:16.007 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:10:06.619 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:08:16.016 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:10:06.677 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:08:16.083 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:10:06.681 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:08:16.087 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:10:06.696 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:08:16.102 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:10:06.704 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:08:16.100 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:10:06.801 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:08:16.204 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:10:11.531 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:10:11.524+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:10:12.044 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:10:12.030+0000 ec49640 -1 osd.2 322 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.5011.0:5 112.5s0 112.82d2cd9d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e291) 2024-02-09T08:10:15.466 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:10:15.378+0000 ec49640 -1 osd.2 324 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.5011.0:5 112.5s0 112.82d2cd9d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e291) 2024-02-09T08:10:15.534 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:10:15.431+0000 12c51640 -1 osd.3 324 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4844.0:2 117.6 117:602f83fe:::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e297) 2024-02-09T08:10:16.394 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:10:16.382+0000 ec49640 -1 osd.2 324 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.5011.0:5 112.5s0 112.82d2cd9d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e291) 2024-02-09T08:10:16.465 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:10:16.451+0000 12c51640 -1 osd.3 324 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4844.0:2 117.6 117:602f83fe:::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e297) 2024-02-09T08:10:16.560 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:10:16.556+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:10:17.443 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:10:17.431+0000 ec49640 -1 osd.2 324 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.5011.0:5 112.5s0 112:b9b34b41:test-rados-api-smithi062-40931-18::bar:head [write 19~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e291) 2024-02-09T08:10:21.717 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: Running main() from gmock_main.cc 2024-02-09T08:10:21.717 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [==========] Running 17 tests from 1 test suite. 2024-02-09T08:10:21.717 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [----------] Global test environment set-up. 2024-02-09T08:10:21.717 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest 2024-02-09T08:10:21.717 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.NewDelete 2024-02-09T08:10:21.717 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ OK ] CReadOpsTest.NewDelete (0 ms) 2024-02-09T08:10:21.717 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.SetOpFlags 2024-02-09T08:10:21.717 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ OK ] CReadOpsTest.SetOpFlags (30575 ms) 2024-02-09T08:10:21.717 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertExists 2024-02-09T08:10:21.717 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertExists (23690 ms) 2024-02-09T08:10:21.717 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertVersion 2024-02-09T08:10:21.717 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertVersion (22046 ms) 2024-02-09T08:10:21.718 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpXattr 2024-02-09T08:10:21.718 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpXattr (31947 ms) 2024-02-09T08:10:21.718 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Read 2024-02-09T08:10:21.718 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Read (174894 ms) 2024-02-09T08:10:21.718 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Checksum 2024-02-09T08:10:21.718 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Checksum (11326 ms) 2024-02-09T08:10:21.718 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.RWOrderedRead 2024-02-09T08:10:21.718 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ OK ] CReadOpsTest.RWOrderedRead (4506 ms) 2024-02-09T08:10:21.718 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ShortRead 2024-02-09T08:10:21.718 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ShortRead (8280 ms) 2024-02-09T08:10:21.718 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Exec 2024-02-09T08:10:21.718 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Exec (2787 ms) 2024-02-09T08:10:21.718 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ExecUserBuf 2024-02-09T08:10:21.719 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ExecUserBuf (6304 ms) 2024-02-09T08:10:21.719 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat 2024-02-09T08:10:21.719 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat (2134 ms) 2024-02-09T08:10:21.719 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat2 2024-02-09T08:10:21.719 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat2 (10076 ms) 2024-02-09T08:10:21.719 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Omap 2024-02-09T08:10:21.719 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Omap (10660 ms) 2024-02-09T08:10:21.719 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.OmapNuls 2024-02-09T08:10:21.719 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ OK ] CReadOpsTest.OmapNuls (5841 ms) 2024-02-09T08:10:21.719 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.GetXattrs 2024-02-09T08:10:21.719 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ OK ] CReadOpsTest.GetXattrs (12262 ms) 2024-02-09T08:10:21.719 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpExt 2024-02-09T08:10:21.719 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpExt (2475 ms) 2024-02-09T08:10:21.719 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest (359803 ms total) 2024-02-09T08:10:21.719 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: 2024-02-09T08:10:21.720 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [----------] Global test environment tear-down 2024-02-09T08:10:21.720 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [==========] 17 tests from 1 test suite ran. (371815 ms total) 2024-02-09T08:10:21.720 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ PASSED ] 17 tests. 2024-02-09T08:10:21.824 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:10:21.819+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:10:26.856 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:10:26.849+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:10:31.893 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:10:31.881+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:10:34.553 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: Running main() from gmock_main.cc 2024-02-09T08:10:34.553 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [==========] Running 11 tests from 2 test suites. 2024-02-09T08:10:34.553 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [----------] Global test environment set-up. 2024-02-09T08:10:34.553 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [----------] 5 tests from NeoRadosSnapshots 2024-02-09T08:10:34.553 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapList 2024-02-09T08:10:34.553 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapList (36751 ms) 2024-02-09T08:10:34.553 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapRemove 2024-02-09T08:10:34.553 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapRemove (23758 ms) 2024-02-09T08:10:34.553 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [ RUN ] NeoRadosSnapshots.Rollback 2024-02-09T08:10:34.553 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [ OK ] NeoRadosSnapshots.Rollback (31314 ms) 2024-02-09T08:10:34.554 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapGetName 2024-02-09T08:10:34.554 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapGetName (41632 ms) 2024-02-09T08:10:34.554 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapCreateRemove 2024-02-09T08:10:34.554 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapCreateRemove (19866 ms) 2024-02-09T08:10:34.554 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [----------] 5 tests from NeoRadosSnapshots (153321 ms total) 2024-02-09T08:10:34.554 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: 2024-02-09T08:10:34.554 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [----------] 6 tests from NeoRadosSelfManagedSnaps 2024-02-09T08:10:34.554 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Snap 2024-02-09T08:10:34.554 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Snap (131890 ms) 2024-02-09T08:10:34.554 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Rollback 2024-02-09T08:10:34.554 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Rollback (17876 ms) 2024-02-09T08:10:34.554 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.SnapOverlap 2024-02-09T08:10:34.554 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.SnapOverlap (27796 ms) 2024-02-09T08:10:34.554 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Bug11677 2024-02-09T08:10:34.555 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Bug11677 (14827 ms) 2024-02-09T08:10:34.555 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.OrderSnap 2024-02-09T08:10:34.555 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.OrderSnap (8860 ms) 2024-02-09T08:10:34.555 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.ReusePurgedSnap 2024-02-09T08:10:34.555 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: Deleting snap 3 in pool ReusePurgedSnapsmithi062-42071-11. 2024-02-09T08:10:34.555 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: Waiting for snaps to purge. 2024-02-09T08:10:34.555 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.ReusePurgedSnap (29846 ms) 2024-02-09T08:10:34.555 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [----------] 6 tests from NeoRadosSelfManagedSnaps (231095 ms total) 2024-02-09T08:10:34.555 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: 2024-02-09T08:10:34.555 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [----------] Global test environment tear-down 2024-02-09T08:10:34.555 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [==========] 11 tests from 2 test suites ran. (384416 ms total) 2024-02-09T08:10:34.555 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [ PASSED ] 11 tests. 2024-02-09T08:10:34.672 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd_pp: Running main() from gmock_main.cc 2024-02-09T08:10:34.672 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd_pp: [==========] Running 3 tests from 1 test suite. 2024-02-09T08:10:34.672 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd_pp: [----------] Global test environment set-up. 2024-02-09T08:10:34.672 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd 2024-02-09T08:10:34.672 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.MonDescribePP 2024-02-09T08:10:34.672 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd_pp: [ OK ] LibRadosCmd.MonDescribePP (934 ms) 2024-02-09T08:10:34.672 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.OSDCmdPP 2024-02-09T08:10:34.673 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd_pp: [ OK ] LibRadosCmd.OSDCmdPP (529 ms) 2024-02-09T08:10:34.673 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.PGCmdPP 2024-02-09T08:10:34.673 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd_pp: [ OK ] LibRadosCmd.PGCmdPP (383337 ms) 2024-02-09T08:10:34.673 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd (384800 ms total) 2024-02-09T08:10:34.673 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd_pp: 2024-02-09T08:10:34.673 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd_pp: [----------] Global test environment tear-down 2024-02-09T08:10:34.673 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd_pp: [==========] 3 tests from 1 test suite ran. (384800 ms total) 2024-02-09T08:10:34.673 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd_pp: [ PASSED ] 3 tests. 2024-02-09T08:10:34.849 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:08:44.256 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:10:34.923 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:08:44.330 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:10:34.992 INFO:tasks.workunit.client.0.smithi062.stdout:_pp: timed out 2024-02-09T08:10:34.992 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: flushing 2024-02-09T08:10:34.992 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: flushed 2024-02-09T08:10:34.992 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 (10666 ms) 2024-02-09T08:10:34.992 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 2024-02-09T08:10:34.992 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: trying... 2024-02-09T08:10:34.992 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: handle_notify cookie 94097242183616 notify_id 1288490188805 notifier_gid 4793 2024-02-09T08:10:34.992 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: timed out 2024-02-09T08:10:34.993 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: flushing 2024-02-09T08:10:34.993 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: flushed 2024-02-09T08:10:34.993 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 (15318 ms) 2024-02-09T08:10:34.993 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 2024-02-09T08:10:34.993 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: List watches 2024-02-09T08:10:34.993 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: notify2 2024-02-09T08:10:34.993 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: handle_notify cookie 94097242183568 notify_id 1335734829057 notifier_gid 4793 2024-02-09T08:10:34.993 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: notify2 done 2024-02-09T08:10:34.993 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: watch_check 2024-02-09T08:10:34.993 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: unwatch2 2024-02-09T08:10:34.993 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: flushing 2024-02-09T08:10:34.993 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: done 2024-02-09T08:10:34.993 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 (17284 ms) 2024-02-09T08:10:34.994 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 2024-02-09T08:10:34.994 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: List watches 2024-02-09T08:10:34.994 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: notify2 2024-02-09T08:10:34.994 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: handle_notify cookie 94097242183568 notify_id 1370094567429 notifier_gid 4793 2024-02-09T08:10:34.994 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: notify2 done 2024-02-09T08:10:34.994 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: watch_check 2024-02-09T08:10:34.994 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: unwatch2 2024-02-09T08:10:34.994 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: flushing 2024-02-09T08:10:34.994 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: done 2024-02-09T08:10:34.994 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 (4415 ms) 2024-02-09T08:10:34.994 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP (180984 ms total) 2024-02-09T08:10:34.994 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: 2024-02-09T08:10:34.994 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [----------] Global test environment tear-down 2024-02-09T08:10:34.994 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [==========] 16 tests from 2 test suites ran. (385170 ms total) 2024-02-09T08:10:34.995 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ PASSED ] 16 tests. 2024-02-09T08:10:35.102 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:08:44.508 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:10:35.599 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:08:44.996 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:10:35.608 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:08:45.004 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:10:35.715 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:08:45.112 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:10:35.736 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:08:45.142 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:10:35.848 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:08:45.254 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:10:36.038 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:08:45.445 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:10:37.536 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:10:37.479+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:10:42.504 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:10:42.493+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:10:47.517 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:10:47.512+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:10:48.298 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: Running main() from gmock_main.cc 2024-02-09T08:10:48.298 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [==========] Running 9 tests from 2 test suites. 2024-02-09T08:10:48.298 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [----------] Global test environment set-up. 2024-02-09T08:10:48.298 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP 2024-02-09T08:10:48.298 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: seed 41315 2024-02-09T08:10:48.298 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPP 2024-02-09T08:10:48.298 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPP (18049 ms) 2024-02-09T08:10:48.298 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.Stat2Mtime2PP 2024-02-09T08:10:48.298 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [ OK ] LibRadosStatPP.Stat2Mtime2PP (59343 ms) 2024-02-09T08:10:48.298 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.ClusterStatPP 2024-02-09T08:10:48.298 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [ OK ] LibRadosStatPP.ClusterStatPP (16 ms) 2024-02-09T08:10:48.299 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.PoolStatPP 2024-02-09T08:10:48.299 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [ OK ] LibRadosStatPP.PoolStatPP (82171 ms) 2024-02-09T08:10:48.299 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPPNS 2024-02-09T08:10:48.299 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPPNS (119144 ms) 2024-02-09T08:10:48.299 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP (278723 ms total) 2024-02-09T08:10:48.299 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: 2024-02-09T08:10:48.299 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP 2024-02-09T08:10:48.299 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPP 2024-02-09T08:10:48.299 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPP (27819 ms) 2024-02-09T08:10:48.299 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.ClusterStatPP 2024-02-09T08:10:48.299 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.ClusterStatPP (15 ms) 2024-02-09T08:10:48.299 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.PoolStatPP 2024-02-09T08:10:48.299 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.PoolStatPP (1687 ms) 2024-02-09T08:10:48.299 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPPNS 2024-02-09T08:10:48.299 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPPNS (53471 ms) 2024-02-09T08:10:48.300 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP (82992 ms total) 2024-02-09T08:10:48.300 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: 2024-02-09T08:10:48.300 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [----------] Global test environment tear-down 2024-02-09T08:10:48.300 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [==========] 9 tests from 2 test suites ran. (398485 ms total) 2024-02-09T08:10:48.300 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [ PASSED ] 9 tests. 2024-02-09T08:10:52.600 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:10:52.574+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:10:57.620 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:10:57.615+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:10:58.412 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: Running main() from gmock_main.cc 2024-02-09T08:10:58.412 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [==========] Running 24 tests from 2 test suites. 2024-02-09T08:10:58.412 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [----------] Global test environment set-up. 2024-02-09T08:10:58.413 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [----------] 14 tests from LibRadosIo 2024-02-09T08:10:58.413 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ RUN ] LibRadosIo.SimpleWrite 2024-02-09T08:10:58.413 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ OK ] LibRadosIo.SimpleWrite (60154 ms) 2024-02-09T08:10:58.413 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ RUN ] LibRadosIo.TooBig 2024-02-09T08:10:58.413 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ OK ] LibRadosIo.TooBig (0 ms) 2024-02-09T08:10:58.413 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ RUN ] LibRadosIo.ReadTimeout 2024-02-09T08:10:58.413 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: no timeout :/ 2024-02-09T08:10:58.413 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: no timeout :/ 2024-02-09T08:10:58.413 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: no timeout :/ 2024-02-09T08:10:58.413 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: no timeout :/ 2024-02-09T08:10:58.413 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ OK ] LibRadosIo.ReadTimeout (60261 ms) 2024-02-09T08:10:58.413 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ RUN ] LibRadosIo.RoundTrip 2024-02-09T08:10:58.413 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ OK ] LibRadosIo.RoundTrip (42371 ms) 2024-02-09T08:10:58.414 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ RUN ] LibRadosIo.Checksum 2024-02-09T08:10:58.414 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ OK ] LibRadosIo.Checksum (2402 ms) 2024-02-09T08:10:58.414 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ RUN ] LibRadosIo.OverlappingWriteRoundTrip 2024-02-09T08:10:58.414 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ OK ] LibRadosIo.OverlappingWriteRoundTrip (102544 ms) 2024-02-09T08:10:58.414 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ RUN ] LibRadosIo.WriteFullRoundTrip 2024-02-09T08:10:58.414 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ OK ] LibRadosIo.WriteFullRoundTrip (2388 ms) 2024-02-09T08:10:58.414 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ RUN ] LibRadosIo.AppendRoundTrip 2024-02-09T08:10:58.414 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ OK ] LibRadosIo.AppendRoundTrip (1331 ms) 2024-02-09T08:10:58.414 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ RUN ] LibRadosIo.ZeroLenZero 2024-02-09T08:10:58.414 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ OK ] LibRadosIo.ZeroLenZero (5665 ms) 2024-02-09T08:10:58.414 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ RUN ] LibRadosIo.TruncTest 2024-02-09T08:10:58.414 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ OK ] LibRadosIo.TruncTest (4008 ms) 2024-02-09T08:10:58.414 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ RUN ] LibRadosIo.RemoveTest 2024-02-09T08:10:58.414 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ OK ] LibRadosIo.RemoveTest (1389 ms) 2024-02-09T08:10:58.414 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ RUN ] LibRadosIo.XattrsRoundTrip 2024-02-09T08:10:58.415 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ OK ] LibRadosIo.XattrsRoundTrip (7451 ms) 2024-02-09T08:10:58.415 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ RUN ] LibRadosIo.RmXattr 2024-02-09T08:10:58.415 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ OK ] LibRadosIo.RmXattr (14792 ms) 2024-02-09T08:10:58.415 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ RUN ] LibRadosIo.XattrIter 2024-02-09T08:10:58.415 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ OK ] LibRadosIo.XattrIter (3191 ms) 2024-02-09T08:10:58.415 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [----------] 14 tests from LibRadosIo (307947 ms total) 2024-02-09T08:10:58.415 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: 2024-02-09T08:10:58.415 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [----------] 10 tests from LibRadosIoEC 2024-02-09T08:10:58.415 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ RUN ] LibRadosIoEC.SimpleWrite 2024-02-09T08:10:58.415 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ OK ] LibRadosIoEC.SimpleWrite (9988 ms) 2024-02-09T08:10:58.415 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ RUN ] LibRadosIoEC.RoundTrip 2024-02-09T08:10:58.415 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ OK ] LibRadosIoEC.RoundTrip (41691 ms) 2024-02-09T08:10:58.415 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ RUN ] LibRadosIoEC.OverlappingWriteRoundTrip 2024-02-09T08:10:58.415 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ OK ] LibRadosIoEC.OverlappingWriteRoundTrip (1532 ms) 2024-02-09T08:10:58.416 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ RUN ] LibRadosIoEC.WriteFullRoundTrip 2024-02-09T08:10:58.416 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ OK ] LibRadosIoEC.WriteFullRoundTrip (641 ms) 2024-02-09T08:10:58.416 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ RUN ] LibRadosIoEC.AppendRoundTrip 2024-02-09T08:10:58.416 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ OK ] LibRadosIoEC.AppendRoundTrip (1910 ms) 2024-02-09T08:10:58.416 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ RUN ] LibRadosIoEC.TruncTest 2024-02-09T08:10:58.416 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ OK ] LibRadosIoEC.TruncTest (1050 ms) 2024-02-09T08:10:58.416 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ RUN ] LibRadosIoEC.RemoveTest 2024-02-09T08:10:58.416 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ OK ] LibRadosIoEC.RemoveTest (168 ms) 2024-02-09T08:10:58.416 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ RUN ] LibRadosIoEC.XattrsRoundTrip 2024-02-09T08:10:58.417 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ OK ] LibRadosIoEC.XattrsRoundTrip (218 ms) 2024-02-09T08:10:58.417 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ RUN ] LibRadosIoEC.RmXattr 2024-02-09T08:10:58.417 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ OK ] LibRadosIoEC.RmXattr (5170 ms) 2024-02-09T08:10:58.417 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ RUN ] LibRadosIoEC.XattrIter 2024-02-09T08:10:58.417 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ OK ] LibRadosIoEC.XattrIter (1146 ms) 2024-02-09T08:10:58.417 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [----------] 10 tests from LibRadosIoEC (63514 ms total) 2024-02-09T08:10:58.417 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: 2024-02-09T08:10:58.417 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [----------] Global test environment tear-down 2024-02-09T08:10:58.418 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [==========] 24 tests from 2 test suites ran. (408781 ms total) 2024-02-09T08:10:58.418 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ PASSED ] 24 tests. 2024-02-09T08:10:58.424 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [==========] Running 11 tests from 3 test suites. 2024-02-09T08:10:58.424 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [----------] Global test environment set-up. 2024-02-09T08:10:58.424 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [----------] 7 tests from LibRadosList 2024-02-09T08:10:58.424 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [ RUN ] LibRadosList.ListObjects 2024-02-09T08:10:58.424 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [ OK ] LibRadosList.ListObjects (354179 ms) 2024-02-09T08:10:58.424 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [ RUN ] LibRadosList.ListObjectsZeroInName 2024-02-09T08:10:58.424 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [ OK ] LibRadosList.ListObjectsZeroInName (32870 ms) 2024-02-09T08:10:58.425 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [ RUN ] LibRadosList.ListObjectsNS 2024-02-09T08:10:58.425 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: myset foo1,foo2,foo3 2024-02-09T08:10:58.425 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: foo1 2024-02-09T08:10:58.425 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: foo2 2024-02-09T08:10:58.425 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: foo3 2024-02-09T08:10:58.425 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: myset foo1,foo4,foo5 2024-02-09T08:10:58.425 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: foo4 2024-02-09T08:10:58.425 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: foo5 2024-02-09T08:10:58.425 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: foo1 2024-02-09T08:10:58.425 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: myset foo6,foo7 2024-02-09T08:10:58.425 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: foo7 2024-02-09T08:10:58.425 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: foo6 2024-02-09T08:10:58.425 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2024-02-09T08:10:58.425 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: ns1:foo4 2024-02-09T08:10:58.425 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: ns1:foo5 2024-02-09T08:10:58.426 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: ns2:foo7 2024-02-09T08:10:58.426 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: ns2:foo6 2024-02-09T08:10:58.426 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: ns1:foo1 2024-02-09T08:10:58.426 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: :foo1 2024-02-09T08:10:58.426 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: :foo2 2024-02-09T08:10:58.426 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: :foo3 2024-02-09T08:10:58.426 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [ OK ] LibRadosList.ListObjectsNS (5119 ms) 2024-02-09T08:10:58.426 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [ RUN ] LibRadosList.ListObjectsStart 2024-02-09T08:10:58.426 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 1 0 2024-02-09T08:10:58.426 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 10 0 2024-02-09T08:10:58.426 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 13 0 2024-02-09T08:10:58.426 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 7 0 2024-02-09T08:10:58.426 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 14 0 2024-02-09T08:10:58.427 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 0 0 2024-02-09T08:10:58.427 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 15 0 2024-02-09T08:10:58.427 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 11 0 2024-02-09T08:10:58.427 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 5 0 2024-02-09T08:10:58.427 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 8 0 2024-02-09T08:10:58.427 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 6 0 2024-02-09T08:10:58.427 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 3 0 2024-02-09T08:10:58.427 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 4 0 2024-02-09T08:10:58.427 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 12 0 2024-02-09T08:10:58.427 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 9 0 2024-02-09T08:10:58.427 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 2 0 2024-02-09T08:10:58.427 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2024-02-09T08:10:58.427 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [ OK ] LibRadosList.ListObjectsStart (2413 ms) 2024-02-09T08:10:58.427 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [ RUN ] LibRadosList.ListObjectsCursor 2024-02-09T08:10:58.428 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: x cursor=MIN 2024-02-09T08:10:58.428 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > oid=1 cursor=6:02547ec2:::1:head 2024-02-09T08:10:58.428 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > oid=10 cursor=6:52ea6a34:::10:head 2024-02-09T08:10:58.428 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > oid=13 cursor=6:566253c9:::13:head 2024-02-09T08:10:58.428 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > oid=7 cursor=6:5c6b0b28:::7:head 2024-02-09T08:10:58.428 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > oid=14 cursor=6:62a1935d:::14:head 2024-02-09T08:10:58.428 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > oid=0 cursor=6:6cac518f:::0:head 2024-02-09T08:10:58.428 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > oid=15 cursor=6:863748b0:::15:head 2024-02-09T08:10:58.428 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > oid=11 cursor=6:89d3ae78:::11:head 2024-02-09T08:10:58.428 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > oid=5 cursor=6:b29083e3:::5:head 2024-02-09T08:10:58.428 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > oid=8 cursor=6:bd63b0f1:::8:head 2024-02-09T08:10:58.428 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > oid=6 cursor=6:c4fdafeb:::6:head 2024-02-09T08:10:58.428 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > oid=3 cursor=6:cfc208b3:::3:head 2024-02-09T08:10:58.428 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > oid=4 cursor=6:d83876eb:::4:head 2024-02-09T08:10:58.429 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > oid=12 cursor=6:de5d7c5f:::12:head 2024-02-09T08:10:58.431 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > oid=9 cursor=6:e960b815:::9:head 2024-02-09T08:10:58.431 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > oid=2 cursor=6:f905c69b:::2:head 2024-02-09T08:10:58.431 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: FIRST> seek to MIN oid=1 2024-02-09T08:10:58.432 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : oid=1 cursor=6:02547ec2:::1:head 2024-02-09T08:10:58.432 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 6:02547ec2:::1:head 2024-02-09T08:10:58.432 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 6:02547ec2:::1:head -> 1 2024-02-09T08:10:58.432 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : oid=10 cursor=6:52ea6a34:::10:head 2024-02-09T08:10:58.432 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 6:52ea6a34:::10:head 2024-02-09T08:10:58.432 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 6:52ea6a34:::10:head -> 10 2024-02-09T08:10:58.432 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : oid=13 cursor=6:566253c9:::13:head 2024-02-09T08:10:58.432 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 6:566253c9:::13:head 2024-02-09T08:10:58.432 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 6:566253c9:::13:head -> 13 2024-02-09T08:10:58.432 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : oid=7 cursor=6:5c6b0b28:::7:head 2024-02-09T08:10:58.432 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 6:5c6b0b28:::7:head 2024-02-09T08:10:58.432 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 6:5c6b0b28:::7:head -> 7 2024-02-09T08:10:59.329 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : oid=14 cursor=6:62a1935d:::1osIoECPP.RoundTripPP2 (314 ms) 2024-02-09T08:10:59.329 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2024-02-09T08:10:59.329 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoECPP.OverlappingWriteRoundTripPP (2466 ms) 2024-02-09T08:10:59.330 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP 2024-02-09T08:10:59.330 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP (3625 ms) 2024-02-09T08:10:59.330 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP2 2024-02-09T08:10:59.330 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP2 (3100 ms) 2024-02-09T08:10:59.330 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.AppendRoundTripPP 2024-02-09T08:10:59.330 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoECPP.AppendRoundTripPP (5179 ms) 2024-02-09T08:10:59.330 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.TruncTestPP 2024-02-09T08:10:59.330 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoECPP.TruncTestPP (7126 ms) 2024-02-09T08:10:59.330 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RemoveTestPP 2024-02-09T08:10:59.330 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RemoveTestPP (4932 ms) 2024-02-09T08:10:59.330 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrsRoundTripPP 2024-02-09T08:10:59.330 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrsRoundTripPP (17713 ms) 2024-02-09T08:10:59.330 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RmXattrPP 2024-02-09T08:10:59.330 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RmXattrPP (69601 ms) 2024-02-09T08:10:59.331 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrListPP 2024-02-09T08:10:59.331 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrListPP (261 ms) 2024-02-09T08:10:59.331 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtPP 2024-02-09T08:10:59.331 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtPP (8757 ms) 2024-02-09T08:10:59.331 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtDNEPP 2024-02-09T08:10:59.331 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtDNEPP (1171 ms) 2024-02-09T08:10:59.331 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtMismatchPP 2024-02-09T08:10:59.331 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtMismatchPP (3707 ms) 2024-02-09T08:10:59.331 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [----------] 17 tests from LibRadosIoECPP (155176 ms total) 2024-02-09T08:10:59.331 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: 2024-02-09T08:10:59.331 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [----------] Global test environment tear-down 2024-02-09T08:10:59.331 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [==========] 37 tests from 2 test suites ran. (409691 ms total) 2024-02-09T08:10:59.331 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ PASSED ] 37 tests. 2024-02-09T08:10:59.583 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: Running main() from gmock_main.cc 2024-02-09T08:10:59.583 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: [==========] Running 4 tests from 1 test suite. 2024-02-09T08:10:59.583 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: [----------] Global test environment set-up. 2024-02-09T08:10:59.583 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: [----------] 4 tests from LibRadosCmd 2024-02-09T08:10:59.583 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: [ RUN ] LibRadosCmd.MonDescribe 2024-02-09T08:10:59.583 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: [ OK ] LibRadosCmd.MonDescribe (1390 ms) 2024-02-09T08:10:59.583 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: [ RUN ] LibRadosCmd.OSDCmd 2024-02-09T08:10:59.583 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: [ OK ] LibRadosCmd.OSDCmd (102 ms) 2024-02-09T08:10:59.583 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: [ RUN ] LibRadosCmd.PGCmd 2024-02-09T08:10:59.583 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: [ OK ] LibRadosCmd.PGCmd (401234 ms) 2024-02-09T08:10:59.584 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: [ RUN ] LibRadosCmd.WatchLog 2024-02-09T08:10:59.584 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-09T08:10:49.902599+0000 mon.a [INF] from='client.? 172.21.15.62:0/819461881' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi062-40943-22"}]: dispatch 2024-02-09T08:10:59.584 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-09T08:10:50.031597+0000 mon.b [INF] from='client.? 172.21.15.62:0/2702013560' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi062-41330-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-09T08:10:59.584 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-09T08:10:50.437635+0000 mon.b [INF] from='client.? 172.21.15.62:0/2591236587' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi062-40931-16"}]: dispatch 2024-02-09T08:10:59.584 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-09T08:10:51.085427+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi062-41330-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-09T08:10:59.584 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-09T08:10:51.114422+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi062-40931-16"}]: dispatch 2024-02-09T08:10:59.584 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-09T08:10:51.235010+0000 mon.a [INF] from='client.4942 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi062-41092-10"}]': finished 2024-02-09T08:10:59.584 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-09T08:10:50.883352+0000 mon.b [INF] from='client.4960 172.21.15.62:0/1064804902' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi062-41995-2"}]: dispatch 2024-02-09T08:10:59.584 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-09T08:10:52.400690+0000 mon.c [INF] from='client.4942 172.21.15.62:0/2313117335' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi062-41092-10"}]: dispatch 2024-02-09T08:10:59.584 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-09T08:10:52.514220+0000 mon.a [INF] from='client.4960 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi062-41995-2"}]: dispatch 2024-02-09T08:10:59.584 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-09T08:10:52.555349+0000 mon.a [WRN] Health check update: 14 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-09T08:10:59.584 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-09T08:10:53.531228+0000 mon.a [INF] from='client.? 172.21.15.62:0/3563980108' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi062-41131-10"}]: dispatch 2024-02-09T08:10:59.585 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-09T08:10:54.492015+0000 mon.a [INF] from='client.4942 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi062-41092-10"}]: dispatch 2024-02-09T08:10:59.585 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-09T08:10:54.672452+0000 mon.a [INF] from='client.? 172.21.15.62:0/819461881' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi062-40943-22"}]': finished 2024-02-09T08:11:02.217 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-09T08:10:54.679722+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi062-41330- api_lock: Running main() from gmock_main.cc 2024-02-09T08:11:02.217 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [==========] Running 16 tests from 2 test suites. 2024-02-09T08:11:02.217 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [----------] Global test environment set-up. 2024-02-09T08:11:02.217 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [----------] 8 tests from LibRadosLock 2024-02-09T08:11:02.217 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusive 2024-02-09T08:11:02.217 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ OK ] LibRadosLock.LockExclusive (39266 ms) 2024-02-09T08:11:02.217 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ RUN ] LibRadosLock.LockShared 2024-02-09T08:11:02.218 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ OK ] LibRadosLock.LockShared (55269 ms) 2024-02-09T08:11:02.218 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusiveDur 2024-02-09T08:11:02.218 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ OK ] LibRadosLock.LockExclusiveDur (4986 ms) 2024-02-09T08:11:02.218 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ RUN ] LibRadosLock.LockSharedDur 2024-02-09T08:11:02.218 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ OK ] LibRadosLock.LockSharedDur (25611 ms) 2024-02-09T08:11:02.218 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ RUN ] LibRadosLock.LockMayRenew 2024-02-09T08:11:02.218 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ OK ] LibRadosLock.LockMayRenew (32444 ms) 2024-02-09T08:11:02.218 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ RUN ] LibRadosLock.Unlock 2024-02-09T08:11:02.218 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ OK ] LibRadosLock.Unlock (24907 ms) 2024-02-09T08:11:02.218 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ RUN ] LibRadosLock.ListLockers 2024-02-09T08:11:02.218 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ OK ] LibRadosLock.ListLockers (4296 ms) 2024-02-09T08:11:02.218 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ RUN ] LibRadosLock.BreakLock 2024-02-09T08:11:02.219 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ OK ] LibRadosLock.BreakLock (3259 ms) 2024-02-09T08:11:02.219 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [----------] 8 tests from LibRadosLock (190038 ms total) 2024-02-09T08:11:02.219 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: 2024-02-09T08:11:02.219 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [----------] 8 tests from LibRadosLockEC 2024-02-09T08:11:02.219 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusive 2024-02-09T08:11:02.219 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusive (83870 ms) 2024-02-09T08:11:02.219 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ RUN ] LibRadosLockEC.LockShared 2024-02-09T08:11:02.219 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ OK ] LibRadosLockEC.LockShared (2288 ms) 2024-02-09T08:11:02.219 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusiveDur 2024-02-09T08:11:02.219 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusiveDur (32698 ms) 2024-02-09T08:11:02.219 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ RUN ] LibRadosLockEC.LockSharedDur 2024-02-09T08:11:02.219 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ OK ] LibRadosLockEC.LockSharedDur (3665 ms) 2024-02-09T08:11:02.219 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ RUN ] LibRadosLockEC.LockMayRenew 2024-02-09T08:11:02.219 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ OK ] LibRadosLockEC.LockMayRenew (6617 ms) 2024-02-09T08:11:02.220 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ RUN ] LibRadosLockEC.Unlock 2024-02-09T08:11:02.220 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ OK ] LibRadosLockEC.Unlock (10229 ms) 2024-02-09T08:11:02.220 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ RUN ] LibRadosLockEC.ListLockers 2024-02-09T08:11:02.220 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ OK ] LibRadosLockEC.ListLockers (40694 ms) 2024-02-09T08:11:02.220 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ RUN ] LibRadosLockEC.BreakLock 2024-02-09T08:11:02.220 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ OK ] LibRadosLockEC.BreakLock (2624 ms) 2024-02-09T08:11:02.220 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [----------] 8 tests from LibRadosLockEC (182685 ms total) 2024-02-09T08:11:02.220 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: 2024-02-09T08:11:02.221 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [----------] Global test environment tear-down 2024-02-09T08:11:02.221 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [==========] 16 tests from 2 test suites ran. (412517 ms total) 2024-02-09T08:11:02.221 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ PASSED ] 16 tests. 2024-02-09T08:11:02.734 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:11:02.731+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:11:04.824 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: Running main() from gmock_main.cc 2024-02-09T08:11:04.825 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [==========] Running 16 tests from 2 test suites. 2024-02-09T08:11:04.825 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [----------] Global test environment set-up. 2024-02-09T08:11:04.825 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP 2024-02-09T08:11:04.825 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: seed 41131 2024-02-09T08:11:04.825 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusivePP 2024-02-09T08:11:04.825 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusivePP (32468 ms) 2024-02-09T08:11:04.825 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedPP 2024-02-09T08:11:04.825 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedPP (233205 ms) 2024-02-09T08:11:04.825 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusiveDurPP 2024-02-09T08:11:04.825 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusiveDurPP (15888 ms) 2024-02-09T08:11:04.825 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedDurPP 2024-02-09T08:11:04.825 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedDurPP (8659 ms) 2024-02-09T08:11:04.825 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockMayRenewPP 2024-02-09T08:11:04.825 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockMayRenewPP (3812 ms) 2024-02-09T08:11:04.826 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.UnlockPP 2024-02-09T08:11:04.826 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ OK ] LibRadosLockPP.UnlockPP (5159 ms) 2024-02-09T08:11:04.826 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.ListLockersPP 2024-02-09T08:11:04.826 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ OK ] LibRadosLockPP.ListLockersPP (6009 ms) 2024-02-09T08:11:04.826 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.BreakLockPP 2024-02-09T08:11:04.826 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ OK ] LibRadosLockPP.BreakLockPP (3759 ms) 2024-02-09T08:11:04.826 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP (308959 ms total) 2024-02-09T08:11:04.826 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: 2024-02-09T08:11:04.826 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP 2024-02-09T08:11:04.826 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusivePP 2024-02-09T08:11:04.826 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusivePP (68283 ms) 2024-02-09T08:11:04.826 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedPP 2024-02-09T08:11:04.826 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedPP (1485 ms) 2024-02-09T08:11:04.826 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusiveDurPP 2024-02-09T08:11:04.827 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusiveDurPP (1453 ms) 2024-02-09T08:11:04.827 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedDurPP 2024-02-09T08:11:04.827 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedDurPP (1194 ms) 2024-02-09T08:11:04.827 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockMayRenewPP 2024-02-09T08:11:04.827 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockMayRenewPP (623 ms) 2024-02-09T08:11:04.827 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.UnlockPP 2024-02-09T08:11:04.827 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.UnlockPP (371 ms) 2024-02-09T08:11:04.827 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.ListLockersPP 2024-02-09T08:11:04.827 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.ListLockersPP (2529 ms) 2024-02-09T08:11:04.827 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.BreakLockPP 2024-02-09T08:11:04.827 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.BreakLockPP (119 ms) 2024-02-09T08:11:04.827 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP (76057 ms total) 2024-02-09T08:11:04.827 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: 2024-02-09T08:11:04.827 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [----------] Global test environment tear-down 2024-02-09T08:11:04.827 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [==========] 16 tests from 2 test suites ran. (415100 ms total) 2024-02-09T08:11:04.828 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ PASSED ] 16 tests. 2024-02-09T08:11:05.213 INFO:tasks.workunit.client.0.smithi062.stdout:4:head 2024-02-09T08:11:05.213 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 6:62a1935d:::14:head 2024-02-09T08:11:05.213 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 6:62a1935d:::14:head -> 14 2024-02-09T08:11:05.213 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : oid=0 cursor=6:6cac518f:::0:head 2024-02-09T08:11:05.213 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 6:6cac518f:::0:head 2024-02-09T08:11:05.214 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 6:6cac518f:::0:head -> 0 2024-02-09T08:11:05.214 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : oid=15 cursor=6:863748b0:::15:head 2024-02-09T08:11:05.214 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 6:863748b0:::15:head 2024-02-09T08:11:05.214 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 6:863748b0:::15:head -> 15 2024-02-09T08:11:05.214 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : oid=11 cursor=6:89d3ae78:::11:head 2024-02-09T08:11:05.214 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 6:89d3ae78:::11:head 2024-02-09T08:11:05.214 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 6:89d3ae78:::11:head -> 11 2024-02-09T08:11:05.214 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : oid=5 cursor=6:b29083e3:::5:head 2024-02-09T08:11:05.214 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 6:b29083e3:::5:head 2024-02-09T08:11:05.214 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 6:b29083e3:::5:head -> 5 2024-02-09T08:11:05.214 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : oid=8 cursor=6:bd63b0f1:::8:head 2024-02-09T08:11:05.214 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 6:bd63b0f1:::8:head 2024-02-09T08:11:05.214 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 6:bd63b0f1:::8:head -> 8 2024-02-09T08:11:05.214 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : oid=6 cursor=6:c4fdafeb:::6:head 2024-02-09T08:11:05.214 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 6:c4fdafeb:::6:head 2024-02-09T08:11:05.215 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 6:c4fdafeb:::6:head -> 6 2024-02-09T08:11:05.215 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : oid=3 cursor=6:cfc208b3:::3:head 2024-02-09T08:11:05.215 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 6:cfc208b3:::3:head 2024-02-09T08:11:05.215 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 6:cfc208b3:::3:head -> 3 2024-02-09T08:11:05.215 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : oid=4 cursor=6:d83876eb:::4:head 2024-02-09T08:11:05.215 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 6:d83876eb:::4:head 2024-02-09T08:11:05.215 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 6:d83876eb:::4:head -> 4 2024-02-09T08:11:05.215 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : oid=12 cursor=6:de5d7c5f:::12:head 2024-02-09T08:11:05.215 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 6:de5d7c5f:::12:head 2024-02-09T08:11:05.215 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 6:de5d7c5f:::12:head -> 12 2024-02-09T08:11:05.215 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : oid=9 cursor=6:e960b815:::9:head 2024-02-09T08:11:05.216 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 6:e960b815:::9:head 2024-02-09T08:11:05.216 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 6:e960b815:::9:head -> 9 2024-02-09T08:11:05.216 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : oid=2 cursor=6:f905c69b:::2:head 2024-02-09T08:11:05.216 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 6:f905c69b:::2:head 2024-02-09T08:11:05.216 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 6:f905c69b:::2:head -> 2 2024-02-09T08:11:05.216 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 6:52ea6a34:::10:head 2024-02-09T08:11:05.216 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : cursor()=6:52ea6a34:::10:head expected=6:52ea6a34:::10:head 2024-02-09T08:11:05.216 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 6:52ea6a34:::10:head -> 10 2024-02-09T08:11:05.216 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : entry=10 expected=10 2024-02-09T08:11:05.216 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 6:b29083e3:::5:head 2024-02-09T08:11:05.216 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : cursor()=6:b29083e3:::5:head expected=6:b29083e3:::5:head 2024-02-09T08:11:05.216 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 6:b29083e3:::5:head -> 5 2024-02-09T08:11:05.216 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : entry=5 expected=5 2024-02-09T08:11:05.217 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 6:566253c9:::13:head 2024-02-09T08:11:05.217 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : cursor()=6:566253c9:::13:head expected=6:566253c9:::13:head 2024-02-09T08:11:05.217 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 6:566253c9:::13:head -> 13 2024-02-09T08:11:05.217 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : entry=13 expected=13 2024-02-09T08:11:05.217 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 6:02547ec2:::1:head 2024-02-09T08:11:05.217 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : cursor()=6:02547ec2:::1:head expected=6:02547ec2:::1:head 2024-02-09T08:11:05.217 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 6:02547ec2:::1:head -> 1 2024-02-09T08:11:05.217 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : entry=1 expected=1 2024-02-09T08:11:05.217 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 6:f905c69b:::2:head 2024-02-09T08:11:05.217 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : cursor()=6:f905c69b:::2:head expected=6:f905c69b:::2:head 2024-02-09T08:11:05.217 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 6:f905c69b:::2:head -> 2 2024-02-09T08:11:05.217 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : entry=2 expected=2 2024-02-09T08:11:05.217 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 6:e960b815:::9:head 2024-02-09T08:11:05.217 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : cursor()=6:e960b815:::9:head expected=6:e960b815:::9:head 2024-02-09T08:11:05.218 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 6:e960b815:::9:head -> 9 2024-02-09T08:11:05.218 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : entry=9 expected=9 2024-02-09T08:11:05.218 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 6:de5d7c5f:::12:head 2024-02-09T08:11:05.218 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : cursor()=6:de5d7c5f:::12:head expected=6:de5d7c5f:::12:head 2024-02-09T08:11:05.218 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 6:de5d7c5f:::12:head -> 12 2024-02-09T08:11:05.218 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : entry=12 expected=12 2024-02-09T08:11:05.218 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 6:6cac518f:::0:head 2024-02-09T08:11:05.218 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : cursor()=6:6cac518f:::0:head expected=6:6cac518f:::0:head 2024-02-09T08:11:05.218 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 6:6cac518f:::0:head -> 0 2024-02-09T08:11:05.218 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : entry=0 expected=0 2024-02-09T08:11:05.218 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 6:62a1935d:::14:head 2024-02-09T08:11:07.821 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:11:07.765+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:11:12.439 INFO:tasks.workunit.client.0.smithi062.stdout: 12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-09T08:11:12.440 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-09T08:10:54.682433+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi062-40931-16"}]': finished 2024-02-09T08:11:12.440 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-09T08:10:55.521756+0000 mon.a [INF] from='client.? 172.21.15.62:0/819461881' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi062-40943-22"}]: dispatch 2024-02-09T08:11:12.440 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-09T08:10:56.159884+0000 mon.c [INF] from='client.? 172.21.15.62:0/3153269917' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-02-09T08:11:12.440 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-09T08:10:56.189936+0000 mon.b [INF] from='client.? 172.21.15.62:0/2702013560' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi062-41330-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi062-41330-12"}]: dispatch 2024-02-09T08:11:12.440 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-09T08:10:57.403429+0000 mon.a [WRN] Health check update: 1 slow ops, oldest one blocked for 296 sec, mon.a has slow ops (SLOW_OPS) 2024-02-09T08:11:12.440 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-09T08:10:57.589521+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi062-41330-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi062-41330-12"}]: dispatch 2024-02-09T08:11:12.440 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-09T08:10:57.601299+0000 mon.a [WRN] Health check update: 10 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-09T08:11:12.440 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-09T08:10:58.035344+0000 client.admin [INF] onexx 2024-02-09T08:11:12.440 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-09T08:10:58.061095+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-02-09T08:11:12.440 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-09T08:10:58.100463+0000 mon.a [INF] from='client.4960 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi062-41995-2"}]': finished 2024-02-09T08:11:12.440 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-09T08:10:58.117666+0000 mon.a [INF] from='client.? 172.21.15.62:0/3563980108' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi062-41131-10"}]': finished 2024-02-09T08:11:12.441 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-09T08:10:58.120517+0000 mon.a [INF] from='client.4942 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi062-41092-10"}]': finished 2024-02-09T08:11:12.441 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-09T08:10:58.123370+0000 mon.a [INF] from='client.? 172.21.15.62:0/819461881' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi062-40943-22"}]': finished 2024-02-09T08:11:12.441 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-09T08:10:58.885410+0000 mon.a [INF] from='client.? 172.21.15.62:0/3563980108' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi062-41131-10"}]: dispatch 2024-02-09T08:11:12.441 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-09T08:11:03.202614+0000 mon.c [INF] from='client.? 172.21.15.62:0/3153269917' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-02-09T08:11:12.441 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-09T08:11:04.887423+0000 client.admin [INF] twoxx 2024-02-09T08:11:12.441 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-09T08:11:04.929228+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-02-09T08:11:12.441 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-09T08:11:04.958693+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi062-41330-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi062-41330-12"}]': finished 2024-02-09T08:11:12.812 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:11:12.809+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:11:17.878 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:11:17.859+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:11:18.662 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-09T08:11:04.960930+0000 mon.a [INF] from='client.4960 ' entity='client.admin' cmd='[{"p list_parallel: process_1_[41727]: starting. 2024-02-09T08:11:18.663 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_1_[41727]: creating pool ceph_test_rados_list_parallel.smithi062-41681 2024-02-09T08:11:18.663 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_1_[41727]: created object 0... 2024-02-09T08:11:18.663 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_1_[41727]: created object 25... 2024-02-09T08:11:18.663 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_1_[41727]: created object 49... 2024-02-09T08:11:18.663 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_1_[41727]: finishing. 2024-02-09T08:11:18.664 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_1_[41727]: shutting down. 2024-02-09T08:11:18.664 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_2_[41731]: starting. 2024-02-09T08:11:18.664 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_2_[41731]: listing objects. 2024-02-09T08:11:18.664 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_2_[41731]: listed object 0... 2024-02-09T08:11:18.664 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_2_[41731]: listed object 25... 2024-02-09T08:11:18.664 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_2_[41731]: saw 50 objects 2024-02-09T08:11:18.664 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_2_[41731]: shutting down. 2024-02-09T08:11:18.665 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-09T08:11:18.665 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_3_[57032]: starting. 2024-02-09T08:11:18.665 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_3_[57032]: creating pool ceph_test_rados_list_parallel.smithi062-41681 2024-02-09T08:11:18.665 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_3_[57032]: created object 0... 2024-02-09T08:11:18.665 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_3_[57032]: created object 25... 2024-02-09T08:11:18.665 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_3_[57032]: created object 49... 2024-02-09T08:11:18.666 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_3_[57032]: finishing. 2024-02-09T08:11:18.666 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_3_[57032]: shutting down. 2024-02-09T08:11:18.666 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-09T08:11:18.666 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_4_[57033]: starting. 2024-02-09T08:11:18.666 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_4_[57033]: listing objects. 2024-02-09T08:11:18.666 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_4_[57033]: listed object 0... 2024-02-09T08:11:18.667 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_4_[57033]: listed object 25... 2024-02-09T08:11:18.667 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_4_[57033]: saw 46 objects 2024-02-09T08:11:18.667 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_4_[57033]: shutting down. 2024-02-09T08:11:18.667 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-09T08:11:18.667 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_5_[57034]: starting. 2024-02-09T08:11:18.667 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_5_[57034]: removed 25 objects... 2024-02-09T08:11:18.667 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_5_[57034]: removed half of the objects 2024-02-09T08:11:18.667 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_5_[57034]: removed 50 objects... 2024-02-09T08:11:18.668 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_5_[57034]: removed 50 objects 2024-02-09T08:11:18.668 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_5_[57034]: shutting down. 2024-02-09T08:11:18.668 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-09T08:11:18.668 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-09T08:11:18.668 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_6_[73083]: starting. 2024-02-09T08:11:18.668 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_6_[73083]: creating pool ceph_test_rados_list_parallel.smithi062-41681 2024-02-09T08:11:18.669 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_6_[73083]: created object 0... 2024-02-09T08:11:18.669 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_6_[73083]: created object 25... 2024-02-09T08:11:18.669 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_6_[73083]: created object 49... 2024-02-09T08:11:18.669 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_6_[73083]: finishing. 2024-02-09T08:11:18.669 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_6_[73083]: shutting down. 2024-02-09T08:11:18.669 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-09T08:11:18.670 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-09T08:11:18.670 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_7_[73084]: starting. 2024-02-09T08:11:18.670 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_7_[73084]: listing objects. 2024-02-09T08:11:18.670 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_7_[73084]: listed object 0... 2024-02-09T08:11:18.670 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_7_[73084]: listed object 25... 2024-02-09T08:11:18.670 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_7_[73084]: listed object 50... 2024-02-09T08:11:18.670 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_7_[73084]: saw 55 objects 2024-02-09T08:11:18.671 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_7_[73084]: shutting down. 2024-02-09T08:11:18.671 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-09T08:11:18.671 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-09T08:11:18.671 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_8_[73085]: starting. 2024-02-09T08:11:18.671 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_8_[73085]: added 25 objects... 2024-02-09T08:11:18.671 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_8_[73085]: added half of the objects 2024-02-09T08:11:18.672 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_8_[73085]: added 50 objects... 2024-02-09T08:11:18.672 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_8_[73085]: added 50 objects 2024-02-09T08:11:18.672 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_8_[73085]: shutting down. 2024-02-09T08:11:18.672 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-09T08:11:18.672 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-09T08:11:19.661 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: **********************refix": "osd crush rule rm", "name":"ListObjectsNSsmithi062-41995-2"}]': finished 2024-02-09T08:11:19.661 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-09T08:11:04.962893+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-41096-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-09T08:11:19.661 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-09T08:11:07.742542+0000 mon.a [WRN] Health check update: 1 slow ops, oldest one blocked for 301 sec, mon.a has slow ops (SLOW_OPS) 2024-02-09T08:11:19.662 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-09T08:11:08.649346+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-02-09T08:11:19.662 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-09T08:11:08.687701+0000 mon.b [INF] from='client.? 172.21.15.62:0/1078388156' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi062-41995-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-09T08:11:19.662 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-09T08:11:09.439807+0000 mon.b [INF] from='client.? 172.21.15.62:0/3336539574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-41096-6", "tierpool": "test-rados-api-smithi062-41096-9", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-09T08:11:19.662 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-09T08:11:09.967081+0000 mon.a [INF] from='client.? 172.21.15.62:0/613857971' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi062-40894-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-09T08:11:19.662 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-09T08:11:10.563509+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi062-41995-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-09T08:11:19.662 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-09T08:11:10.583625+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-41096-6", "tierpool": "test-rados-api-smithi062-41096-9", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-09T08:11:19.662 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-09T08:11:11.602736+0000 mon.a [WRN] Health check update: 11 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-09T08:11:19.662 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-09T08:11:12.770275+0000 mon.a [WRN] Health check update: 1 slow ops, oldest one blocked for 306 sec, mon.a has slow ops (SLOW_OPS) 2024-02-09T08:11:19.663 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-09T08:11:12.776017+0000 mon.a [WRN] pool 'PoolQuotaPP_smithi062-40915-3' is full (reached quota's max_bytes: 4 KiB) 2024-02-09T08:11:19.663 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-09T08:11:12.800275+0000 mon.a [WRN] Health check failed: 1 pool(s) full (POOL_FULL) 2024-02-09T08:11:19.663 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-09T08:11:12.120164+0000 mon.c [INF] from='client.? 172.21.15.62:0/3153269917' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-02-09T08:11:19.663 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-09T08:11:13.168327+0000 client.admin [INF] threexx 2024-02-09T08:11:19.663 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-09T08:11:13.683504+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-02-09T08:11:19.663 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-09T08:11:14.643546+0000 mon.a [INF] from='client.? 172.21.15.62:0/613857971' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi062-40894-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-09T08:11:19.663 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-09T08:11:14.646296+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi062-41995-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-09T08:11:22.922 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:11:22.917+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:11:27.975 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:11:27.966+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:11:28.230 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-09T08:11:14.649752+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-41096-6", "tierpool": "test-rados-api-smithi062-41096-9", "force_nonempty": "--force-nonempty" }]': finished 2024-02-09T08:11:28.230 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: [ OK ] LibRadosCmd.WatchLog (35646 ms) 2024-02-09T08:11:28.230 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: [----------] 4 tests from LibRadosCmd (438373 ms total) 2024-02-09T08:11:28.230 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: 2024-02-09T08:11:28.230 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: [----------] Global test environment tear-down 2024-02-09T08:11:28.230 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: [==========] 4 tests from 1 test suite ran. (438373 ms total) 2024-02-09T08:11:28.230 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: [ PASSED ] 4 tests. 2024-02-09T08:11:29.858 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: Running main() from gmock_main.cc 2024-02-09T08:11:29.858 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [==========] Running 11 tests from 2 test suites. 2024-02-09T08:11:29.859 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [----------] Global test environment set-up. 2024-02-09T08:11:29.859 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify 2024-02-09T08:11:29.859 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify 2024-02-09T08:11:29.859 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: watch_notify_test_cb 2024-02-09T08:11:29.859 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify (53569 ms) 2024-02-09T08:11:29.859 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch2Delete 2024-02-09T08:11:29.859 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2024-02-09T08:11:29.859 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94914552061552 err -107 2024-02-09T08:11:29.859 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch2Delete (16949 ms) 2024-02-09T08:11:29.859 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete 2024-02-09T08:11:29.859 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2024-02-09T08:11:29.859 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94914552061552 err -107 2024-02-09T08:11:29.859 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete (10114 ms) 2024-02-09T08:11:29.860 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2 2024-02-09T08:11:29.860 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: watch_notify2_test_cb from 4471 notify_id 399431958528 cookie 94914552063600 2024-02-09T08:11:29.860 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2 (14941 ms) 2024-02-09T08:11:29.860 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchNotify2 2024-02-09T08:11:29.860 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: watch_notify2_test_cb from 4471 notify_id 523986010112 cookie 94914552102160 2024-02-09T08:11:29.860 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchNotify2 (30703 ms) 2024-02-09T08:11:29.860 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioNotify 2024-02-09T08:11:29.860 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: watch_notify2_test_cb from 4471 notify_id 579820584960 cookie 94914552102160 2024-02-09T08:11:29.860 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioNotify (23511 ms) 2024-02-09T08:11:29.860 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Multi 2024-02-09T08:11:29.860 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: watch_notify2_test_cb from 4471 notify_id 687194767361 cookie 94914552102160 2024-02-09T08:11:29.860 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: watch_notify2_test_cb from 4471 notify_id 687194767361 cookie 94914552115584 2024-02-09T08:11:29.860 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Multi (21409 ms) 2024-02-09T08:11:29.860 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Timeout 2024-02-09T08:11:29.861 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: watch_notify2_test_cb from 4471 notify_id 751619276800 cookie 94914552102160 2024-02-09T08:11:29.861 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: watch_notify2_test_cb from 4471 notify_id 764504178689 cookie 94914552102160 2024-02-09T08:11:29.861 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Timeout (48551 ms) 2024-02-09T08:11:29.861 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch3Timeout 2024-02-09T08:11:29.861 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: waiting up to 1024 for osd to time us out ... 2024-02-09T08:11:29.862 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94914552115584 err -107 2024-02-09T08:11:29.862 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: watch_notify2_test_cb from 4471 notify_id 1241245548545 cookie 94914552115584 2024-02-09T08:11:29.862 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch3Timeout (143107 ms) 2024-02-09T08:11:29.862 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete2 2024-02-09T08:11:29.862 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: waiting up to 30 for disconnect notification ... 2024-02-09T08:11:29.862 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94914552115584 err -107 2024-02-09T08:11:29.862 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete2 (9343 ms) 2024-02-09T08:11:29.862 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify (372198 ms total) 2024-02-09T08:11:29.862 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: 2024-02-09T08:11:29.862 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC 2024-02-09T08:11:29.862 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotifyEC.WatchNotify 2024-02-09T08:11:29.862 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: watch_notify_test_cb 2024-02-09T08:11:29.862 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [ OK ] LibRadosWatchNotifyEC.WatchNotify (8165 ms) 2024-02-09T08:11:29.862 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC (8165 ms total) 2024-02-09T08:11:29.863 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: 2024-02-09T08:11:29.863 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [----------] Global test environment tear-down 2024-02-09T08:11:29.863 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [==========] 11 tests from 2 test suites ran. (440046 ms total) 2024-02-09T08:11:29.863 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [ PASSED ] 11 tests. 2024-02-09T08:11:29.871 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: process_1_[41792]: starting. 2024-02-09T08:11:29.871 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: process_1_[41792]: creating pool ceph_test_rados_delete_pools_parallel.smithi062-41728 2024-02-09T08:11:29.871 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: process_1_[41792]: created object 0... 2024-02-09T08:11:29.871 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: process_1_[41792]: created object 25... 2024-02-09T08:11:29.872 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: process_1_[41792]: created object 49... 2024-02-09T08:11:29.872 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: process_1_[41792]: finishing. 2024-02-09T08:11:29.872 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: process_1_[41792]: shutting down. 2024-02-09T08:11:29.872 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: process_2_[41793]: starting. 2024-02-09T08:11:29.872 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: process_2_[41793]: deleting pool ceph_test_rados_delete_pools_parallel.smithi062-41728 2024-02-09T08:11:29.872 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: process_2_[41793]: shutting down. 2024-02-09T08:11:29.872 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: ******************************* 2024-02-09T08:11:29.872 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: process_3_[84413]: starting. 2024-02-09T08:11:29.872 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: process_3_[84413]: creating pool ceph_test_rados_delete_pools_parallel.smithi062-41728 2024-02-09T08:11:29.872 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: process_3_[84413]: created object 0... 2024-02-09T08:11:29.872 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: process_3_[84413]: created object 25... 2024-02-09T08:11:29.873 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: process_3_[84413]: created object 49... 2024-02-09T08:11:29.873 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: process_3_[84413]: finishing. 2024-02-09T08:11:29.873 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: process_3_[84413]: shutting down. 2024-02-09T08:11:29.873 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: ******************************* 2024-02-09T08:11:29.873 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: process_5_[84415]: starting. 2024-02-09T08:11:29.873 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: process_5_[84415]: listing objects. 2024-02-09T08:11:29.873 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: process_5_[84415]: listed object 0... 2024-02-09T08:11:29.873 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: process_5_[84415]: listed object 25... 2024-02-09T08:11:29.873 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: process_5_[84415]: saw 50 objects 2024-02-09T08:11:29.873 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: process_5_[84415]: shutting down. 2024-02-09T08:11:29.873 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: ******************************* 2024-02-09T08:11:29.873 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: process_4_[84414]: starting. 2024-02-09T08:11:29.873 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: process_4_[84414]: deleting pool ceph_test_rados_delete_pools_parallel.smithi062-41728 2024-02-09T08:11:29.873 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: process_4_[84414]: shutting down. 2024-02-09T08:11:29.874 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: ******************************* 2024-02-09T08:11:29.874 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: ******************************* 2024-02-09T08:11:29.874 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: ******* SUCCESS ********** 2024-02-09T08:11:29.877 INFO:tasks.workunit.client.0.smithi062.stdout:sc.WriteSame 2024-02-09T08:11:29.877 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [ OK ] LibRadosMisc.WriteSame (12338 ms) 2024-02-09T08:11:29.877 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [ RUN ] LibRadosMisc.CmpExt 2024-02-09T08:11:29.877 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [ OK ] LibRadosMisc.CmpExt (44501 ms) 2024-02-09T08:11:29.877 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [ RUN ] LibRadosMisc.Applications 2024-02-09T08:11:29.877 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [ OK ] LibRadosMisc.Applications (6651 ms) 2024-02-09T08:11:29.877 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatOSD 2024-02-09T08:11:29.877 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatOSD (0 ms) 2024-02-09T08:11:29.877 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatClient 2024-02-09T08:11:29.878 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatClient (0 ms) 2024-02-09T08:11:29.878 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [ RUN ] LibRadosMisc.ShutdownRace 2024-02-09T08:11:29.878 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [ OK ] LibRadosMisc.ShutdownRace (75663 ms) 2024-02-09T08:11:29.878 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [----------] 8 tests from LibRadosMisc (149902 ms total) 2024-02-09T08:11:29.878 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: 2024-02-09T08:11:29.878 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [----------] Global test environment tear-down 2024-02-09T08:11:29.878 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [==========] 12 tests from 4 test suites ran. (440153 ms total) 2024-02-09T08:11:29.878 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [ PASSED ] 12 tests. 2024-02-09T08:11:32.994 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:11:32.991+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:11:33.329 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:09:42.735 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:11:33.407 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:09:42.813 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:11:33.499 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:09:42.905 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:11:33.507 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:09:42.913 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:11:33.544 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:09:42.940 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:11:33.547 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:09:42.954 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:11:33.568 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:09:42.964 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:11:33.628 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:09:43.034 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:11:33.670 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:09:43.067 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:11:35.687 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: Running main() from gmock_main.cc 2024-02-09T08:11:35.687 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [==========] Running 13 tests from 4 test suites. 2024-02-09T08:11:35.687 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [----------] Global test environment set-up. 2024-02-09T08:11:35.687 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots 2024-02-09T08:11:35.687 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapList 2024-02-09T08:11:35.687 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapList (28814 ms) 2024-02-09T08:11:35.687 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapRemove 2024-02-09T08:11:35.687 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapRemove (33075 ms) 2024-02-09T08:11:35.687 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.Rollback 2024-02-09T08:11:35.687 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ OK ] LibRadosSnapshots.Rollback (27746 ms) 2024-02-09T08:11:35.688 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapGetName 2024-02-09T08:11:35.688 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapGetName (4907 ms) 2024-02-09T08:11:35.688 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots (94542 ms total) 2024-02-09T08:11:35.688 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: 2024-02-09T08:11:35.688 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged 2024-02-09T08:11:35.688 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Snap 2024-02-09T08:11:35.688 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Snap (30623 ms) 2024-02-09T08:11:35.688 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Rollback 2024-02-09T08:11:35.688 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Rollback (19687 ms) 2024-02-09T08:11:35.688 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.FutureSnapRollback 2024-02-09T08:11:35.688 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.FutureSnapRollback (140896 ms) 2024-02-09T08:11:35.688 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged (191206 ms total) 2024-02-09T08:11:35.688 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: 2024-02-09T08:11:35.688 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC 2024-02-09T08:11:35.689 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapList 2024-02-09T08:11:35.689 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapList (32230 ms) 2024-02-09T08:11:35.689 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapRemove 2024-02-09T08:11:35.689 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapRemove (9484 ms) 2024-02-09T08:11:35.689 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.Rollback 2024-02-09T08:11:35.689 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.Rollback (8468 ms) 2024-02-09T08:11:35.689 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapGetName 2024-02-09T08:11:35.689 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapGetName (8475 ms) 2024-02-09T08:11:35.689 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC (58657 ms total) 2024-02-09T08:11:35.689 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: 2024-02-09T08:11:35.689 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC 2024-02-09T08:11:35.689 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Snap 2024-02-09T08:11:35.689 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Snap (41304 ms) 2024-02-09T08:11:35.690 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Rollback 2024-02-09T08:11:35.690 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Rollback (30436 ms) 2024-02-09T08:11:35.690 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC (71740 ms total) 2024-02-09T08:11:35.690 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: 2024-02-09T08:11:35.690 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [----------] Global test environment tear-down 2024-02-09T08:11:35.690 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [==========] 13 tests from 4 test suites ran. (445920 ms total) 2024-02-09T08:11:35.690 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ PASSED ] 13 tests. 2024-02-09T08:11:38.010 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:11:38.006+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:11:43.037 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:11:43.034+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:11:45.558 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: Running main() from gmock_main.cc 2024-02-09T08:11:45.558 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [==========] Running 21 tests from 5 test suites. 2024-02-09T08:11:45.558 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [----------] Global test environment set-up. 2024-02-09T08:11:45.558 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP 2024-02-09T08:11:45.558 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: seed 41242 2024-02-09T08:11:45.558 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapListPP 2024-02-09T08:11:45.558 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapListPP (14648 ms) 2024-02-09T08:11:45.558 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapRemovePP 2024-02-09T08:11:45.558 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapRemovePP (11647 ms) 2024-02-09T08:11:45.558 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.RollbackPP 2024-02-09T08:11:45.559 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.RollbackPP (10279 ms) 2024-02-09T08:11:45.559 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapGetNamePP 2024-02-09T08:11:45.559 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapGetNamePP (7762 ms) 2024-02-09T08:11:45.559 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapCreateRemovePP 2024-02-09T08:11:45.559 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapCreateRemovePP (26265 ms) 2024-02-09T08:11:45.559 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP (70601 ms total) 2024-02-09T08:11:45.559 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: 2024-02-09T08:11:45.559 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP 2024-02-09T08:11:45.559 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapPP 2024-02-09T08:11:45.559 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapPP (178802 ms) 2024-02-09T08:11:45.559 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2024-02-09T08:11:45.559 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.RollbackPP (6448 ms) 2024-02-09T08:11:45.560 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2024-02-09T08:11:45.560 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP (35148 ms) 2024-02-09T08:11:45.560 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.Bug11677 2024-02-09T08:11:45.560 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.Bug11677 (38459 ms) 2024-02-09T08:11:45.560 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.OrderSnap 2024-02-09T08:11:45.560 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.OrderSnap (5141 ms) 2024-02-09T08:11:45.560 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-02-09T08:11:45.560 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1310-g0089f33e/rpm/el9/BUILD/ceph-19.0.0-1310-g0089f33e/src/test/librados/snapshots_cxx.cc:463: Skipped 2024-02-09T08:11:45.560 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: 2024-02-09T08:11:45.560 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback (0 ms) 2024-02-09T08:11:45.560 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap 2024-02-09T08:11:45.560 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: deleting snap 14 in pool LibRadosSnapshotsSelfManagedPP_smithi062-41242-7 2024-02-09T08:11:45.561 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: waiting for snaps to purge 2024-02-09T08:11:45.561 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap (21714 ms) 2024-02-09T08:11:45.561 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP (285712 ms total) 2024-02-09T08:11:45.561 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: 2024-02-09T08:11:45.561 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode 2024-02-09T08:11:45.561 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected 2024-02-09T08:11:45.561 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected (11 ms) 2024-02-09T08:11:45.561 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance 2024-02-09T08:11:45.561 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance (58103 ms) 2024-02-09T08:11:45.561 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode (58114 ms total) 2024-02-09T08:11:45.561 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: 2024-02-09T08:11:45.561 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP 2024-02-09T08:11:45.562 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapListPP 2024-02-09T08:11:45.562 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapListPP (8812 ms) 2024-02-09T08:11:45.562 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapRemovePP 2024-02-09T08:11:48.109 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:11:48.106+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:11:53.171 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:11:53.167+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:11:53.370 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:10:02.777 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:11:53.458 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:10:02.864 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:11:53.525 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:10:02.922 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:11:53.531 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:10:02.927 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:11:53.540 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:10:02.947 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:11:53.542 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:10:02.949 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:11:53.567 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:10:02.973 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:11:53.622 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:10:03.029 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:11:53.632 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:10:03.029 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:11:58.283 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:11:58.280+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:12:03.300 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:12:03.297+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:12:08.428 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:12:08.424+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:12:11.011 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ OK io: Running main() from gmock_main.cc 2024-02-09T08:12:11.011 INFO:tasks.workunit.client.0.smithi062.stdout: io: [==========] Running 14 tests from 1 test suite. 2024-02-09T08:12:11.011 INFO:tasks.workunit.client.0.smithi062.stdout: io: [----------] Global test environment set-up. 2024-02-09T08:12:11.011 INFO:tasks.workunit.client.0.smithi062.stdout: io: [----------] 14 tests from NeoRadosIo 2024-02-09T08:12:11.011 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ RUN ] NeoRadosIo.Limits 2024-02-09T08:12:11.011 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ OK ] NeoRadosIo.Limits (103519 ms) 2024-02-09T08:12:11.011 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ RUN ] NeoRadosIo.SimpleWrite 2024-02-09T08:12:11.011 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ OK ] NeoRadosIo.SimpleWrite (90499 ms) 2024-02-09T08:12:11.011 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ RUN ] NeoRadosIo.ReadOp 2024-02-09T08:12:11.011 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ OK ] NeoRadosIo.ReadOp (91928 ms) 2024-02-09T08:12:11.012 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ RUN ] NeoRadosIo.SparseRead 2024-02-09T08:12:11.012 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ OK ] NeoRadosIo.SparseRead (17275 ms) 2024-02-09T08:12:11.012 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ RUN ] NeoRadosIo.RoundTrip 2024-02-09T08:12:11.012 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ OK ] NeoRadosIo.RoundTrip (77793 ms) 2024-02-09T08:12:11.012 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ RUN ] NeoRadosIo.ReadIntoBuufferlist 2024-02-09T08:12:11.012 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ OK ] NeoRadosIo.ReadIntoBuufferlist (32283 ms) 2024-02-09T08:12:11.012 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ RUN ] NeoRadosIo.OverlappingWriteRoundTrip 2024-02-09T08:12:11.012 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ OK ] NeoRadosIo.OverlappingWriteRoundTrip (24809 ms) 2024-02-09T08:12:11.012 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ RUN ] NeoRadosIo.WriteFullRoundTrip 2024-02-09T08:12:11.012 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ OK ] NeoRadosIo.WriteFullRoundTrip (11673 ms) 2024-02-09T08:12:11.012 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ RUN ] NeoRadosIo.AppendRoundTrip 2024-02-09T08:12:11.012 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ OK ] NeoRadosIo.AppendRoundTrip (4678 ms) 2024-02-09T08:12:11.012 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ RUN ] NeoRadosIo.Trunc 2024-02-09T08:12:11.012 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ OK ] NeoRadosIo.Trunc (3104 ms) 2024-02-09T08:12:11.013 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ RUN ] NeoRadosIo.Remove 2024-02-09T08:12:11.013 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ OK ] NeoRadosIo.Remove (5049 ms) 2024-02-09T08:12:11.013 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ RUN ] NeoRadosIo.XattrsRoundTrip 2024-02-09T08:12:11.013 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ OK ] NeoRadosIo.XattrsRoundTrip (4893 ms) 2024-02-09T08:12:11.013 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ RUN ] NeoRadosIo.RmXattr 2024-02-09T08:12:11.013 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ OK ] NeoRadosIo.RmXattr (8495 ms) 2024-02-09T08:12:11.013 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ RUN ] NeoRadosIo.GetXattrs 2024-02-09T08:12:11.013 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ OK ] NeoRadosIo.GetXattrs (4945 ms) 2024-02-09T08:12:11.013 INFO:tasks.workunit.client.0.smithi062.stdout: io: [----------] 14 tests from NeoRadosIo (480944 ms total) 2024-02-09T08:12:11.013 INFO:tasks.workunit.client.0.smithi062.stdout: io: 2024-02-09T08:12:11.013 INFO:tasks.workunit.client.0.smithi062.stdout: io: [----------] Global test environment tear-down 2024-02-09T08:12:11.013 INFO:tasks.workunit.client.0.smithi062.stdout: io: [==========] 14 tests from 1 test suite ran. (480944 ms total) 2024-02-09T08:12:11.013 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ PASSED ] 14 tests. 2024-02-09T08:12:11.042 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:10:20.448 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:12:11.071 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:10:20.468 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:12:11.074 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:10:20.471 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:12:11.077 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:10:20.483 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:12:11.079 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:10:20.485 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:12:11.088 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:10:20.494 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:12:11.237 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:10:20.644 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:12:11.240 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:10:20.636 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:12:11.380 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:10:20.786 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:12:13.492 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:12:13.488+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:12:13.821 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:10:23.217 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:12:13.843 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:10:23.249 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:12:13.847 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:10:23.253 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:12:13.890 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:10:23.287 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:12:13.958 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:10:23.354 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:12:14.031 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:10:23.437 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:12:16.838 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:10:26.245 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:12:16.839 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:10:26.246 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:12:16.911 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:10:26.318 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:12:18.512 INFO:tasks.workunit.client.0.smithi062.stdout:********* 2024-02-09T08:12:18.512 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_9_[90807]: starting. 2024-02-09T08:12:18.512 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_9_[90807]: creating pool ceph_test_rados_list_parallel.smithi062-41681 2024-02-09T08:12:18.512 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_9_[90807]: created object 0... 2024-02-09T08:12:18.512 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_9_[90807]: created object 25... 2024-02-09T08:12:18.512 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_9_[90807]: created object 49... 2024-02-09T08:12:18.512 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_9_[90807]: finishing. 2024-02-09T08:12:18.513 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_9_[90807]: shutting down. 2024-02-09T08:12:18.513 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-09T08:12:18.513 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-09T08:12:18.513 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-09T08:12:18.513 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_10_[90808]: starting. 2024-02-09T08:12:18.513 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_10_[90808]: listing objects. 2024-02-09T08:12:18.513 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_10_[90808]: listed object 0... 2024-02-09T08:12:18.513 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_10_[90808]: listed object 25... 2024-02-09T08:12:18.513 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_10_[90808]: listed object 50... 2024-02-09T08:12:18.513 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_10_[90808]: listed object 75... 2024-02-09T08:12:18.513 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_10_[90808]: saw 99 objects 2024-02-09T08:12:18.513 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_10_[90808]: shutting down. 2024-02-09T08:12:18.513 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-09T08:12:18.513 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-09T08:12:18.513 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-09T08:12:18.514 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_13_[90811]: starting. 2024-02-09T08:12:18.514 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_13_[90811]: removed 25 objects... 2024-02-09T08:12:18.514 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_13_[90811]: removed half of the objects 2024-02-09T08:12:18.514 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_13_[90811]: removed 50 objects... 2024-02-09T08:12:18.514 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_13_[90811]: removed 50 objects 2024-02-09T08:12:18.514 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_13_[90811]: shutting down. 2024-02-09T08:12:18.514 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-09T08:12:18.514 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-09T08:12:18.514 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-09T08:12:18.514 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_11_[90809]: starting. 2024-02-09T08:12:18.514 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_11_[90809]: added 25 objects... 2024-02-09T08:12:18.514 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_11_[90809]: added half of the objects 2024-02-09T08:12:18.514 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_11_[90809]: added 50 objects... 2024-02-09T08:12:18.514 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_11_[90809]: added 50 objects 2024-02-09T08:12:18.515 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_11_[90809]: shutting down. 2024-02-09T08:12:18.515 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-09T08:12:18.515 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-09T08:12:18.515 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-09T08:12:18.515 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_12_[90810]: starting. 2024-02-09T08:12:18.515 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_12_[90810]: added 25 objects... 2024-02-09T08:12:18.515 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_12_[90810]: added half of the objects 2024-02-09T08:12:18.515 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_12_[90810]: added 50 objects... 2024-02-09T08:12:18.515 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_12_[90810]: added 50 objects 2024-02-09T08:12:18.515 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_12_[90810]: shutting down. 2024-02-09T08:12:18.515 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-09T08:12:18.515 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-09T08:12:18.515 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-09T08:12:18.515 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-09T08:12:18.515 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_14_[104812]: starting. 2024-02-09T08:12:18.516 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_14_[104812]: creating pool ceph_test_rados_list_parallel.smithi062-41681 2024-02-09T08:12:18.516 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_14_[104812]: created object 0... 2024-02-09T08:12:18.516 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_14_[104812]: created object 25... 2024-02-09T08:12:18.516 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_14_[104812]: created object 49... 2024-02-09T08:12:18.516 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_14_[104812]: finishing. 2024-02-09T08:12:18.516 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_14_[104812]: shutting down. 2024-02-09T08:12:18.516 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-09T08:12:18.516 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-09T08:12:18.516 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-09T08:12:18.516 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-09T08:12:18.516 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_15_[104813]: starting. 2024-02-09T08:12:18.516 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_15_[104813]: listing objects. 2024-02-09T08:12:18.516 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_15_[104813]: listed object 0... 2024-02-09T08:12:18.592 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:12:18.589+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:12:23.606 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:12:23.602+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:12:26.939 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_15_[104813]: list read_operations: Running main() from gmock_main.cc 2024-02-09T08:12:26.939 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [==========] Running 14 tests from 1 test suite. 2024-02-09T08:12:26.939 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [----------] Global test environment set-up. 2024-02-09T08:12:26.939 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [----------] 14 tests from NeoRadosReadOps 2024-02-09T08:12:26.939 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ RUN ] NeoRadosReadOps.SetOpFlags 2024-02-09T08:12:26.940 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ OK ] NeoRadosReadOps.SetOpFlags (119400 ms) 2024-02-09T08:12:26.940 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ RUN ] NeoRadosReadOps.AssertExists 2024-02-09T08:12:26.940 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ OK ] NeoRadosReadOps.AssertExists (51102 ms) 2024-02-09T08:12:26.940 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ RUN ] NeoRadosReadOps.AssertVersion 2024-02-09T08:12:26.940 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ OK ] NeoRadosReadOps.AssertVersion (15251 ms) 2024-02-09T08:12:26.940 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ RUN ] NeoRadosReadOps.CmpXattr 2024-02-09T08:12:26.940 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ OK ] NeoRadosReadOps.CmpXattr (175003 ms) 2024-02-09T08:12:26.940 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ RUN ] NeoRadosReadOps.Read 2024-02-09T08:12:26.940 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ OK ] NeoRadosReadOps.Read (13553 ms) 2024-02-09T08:12:26.940 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ RUN ] NeoRadosReadOps.Checksum 2024-02-09T08:12:26.940 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ OK ] NeoRadosReadOps.Checksum (18662 ms) 2024-02-09T08:12:26.940 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ RUN ] NeoRadosReadOps.RWOrderedRead 2024-02-09T08:12:26.941 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ OK ] NeoRadosReadOps.RWOrderedRead (27109 ms) 2024-02-09T08:12:26.941 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ RUN ] NeoRadosReadOps.ShortRead 2024-02-09T08:12:26.941 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ OK ] NeoRadosReadOps.ShortRead (18499 ms) 2024-02-09T08:12:26.941 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ RUN ] NeoRadosReadOps.Exec 2024-02-09T08:12:26.941 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ OK ] NeoRadosReadOps.Exec (12421 ms) 2024-02-09T08:12:26.941 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ RUN ] NeoRadosReadOps.Stat 2024-02-09T08:12:26.941 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ OK ] NeoRadosReadOps.Stat (7228 ms) 2024-02-09T08:12:26.941 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ RUN ] NeoRadosReadOps.Omap 2024-02-09T08:12:26.941 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ OK ] NeoRadosReadOps.Omap (9222 ms) 2024-02-09T08:12:26.941 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ RUN ] NeoRadosReadOps.OmapNuls 2024-02-09T08:12:26.941 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ OK ] NeoRadosReadOps.OmapNuls (12294 ms) 2024-02-09T08:12:26.941 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ RUN ] NeoRadosReadOps.GetXattrs 2024-02-09T08:12:26.941 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ OK ] NeoRadosReadOps.GetXattrs (6704 ms) 2024-02-09T08:12:26.941 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ RUN ] NeoRadosReadOps.CmpExt 2024-02-09T08:12:26.942 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ OK ] NeoRadosReadOps.CmpExt (10367 ms) 2024-02-09T08:12:26.942 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [----------] 14 tests from NeoRadosReadOps (496816 ms total) 2024-02-09T08:12:26.942 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: 2024-02-09T08:12:26.942 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [----------] Global test environment tear-down 2024-02-09T08:12:26.942 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [==========] 14 tests from 1 test suite ran. (496816 ms total) 2024-02-09T08:12:26.942 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ PASSED ] 14 tests. 2024-02-09T08:12:28.620 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:12:28.617+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:12:32.496 INFO:tasks.workunit.client.0.smithi062.stdout:ed object 25... 2024-02-09T08:12:32.496 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_15_[104813]: listed object 50... 2024-02-09T08:12:32.496 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_15_[104813]: listed object 75... 2024-02-09T08:12:32.496 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_15_[104813]: listed object 100... 2024-02-09T08:12:32.496 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_15_[104813]: listed object 125... 2024-02-09T08:12:32.496 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_15_[104813]: saw 150 objects 2024-02-09T08:12:32.496 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_15_[104813]: shutting down. 2024-02-09T08:12:32.496 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-09T08:12:32.496 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-09T08:12:32.497 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-09T08:12:32.497 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-09T08:12:32.497 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_16_[104814]: starting. 2024-02-09T08:12:32.497 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_16_[104814]: added 25 objects... 2024-02-09T08:12:32.497 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_16_[104814]: added half of the objects 2024-02-09T08:12:32.497 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_16_[104814]: added 50 objects... 2024-02-09T08:12:32.497 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_16_[104814]: added 50 objects 2024-02-09T08:12:32.497 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_16_[104814]: shutting down. 2024-02-09T08:12:32.497 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-09T08:12:32.497 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-09T08:12:32.497 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-09T08:12:32.497 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-09T08:12:32.498 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-09T08:12:32.498 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******* SUCCESS ********** 2024-02-09T08:12:33.661 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:12:33.658+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:12:33.899 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:10:43.305 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:12:33.971 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:10:43.378 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:12:34.042 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:10:43.439 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:12:34.049 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:10:43.446 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:12:34.055 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:10:43.462 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:12:34.057 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:10:43.464 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:12:34.069 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:10:43.476 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:12:34.141 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:10:43.537 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:12:34.149 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:10:43.556 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:12:38.726 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:12:38.721+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:12:38.894 INFO:tasks.workunit.client.0.smithi062.stdout: ] LibRadosSnapshotsECPP.SnapRemovePP (4444 ms) 2024-02-09T08:12:38.894 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.RollbackPP 2024-02-09T08:12:38.894 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.RollbackPP (6092 ms) 2024-02-09T08:12:38.894 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapGetNamePP 2024-02-09T08:12:38.895 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapGetNamePP (3936 ms) 2024-02-09T08:12:38.895 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP (23284 ms total) 2024-02-09T08:12:38.895 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: 2024-02-09T08:12:38.895 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP 2024-02-09T08:12:38.895 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2024-02-09T08:12:38.895 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.SnapPP (8880 ms) 2024-02-09T08:12:38.895 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2024-02-09T08:12:38.895 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.RollbackPP (17168 ms) 2024-02-09T08:12:38.895 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2024-02-09T08:12:38.895 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.Bug11677 (8134 ms) 2024-02-09T08:12:38.895 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP (34182 ms total) 2024-02-09T08:12:38.895 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: 2024-02-09T08:12:38.895 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [----------] Global test environment tear-down 2024-02-09T08:12:38.895 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [==========] 21 tests from 5 test suites ran. (509115 ms total) 2024-02-09T08:12:38.895 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ PASSED ] 20 tests. 2024-02-09T08:12:38.896 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ SKIPPED ] 1 test, listed below: 2024-02-09T08:12:38.896 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-02-09T08:12:43.746 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:12:43.740+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:12:48.831 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:12:48.827+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:12:53.851 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:12:53.845+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:12:53.916 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:11:03.323 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:12:53.920 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:11:03.326 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:12:53.989 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:11:03.386 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:12:53.992 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:11:03.389 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:12:54.002 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:11:03.408 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:12:54.004 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:11:03.411 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:12:54.016 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:11:03.423 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:12:54.065 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:11:03.461 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:12:54.082 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:11:03.489 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:12:58.864 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:12:58.861+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:13:03.905 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:13:03.902+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:13:08.920 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:13:08.917+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:13:14.016 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:13:14.010+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:13:14.248 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:11:23.655 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:13:14.262 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:11:23.668 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:13:14.268 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:11:23.664 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:13:14.271 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:11:23.667 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:13:14.272 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:11:23.679 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:13:14.275 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:11:23.682 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:13:14.405 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:11:23.802 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:13:14.410 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:11:23.817 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:13:14.474 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:11:23.880 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:13:18.609 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: Running main() from gmock_main.cc 2024-02-09T08:13:18.609 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [==========] Running 42 tests from 2 test suites. 2024-02-09T08:13:18.609 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [----------] Global test environment set-up. 2024-02-09T08:13:18.609 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [----------] 26 tests from LibRadosAio 2024-02-09T08:13:18.610 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAio.TooBig 2024-02-09T08:13:18.610 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAio.TooBig (6200 ms) 2024-02-09T08:13:18.610 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAio.SimpleWrite 2024-02-09T08:13:18.610 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAio.SimpleWrite (315334 ms) 2024-02-09T08:13:18.610 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAio.WaitForSafe 2024-02-09T08:13:18.610 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAio.WaitForSafe (9909 ms) 2024-02-09T08:13:18.610 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip 2024-02-09T08:13:18.610 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip (46728 ms) 2024-02-09T08:13:18.610 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip2 2024-02-09T08:13:18.610 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip2 (32128 ms) 2024-02-09T08:13:18.610 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip3 2024-02-09T08:13:18.610 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip3 (23274 ms) 2024-02-09T08:13:18.610 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripAppend 2024-02-09T08:13:18.610 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAio.RoundTripAppend (11226 ms) 2024-02-09T08:13:18.611 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAio.RemoveTest 2024-02-09T08:13:18.611 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAio.RemoveTest (4364 ms) 2024-02-09T08:13:18.611 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAio.XattrsRoundTrip 2024-02-09T08:13:18.611 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAio.XattrsRoundTrip (6776 ms) 2024-02-09T08:13:18.611 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAio.RmXattr 2024-02-09T08:13:18.611 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAio.RmXattr (13955 ms) 2024-02-09T08:13:18.611 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAio.XattrIter 2024-02-09T08:13:18.611 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAio.XattrIter (6518 ms) 2024-02-09T08:13:18.611 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAio.IsComplete 2024-02-09T08:13:18.611 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAio.IsComplete (5357 ms) 2024-02-09T08:13:18.611 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAio.IsSafe 2024-02-09T08:13:18.611 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAio.IsSafe (7207 ms) 2024-02-09T08:13:18.611 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAio.ReturnValue 2024-02-09T08:13:18.611 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAio.ReturnValue (3674 ms) 2024-02-09T08:13:18.611 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAio.Flush 2024-02-09T08:13:18.612 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAio.Flush (3407 ms) 2024-02-09T08:13:18.612 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAio.FlushAsync 2024-02-09T08:13:18.612 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAio.FlushAsync (5746 ms) 2024-02-09T08:13:18.612 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteFull 2024-02-09T08:13:18.612 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteFull (4723 ms) 2024-02-09T08:13:18.612 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteSame 2024-02-09T08:13:18.612 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteSame (5846 ms) 2024-02-09T08:13:18.612 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStat 2024-02-09T08:13:18.612 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAio.SimpleStat (4564 ms) 2024-02-09T08:13:18.612 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAio.OperateMtime 2024-02-09T08:13:18.612 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAio.OperateMtime (4504 ms) 2024-02-09T08:13:18.612 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAio.Operate2Mtime 2024-02-09T08:13:18.612 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAio.Operate2Mtime (4988 ms) 2024-02-09T08:13:18.613 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStatNS 2024-02-09T08:13:18.613 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAio.SimpleStatNS (4193 ms) 2024-02-09T08:13:18.613 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAio.StatRemove 2024-02-09T08:13:18.613 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAio.StatRemove (4797 ms) 2024-02-09T08:13:18.613 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAio.ExecuteClass 2024-02-09T08:13:18.613 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAio.ExecuteClass (5664 ms) 2024-02-09T08:13:18.613 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAio.MultiWrite 2024-02-09T08:13:18.613 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAio.MultiWrite (3457 ms) 2024-02-09T08:13:18.614 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAio.AioUnlock 2024-02-09T08:13:18.614 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAio.AioUnlock (4445 ms) 2024-02-09T08:13:18.614 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [----------] 26 tests from LibRadosAio (548988 ms total) 2024-02-09T08:13:18.614 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: 2024-02-09T08:13:18.614 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [----------] 16 tests from LibRadosAioEC 2024-02-09T08:13:19.029 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:13:19.025+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:13:24.040 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:13:24.037+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:13:29.102 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:13:29.085+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:13:34.106 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:13:34.103+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:13:34.161 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:11:43.557 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:13:34.161 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:11:43.567 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:13:34.162 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:11:43.559 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:13:34.208 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:11:43.605 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:13:34.214 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:11:43.620 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:13:34.216 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:11:43.623 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:13:34.218 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:11:43.625 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:13:34.264 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:11:43.670 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:13:34.264 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:11:43.671 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:13:39.115 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:13:39.113+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:13:44.127 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:13:44.123+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:13:49.136 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:13:49.133+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:13:51.419 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-02-09T08:13:51.413+0000 ec49640 -1 osd.5 460 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17497.0:156 134.3s0 134:d1c21232:::155:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e448) 2024-02-09T08:13:52.452 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-02-09T08:13:52.445+0000 ec49640 -1 osd.5 460 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17497.0:156 134.3s0 134:d1c21232:::155:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e448) 2024-02-09T08:13:53.495 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-02-09T08:13:53.489+0000 ec49640 -1 osd.5 460 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17497.0:156 134.3s0 134:d1c21232:::155:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e448) 2024-02-09T08:13:53.739 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:13:53.734+0000 ec49640 -1 osd.0 460 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4921.0:705 95.1f 95:f9fcb2f5:::test_698:head [cmpext 0~0 in=4b,write 0~3 in=3b] snapc 0=[] ondisk+write+known_if_redirected+returnvec+supports_pool_eio e451) 2024-02-09T08:13:54.155 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:13:54.151+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:13:54.254 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:12:03.661 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:13:54.260 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:12:03.666 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:13:54.260 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:12:03.667 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:13:54.262 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:12:03.669 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:13:54.289 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:12:03.696 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:13:54.292 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:12:03.699 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:13:54.308 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:12:03.705 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:13:54.309 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:12:03.706 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:13:54.334 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:12:03.730 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:13:54.506 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-02-09T08:13:54.500+0000 ec49640 -1 osd.5 460 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17497.0:156 134.3s0 134:d1c21232:::155:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e448) 2024-02-09T08:13:54.747 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:13:54.743+0000 ec49640 -1 osd.0 460 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4921.0:705 95.1f 95:f9fcb2f5:::test_698:head [cmpext 0~0 in=4b,write 0~3 in=3b] snapc 0=[] ondisk+write+known_if_redirected+returnvec+supports_pool_eio e451) 2024-02-09T08:13:55.467 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-02-09T08:13:55.462+0000 ec49640 -1 osd.5 460 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17497.0:156 134.3s0 134:d1c21232:::155:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e448) 2024-02-09T08:13:55.747 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:13:55.743+0000 ec49640 -1 osd.0 460 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4921.0:705 95.1f 95:f9fcb2f5:::test_698:head [cmpext 0~0 in=4b,write 0~3 in=3b] snapc 0=[] ondisk+write+known_if_redirected+returnvec+supports_pool_eio e451) 2024-02-09T08:13:56.442 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-02-09T08:13:56.436+0000 ec49640 -1 osd.5 460 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17497.0:156 134.3s0 134:d1c21232:::155:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e448) 2024-02-09T08:13:56.800 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:13:56.796+0000 ec49640 -1 osd.0 460 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4921.0:705 95.1f 95:f9fcb2f5:::test_698:head [cmpext 0~0 in=4b,write 0~3 in=3b] snapc 0=[] ondisk+write+known_if_redirected+returnvec+supports_pool_eio e451) 2024-02-09T08:13:57.448 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-02-09T08:13:57.441+0000 ec49640 -1 osd.5 460 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17497.0:156 134.3s0 134:d1c21232:::155:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e448) 2024-02-09T08:13:57.791 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:13:57.786+0000 ec49640 -1 osd.0 460 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4921.0:705 95.1f 95:f9fcb2f5:::test_698:head [cmpext 0~0 in=4b,write 0~3 in=3b] snapc 0=[] ondisk+write+known_if_redirected+returnvec+supports_pool_eio e451) 2024-02-09T08:13:58.499 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-02-09T08:13:58.493+0000 ec49640 -1 osd.5 460 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17497.0:156 134.3s0 134:d1c21232:::155:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e448) 2024-02-09T08:13:58.798 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:13:58.793+0000 ec49640 -1 osd.0 460 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4921.0:705 95.1f 95:f9fcb2f5:::test_698:head [cmpext 0~0 in=4b,write 0~3 in=3b] snapc 0=[] ondisk+write+known_if_redirected+returnvec+supports_pool_eio e451) 2024-02-09T08:13:59.165 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:13:59.161+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:13:59.220 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:13:59.214+0000 12c51640 -1 osd.4 450 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.11004.0:352 128.16 128:6a288149:::350:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e449) 2024-02-09T08:13:59.497 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-02-09T08:13:59.491+0000 ec49640 -1 osd.5 460 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17497.0:156 134.3s0 134:d1c21232:::155:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e448) 2024-02-09T08:13:59.779 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:13:59.775+0000 ec49640 -1 osd.0 460 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4921.0:705 95.1f 95:f9fcb2f5:::test_698:head [cmpext 0~0 in=4b,write 0~3 in=3b] snapc 0=[] ondisk+write+known_if_redirected+returnvec+supports_pool_eio e451) 2024-02-09T08:14:00.464 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-02-09T08:14:00.459+0000 ec49640 -1 osd.5 460 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17497.0:156 134.3s0 134:d1c21232:::155:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e448) 2024-02-09T08:14:00.756 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:14:00.750+0000 ec49640 -1 osd.0 460 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4921.0:705 95.1f 95:f9fcb2f5:::test_698:head [cmpext 0~0 in=4b,write 0~3 in=3b] snapc 0=[] ondisk+write+known_if_redirected+returnvec+supports_pool_eio e451) 2024-02-09T08:14:01.131 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:14:01.118+0000 ec49640 -1 osd.7 460 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21883.0:2 197.a 197.8c27e3ca (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e459) 2024-02-09T08:14:01.502 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-02-09T08:14:01.495+0000 ec49640 -1 osd.5 460 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.17497.0:156 134.3s0 134:d1c21232:::155:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e448) 2024-02-09T08:14:02.103 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:14:02.096+0000 ec49640 -1 osd.7 460 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.21883.0:2 197.a 197.8c27e3ca (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e459) 2024-02-09T08:14:04.248 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:14:04.243+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:14:06.469 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAioEC.Simpl api_aio_pp: Running main() from gmock_main.cc 2024-02-09T08:14:06.469 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [==========] Running 57 tests from 4 test suites. 2024-02-09T08:14:06.469 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [----------] Global test environment set-up. 2024-02-09T08:14:06.469 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio 2024-02-09T08:14:06.469 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.TooBigPP 2024-02-09T08:14:06.470 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.TooBigPP (4841 ms) 2024-02-09T08:14:06.470 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolQuotaPP 2024-02-09T08:14:06.470 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolQuotaPP (435379 ms) 2024-02-09T08:14:06.470 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleWritePP 2024-02-09T08:14:06.470 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleWritePP (12344 ms) 2024-02-09T08:14:06.470 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.WaitForSafePP 2024-02-09T08:14:06.470 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.WaitForSafePP (5417 ms) 2024-02-09T08:14:06.470 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP 2024-02-09T08:14:06.470 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP (4049 ms) 2024-02-09T08:14:06.470 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP2 2024-02-09T08:14:06.470 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP2 (5912 ms) 2024-02-09T08:14:06.470 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP3 2024-02-09T08:14:06.470 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP3 (6286 ms) 2024-02-09T08:14:06.470 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripSparseReadPP 2024-02-09T08:14:06.471 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripSparseReadPP (6024 ms) 2024-02-09T08:14:06.471 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsCompletePP 2024-02-09T08:14:06.471 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.IsCompletePP (8786 ms) 2024-02-09T08:14:06.471 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsSafePP 2024-02-09T08:14:06.471 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.IsSafePP (7017 ms) 2024-02-09T08:14:06.471 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.ReturnValuePP 2024-02-09T08:14:06.471 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.ReturnValuePP (4615 ms) 2024-02-09T08:14:06.471 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushPP 2024-02-09T08:14:06.471 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushPP (5847 ms) 2024-02-09T08:14:06.471 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushAsyncPP 2024-02-09T08:14:06.471 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushAsyncPP (3777 ms) 2024-02-09T08:14:06.471 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP 2024-02-09T08:14:06.471 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP (4308 ms) 2024-02-09T08:14:06.472 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP2 2024-02-09T08:14:06.472 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP2 (3508 ms) 2024-02-09T08:14:06.472 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP 2024-02-09T08:14:06.472 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP (5696 ms) 2024-02-09T08:14:06.472 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP2 2024-02-09T08:14:06.472 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP2 (4679 ms) 2024-02-09T08:14:06.472 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPPNS 2024-02-09T08:14:06.472 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPPNS (4320 ms) 2024-02-09T08:14:06.472 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPP 2024-02-09T08:14:06.472 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPP (2630 ms) 2024-02-09T08:14:06.472 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime 2024-02-09T08:14:06.472 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime (4583 ms) 2024-02-09T08:14:06.472 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime2 2024-02-09T08:14:06.473 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime2 (3264 ms) 2024-02-09T08:14:06.473 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.StatRemovePP 2024-02-09T08:14:06.473 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.StatRemovePP (4681 ms) 2024-02-09T08:14:06.473 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.ExecuteClassPP 2024-02-09T08:14:06.473 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.ExecuteClassPP (3418 ms) 2024-02-09T08:14:06.473 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.OmapPP 2024-02-09T08:14:06.473 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.OmapPP (3231 ms) 2024-02-09T08:14:06.473 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiWritePP 2024-02-09T08:14:06.473 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiWritePP (3492 ms) 2024-02-09T08:14:06.473 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.AioUnlockPP 2024-02-09T08:14:06.473 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.AioUnlockPP (35552 ms) 2024-02-09T08:14:06.473 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripAppendPP 2024-02-09T08:14:09.284 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:14:09.279+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:14:14.320 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:14:14.314+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:14:14.540 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:12:23.947 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:14.544 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:12:23.951 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:14.587 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:12:23.983 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:14.590 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:12:23.996 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:14.592 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:12:23.988 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:14.594 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:12:24.001 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:14.612 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:12:24.019 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:14.644 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:12:24.040 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:14.658 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:12:24.065 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:16.095 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:12:25.491 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:16.096 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:12:25.493 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:16.131 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:12:25.528 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:16.331 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:12:25.737 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:16.332 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:12:25.739 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:16.351 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:12:25.758 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:16.850 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:12:26.256 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:16.857 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:12:26.264 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:16.878 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:12:26.284 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:19.416 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:14:19.412+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:14:24.470 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:14:24.458+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:14:29.485 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:14:29.481+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:14:29.493 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:12:38.900 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:29.549 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:12:38.946 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:29.550 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:12:38.957 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:29.554 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:12:38.951 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:29.601 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:12:38.998 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:29.602 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:12:39.008 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:29.613 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:12:39.020 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:29.615 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:12:39.021 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:29.662 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:12:39.068 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:34.529 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:14:34.526+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:14:34.708 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:12:44.115 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:34.765 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:12:44.171 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:34.772 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:12:44.168 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:34.774 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:12:44.171 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:34.793 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:12:44.199 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:34.800 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:12:44.197 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:34.840 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:12:44.246 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:34.848 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:12:44.254 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:34.877 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:12:44.284 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:39.546 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:14:39.540+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:14:44.581 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:14:44.576+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:14:44.738 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:12:54.145 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:44.798 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:12:54.194 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:44.800 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:12:54.197 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:44.812 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:12:54.219 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:44.847 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:12:54.243 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:44.868 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:12:54.274 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:44.890 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:12:54.296 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:44.893 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:12:54.300 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:44.936 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:12:54.342 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:49.594 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:14:49.591+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:14:52.224 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRados list: Running main() from gmock_main.cc 2024-02-09T08:14:52.225 INFO:tasks.workunit.client.0.smithi062.stdout: list: [==========] Running 3 tests from 1 test suite. 2024-02-09T08:14:52.225 INFO:tasks.workunit.client.0.smithi062.stdout: list: [----------] Global test environment set-up. 2024-02-09T08:14:52.225 INFO:tasks.workunit.client.0.smithi062.stdout: list: [----------] 3 tests from NeoradosList 2024-02-09T08:14:52.225 INFO:tasks.workunit.client.0.smithi062.stdout: list: [ RUN ] NeoradosList.ListObjects 2024-02-09T08:14:52.225 INFO:tasks.workunit.client.0.smithi062.stdout: list: [ OK ] NeoradosList.ListObjects (322625 ms) 2024-02-09T08:14:52.225 INFO:tasks.workunit.client.0.smithi062.stdout: list: [ RUN ] NeoradosList.ListObjectsNS 2024-02-09T08:14:52.226 INFO:tasks.workunit.client.0.smithi062.stdout: list: [ OK ] NeoradosList.ListObjectsNS (79739 ms) 2024-02-09T08:14:52.226 INFO:tasks.workunit.client.0.smithi062.stdout: list: [ RUN ] NeoradosList.ListObjectsMany 2024-02-09T08:14:52.226 INFO:tasks.workunit.client.0.smithi062.stdout: list: [ OK ] NeoradosList.ListObjectsMany (239804 ms) 2024-02-09T08:14:52.226 INFO:tasks.workunit.client.0.smithi062.stdout: list: [----------] 3 tests from NeoradosList (642168 ms total) 2024-02-09T08:14:52.226 INFO:tasks.workunit.client.0.smithi062.stdout: list: 2024-02-09T08:14:52.227 INFO:tasks.workunit.client.0.smithi062.stdout: list: [----------] Global test environment tear-down 2024-02-09T08:14:52.227 INFO:tasks.workunit.client.0.smithi062.stdout: list: [==========] 3 tests from 1 test suite ran. (642169 ms total) 2024-02-09T08:14:52.227 INFO:tasks.workunit.client.0.smithi062.stdout: list: [ PASSED ] 3 tests. 2024-02-09T08:14:54.649 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:14:54.641+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:14:54.796 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:13:04.203 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:54.802 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:13:04.209 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:54.821 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:13:04.217 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:54.823 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:13:04.229 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:54.824 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:13:04.231 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:54.899 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:13:04.295 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:54.930 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:13:04.336 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:54.966 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:13:04.372 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:54.977 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:13:04.374 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:59.673 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:14:59.669+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:14:59.681 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:13:09.088 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:59.746 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:13:09.152 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:59.763 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:13:09.169 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:59.806 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:13:09.202 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:59.807 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:13:09.203 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:59.821 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:13:09.228 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:59.824 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:13:09.231 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:59.825 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:13:09.221 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:14:59.850 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:13:09.256 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:15:04.361 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : cursor()=6:62a1935d:::14:head expected=6:62a1935d:::14:head 2024-02-09T08:15:04.361 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 6:62a1935d:::14:head -> 14 2024-02-09T08:15:04.361 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : entry=14 expected=14 2024-02-09T08:15:04.361 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 6:5c6b0b28:::7:head 2024-02-09T08:15:04.361 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : cursor()=6:5c6b0b28:::7:head expected=6:5c6b0b28:::7:head 2024-02-09T08:15:04.361 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 6:5c6b0b28:::7:head -> 7 2024-02-09T08:15:04.361 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : entry=7 expected=7 2024-02-09T08:15:04.362 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 6:d83876eb:::4:head 2024-02-09T08:15:04.362 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : cursor()=6:d83876eb:::4:head expected=6:d83876eb:::4:head 2024-02-09T08:15:04.362 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 6:d83876eb:::4:head -> 4 2024-02-09T08:15:04.362 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : entry=4 expected=4 2024-02-09T08:15:04.362 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 6:cfc208b3:::3:head 2024-02-09T08:15:04.362 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : cursor()=6:cfc208b3:::3:head expected=6:cfc208b3:::3:head 2024-02-09T08:15:04.362 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 6:cfc208b3:::3:head -> 3 2024-02-09T08:15:04.362 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : entry=3 expected=3 2024-02-09T08:15:04.362 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 6:c4fdafeb:::6:head 2024-02-09T08:15:04.362 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : cursor()=6:c4fdafeb:::6:head expected=6:c4fdafeb:::6:head 2024-02-09T08:15:04.362 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 6:c4fdafeb:::6:head -> 6 2024-02-09T08:15:04.362 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : entry=6 expected=6 2024-02-09T08:15:04.362 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 6:bd63b0f1:::8:head 2024-02-09T08:15:04.362 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : cursor()=6:bd63b0f1:::8:head expected=6:bd63b0f1:::8:head 2024-02-09T08:15:04.363 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 6:bd63b0f1:::8:head -> 8 2024-02-09T08:15:04.363 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : entry=8 expected=8 2024-02-09T08:15:04.363 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 6:89d3ae78:::11:head 2024-02-09T08:15:04.363 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : cursor()=6:89d3ae78:::11:head expected=6:89d3ae78:::11:head 2024-02-09T08:15:04.363 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 6:89d3ae78:::11:head -> 11 2024-02-09T08:15:04.363 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : entry=11 expected=11 2024-02-09T08:15:04.363 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 6:863748b0:::15:head 2024-02-09T08:15:04.363 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : cursor()=6:863748b0:::15:head expected=6:863748b0:::15:head 2024-02-09T08:15:04.363 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 6:863748b0:::15:head -> 15 2024-02-09T08:15:04.363 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : entry=15 expected=15 2024-02-09T08:15:04.363 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [ OK ] LibRadosList.ListObjectsCursor (19875 ms) 2024-02-09T08:15:04.363 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjects 2024-02-09T08:15:04.363 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [ OK ] LibRadosList.EnumerateObjects (101974 ms) 2024-02-09T08:15:04.363 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjectsSplit 2024-02-09T08:15:04.363 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: split 0/5 -> MIN 6:33333333::::head 2024-02-09T08:15:04.364 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: split 1/5 -> 6:33333333::::head 6:66666666::::head 2024-02-09T08:15:04.364 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: split 2/5 -> 6:66666666::::head 6:99999999::::head 2024-02-09T08:15:04.364 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: split 3/5 -> 6:99999999::::head 6:cccccccc::::head 2024-02-09T08:15:04.364 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: split 4/5 -> 6:cccccccc::::head MAX 2024-02-09T08:15:04.364 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [ OK ] LibRadosList.EnumerateObjectsSplit (102151 ms) 2024-02-09T08:15:04.364 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [----------] 7 tests from LibRadosList (618582 ms total) 2024-02-09T08:15:04.364 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 2024-02-09T08:15:04.364 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [----------] 3 tests from LibRadosListEC 2024-02-09T08:15:04.364 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [ RUN ] LibRadosListEC.ListObjects 2024-02-09T08:15:04.364 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [ OK ] LibRadosListEC.ListObjects (6366 ms) 2024-02-09T08:15:04.364 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsNS 2024-02-09T08:15:04.364 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: myset foo1,foo2,foo3 2024-02-09T08:15:04.364 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: foo1 2024-02-09T08:15:04.364 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: foo2 2024-02-09T08:15:04.365 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: foo3 2024-02-09T08:15:04.365 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: myset foo1,foo4,foo5 2024-02-09T08:15:04.365 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: foo4 2024-02-09T08:15:04.365 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: foo5 2024-02-09T08:15:04.365 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: foo1 2024-02-09T08:15:04.365 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: myset foo6,foo7 2024-02-09T08:15:04.365 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: foo7 2024-02-09T08:15:04.365 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: foo6 2024-02-09T08:15:04.365 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2024-02-09T08:15:04.365 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: ns1:foo4 2024-02-09T08:15:04.366 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: ns1:foo5 2024-02-09T08:15:04.366 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: ns2:foo7 2024-02-09T08:15:04.366 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: ns2:foo6 2024-02-09T08:15:04.366 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: ns1:foo1 2024-02-09T08:15:04.366 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: :foo1 2024-02-09T08:15:04.366 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: :foo2 2024-02-09T08:15:04.367 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: :foo3 2024-02-09T08:15:04.367 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsNS (13412 ms) 2024-02-09T08:15:04.367 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsStart 2024-02-09T08:15:04.367 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 1 0 2024-02-09T08:15:04.367 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 10 0 2024-02-09T08:15:04.367 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 13 0 2024-02-09T08:15:04.780 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:15:04.775+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:15:09.790 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:15:09.786+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:15:13.549 INFO:tasks.workunit.client.0.smithi062.stdout: write_operations: Running main() from gmock_main.cc 2024-02-09T08:15:13.549 INFO:tasks.workunit.client.0.smithi062.stdout: write_operations: [==========] Running 7 tests from 1 test suite. 2024-02-09T08:15:13.549 INFO:tasks.workunit.client.0.smithi062.stdout: write_operations: [----------] Global test environment set-up. 2024-02-09T08:15:13.549 INFO:tasks.workunit.client.0.smithi062.stdout: write_operations: [----------] 7 tests from NeoRadosWriteOps 2024-02-09T08:15:13.549 INFO:tasks.workunit.client.0.smithi062.stdout: write_operations: [ RUN ] NeoRadosWriteOps.AssertExists 2024-02-09T08:15:13.549 INFO:tasks.workunit.client.0.smithi062.stdout: write_operations: [ OK ] NeoRadosWriteOps.AssertExists (55619 ms) 2024-02-09T08:15:13.549 INFO:tasks.workunit.client.0.smithi062.stdout: write_operations: [ RUN ] NeoRadosWriteOps.AssertVersion 2024-02-09T08:15:13.549 INFO:tasks.workunit.client.0.smithi062.stdout: write_operations: [ OK ] NeoRadosWriteOps.AssertVersion (31571 ms) 2024-02-09T08:15:13.549 INFO:tasks.workunit.client.0.smithi062.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Xattrs 2024-02-09T08:15:13.549 INFO:tasks.workunit.client.0.smithi062.stdout: write_operations: [ OK ] NeoRadosWriteOps.Xattrs (33429 ms) 2024-02-09T08:15:13.549 INFO:tasks.workunit.client.0.smithi062.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Write 2024-02-09T08:15:13.550 INFO:tasks.workunit.client.0.smithi062.stdout: write_operations: [ OK ] NeoRadosWriteOps.Write (21732 ms) 2024-02-09T08:15:13.550 INFO:tasks.workunit.client.0.smithi062.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Exec 2024-02-09T08:15:13.550 INFO:tasks.workunit.client.0.smithi062.stdout: write_operations: [ OK ] NeoRadosWriteOps.Exec (8672 ms) 2024-02-09T08:15:13.550 INFO:tasks.workunit.client.0.smithi062.stdout: write_operations: [ RUN ] NeoRadosWriteOps.WriteSame 2024-02-09T08:15:13.550 INFO:tasks.workunit.client.0.smithi062.stdout: write_operations: [ OK ] NeoRadosWriteOps.WriteSame (30007 ms) 2024-02-09T08:15:13.550 INFO:tasks.workunit.client.0.smithi062.stdout: write_operations: [ RUN ] NeoRadosWriteOps.CmpExt 2024-02-09T08:15:13.550 INFO:tasks.workunit.client.0.smithi062.stdout: write_operations: [ OK ] NeoRadosWriteOps.CmpExt (482379 ms) 2024-02-09T08:15:13.550 INFO:tasks.workunit.client.0.smithi062.stdout: write_operations: [----------] 7 tests from NeoRadosWriteOps (663409 ms total) 2024-02-09T08:15:13.550 INFO:tasks.workunit.client.0.smithi062.stdout: write_operations: 2024-02-09T08:15:13.550 INFO:tasks.workunit.client.0.smithi062.stdout: write_operations: [----------] Global test environment tear-down 2024-02-09T08:15:13.550 INFO:tasks.workunit.client.0.smithi062.stdout: write_operations: [==========] 7 tests from 1 test suite ran. (663409 ms total) 2024-02-09T08:15:13.550 INFO:tasks.workunit.client.0.smithi062.stdout: write_operations: [ PASSED ] 7 tests. 2024-02-09T08:15:14.913 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:15:14.909+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:15:15.094 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:13:24.501 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:15:15.170 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:13:24.576 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:15:15.237 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:13:24.634 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:15:15.240 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:13:24.637 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:15:15.240 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:13:24.647 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:15:15.248 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:13:24.654 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:15:15.264 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:13:24.670 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:15:15.306 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:13:24.702 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:15:15.330 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:13:24.736 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:15:16.152 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: Running main() from gmock_main.cc 2024-02-09T08:15:16.152 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: [==========] Running 8 tests from 2 test suites. 2024-02-09T08:15:16.152 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: [----------] Global test environment set-up. 2024-02-09T08:15:16.152 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps 2024-02-09T08:15:16.152 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: [ RUN ] LibradosCWriteOps.NewDelete 2024-02-09T08:15:16.152 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: [ OK ] LibradosCWriteOps.NewDelete (0 ms) 2024-02-09T08:15:16.153 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps (0 ms total) 2024-02-09T08:15:16.153 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: 2024-02-09T08:15:16.153 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps 2024-02-09T08:15:16.153 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.assertExists 2024-02-09T08:15:16.153 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.assertExists (74852 ms) 2024-02-09T08:15:16.153 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteOpAssertVersion 2024-02-09T08:15:16.153 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteOpAssertVersion (28820 ms) 2024-02-09T08:15:16.153 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Xattrs 2024-02-09T08:15:16.153 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Xattrs (25864 ms) 2024-02-09T08:15:16.153 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Write 2024-02-09T08:15:16.153 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Write (9290 ms) 2024-02-09T08:15:16.153 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Exec 2024-02-09T08:15:16.153 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Exec (56551 ms) 2024-02-09T08:15:16.153 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteSame 2024-02-09T08:15:16.154 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteSame (16719 ms) 2024-02-09T08:15:16.154 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.CmpExt 2024-02-09T08:15:16.154 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.CmpExt (454158 ms) 2024-02-09T08:15:16.154 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps (666254 ms total) 2024-02-09T08:15:16.154 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: 2024-02-09T08:15:16.154 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: [----------] Global test environment tear-down 2024-02-09T08:15:16.154 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: [==========] 8 tests from 2 test suites ran. (666255 ms total) 2024-02-09T08:15:16.154 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: [ PASSED ] 8 tests. 2024-02-09T08:15:16.155 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 7 0 2024-02-09T08:15:16.155 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 14 0 2024-02-09T08:15:16.155 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 0 0 2024-02-09T08:15:16.155 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 15 0 2024-02-09T08:15:16.155 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 11 0 2024-02-09T08:15:16.155 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 5 0 2024-02-09T08:15:16.155 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 8 0 2024-02-09T08:15:16.155 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 6 0 2024-02-09T08:15:16.156 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 3 0 2024-02-09T08:15:16.156 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 4 0 2024-02-09T08:15:16.156 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 12 0 2024-02-09T08:15:16.156 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 9 0 2024-02-09T08:15:16.156 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 2 0 2024-02-09T08:15:16.156 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2024-02-09T08:15:16.156 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsStart (11710 ms) 2024-02-09T08:15:16.156 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [----------] 3 tests from LibRadosListEC (31488 ms total) 2024-02-09T08:15:16.156 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 2024-02-09T08:15:16.156 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [----------] 1 test from LibRadosListNP 2024-02-09T08:15:16.156 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [ RUN ] LibRadosListNP.ListObjectsError 2024-02-09T08:15:16.156 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [ OK ] LibRadosListNP.ListObjectsError (3665 ms) 2024-02-09T08:15:16.156 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [----------] 1 test from LibRadosListNP (3665 ms total) 2024-02-09T08:15:16.157 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 2024-02-09T08:15:16.157 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [----------] Global test environment tear-down 2024-02-09T08:15:16.157 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [==========] 11 tests from 3 test suites ran. (666476 ms total) 2024-02-09T08:15:16.157 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [ PASSED ] 11 tests. 2024-02-09T08:15:19.931 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:15:19.927+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:15:19.991 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:13:29.398 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:15:19.994 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:13:29.400 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:15:20.019 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:13:29.425 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:15:20.050 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:13:29.447 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:15:20.051 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:13:29.448 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:15:20.059 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:13:29.466 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:15:20.061 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:13:29.467 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:15:20.068 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:13:29.464 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:15:20.080 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:13:29.487 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:15:23.867 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [==========] Running 31 tests from 7 test suites. 2024-02-09T08:15:23.868 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [----------] Global test environment set-up. 2024-02-09T08:15:23.868 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion 2024-02-09T08:15:23.868 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosMiscVersion.VersionPP 2024-02-09T08:15:23.868 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosMiscVersion.VersionPP (0 ms) 2024-02-09T08:15:23.868 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-02-09T08:15:23.868 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: 2024-02-09T08:15:23.868 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [----------] 22 tests from LibRadosMiscPP 2024-02-09T08:15:23.868 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: seed 41072 2024-02-09T08:15:23.868 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WaitOSDMapPP 2024-02-09T08:15:23.868 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WaitOSDMapPP (10 ms) 2024-02-09T08:15:23.868 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNamePP 2024-02-09T08:15:23.868 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNamePP (106500 ms) 2024-02-09T08:15:23.869 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongLocatorPP 2024-02-09T08:15:23.869 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongLocatorPP (44033 ms) 2024-02-09T08:15:23.869 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNSpacePP 2024-02-09T08:15:23.869 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNSpacePP (119415 ms) 2024-02-09T08:15:23.869 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongAttrNamePP 2024-02-09T08:15:23.869 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongAttrNamePP (10215 ms) 2024-02-09T08:15:23.869 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.ExecPP 2024-02-09T08:15:23.869 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.ExecPP (995 ms) 2024-02-09T08:15:23.869 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BadFlagsPP 2024-02-09T08:15:23.869 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BadFlagsPP (4557 ms) 2024-02-09T08:15:23.869 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate1PP 2024-02-09T08:15:23.869 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate1PP (3076 ms) 2024-02-09T08:15:23.869 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate2PP 2024-02-09T08:15:23.869 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate2PP (2190 ms) 2024-02-09T08:15:23.870 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigObjectPP 2024-02-09T08:15:23.870 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigObjectPP (14927 ms) 2024-02-09T08:15:23.870 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AioOperatePP 2024-02-09T08:15:23.870 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AioOperatePP (685 ms) 2024-02-09T08:15:23.870 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertExistsPP 2024-02-09T08:15:23.870 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertExistsPP (3221 ms) 2024-02-09T08:15:23.870 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertVersionPP 2024-02-09T08:15:23.870 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertVersionPP (6242 ms) 2024-02-09T08:15:23.870 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigAttrPP 2024-02-09T08:15:23.870 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: osd_max_attr_size = 0 2024-02-09T08:15:23.870 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: osd_max_attr_size == 0; skipping test 2024-02-09T08:15:23.870 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigAttrPP (212706 ms) 2024-02-09T08:15:23.870 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyPP 2024-02-09T08:15:23.870 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyPP (9421 ms) 2024-02-09T08:15:23.870 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyScrubPP 2024-02-09T08:15:23.871 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: waiting for initial deep scrubs... 2024-02-09T08:15:23.871 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: done waiting, doing copies 2024-02-09T08:15:23.871 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: waiting for final deep scrubs... 2024-02-09T08:15:23.871 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: done waiting 2024-02-09T08:15:23.871 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyScrubPP (124241 ms) 2024-02-09T08:15:23.871 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WriteSamePP 2024-02-09T08:15:23.871 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WriteSamePP (980 ms) 2024-02-09T08:15:23.871 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CmpExtPP 2024-02-09T08:15:23.871 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CmpExtPP (84 ms) 2024-02-09T08:15:23.871 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Applications 2024-02-09T08:15:23.871 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Applications (5044 ms) 2024-02-09T08:15:23.871 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatOSD 2024-02-09T08:15:23.871 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatOSD (0 ms) 2024-02-09T08:15:23.871 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatClient 2024-02-09T08:15:23.872 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatClient (0 ms) 2024-02-09T08:15:23.872 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Conf 2024-02-09T08:15:23.872 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Conf (0 ms) 2024-02-09T08:15:24.994 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:15:24.985+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:15:30.009 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:15:30.005+0000 d97e640 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] for 97sec e98 v98) 2024-02-09T08:15:30.016 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:13:39.422 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:15:30.073 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:13:39.468 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:15:30.074 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:13:39.470 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:15:30.085 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:13:39.492 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:15:30.087 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:13:39.494 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:15:30.094 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:13:39.500 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:15:30.110 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:13:39.506 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:15:30.130 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:13:39.536 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:15:30.137 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:13:39.543 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:15:38.480 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp ec_list: Running main() from gmock_main.cc 2024-02-09T08:15:38.480 INFO:tasks.workunit.client.0.smithi062.stdout: ec_list: [==========] Running 3 tests from 1 test suite. 2024-02-09T08:15:38.480 INFO:tasks.workunit.client.0.smithi062.stdout: ec_list: [----------] Global test environment set-up. 2024-02-09T08:15:38.481 INFO:tasks.workunit.client.0.smithi062.stdout: ec_list: [----------] 3 tests from NeoradosECList 2024-02-09T08:15:38.481 INFO:tasks.workunit.client.0.smithi062.stdout: ec_list: [ RUN ] NeoradosECList.ListObjects 2024-02-09T08:15:38.481 INFO:tasks.workunit.client.0.smithi062.stdout: ec_list: [ OK ] NeoradosECList.ListObjects (266557 ms) 2024-02-09T08:15:38.481 INFO:tasks.workunit.client.0.smithi062.stdout: ec_list: [ RUN ] NeoradosECList.ListObjectsNS 2024-02-09T08:15:38.481 INFO:tasks.workunit.client.0.smithi062.stdout: ec_list: [ OK ] NeoradosECList.ListObjectsNS (149392 ms) 2024-02-09T08:15:38.481 INFO:tasks.workunit.client.0.smithi062.stdout: ec_list: [ RUN ] NeoradosECList.ListObjectsMany 2024-02-09T08:15:38.481 INFO:tasks.workunit.client.0.smithi062.stdout: ec_list: [ OK ] NeoradosECList.ListObjectsMany (272434 ms) 2024-02-09T08:15:38.481 INFO:tasks.workunit.client.0.smithi062.stdout: ec_list: [----------] 3 tests from NeoradosECList (688383 ms total) 2024-02-09T08:15:38.481 INFO:tasks.workunit.client.0.smithi062.stdout: ec_list: 2024-02-09T08:15:38.481 INFO:tasks.workunit.client.0.smithi062.stdout: ec_list: [----------] Global test environment tear-down 2024-02-09T08:15:38.481 INFO:tasks.workunit.client.0.smithi062.stdout: ec_list: [==========] 3 tests from 1 test suite ran. (688383 ms total) 2024-02-09T08:15:38.481 INFO:tasks.workunit.client.0.smithi062.stdout: ec_list: [ PASSED ] 3 tests. 2024-02-09T08:15:40.087 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:13:49.493 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:15:40.139 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:13:49.535 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:15:40.141 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:13:49.538 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:15:40.155 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:13:49.561 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:15:40.174 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:13:49.570 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:15:40.200 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:13:49.607 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:15:40.222 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:13:49.629 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:15:40.235 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:13:49.641 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:15:40.291 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:13:49.698 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:15:45.290 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:13:54.696 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:15:45.300 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:13:54.707 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:15:45.305 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:13:54.712 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:15:45.309 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:13:54.706 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:15:45.312 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:13:54.709 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:15:45.314 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:13:54.720 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:15:45.337 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:13:54.744 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:15:45.349 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:13:54.755 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:15:45.397 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:13:54.794 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:15:55.271 INFO:tasks.workunit.client.0.smithi062.stdout:: [----------] 22 tests from LibRadosMiscPP (668542 ms total) 2024-02-09T08:15:55.271 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: 2024-02-09T08:15:55.271 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP 2024-02-09T08:15:55.272 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosTwoPoolsECPP.CopyFrom 2024-02-09T08:15:55.272 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosTwoPoolsECPP.CopyFrom (2978 ms) 2024-02-09T08:15:55.272 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP (2978 ms total) 2024-02-09T08:15:55.272 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: 2024-02-09T08:15:55.272 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)0, Checksummer::xxhash32, ceph_le > 2024-02-09T08:15:55.272 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Subset 2024-02-09T08:15:55.272 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Subset (745 ms) 2024-02-09T08:15:55.272 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Chunked 2024-02-09T08:15:55.272 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Chunked (107 ms) 2024-02-09T08:15:55.273 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0 (852 ms total) 2024-02-09T08:15:55.273 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: 2024-02-09T08:15:55.273 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)1, Checksummer::xxhash64, ceph_le > 2024-02-09T08:15:55.273 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Subset 2024-02-09T08:15:55.273 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Subset (917 ms) 2024-02-09T08:15:55.273 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Chunked 2024-02-09T08:15:55.273 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Chunked (47 ms) 2024-02-09T08:15:55.273 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1 (964 ms total) 2024-02-09T08:15:55.273 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: 2024-02-09T08:15:55.273 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)2, Checksummer::crc32c, ceph_le > 2024-02-09T08:15:55.273 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Subset 2024-02-09T08:15:55.273 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Subset (1639 ms) 2024-02-09T08:15:55.274 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Chunked 2024-02-09T08:15:55.274 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Chunked (101 ms) 2024-02-09T08:15:55.274 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2 (1740 ms total) 2024-02-09T08:15:55.274 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: 2024-02-09T08:15:55.274 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP 2024-02-09T08:15:55.274 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosMiscECPP.CompareExtentRange 2024-02-09T08:15:55.274 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosMiscECPP.CompareExtentRange (1635 ms) 2024-02-09T08:15:55.274 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP (1635 ms total) 2024-02-09T08:15:55.274 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: 2024-02-09T08:15:55.274 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [----------] Global test environment tear-down 2024-02-09T08:15:55.274 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [==========] 31 tests from 7 test suites ran. (705556 ms total) 2024-02-09T08:15:55.275 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ PASSED ] 31 tests. 2024-02-09T08:16:00.420 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:14:09.826 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:00.421 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:14:09.828 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:00.465 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:14:09.861 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:00.465 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:14:09.862 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:00.488 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:14:09.895 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:00.489 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:14:09.895 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:00.495 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:14:09.902 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:00.501 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:14:09.898 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:00.542 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:14:09.949 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:06.546 INFO:tasks.workunit.client.0.smithi062.stdout:eWrite 2024-02-09T08:16:06.546 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleWrite (48860 ms) 2024-02-09T08:16:06.546 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAioEC.WaitForComplete 2024-02-09T08:16:06.546 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAioEC.WaitForComplete (8084 ms) 2024-02-09T08:16:06.546 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip 2024-02-09T08:16:06.547 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip (7507 ms) 2024-02-09T08:16:06.547 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip2 2024-02-09T08:16:06.547 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip2 (9040 ms) 2024-02-09T08:16:06.547 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripAppend 2024-02-09T08:16:06.547 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripAppend (6986 ms) 2024-02-09T08:16:06.547 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAioEC.IsComplete 2024-02-09T08:16:06.547 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAioEC.IsComplete (7821 ms) 2024-02-09T08:16:06.547 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAioEC.IsSafe 2024-02-09T08:16:06.547 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAioEC.IsSafe (8085 ms) 2024-02-09T08:16:06.547 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAioEC.ReturnValue 2024-02-09T08:16:06.547 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAioEC.ReturnValue (7459 ms) 2024-02-09T08:16:06.547 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAioEC.Flush 2024-02-09T08:16:06.547 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAioEC.Flush (7956 ms) 2024-02-09T08:16:06.547 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAioEC.FlushAsync 2024-02-09T08:16:06.547 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAioEC.FlushAsync (9126 ms) 2024-02-09T08:16:06.548 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripWriteFull 2024-02-09T08:16:06.548 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripWriteFull (8713 ms) 2024-02-09T08:16:06.548 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStat 2024-02-09T08:16:06.548 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStat (6939 ms) 2024-02-09T08:16:06.548 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStatNS 2024-02-09T08:16:06.548 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStatNS (8754 ms) 2024-02-09T08:16:06.548 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAioEC.StatRemove 2024-02-09T08:16:06.548 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAioEC.StatRemove (6957 ms) 2024-02-09T08:16:06.548 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAioEC.ExecuteClass 2024-02-09T08:16:06.548 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAioEC.ExecuteClass (7774 ms) 2024-02-09T08:16:06.548 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAioEC.MultiWrite 2024-02-09T08:16:06.548 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAioEC.MultiWrite (7872 ms) 2024-02-09T08:16:06.548 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [----------] 16 tests from LibRadosAioEC (167934 ms total) 2024-02-09T08:16:06.548 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: 2024-02-09T08:16:06.549 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [----------] Global test environment tear-down 2024-02-09T08:16:06.549 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [==========] 42 tests from 2 test suites ran. (716922 ms total) 2024-02-09T08:16:06.549 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ PASSED ] 42 tests. 2024-02-09T08:16:15.550 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:14:24.956 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:15.553 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:14:24.960 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:15.599 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:14:25.005 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:15.606 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:14:25.013 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:15.611 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:14:25.018 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:15.621 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:14:25.018 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:15.622 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:14:25.019 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:15.654 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:14:25.061 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:15.673 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:14:25.070 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:20.418 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:14:29.824 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:20.422 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:14:29.828 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:20.436 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:14:29.842 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:20.468 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:14:29.874 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:20.471 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:14:29.867 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:20.472 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:14:29.869 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:20.486 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:14:29.882 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:20.487 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:14:29.892 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:20.504 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:14:29.910 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:30.512 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:14:39.918 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:30.515 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:14:39.922 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:30.541 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:14:39.948 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:30.559 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:14:39.956 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:30.560 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:14:39.957 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:30.568 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:14:39.975 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:30.576 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:14:39.983 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:30.585 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:14:39.982 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:30.604 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:14:40.010 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:40.702 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:14:50.108 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:40.704 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:14:50.111 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:40.754 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:14:50.160 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:40.760 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:14:50.166 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:40.760 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:14:50.157 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:40.761 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:14:50.168 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:40.764 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:14:50.161 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:40.796 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:14:50.203 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:40.799 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:14:50.195 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:45.716 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:14:55.112 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:45.716 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:14:55.113 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:45.724 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:14:55.131 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:45.729 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:14:55.136 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:45.741 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:14:55.137 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:45.751 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:14:55.158 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:45.784 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:14:55.190 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:45.785 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:14:55.192 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:45.811 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:14:55.217 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:16:56.071 INFO:tasks.workunit.client.0.smithi062.stdout:Aio.RoundTripAppendPP (3187 ms) 2024-02-09T08:16:56.071 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.RacingRemovePP 2024-02-09T08:16:56.071 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.RacingRemovePP (4143 ms) 2024-02-09T08:16:56.071 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP 2024-02-09T08:16:56.071 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP (3809 ms) 2024-02-09T08:16:56.071 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP2 2024-02-09T08:16:56.071 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP2 (4336 ms) 2024-02-09T08:16:56.071 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolEIOFlag 2024-02-09T08:16:56.071 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: setting pool EIO 2024-02-09T08:16:56.072 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: max_success 0, min_failed 1 2024-02-09T08:16:56.072 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolEIOFlag (4284 ms) 2024-02-09T08:16:56.072 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiReads 2024-02-09T08:16:56.072 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiReads (4659 ms) 2024-02-09T08:16:56.072 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio (618075 ms total) 2024-02-09T08:16:56.072 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: 2024-02-09T08:16:56.072 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP 2024-02-09T08:16:56.072 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.ReadIntoBufferlist 2024-02-09T08:16:56.072 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAioPP.ReadIntoBufferlist (4424 ms) 2024-02-09T08:16:56.072 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.XattrsRoundTripPP 2024-02-09T08:16:56.072 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAioPP.XattrsRoundTripPP (12227 ms) 2024-02-09T08:16:56.072 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RmXattrPP 2024-02-09T08:16:56.072 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RmXattrPP (19152 ms) 2024-02-09T08:16:56.073 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RemoveTestPP 2024-02-09T08:16:56.073 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RemoveTestPP (4683 ms) 2024-02-09T08:16:56.073 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP (40486 ms total) 2024-02-09T08:16:56.073 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: 2024-02-09T08:16:56.073 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP 2024-02-09T08:16:56.073 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosIoPP.XattrListPP 2024-02-09T08:16:56.073 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosIoPP.XattrListPP (3231 ms) 2024-02-09T08:16:56.073 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP (3231 ms total) 2024-02-09T08:16:56.076 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: 2024-02-09T08:16:56.076 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC 2024-02-09T08:16:56.076 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleWritePP 2024-02-09T08:16:56.076 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleWritePP (16835 ms) 2024-02-09T08:16:56.076 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.WaitForSafePP 2024-02-09T08:16:56.076 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAioEC.WaitForSafePP (6933 ms) 2024-02-09T08:16:56.077 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP 2024-02-09T08:16:56.077 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP (8785 ms) 2024-02-09T08:16:56.077 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP2 2024-02-09T08:16:56.077 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP2 (6915 ms) 2024-02-09T08:16:56.077 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP3 2024-02-09T08:16:56.077 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP3 (3168 ms) 2024-02-09T08:16:56.077 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripSparseReadPP 2024-02-09T08:16:56.077 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripSparseReadPP (8025 ms) 2024-02-09T08:16:56.077 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripAppendPP 2024-02-09T08:16:56.077 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripAppendPP (7823 ms) 2024-02-09T08:16:56.077 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsCompletePP 2024-02-09T08:16:56.078 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsCompletePP (8756 ms) 2024-02-09T08:16:56.078 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsSafePP 2024-02-09T08:16:56.078 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsSafePP (6939 ms) 2024-02-09T08:16:56.078 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ReturnValuePP 2024-02-09T08:16:56.078 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ReturnValuePP (7850 ms) 2024-02-09T08:16:56.078 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushPP 2024-02-09T08:16:56.078 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushPP (7318 ms) 2024-02-09T08:16:56.078 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushAsyncPP 2024-02-09T08:16:56.078 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushAsyncPP (8273 ms) 2024-02-09T08:16:56.078 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP 2024-02-09T08:16:56.078 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP (7032 ms) 2024-02-09T08:17:00.833 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:15:10.239 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:17:00.853 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:15:10.259 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:17:00.889 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:15:10.296 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:17:00.890 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:15:10.296 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:17:00.891 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:15:10.298 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:17:00.907 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:15:10.304 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:17:00.908 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:15:10.305 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:17:00.930 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:15:10.337 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:17:00.943 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:15:10.339 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:17:15.749 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:15:25.155 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:17:15.751 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:15:25.157 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:17:15.788 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:15:25.194 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:17:15.800 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:15:25.196 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:17:15.800 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:15:25.197 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:17:15.815 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:15:25.222 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:17:15.818 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:15:25.225 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:17:15.835 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:15:25.232 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:17:15.859 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:15:25.265 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:17:25.827 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:15:35.234 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:17:25.830 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:15:35.237 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:17:25.872 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:15:35.279 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:17:25.882 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:15:35.279 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:17:25.884 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:15:35.280 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:17:25.898 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:15:35.305 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:17:25.906 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:15:35.313 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:17:25.909 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:15:35.306 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:17:25.935 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:15:35.342 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:17:30.827 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:15:40.233 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:17:30.831 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:15:40.238 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:17:30.854 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:15:40.260 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:17:30.877 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:15:40.274 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:17:30.879 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:15:40.275 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:17:30.887 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:15:40.293 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:17:30.893 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:15:40.290 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:17:30.909 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:15:40.315 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:17:30.923 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:15:40.330 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:17:43.454 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP2 2024-02-09T08:17:43.455 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP2 (3276 ms) 2024-02-09T08:17:43.455 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPP 2024-02-09T08:17:43.455 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPP (7432 ms) 2024-02-09T08:17:43.455 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPPNS 2024-02-09T08:17:43.455 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPPNS (7362 ms) 2024-02-09T08:17:43.455 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.StatRemovePP 2024-02-09T08:17:43.455 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAioEC.StatRemovePP (6751 ms) 2024-02-09T08:17:43.455 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ExecuteClassPP 2024-02-09T08:17:43.455 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ExecuteClassPP (8002 ms) 2024-02-09T08:17:43.455 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.OmapPP 2024-02-09T08:17:43.455 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAioEC.OmapPP (7037 ms) 2024-02-09T08:17:43.455 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.MultiWritePP 2024-02-09T08:17:43.455 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAioEC.MultiWritePP (7521 ms) 2024-02-09T08:17:43.456 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC (152033 ms total) 2024-02-09T08:17:43.456 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: 2024-02-09T08:17:43.456 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [----------] Global test environment tear-down 2024-02-09T08:17:43.456 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [==========] 57 tests from 4 test suites ran. (813825 ms total) 2024-02-09T08:17:43.456 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ PASSED ] 57 tests. 2024-02-09T08:17:45.902 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:15:55.309 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:17:45.904 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:15:55.311 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:17:45.945 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:15:55.352 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:17:45.955 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:15:55.351 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:17:45.958 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:15:55.355 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:17:45.965 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:15:55.371 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:17:45.967 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:15:55.374 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:17:45.994 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:15:55.390 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:17:46.009 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:15:55.415 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:17:46.973 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:15:56.369 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:17:46.974 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:15:56.371 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:17:46.986 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:15:56.383 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:17:47.065 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:15:56.471 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:17:47.067 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:15:56.474 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:17:47.067 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:15:56.474 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:17:47.077 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:15:56.483 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:17:47.090 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:15:56.497 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:17:47.160 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:15:56.566 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:01.068 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:16:10.474 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:01.072 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:16:10.478 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:01.101 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:16:10.507 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:01.124 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:16:10.521 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:01.126 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:16:10.523 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:01.127 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:16:10.534 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:01.132 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:16:10.539 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:01.156 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:16:10.552 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:01.166 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:16:10.572 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:02.270 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:16:11.667 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:02.272 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:16:11.668 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:02.287 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:16:11.683 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:02.432 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:16:11.838 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:02.436 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:16:11.842 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:02.513 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:16:11.920 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:02.587 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:16:11.994 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:02.588 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:16:11.995 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:02.610 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:16:12.016 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:05.992 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:16:15.388 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:05.992 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:16:15.389 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:05.993 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:16:15.399 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:05.995 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:16:15.402 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:06.009 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:16:15.405 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:06.016 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:16:15.422 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:06.052 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:16:15.459 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:06.059 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:16:15.466 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:06.073 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:16:15.479 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:16.139 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:16:25.545 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:16.212 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:16:25.619 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:16.246 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:16:25.652 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:16.264 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:16:25.660 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:16.267 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:16:25.664 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:16.270 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:16:25.677 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:16.278 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:16:25.684 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:16.296 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:16:25.692 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:16.313 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:16:25.720 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:26.028 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:16:35.434 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:26.079 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:16:35.486 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:26.097 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:16:35.504 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:26.124 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:16:35.520 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:26.125 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:16:35.522 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:26.141 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:16:35.537 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:26.143 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:16:35.550 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:26.145 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:16:35.551 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:26.164 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:16:35.570 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:36.103 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:16:45.499 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:36.104 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:16:45.500 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:36.106 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:16:45.513 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:36.109 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:16:45.516 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:36.118 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:16:45.514 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:36.126 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:16:45.533 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:36.161 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:16:45.568 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:36.163 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:16:45.570 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:36.176 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:16:45.583 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:46.125 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:16:55.532 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:46.129 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:16:55.536 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:46.142 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:16:55.549 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:46.175 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:16:55.571 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:46.176 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:16:55.572 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:46.176 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:16:55.583 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:46.178 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:16:55.585 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:46.191 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:16:55.597 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:46.191 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:16:55.588 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:56.318 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:17:05.724 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:56.376 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:17:05.772 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:56.377 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:17:05.774 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:56.385 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:17:05.791 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:56.407 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:17:05.803 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:56.421 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:17:05.827 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:56.448 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:17:05.855 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:56.457 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:17:05.864 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:18:56.490 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:17:05.897 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:19:06.536 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:17:15.942 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:19:06.539 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:17:15.946 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:19:06.574 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:17:15.981 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:19:06.596 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:17:15.993 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:19:06.600 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:17:15.997 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:19:06.608 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:17:16.014 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:19:06.615 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:17:16.022 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:19:06.625 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:17:16.022 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:19:06.658 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:17:16.065 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:19:11.297 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:17:20.704 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:19:11.300 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:17:20.706 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:19:11.323 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:17:20.730 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:19:11.349 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:17:20.746 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:19:11.351 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:17:20.747 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:19:11.356 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:17:20.763 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:19:11.358 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:17:20.765 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:19:11.367 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:17:20.763 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:19:11.376 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:17:20.783 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:19:26.463 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:17:35.869 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:19:26.510 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:17:35.906 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:19:26.511 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:17:35.907 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:19:26.515 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:17:35.922 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:19:26.541 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:17:35.938 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:19:26.563 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:17:35.970 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:19:26.582 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:17:35.988 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:19:26.583 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:17:35.990 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:19:26.614 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:17:36.020 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:19:31.535 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:17:40.941 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:19:31.586 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:17:40.993 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:19:31.590 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:17:40.986 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:19:31.591 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:17:40.988 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:19:31.592 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:17:40.999 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:19:31.612 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:17:41.018 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:19:31.613 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:17:41.010 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:19:31.627 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:17:41.034 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:19:31.632 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:17:41.039 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:19:46.695 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:17:56.091 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:19:46.696 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:17:56.092 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:19:46.719 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:17:56.125 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:19:46.721 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:17:56.127 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:19:46.731 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:17:56.127 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:19:46.762 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:17:56.169 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:19:46.782 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:17:56.189 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:19:46.785 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:17:56.191 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:19:46.825 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:17:56.232 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:19:52.032 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [==========] Running 77 tests from 4 test suites. 2024-02-09T08:19:52.033 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [----------] Global test environment set-up. 2024-02-09T08:19:52.033 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP 2024-02-09T08:19:52.033 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: seed 41096 2024-02-09T08:19:52.033 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.Dirty 2024-02-09T08:19:52.033 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTierPP.Dirty (93355 ms) 2024-02-09T08:19:52.033 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.FlushWriteRaces 2024-02-09T08:19:52.033 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTierPP.FlushWriteRaces (73987 ms) 2024-02-09T08:19:52.033 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.HitSetNone 2024-02-09T08:19:52.033 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTierPP.HitSetNone (2224 ms) 2024-02-09T08:19:52.033 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP (169566 ms total) 2024-02-09T08:19:52.033 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: 2024-02-09T08:19:52.033 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [----------] 48 tests from LibRadosTwoPoolsPP 2024-02-09T08:19:52.034 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Overlay 2024-02-09T08:19:52.034 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Overlay (224973 ms) 2024-02-09T08:19:52.034 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Promote 2024-02-09T08:19:52.034 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Promote (75938 ms) 2024-02-09T08:19:52.034 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnap 2024-02-09T08:19:52.034 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnap (43731 ms) 2024-02-09T08:19:52.034 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapScrub 2024-02-09T08:19:52.034 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: my_snaps [3] 2024-02-09T08:19:52.034 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: my_snaps [4,3] 2024-02-09T08:19:52.034 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: my_snaps [5,4,3] 2024-02-09T08:19:52.034 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: my_snaps [6,5,4,3] 2024-02-09T08:19:52.034 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: promoting some heads 2024-02-09T08:19:52.034 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: promoting from clones for snap 6 2024-02-09T08:19:52.034 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: promoting from clones for snap 5 2024-02-09T08:19:52.035 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: promoting from clones for snap 4 2024-02-09T08:19:52.035 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: promoting from clones for snap 3 2024-02-09T08:19:52.035 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: waiting for scrubs... 2024-02-09T08:19:52.035 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: done waiting 2024-02-09T08:19:52.035 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnapScrub (235588 ms) 2024-02-09T08:19:52.035 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2024-02-09T08:19:52.035 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnapTrimRace (14095 ms) 2024-02-09T08:19:52.035 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Whiteout 2024-02-09T08:19:52.035 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Whiteout (9976 ms) 2024-02-09T08:19:52.035 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2024-02-09T08:19:52.035 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate (10585 ms) 2024-02-09T08:19:52.035 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Evict 2024-02-09T08:19:52.035 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Evict (10944 ms) 2024-02-09T08:19:52.035 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap 2024-02-09T08:19:52.036 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnap (13409 ms) 2024-02-09T08:19:52.036 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap2 2024-02-09T08:19:52.036 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnap2 (11348 ms) 2024-02-09T08:19:52.036 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ListSnap 2024-02-09T08:19:52.036 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ListSnap (14228 ms) 2024-02-09T08:19:52.036 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2024-02-09T08:19:52.036 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace (41605 ms) 2024-02-09T08:19:52.036 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlush 2024-02-09T08:19:52.036 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TryFlush (11886 ms) 2024-02-09T08:19:52.036 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Flush 2024-02-09T08:19:52.036 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Flush (10460 ms) 2024-02-09T08:19:52.036 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushSnap 2024-02-09T08:19:52.036 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.FlushSnap (15221 ms) 2024-02-09T08:19:52.037 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2024-02-09T08:19:52.037 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.FlushTryFlushRaces (8856 ms) 2024-02-09T08:19:52.037 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlushReadRace 2024-02-09T08:19:52.037 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TryFlushReadRace (11714 ms) 2024-02-09T08:20:01.584 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:18:10.991 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:01.590 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:18:10.997 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:01.619 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:18:11.026 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:01.634 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:18:11.030 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:01.635 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:18:11.031 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:01.637 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:18:11.044 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:01.640 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:18:11.047 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:01.662 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:18:11.059 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:01.670 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:18:11.077 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:06.716 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:18:16.123 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:06.718 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:18:16.125 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:06.735 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:18:16.142 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:06.767 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:18:16.163 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:06.768 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:18:16.175 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:06.768 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:18:16.165 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:06.769 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:18:16.176 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:06.783 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:18:16.180 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:06.785 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:18:16.192 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:14.072 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetRead 2024-02-09T08:20:14.072 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: hmm, no HitSet yet 2024-02-09T08:20:14.072 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: ok, hit_set contains 272:602f83fe:::foo:head 2024-02-09T08:20:14.072 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetRead (10077 ms) 2024-02-09T08:20:14.072 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetWrite 2024-02-09T08:20:14.072 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg_num = 32 2024-02-09T08:20:14.072 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 0 ls 1707466808,0 2024-02-09T08:20:14.072 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 1 ls 1707466809,0 2024-02-09T08:20:14.072 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 2 ls 1707466808,0 2024-02-09T08:20:14.072 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 3 ls 1707466808,0 2024-02-09T08:20:14.073 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 4 ls 1707466808,0 2024-02-09T08:20:14.073 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 5 ls 1707466809,0 2024-02-09T08:20:14.073 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 6 ls 1707466808,0 2024-02-09T08:20:14.073 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 7 ls 1707466808,0 2024-02-09T08:20:14.073 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 8 ls 1707466808,0 2024-02-09T08:20:14.073 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 9 ls 1707466808,0 2024-02-09T08:20:14.073 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 10 ls 1707466809,0 2024-02-09T08:20:14.073 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 11 ls 1707466809,0 2024-02-09T08:20:14.073 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 12 ls 1707466809,0 2024-02-09T08:20:14.073 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 13 ls 1707466809,0 2024-02-09T08:20:14.073 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 14 ls 1707466808,0 2024-02-09T08:20:14.073 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 15 ls 1707466808,0 2024-02-09T08:20:14.073 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 16 ls 1707466808,0 2024-02-09T08:20:14.073 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 17 ls 1707466809,0 2024-02-09T08:20:14.074 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 18 ls 1707466809,0 2024-02-09T08:20:14.074 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 19 ls 1707466809,0 2024-02-09T08:20:14.074 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 20 ls 1707466809,0 2024-02-09T08:20:14.074 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 21 ls 1707466809,0 2024-02-09T08:20:14.074 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 22 ls 1707466808,0 2024-02-09T08:20:14.074 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 23 ls 1707466808,0 2024-02-09T08:20:14.074 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 24 ls 1707466809,0 2024-02-09T08:20:14.074 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 25 ls 1707466808,0 2024-02-09T08:20:14.074 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 26 ls 1707466808,0 2024-02-09T08:20:14.074 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 27 ls 1707466809,0 2024-02-09T08:20:14.074 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 28 ls 1707466809,0 2024-02-09T08:20:14.074 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 29 ls 1707466808,0 2024-02-09T08:20:14.074 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 30 ls 1707466808,0 2024-02-09T08:20:14.074 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 31 ls 1707466809,0 2024-02-09T08:20:14.075 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg_num = 32 2024-02-09T08:20:14.075 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:6cac518f:::0:head 2024-02-09T08:20:14.075 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:02547ec2:::1:head 2024-02-09T08:20:14.075 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:f905c69b:::2:head 2024-02-09T08:20:14.075 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:cfc208b3:::3:head 2024-02-09T08:20:14.075 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:d83876eb:::4:head 2024-02-09T08:20:14.075 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:b29083e3:::5:head 2024-02-09T08:20:14.075 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:c4fdafeb:::6:head 2024-02-09T08:20:14.075 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:5c6b0b28:::7:head 2024-02-09T08:20:14.075 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:bd63b0f1:::8:head 2024-02-09T08:20:14.075 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:e960b815:::9:head 2024-02-09T08:20:14.075 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:52ea6a34:::10:head 2024-02-09T08:20:14.075 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:89d3ae78:::11:head 2024-02-09T08:20:14.075 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:de5d7c5f:::12:head 2024-02-09T08:20:14.075 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:566253c9:::13:head 2024-02-09T08:20:14.076 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:62a1935d:::14:head 2024-02-09T08:20:14.076 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:863748b0:::15:head 2024-02-09T08:20:14.076 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:3958e169:::16:head 2024-02-09T08:20:14.076 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:4d4dabf9:::17:head 2024-02-09T08:20:14.076 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:8391935d:::18:head 2024-02-09T08:20:14.076 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:28883081:::19:head 2024-02-09T08:20:14.076 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:69259c59:::20:head 2024-02-09T08:20:14.076 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:4bdb80b7:::21:head 2024-02-09T08:20:14.076 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:a11c5d71:::22:head 2024-02-09T08:20:14.076 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:271af37b:::23:head 2024-02-09T08:20:14.076 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:95b121be:::24:head 2024-02-09T08:20:14.076 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:58d1031b:::25:head 2024-02-09T08:20:14.076 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:0a050783:::26:head 2024-02-09T08:20:14.076 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:c709704c:::27:head 2024-02-09T08:20:14.077 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:cbe56eaf:::28:head 2024-02-09T08:20:14.077 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:86b4b162:::29:head 2024-02-09T08:20:14.077 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:70d89383:::30:head 2024-02-09T08:20:14.077 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:dd450c7c:::31:head 2024-02-09T08:20:14.077 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:6d5729b1:::32:head 2024-02-09T08:20:14.077 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:c388f3fb:::33:head 2024-02-09T08:20:14.077 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:56cfea31:::34:head 2024-02-09T08:20:14.077 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:9dbc1bf7:::35:head 2024-02-09T08:20:14.077 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:40b74ccd:::36:head 2024-02-09T08:20:14.077 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:4d5aaf42:::37:head 2024-02-09T08:20:14.077 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:920f362c:::38:head 2024-02-09T08:20:14.077 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:6cc53222:::39:head 2024-02-09T08:20:14.077 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:9cad833f:::40:head 2024-02-09T08:20:14.077 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:1ea84d41:::41:head 2024-02-09T08:20:14.077 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:c4480ef6:::42:head 2024-02-09T08:20:14.078 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:a694361e:::43:head 2024-02-09T08:20:14.078 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:d1bd33e9:::44:head 2024-02-09T08:20:14.078 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:ddc2cd5d:::45:head 2024-02-09T08:20:14.078 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:2b782207:::46:head 2024-02-09T08:20:14.078 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:7b187fca:::47:head 2024-02-09T08:20:14.078 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:90ecdf6f:::48:head 2024-02-09T08:20:14.078 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:a5ed95fe:::49:head 2024-02-09T08:20:14.078 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:ea0eaa55:::50:head 2024-02-09T08:20:14.078 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:f33ef17b:::51:head 2024-02-09T08:20:14.078 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:a0d1b2f6:::52:head 2024-02-09T08:20:14.078 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:60c5229e:::53:head 2024-02-09T08:20:14.078 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:edcbc575:::54:head 2024-02-09T08:20:14.078 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:102cf253:::55:head 2024-02-09T08:20:14.078 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:efb7fb0b:::56:head 2024-02-09T08:20:14.078 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:50d0a326:::57:head 2024-02-09T08:20:14.079 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:d4dc5daf:::58:head 2024-02-09T08:20:14.079 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:3a130462:::59:head 2024-02-09T08:20:14.079 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:ec87ed71:::60:head 2024-02-09T08:20:14.079 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:d5bc9454:::61:head 2024-02-09T08:20:14.079 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:3ddfe313:::62:head 2024-02-09T08:20:14.079 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:7c2816b9:::63:head 2024-02-09T08:20:14.079 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:47e00e4d:::64:head 2024-02-09T08:20:14.079 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:c6410c18:::65:head 2024-02-09T08:20:14.080 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:b48ed237:::66:head 2024-02-09T08:20:14.080 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:cd63ad31:::67:head 2024-02-09T08:20:14.080 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:b179e92b:::68:head 2024-02-09T08:20:14.080 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:0d9f741a:::69:head 2024-02-09T08:20:14.080 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:6d3352ae:::70:head 2024-02-09T08:20:14.080 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:c6d5c19e:::71:head 2024-02-09T08:20:14.080 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:bc4729c3:::72:head 2024-02-09T08:20:14.080 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:77e930b9:::73:head 2024-02-09T08:20:14.080 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:0abeecfd:::74:head 2024-02-09T08:20:14.080 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:b7c37e15:::75:head 2024-02-09T08:20:14.080 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:b6378398:::76:head 2024-02-09T08:20:14.080 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:02bd68de:::77:head 2024-02-09T08:20:14.080 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:cc795d2d:::78:head 2024-02-09T08:20:14.080 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:630d4fea:::79:head 2024-02-09T08:20:14.080 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:e0d29ef5:::80:head 2024-02-09T08:20:14.081 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:fd6f13d2:::81:head 2024-02-09T08:20:14.081 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:606461d5:::82:head 2024-02-09T08:20:14.081 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:eadbdc43:::83:head 2024-02-09T08:20:14.081 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:8761d0bb:::84:head 2024-02-09T08:20:14.081 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:9ef0186f:::85:head 2024-02-09T08:20:14.081 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:e0d41294:::86:head 2024-02-09T08:20:14.081 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:961de695:::87:head 2024-02-09T08:20:14.081 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:1423148f:::88:head 2024-02-09T08:20:14.081 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:633a8fa2:::89:head 2024-02-09T08:20:14.081 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:a8653809:::90:head 2024-02-09T08:20:14.081 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:3dac8b33:::91:head 2024-02-09T08:20:14.081 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:35aad435:::92:head 2024-02-09T08:20:14.081 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:f6dcc343:::93:head 2024-02-09T08:20:14.081 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:dbbdad87:::94:head 2024-02-09T08:20:14.082 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:1cb48ce0:::95:head 2024-02-09T08:20:14.082 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:03cd461c:::96:head 2024-02-09T08:20:14.082 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:17a4ea99:::97:head 2024-02-09T08:20:14.082 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:9993c9a7:::98:head 2024-02-09T08:20:14.082 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:6394211c:::99:head 2024-02-09T08:20:14.082 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:94c7ae57:::100:head 2024-02-09T08:20:14.082 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:6fdee5bb:::101:head 2024-02-09T08:20:14.082 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:9a477fd1:::102:head 2024-02-09T08:20:14.082 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:eb850916:::103:head 2024-02-09T08:20:14.082 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:affc56b9:::104:head 2024-02-09T08:20:14.082 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:b42dc814:::105:head 2024-02-09T08:20:14.082 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:f319f8f0:::106:head 2024-02-09T08:20:14.082 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:9a40b9de:::107:head 2024-02-09T08:20:14.082 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:8b524f28:::108:head 2024-02-09T08:20:14.083 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:e3de589f:::109:head 2024-02-09T08:20:14.083 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:90f90a5b:::110:head 2024-02-09T08:20:14.083 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:a7b4f1d7:::111:head 2024-02-09T08:20:14.083 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:af51766e:::112:head 2024-02-09T08:20:14.083 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:b6f90bd1:::113:head 2024-02-09T08:20:14.083 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:e0261208:::114:head 2024-02-09T08:20:14.083 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:c9569ef7:::115:head 2024-02-09T08:20:14.083 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:61bebe50:::116:head 2024-02-09T08:20:14.083 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:fe93412b:::117:head 2024-02-09T08:20:14.083 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:d3d38bee:::118:head 2024-02-09T08:20:14.083 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:3100ba0c:::119:head 2024-02-09T08:20:14.083 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:d0560ada:::120:head 2024-02-09T08:20:14.083 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:f0ea8b35:::121:head 2024-02-09T08:20:14.083 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:766f231a:::122:head 2024-02-09T08:20:14.083 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:a07a2582:::123:head 2024-02-09T08:20:14.083 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:bd7c6b3a:::124:head 2024-02-09T08:20:14.084 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:fb2ddaff:::125:head 2024-02-09T08:20:14.084 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:4408e1fe:::126:head 2024-02-09T08:20:14.084 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:ee1df7a7:::127:head 2024-02-09T08:20:14.084 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:c3002909:::128:head 2024-02-09T08:20:14.084 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:4f48ffa9:::129:head 2024-02-09T08:20:14.084 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:edf38733:::130:head 2024-02-09T08:20:14.084 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:c08425c0:::131:head 2024-02-09T08:20:14.084 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:5f902d98:::132:head 2024-02-09T08:20:14.084 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:41ea2c93:::133:head 2024-02-09T08:20:14.084 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:813cee13:::134:head 2024-02-09T08:20:14.084 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:0131818d:::135:head 2024-02-09T08:20:14.084 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:26ba5a85:::136:head 2024-02-09T08:20:14.084 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:381b8a5a:::137:head 2024-02-09T08:20:14.084 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:28797e47:::138:head 2024-02-09T08:20:14.085 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:bfca7f22:::139:head 2024-02-09T08:20:14.085 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:36807075:::140:head 2024-02-09T08:20:14.085 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:80b03975:::141:head 2024-02-09T08:20:14.085 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:5c15709b:::142:head 2024-02-09T08:20:14.085 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:f39ea15e:::143:head 2024-02-09T08:20:14.085 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:ea992956:::144:head 2024-02-09T08:20:14.085 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:48887b1c:::145:head 2024-02-09T08:20:14.085 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:9f24a9dd:::146:head 2024-02-09T08:20:14.085 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:987f100b:::147:head 2024-02-09T08:20:14.085 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:d2dd3581:::148:head 2024-02-09T08:20:14.085 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:7fed1808:::149:head 2024-02-09T08:20:14.085 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:c80b70e9:::150:head 2024-02-09T08:20:14.085 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:85ed90f9:::151:head 2024-02-09T08:20:14.085 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:36428b24:::152:head 2024-02-09T08:20:14.085 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:d044c34a:::153:head 2024-02-09T08:20:14.085 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:7c18bf58:::154:head 2024-02-09T08:20:14.086 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:d1c21232:::155:head 2024-02-09T08:20:14.086 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:a7a3c575:::156:head 2024-02-09T08:20:14.086 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:87da0633:::157:head 2024-02-09T08:20:14.086 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:d5ac3822:::158:head 2024-02-09T08:20:14.086 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:3f20522d:::159:head 2024-02-09T08:20:14.086 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:6ca26563:::160:head 2024-02-09T08:20:14.086 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:532ce135:::161:head 2024-02-09T08:20:14.086 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:c78863e6:::162:head 2024-02-09T08:20:16.151 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:18:25.558 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:16.155 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:18:25.562 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:16.179 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:18:25.586 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:16.207 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:18:25.603 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:16.208 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:18:25.605 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:16.224 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:18:25.631 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:16.225 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:18:25.632 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:16.226 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:18:25.622 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:16.250 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:18:25.656 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:17.024 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:18:26.421 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:17.025 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:18:26.422 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:17.033 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:18:26.429 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:17.109 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:18:26.516 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:17.114 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:18:26.521 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:17.128 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:18:26.534 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:17.228 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:18:26.635 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:17.229 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:18:26.636 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:17.252 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:18:26.658 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:26.924 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:18:36.330 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:26.926 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:18:36.333 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:26.953 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:18:36.360 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:26.975 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:18:36.371 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:26.976 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:18:36.372 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:26.995 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:18:36.402 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:26.997 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:18:36.394 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:26.997 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:18:36.404 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:27.030 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:18:36.437 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:31.744 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:18:41.149 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:31.746 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:18:41.153 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:31.762 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:18:41.168 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:31.793 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:18:41.200 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:31.795 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:18:41.192 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:31.797 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:18:41.203 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:31.797 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:18:41.194 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:31.811 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:18:41.208 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:31.814 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:18:41.221 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:47.254 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:18:56.660 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:47.256 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:18:56.663 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:47.300 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:18:56.706 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:47.324 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:18:56.720 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:47.325 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:18:56.722 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:47.347 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:18:56.754 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:47.349 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:18:56.756 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:47.362 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:18:56.758 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:47.390 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:18:56.797 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:52.081 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:19:01.488 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:52.086 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:19:01.493 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:52.100 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:19:01.507 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:52.131 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:19:01.527 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:52.135 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:19:01.541 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:52.136 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:19:01.543 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:52.138 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:19:01.534 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:52.150 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:19:01.557 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:20:52.152 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:19:01.549 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:02.114 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:19:11.520 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:02.116 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:19:11.523 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:02.139 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:19:11.546 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:02.165 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:19:11.572 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:02.167 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:19:11.574 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:02.177 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:19:11.573 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:02.183 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:19:11.580 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:02.191 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:19:11.598 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:02.206 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:19:11.603 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:12.156 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:19:21.562 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:12.162 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:19:21.569 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:12.200 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:19:21.607 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:12.224 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:19:21.620 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:12.228 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:19:21.635 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:12.229 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:19:21.636 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:12.232 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:19:21.629 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:12.256 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:19:21.652 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:12.257 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:19:21.664 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:17.184 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:19:26.591 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:17.186 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:19:26.593 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:17.197 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:19:26.604 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:17.232 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:19:26.628 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:17.232 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:19:26.639 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:17.233 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:19:26.630 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:17.236 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:19:26.643 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:17.245 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:19:26.641 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:17.249 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:19:26.656 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:28.182 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:7462ddf6:::163:head 2024-02-09T08:21:28.182 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:5d165639:::164:head 2024-02-09T08:21:28.182 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:f43765fc:::165:head 2024-02-09T08:21:28.182 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:b4c720e9:::166:head 2024-02-09T08:21:28.183 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:e694b040:::167:head 2024-02-09T08:21:28.183 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:afa38db2:::168:head 2024-02-09T08:21:28.183 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:77ba9f53:::169:head 2024-02-09T08:21:28.183 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:87495034:::170:head 2024-02-09T08:21:28.183 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:7c96bf0e:::171:head 2024-02-09T08:21:28.183 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:dbe346cc:::172:head 2024-02-09T08:21:28.183 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:e943ec24:::173:head 2024-02-09T08:21:28.183 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:f97a9c0c:::174:head 2024-02-09T08:21:28.183 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:6f26e74d:::175:head 2024-02-09T08:21:28.183 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:4f95e106:::176:head 2024-02-09T08:21:28.183 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:0e6f2f8f:::177:head 2024-02-09T08:21:28.183 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:05db05f1:::178:head 2024-02-09T08:21:28.184 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:38a78d66:::179:head 2024-02-09T08:21:28.184 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:d095610b:::180:head 2024-02-09T08:21:28.184 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:a1a9d709:::181:head 2024-02-09T08:21:28.184 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:1e5d39db:::182:head 2024-02-09T08:21:28.184 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:f7df4fb9:::183:head 2024-02-09T08:21:28.184 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:03a7f161:::184:head 2024-02-09T08:21:28.184 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:ba70721e:::185:head 2024-02-09T08:21:28.184 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:28e5662d:::186:head 2024-02-09T08:21:28.184 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:973d52de:::187:head 2024-02-09T08:21:28.184 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:4303eb1c:::188:head 2024-02-09T08:21:28.184 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:b990b48e:::189:head 2024-02-09T08:21:28.184 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:29b8165b:::190:head 2024-02-09T08:21:28.184 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:3547f197:::191:head 2024-02-09T08:21:28.184 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:7e260936:::192:head 2024-02-09T08:21:28.185 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:1abec7b1:::193:head 2024-02-09T08:21:28.185 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:10fdda93:::194:head 2024-02-09T08:21:28.185 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:15817eea:::195:head 2024-02-09T08:21:28.185 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:770bab57:::196:head 2024-02-09T08:21:28.185 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:ed9e13e7:::197:head 2024-02-09T08:21:28.185 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:71471a8f:::198:head 2024-02-09T08:21:28.185 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 273:10fb1d02:::199:head 2024-02-09T08:21:28.185 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetWrite (21770 ms) 2024-02-09T08:21:28.185 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetTrim 2024-02-09T08:21:28.185 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: got ls 1707466832,0 2024-02-09T08:21:28.185 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: first is 1707466832 2024-02-09T08:21:28.185 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: got ls 1707466832,0 2024-02-09T08:21:28.185 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: got ls 1707466832,0 2024-02-09T08:21:28.186 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: got ls 1707466832,1707466834,1707466835,0 2024-02-09T08:21:28.186 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: got ls 1707466832,1707466834,1707466835,0 2024-02-09T08:21:28.186 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: got ls 1707466832,1707466834,1707466835,0 2024-02-09T08:21:28.186 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: got ls 1707466832,1707466834,1707466835,1707466837,1707466838,0 2024-02-09T08:21:28.186 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: got ls 1707466832,1707466834,1707466835,1707466837,1707466838,0 2024-02-09T08:21:28.186 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: got ls 1707466832,1707466834,1707466835,1707466837,1707466838,0 2024-02-09T08:21:28.186 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: got ls 1707466832,1707466834,1707466835,1707466837,1707466838,1707466840,1707466841,0 2024-02-09T08:21:28.186 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: got ls 1707466832,1707466834,1707466835,1707466837,1707466838,1707466840,1707466841,0 2024-02-09T08:21:28.186 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: got ls 1707466832,1707466834,1707466835,1707466837,1707466838,1707466840,1707466841,0 2024-02-09T08:21:28.186 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: got ls 1707466835,1707466837,1707466838,1707466840,1707466841,1707466843,1707466844,0 2024-02-09T08:21:28.186 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: first now 1707466835, trimmed 2024-02-09T08:21:28.186 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetTrim (22885 ms) 2024-02-09T08:21:28.187 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2024-02-09T08:21:28.187 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: foo0 2024-02-09T08:21:28.187 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: verifying foo0 is eventually promoted 2024-02-09T08:21:28.187 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteOn2ndRead (19316 ms) 2024-02-09T08:21:28.187 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ProxyRead 2024-02-09T08:21:32.217 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:19:41.624 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:32.221 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:19:41.627 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:32.255 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:19:41.662 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:32.271 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:19:41.668 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:32.273 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:19:41.670 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:32.275 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:19:41.682 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:32.279 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:19:41.685 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:32.297 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:19:41.694 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:32.310 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:19:41.716 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:33.183 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:19:42.580 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:33.184 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:19:42.581 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:33.193 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:19:42.590 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:33.249 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:19:42.656 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:33.250 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:19:42.657 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:33.263 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:19:42.670 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:33.368 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:19:42.774 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:33.369 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:19:42.775 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:33.391 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:19:42.798 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:47.300 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:19:56.707 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:47.302 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:19:56.709 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:47.328 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:19:56.734 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:47.352 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:19:56.759 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:47.353 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:19:56.749 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:47.353 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:19:56.760 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:47.355 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:19:56.752 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:47.380 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:19:56.786 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:47.380 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:19:56.776 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:52.453 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:20:01.860 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:52.505 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:20:01.901 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:52.506 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:20:01.902 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:52.513 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:20:01.920 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:52.528 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:20:01.925 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:52.580 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:20:01.986 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:52.580 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:20:01.987 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:52.583 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:20:01.990 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:21:52.611 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:20:02.017 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:02.411 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:20:11.817 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:02.413 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:20:11.820 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:02.444 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:20:11.851 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:02.475 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:20:11.870 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:02.484 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:20:11.891 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:02.492 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:20:11.899 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:02.527 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:20:11.933 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:02.579 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:20:11.975 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:02.612 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:20:12.008 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:12.585 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:20:21.991 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:12.587 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:20:21.994 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:12.612 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:20:22.019 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:12.632 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:20:22.029 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:12.640 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:20:22.036 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:12.640 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:20:22.047 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:12.641 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:20:22.048 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:12.669 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:20:22.075 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:12.672 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:20:22.069 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:17.428 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:20:26.832 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:17.430 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:20:26.837 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:17.445 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:20:26.852 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:17.473 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:20:26.870 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:17.474 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:20:26.871 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:17.477 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:20:26.884 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:17.478 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:20:26.885 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:17.488 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:20:26.885 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:17.493 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:20:26.900 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:31.297 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:20:40.704 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:31.300 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:20:40.707 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:31.332 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:20:40.738 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:31.351 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:20:40.747 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:31.353 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:20:40.749 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:31.354 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:20:40.760 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:31.355 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:20:40.762 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:31.383 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:20:40.779 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:31.388 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:20:40.795 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:32.563 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:20:41.969 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:32.613 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:20:42.019 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:32.623 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:20:42.030 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:32.663 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:20:42.060 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:32.668 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:20:42.074 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:32.671 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:20:42.078 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:32.682 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:20:42.089 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:32.685 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:20:42.081 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:32.693 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:20:42.090 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:52.590 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:21:01.996 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:52.593 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:21:01.999 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:52.618 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:21:02.025 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:52.643 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:21:02.050 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:52.644 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:21:02.040 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:52.644 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:21:02.051 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:52.645 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:21:02.042 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:52.668 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:21:02.074 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:52.670 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:21:02.066 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:53.384 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:21:02.780 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:53.386 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:21:02.782 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:53.393 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:21:02.790 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:53.433 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:21:02.839 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:53.433 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:21:02.840 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:53.442 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:21:02.849 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:53.460 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:21:02.867 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:53.462 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:21:02.869 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:22:53.472 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:21:02.879 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:07.754 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:21:17.160 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:07.761 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:21:17.167 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:07.800 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:21:17.207 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:07.814 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:21:17.221 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:07.816 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:21:17.212 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:07.817 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:21:17.213 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:07.818 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:21:17.225 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:07.841 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:21:17.238 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:07.844 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:21:17.251 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:12.622 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:21:22.029 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:12.672 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:21:22.079 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:12.682 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:21:22.089 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:12.718 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:21:22.115 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:12.719 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:21:22.116 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:12.721 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:21:22.128 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:12.722 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:21:22.129 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:12.732 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:21:22.128 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:12.736 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:21:22.143 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:22.696 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:21:32.103 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:22.700 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:21:32.107 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:22.718 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:21:32.125 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:22.746 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:21:32.143 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:22.748 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:21:32.144 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:22.749 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:21:32.156 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:22.750 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:21:32.157 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:22.765 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:21:32.162 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:22.769 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:21:32.176 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:32.741 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:21:42.147 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:32.745 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:21:42.152 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:32.774 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:21:42.180 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:32.788 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:21:42.184 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:32.791 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:21:42.187 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:32.815 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:21:42.221 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:32.817 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:21:42.224 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:32.820 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:21:42.216 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:32.844 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:21:42.250 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:37.747 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:21:47.154 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:37.752 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:21:47.159 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:37.765 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:21:47.171 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:37.797 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:21:47.194 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:37.798 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:21:47.195 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:37.813 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:21:47.209 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:37.820 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:21:47.226 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:37.821 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:21:47.228 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:37.836 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:21:47.243 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:52.785 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:22:02.180 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:52.785 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:22:02.182 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:52.786 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:22:02.192 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:52.787 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:22:02.194 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:52.789 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:22:02.196 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:52.791 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:22:02.198 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:52.805 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:22:02.202 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:52.809 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:22:02.215 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:52.811 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:22:02.218 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:57.759 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:22:07.166 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:57.806 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:22:07.202 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:57.811 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:22:07.206 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:57.813 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:22:07.220 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:57.826 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:22:07.223 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:57.838 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:22:07.245 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:57.865 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:22:07.271 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:57.867 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:22:07.274 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:23:57.880 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:22:07.287 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:12.980 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:22:22.387 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:12.983 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:22:22.390 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:13.011 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:22:22.417 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:13.028 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:22:22.424 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:13.032 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:22:22.439 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:13.033 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:22:22.430 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:13.037 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:22:22.444 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:13.054 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:22:22.451 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:13.058 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:22:22.465 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:18.041 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:22:27.448 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:18.044 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:22:27.451 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:18.073 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:22:27.480 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:18.091 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:22:27.488 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:18.092 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:22:27.489 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:18.107 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:22:27.504 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:18.110 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:22:27.517 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:18.112 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:22:27.519 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:18.132 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:22:27.538 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:32.959 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:22:42.366 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:32.963 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:22:42.370 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:32.993 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:22:42.400 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:33.012 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:22:42.408 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:33.017 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:22:42.413 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:33.018 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:22:42.425 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:33.019 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:22:42.426 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:33.046 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:22:42.442 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:33.048 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:22:42.455 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:33.801 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:22:43.198 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:33.802 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:22:43.199 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:33.812 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:22:43.208 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:33.871 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:22:43.278 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:33.872 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:22:43.279 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:33.885 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:22:43.291 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:33.897 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:22:43.304 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:33.898 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:22:43.305 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:33.907 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:22:43.314 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:51.024 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-02-09T08:24:51.015+0000 22876640 -1 snap_mapper.add_oid found existing snaps mapped on 291:5917cbd5:test-rados-api-smithi062-41096-80::foo:2, removing 2024-02-09T08:24:51.035 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:24:51.025+0000 2a085640 -1 snap_mapper.add_oid found existing snaps mapped on 291:5917cbd5:test-rados-api-smithi062-41096-80::foo:2, removing 2024-02-09T08:24:53.073 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:23:02.479 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:53.076 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:23:02.483 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:53.108 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:23:02.515 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:53.128 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:23:02.524 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:53.131 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:23:02.527 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:53.135 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:23:02.542 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:53.140 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:23:02.547 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:53.165 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:23:02.561 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:53.170 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:23:02.577 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:53.912 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:23:03.309 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:53.913 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:23:03.310 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:53.921 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:23:03.318 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:54.091 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:23:03.497 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:54.092 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:23:03.499 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:54.109 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:23:03.513 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:54.404 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:23:03.811 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:54.424 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:23:03.830 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:24:54.442 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:23:03.848 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:07.527 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:23:16.933 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:07.531 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:23:16.938 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:07.564 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:23:16.971 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:07.581 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:23:16.977 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:07.583 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:23:16.980 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:07.586 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:23:16.992 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:07.587 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:23:16.994 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:07.617 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:23:17.014 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:07.622 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:23:17.029 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:08.412 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:23:17.808 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:08.416 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:23:17.810 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:08.423 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:23:17.820 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:08.514 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:23:17.921 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:08.516 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:23:17.923 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:08.526 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:23:17.933 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:08.613 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:23:18.019 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:08.614 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:23:18.021 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:08.623 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:23:18.030 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:18.118 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:23:27.524 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:18.189 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:23:27.596 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:18.214 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:23:27.621 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:18.236 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:23:27.632 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:18.238 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:23:27.635 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:18.245 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:23:27.652 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:18.247 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:23:27.654 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:18.264 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:23:27.661 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:18.273 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:23:27.680 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:26.500 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ProxyRead (22101 ms) 2024-02-09T08:25:26.501 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.CachePin 2024-02-09T08:25:26.501 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.CachePin (26276 ms) 2024-02-09T08:25:26.501 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.SetRedirectRead 2024-02-09T08:25:26.501 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.SetRedirectRead (5472 ms) 2024-02-09T08:25:26.501 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestPromoteRead 2024-02-09T08:25:26.501 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: require_osd_release = squid 2024-02-09T08:25:26.501 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestPromoteRead (5320 ms) 2024-02-09T08:25:26.501 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRefRead 2024-02-09T08:25:26.501 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRefRead (4457 ms) 2024-02-09T08:25:26.501 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestUnset 2024-02-09T08:25:26.501 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: require_osd_release = squid 2024-02-09T08:25:26.501 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestUnset (4669 ms) 2024-02-09T08:25:26.502 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2024-02-09T08:25:26.502 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: require_osd_release = squid 2024-02-09T08:25:26.502 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestDedupRefRead (5738 ms) 2024-02-09T08:25:26.502 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2024-02-09T08:25:26.502 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: require_osd_release = squid 2024-02-09T08:25:26.502 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapRefcount (40954 ms) 2024-02-09T08:25:26.502 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2024-02-09T08:25:26.502 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: require_osd_release = squid 2024-02-09T08:25:26.502 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 (18750 ms) 2024-02-09T08:25:26.502 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2024-02-09T08:25:26.502 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: require_osd_release = squid 2024-02-09T08:25:26.502 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestTestSnapCreate (5468 ms) 2024-02-09T08:25:26.502 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2024-02-09T08:25:26.503 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: require_osd_release = squid 2024-02-09T08:25:26.503 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote (4435 ms) 2024-02-09T08:25:26.503 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2024-02-09T08:25:26.503 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: require_osd_release = squid 2024-02-09T08:25:26.503 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification (26495 ms) 2024-02-09T08:25:26.503 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2024-02-09T08:25:26.503 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: require_osd_release = squid 2024-02-09T08:25:26.503 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapIncCount (16987 ms) 2024-02-09T08:25:26.503 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvict 2024-02-09T08:25:26.503 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: require_osd_release = squid 2024-02-09T08:25:26.503 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvict (6929 ms) 2024-02-09T08:25:26.503 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvictPromote 2024-02-09T08:25:26.503 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: require_osd_release = squid 2024-02-09T08:25:26.503 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvictPromote (6023 ms) 2024-02-09T08:25:26.503 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2024-02-09T08:25:26.504 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: require_osd_release = squid 2024-02-09T08:25:26.504 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: waiting for scrubs... 2024-02-09T08:25:26.504 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: done waiting 2024-02-09T08:25:26.504 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch (25659 ms) 2024-02-09T08:25:26.504 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.DedupFlushRead 2024-02-09T08:25:26.504 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: require_osd_release = squid 2024-02-09T08:25:26.504 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.DedupFlushRead (12374 ms) 2024-02-09T08:25:26.504 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestFlushSnap 2024-02-09T08:25:26.504 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: require_osd_release = squid 2024-02-09T08:25:26.504 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestFlushSnap (11347 ms) 2024-02-09T08:25:26.504 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2024-02-09T08:25:26.504 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: require_osd_release = squid 2024-02-09T08:25:26.504 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestFlushDupCount (10966 ms) 2024-02-09T08:25:28.183 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:23:37.590 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:28.189 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:23:37.596 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:28.213 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:23:37.619 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:28.233 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:23:37.629 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:28.234 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:23:37.631 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:28.238 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:23:37.645 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:28.239 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:23:37.646 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:28.256 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:23:37.653 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:28.263 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:23:37.670 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:38.314 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:23:47.721 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:38.318 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:23:47.725 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:38.352 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:23:47.758 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:38.371 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:23:47.767 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:38.373 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:23:47.770 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:38.380 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:23:47.786 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:38.382 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:23:47.789 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:38.404 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:23:47.800 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:38.413 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:23:47.819 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:39.245 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:23:48.641 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:39.246 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:23:48.642 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:39.262 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:23:48.659 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:39.329 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:23:48.736 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:39.331 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:23:48.738 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:39.343 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:23:48.750 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:39.412 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:23:48.819 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:39.414 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:23:48.820 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:39.431 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:23:48.838 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:43.312 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:23:52.719 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:43.316 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:23:52.723 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:43.329 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:23:52.736 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:43.363 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:23:52.760 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:43.364 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:23:52.761 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:43.372 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:23:52.779 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:43.374 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:23:52.780 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:43.376 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:23:52.773 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:43.395 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:23:52.801 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:58.504 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:24:07.911 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:58.510 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:24:07.917 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:58.546 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:24:07.953 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:58.555 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:24:07.951 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:58.556 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:24:07.952 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:58.578 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:24:07.985 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:58.581 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:24:07.988 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:58.582 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:24:07.979 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:25:58.612 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:24:08.018 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:26:18.568 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:24:27.974 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:26:18.574 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:24:27.981 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:26:18.594 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:24:28.001 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:26:18.634 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:24:28.031 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:26:18.638 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:24:28.034 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:26:18.646 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:24:28.053 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:26:18.648 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:24:28.054 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:26:18.661 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:24:28.054 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:26:18.667 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:24:28.074 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:26:33.517 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:24:42.923 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:26:33.527 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:24:42.933 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:26:33.555 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:24:42.961 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:26:33.576 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:24:42.973 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:26:33.579 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:24:42.986 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:26:33.580 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:24:42.976 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:26:33.584 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:24:42.991 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:26:33.604 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:24:43.000 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:26:33.607 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:24:43.014 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:26:34.692 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-02-09T08:26:34.684+0000 2687e640 -1 snap_mapper.add_oid found existing snaps mapped on 92:c21785f4:test-rados-api-smithi062-41096-97::foo:21, removing 2024-02-09T08:26:34.710 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:26:34.674+0000 22876640 -1 snap_mapper.add_oid found existing snaps mapped on 92:c21785f4:test-rados-api-smithi062-41096-97::foo:21, removing 2024-02-09T08:26:38.709 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:24:48.116 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:26:38.713 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:24:48.120 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:26:38.734 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:24:48.141 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:26:38.767 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:24:48.174 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:26:38.768 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:24:48.165 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:26:38.769 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:24:48.176 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:26:38.769 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:24:48.166 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:26:38.784 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:24:48.180 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:26:38.786 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:24:48.193 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:26:48.679 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:24:58.085 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:26:48.742 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:24:58.139 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:26:48.744 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:24:58.140 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:26:48.755 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:24:58.161 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:26:48.772 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:24:58.168 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:26:48.786 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:24:58.193 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:26:48.813 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:24:58.220 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:26:48.819 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:24:58.226 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:26:48.856 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:24:58.262 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:26:58.738 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:25:08.144 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:26:58.738 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:25:08.144 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:26:58.739 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:25:08.146 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:26:58.742 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:25:08.149 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:26:58.746 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:25:08.142 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:26:58.750 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:25:08.146 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:26:58.779 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:25:08.185 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:26:58.781 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:25:08.178 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:26:58.784 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:25:08.191 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:08.799 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:25:18.205 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:08.805 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:25:18.212 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:08.838 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:25:18.244 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:08.865 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:25:18.262 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:08.867 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:25:18.263 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:08.882 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:25:18.289 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:08.884 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:25:18.291 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:08.906 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:25:18.303 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:08.921 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:25:18.328 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:19.131 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:25:28.537 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:19.141 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:25:28.548 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:19.148 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:25:28.555 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:19.148 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:25:28.545 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:19.160 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:25:28.556 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:19.175 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:25:28.582 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:19.203 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:25:28.599 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:19.209 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:25:28.616 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:19.247 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:25:28.654 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:23.836 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:25:33.242 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:23.838 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:25:33.245 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:23.854 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:25:33.261 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:23.885 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:25:33.282 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:23.887 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:25:33.283 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:23.903 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:25:33.310 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:23.904 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:25:33.300 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:23.908 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:25:33.314 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:23.923 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:25:33.330 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:38.896 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:25:48.300 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:38.948 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:25:48.345 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:38.949 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:25:48.346 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:38.956 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:25:48.362 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:38.993 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:25:48.389 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:39.003 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:25:48.410 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:39.030 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:25:48.436 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:39.035 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:25:48.441 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:39.084 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:25:48.490 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:43.912 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:25:53.308 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:43.913 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:25:53.310 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:43.931 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:25:53.327 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:43.936 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:25:53.342 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:43.939 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:25:53.346 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:43.967 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:25:53.373 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:44.015 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:25:53.422 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:44.019 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:25:53.426 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:44.043 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:25:53.450 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:48.948 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:25:58.354 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:48.952 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:25:58.359 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:48.974 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:25:58.380 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:49.006 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:25:58.402 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:49.007 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:25:58.403 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:49.014 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:25:58.421 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:49.015 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:25:58.422 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:49.026 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:25:58.422 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:49.036 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:25:58.442 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:54.088 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:26:03.494 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:54.157 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:26:03.553 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:54.158 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:26:03.555 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:54.170 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:26:03.576 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:54.170 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:26:03.577 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:54.173 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:26:03.580 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:54.182 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:26:03.578 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:54.200 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:26:03.607 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:27:54.203 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:26:03.610 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:04.175 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:26:13.582 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:04.189 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:26:13.596 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:04.189 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:26:13.596 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:04.190 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:26:13.587 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:04.191 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:26:13.598 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:04.197 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:26:13.593 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:04.224 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:26:13.631 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:04.286 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:26:13.692 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:04.293 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:26:13.690 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:09.135 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:26:18.541 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:09.212 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:26:18.618 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:09.240 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:26:18.647 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:09.253 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:26:18.650 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:09.256 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:26:18.652 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:09.267 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:26:18.673 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:09.273 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:26:18.680 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:09.274 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:26:18.671 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:09.290 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:26:18.697 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:24.080 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:26:33.487 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:24.085 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:26:33.492 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:24.115 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:26:33.522 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:24.132 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:26:33.539 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:24.138 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:26:33.545 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:24.139 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:26:33.536 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:24.141 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:26:33.538 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:24.167 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:26:33.573 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:24.168 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:26:33.565 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:24.854 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:26:34.250 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:24.856 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:26:34.253 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:24.864 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:26:34.261 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:24.952 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:26:34.358 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:24.953 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:26:34.359 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:24.953 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:26:34.360 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:24.953 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:26:34.360 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:24.961 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:26:34.368 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:24.964 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:26:34.371 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:39.281 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:26:48.687 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:39.287 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:26:48.684 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:39.289 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:26:48.685 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:39.289 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:26:48.695 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:39.335 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:26:48.741 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:39.353 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:26:48.760 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:39.363 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:26:48.770 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:39.364 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:26:48.761 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:39.382 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:26:48.789 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:44.285 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:26:53.691 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:44.290 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:26:53.696 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:44.314 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:26:53.721 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:44.345 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:26:53.741 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:44.347 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:26:53.744 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:44.359 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:26:53.765 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:44.360 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:26:53.767 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:44.362 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:26:53.759 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:44.376 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:26:53.782 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:54.370 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:27:03.777 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:54.372 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:27:03.779 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:54.406 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:27:03.813 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:54.421 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:27:03.818 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:54.423 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:27:03.819 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:54.423 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:27:03.830 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:54.424 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:27:03.831 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:54.446 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:27:03.843 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:28:54.466 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:27:03.873 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:04.262 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:27:13.668 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:04.266 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:27:13.673 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:04.291 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:27:13.697 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:04.310 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:27:13.707 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:04.312 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:27:13.708 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:04.317 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:27:13.724 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:04.318 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:27:13.725 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:04.334 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:27:13.731 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:04.342 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:27:13.748 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:09.315 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:27:18.721 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:09.316 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:27:18.723 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:09.333 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:27:18.739 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:09.364 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:27:18.760 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:09.365 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:27:18.762 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:09.367 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:27:18.773 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:09.372 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:27:18.779 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:09.379 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:27:18.775 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:09.390 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:27:18.797 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:24.341 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:27:33.747 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:24.346 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:27:33.752 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:24.379 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:27:33.786 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:24.392 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:27:33.788 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:24.394 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:27:33.790 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:24.396 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:27:33.803 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:24.400 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:27:33.807 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:24.423 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:27:33.819 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:24.434 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:27:33.840 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:25.402 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:27:34.798 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:25.403 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:27:34.799 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:25.420 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:27:34.817 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:25.632 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:27:35.039 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:25.633 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:27:35.040 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:25.654 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:27:35.061 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:25.762 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:27:35.169 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:25.763 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:27:35.170 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:25.780 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:27:35.187 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:32.881 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2024-02-09T08:29:32.882 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: require_osd_release = squid 2024-02-09T08:29:32.882 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TierFlushDuringFlush (11248 ms) 2024-02-09T08:29:32.882 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2024-02-09T08:29:32.882 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: require_osd_release = squid 2024-02-09T08:29:32.882 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapHasChunk (8105 ms) 2024-02-09T08:29:32.882 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRollback 2024-02-09T08:29:32.882 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: require_osd_release = squid 2024-02-09T08:29:32.882 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRollback (6526 ms) 2024-02-09T08:29:32.882 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2024-02-09T08:29:32.882 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: require_osd_release = squid 2024-02-09T08:29:32.882 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRollbackRefcount (28281 ms) 2024-02-09T08:29:32.882 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvictRollback 2024-02-09T08:29:32.882 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: require_osd_release = squid 2024-02-09T08:29:32.883 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvictRollback (15060 ms) 2024-02-09T08:29:32.883 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PropagateBaseTierError 2024-02-09T08:29:32.883 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PropagateBaseTierError (12641 ms) 2024-02-09T08:29:32.883 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HelloWriteReturn 2024-02-09T08:29:32.883 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: 00000000 79 6f 75 20 6d 69 67 68 74 20 73 65 65 20 74 68 |you might see th| 2024-02-09T08:29:32.883 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: 00000010 69 73 |is| 2024-02-09T08:29:32.883 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: 00000012 2024-02-09T08:29:32.883 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HelloWriteReturn (11922 ms) 2024-02-09T08:29:32.883 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2024-02-09T08:29:32.883 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: require_osd_release = squid 2024-02-09T08:29:32.883 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier (7505 ms) 2024-02-09T08:29:32.883 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [----------] 48 tests from LibRadosTwoPoolsPP (1200313 ms total) 2024-02-09T08:29:32.883 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: 2024-02-09T08:29:32.883 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [----------] 4 tests from LibRadosTierECPP 2024-02-09T08:29:32.884 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.Dirty 2024-02-09T08:29:32.884 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.Dirty (1624 ms) 2024-02-09T08:29:32.884 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.FlushWriteRaces 2024-02-09T08:29:32.884 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.FlushWriteRaces (10956 ms) 2024-02-09T08:29:32.884 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.CallForcesPromote 2024-02-09T08:29:32.884 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.CallForcesPromote (21180 ms) 2024-02-09T08:29:32.884 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.HitSetNone 2024-02-09T08:29:32.884 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.HitSetNone (88 ms) 2024-02-09T08:29:32.884 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [----------] 4 tests from LibRadosTierECPP (33848 ms total) 2024-02-09T08:29:32.884 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: 2024-02-09T08:29:32.884 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [----------] 22 tests from LibRadosTwoPoolsECPP 2024-02-09T08:29:32.884 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Overlay 2024-02-09T08:29:32.884 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Overlay (6837 ms) 2024-02-09T08:29:32.884 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Promote 2024-02-09T08:29:32.885 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Promote (11161 ms) 2024-02-09T08:29:32.885 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteSnap 2024-02-09T08:29:32.885 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: waiting for scrub... 2024-02-09T08:29:32.885 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: done waiting 2024-02-09T08:29:32.885 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteSnap (28635 ms) 2024-02-09T08:29:32.885 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2024-02-09T08:29:32.885 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace (11289 ms) 2024-02-09T08:29:32.885 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Whiteout 2024-02-09T08:29:32.885 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Whiteout (9818 ms) 2024-02-09T08:29:32.885 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Evict 2024-02-09T08:29:32.885 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Evict (9889 ms) 2024-02-09T08:29:32.886 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.EvictSnap 2024-02-09T08:29:32.886 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.EvictSnap (12191 ms) 2024-02-09T08:29:32.886 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TryFlush 2024-02-09T08:29:39.565 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:27:48.971 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:39.566 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:27:48.973 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:39.599 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:27:49.006 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:39.614 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:27:49.011 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:39.616 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:27:49.013 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:39.621 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:27:49.028 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:39.623 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:27:49.030 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:39.662 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:27:49.069 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:39.665 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:27:49.062 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:44.447 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:27:53.854 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:44.451 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:27:53.858 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:44.461 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:27:53.868 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:44.495 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:27:53.889 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:44.496 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:27:53.891 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:44.503 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:27:53.910 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:44.503 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:27:53.900 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:44.506 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:27:53.913 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:44.516 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:27:53.923 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:54.490 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:28:03.897 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:54.543 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:28:03.940 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:54.544 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:28:03.941 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:54.551 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:28:03.958 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:54.570 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:28:03.966 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:54.580 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:28:03.987 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:54.607 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:28:04.014 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:54.609 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:28:04.015 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:29:54.643 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:28:04.050 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:04.548 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:28:13.955 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:04.554 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:28:13.961 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:04.578 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:28:13.985 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:04.599 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:28:13.995 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:04.600 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:28:13.997 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:04.600 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:28:14.007 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:04.604 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:28:14.010 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:04.623 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:28:14.020 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:04.628 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:28:14.035 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:09.686 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:28:19.092 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:09.695 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:28:19.102 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:09.721 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:28:19.127 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:09.747 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:28:19.153 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:09.751 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:28:19.158 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:09.759 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:28:19.156 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:09.765 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:28:19.161 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:09.769 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:28:19.176 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:09.784 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:28:19.180 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:24.729 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:28:34.135 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:24.790 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:28:34.196 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:24.833 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:28:34.239 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:24.857 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:28:34.263 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:24.858 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:28:34.255 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:24.863 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:28:34.269 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:24.864 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:28:34.260 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:24.902 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:28:34.298 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:24.917 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:28:34.323 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:39.932 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:28:49.338 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:39.933 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:28:49.340 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:39.967 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:28:49.374 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:39.979 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:28:49.376 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:39.980 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:28:49.377 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:39.994 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:28:49.401 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:39.996 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:28:49.403 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:40.014 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:28:49.411 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:40.030 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:28:49.437 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:44.949 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:28:54.355 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:44.952 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:28:54.359 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:44.971 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:28:54.378 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:45.007 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:28:54.404 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:45.008 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:28:54.405 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:45.012 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:28:54.419 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:45.013 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:28:54.420 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:45.023 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:28:54.419 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:45.034 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:28:54.441 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:54.768 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:29:04.175 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:54.814 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:29:04.211 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:54.815 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:29:04.212 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:54.822 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:29:04.228 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:54.822 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:29:04.228 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:54.823 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:29:04.230 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:54.837 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:29:04.234 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:54.849 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:29:04.256 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:30:54.852 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:29:04.258 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:04.839 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:29:14.245 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:04.840 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:29:14.247 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:04.852 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:29:14.258 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:04.885 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:29:14.291 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:04.885 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:29:14.282 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:04.886 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:29:14.283 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:04.887 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:29:14.294 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:04.897 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:29:14.294 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:04.902 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:29:14.308 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:10.023 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:29:19.429 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:10.026 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:29:19.433 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:10.045 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:29:19.451 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:10.076 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:29:19.482 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:10.077 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:29:19.484 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:10.083 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:29:19.479 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:10.084 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:29:19.481 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:10.093 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:29:19.500 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:10.105 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:29:19.501 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:24.933 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:29:34.340 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:24.936 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:29:34.342 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:24.968 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:29:34.375 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:24.982 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:29:34.379 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:24.985 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:29:34.381 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:24.985 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:29:34.392 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:24.989 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:29:34.395 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:25.017 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:29:34.414 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:25.033 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:29:34.440 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:25.891 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:29:35.287 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:25.892 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:29:35.289 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:25.902 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:29:35.299 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:25.976 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:29:35.382 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:25.977 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:29:35.384 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:26.007 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:29:35.414 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:26.008 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:29:35.414 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:26.009 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:29:35.416 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:26.024 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:29:35.430 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:32.200 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:29:41.607 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:32.206 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:29:41.613 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:32.231 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:29:41.637 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:32.259 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:29:41.666 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:32.260 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:29:41.657 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:32.261 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:29:41.658 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:32.262 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:29:41.669 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:32.283 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:29:41.679 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:32.294 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:29:41.701 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:39.976 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:29:49.383 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:39.981 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:29:49.387 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:39.993 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:29:49.399 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:40.030 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:29:49.426 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:40.033 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:29:49.430 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:40.034 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:29:49.441 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:40.045 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:29:49.442 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:40.047 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:29:49.454 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:40.058 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:29:49.465 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:45.136 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:29:54.539 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:45.138 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:29:54.544 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:45.158 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:29:54.564 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:45.185 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:29:54.582 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:45.189 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:29:54.586 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:45.190 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:29:54.596 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:45.198 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:29:54.605 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:45.203 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:29:54.600 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:45.213 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:29:54.619 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:55.046 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:30:04.452 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:55.048 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:30:04.455 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:55.050 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:30:04.456 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:55.083 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:30:04.490 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:55.098 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:30:04.494 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:55.100 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:30:04.497 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:55.119 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:30:04.526 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:55.124 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:30:04.521 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:31:55.151 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:30:04.558 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:05.062 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:30:14.468 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:05.065 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:30:14.472 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:05.094 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:30:14.501 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:05.113 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:30:14.510 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:05.115 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:30:14.512 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:05.122 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:30:14.529 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:05.123 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:30:14.530 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:05.134 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:30:14.530 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:05.149 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:30:14.556 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:10.241 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:30:19.647 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:10.244 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:30:19.651 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:10.279 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:30:19.686 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:10.291 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:30:19.688 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:10.295 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:30:19.692 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:10.305 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:30:19.712 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:10.309 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:30:19.706 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:10.318 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:30:19.725 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:10.338 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:30:19.744 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:25.100 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:30:34.506 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:25.174 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:30:34.581 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:25.226 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:30:34.633 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:25.232 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:30:34.628 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:25.237 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:30:34.634 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:25.245 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:30:34.652 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:25.251 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:30:34.658 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:25.285 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:30:34.682 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:25.308 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:30:34.715 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:26.150 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:30:35.547 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:26.151 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:30:35.548 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:26.171 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:30:35.568 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:26.378 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:30:35.785 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:26.379 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:30:35.786 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:26.389 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:30:35.796 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:26.500 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:30:35.906 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:26.501 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:30:35.908 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:26.546 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:30:35.953 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:35.189 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:30:44.595 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:35.190 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:30:44.597 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:35.215 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:30:44.622 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:35.237 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:30:44.634 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:35.240 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:30:44.636 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:35.244 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:30:44.650 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:35.246 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:30:44.653 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:35.267 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:30:44.663 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:35.272 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:30:44.679 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:35.995 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TryFlush (10438 ms) 2024-02-09T08:32:35.995 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FailedFlush 2024-02-09T08:32:35.995 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FailedFlush (15332 ms) 2024-02-09T08:32:35.995 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Flush 2024-02-09T08:32:35.995 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Flush (11264 ms) 2024-02-09T08:32:35.995 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FlushSnap 2024-02-09T08:32:35.995 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FlushSnap (15992 ms) 2024-02-09T08:32:35.995 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2024-02-09T08:32:35.996 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FlushTryFlushRaces (8875 ms) 2024-02-09T08:32:35.996 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TryFlushReadRace 2024-02-09T08:32:35.996 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TryFlushReadRace (8181 ms) 2024-02-09T08:32:35.996 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.HitSetRead 2024-02-09T08:32:35.996 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: hmm, no HitSet yet 2024-02-09T08:32:35.996 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: ok, hit_set contains 323:602f83fe:::foo:head 2024-02-09T08:32:35.996 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.HitSetRead (10983 ms) 2024-02-09T08:32:35.996 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.HitSetTrim 2024-02-09T08:32:35.996 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: got ls 1707467452,0 2024-02-09T08:32:35.996 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: first is 1707467452 2024-02-09T08:32:35.996 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: got ls 1707467452,0 2024-02-09T08:32:35.996 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: got ls 1707467452,0 2024-02-09T08:32:35.996 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: got ls 1707467452,1707467454,1707467455,0 2024-02-09T08:32:35.996 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: got ls 1707467452,1707467454,1707467455,0 2024-02-09T08:32:35.997 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: got ls 1707467452,1707467454,1707467455,0 2024-02-09T08:32:35.997 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: got ls 1707467452,1707467454,1707467455,1707467457,1707467458,0 2024-02-09T08:32:35.997 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: got ls 1707467452,1707467454,1707467455,1707467457,1707467458,0 2024-02-09T08:32:35.997 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: got ls 1707467452,1707467454,1707467455,1707467457,1707467458,0 2024-02-09T08:32:35.997 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: got ls 1707467452,1707467454,1707467455,1707467457,1707467458,1707467460,1707467461,0 2024-02-09T08:32:35.997 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: got ls 1707467452,1707467454,1707467455,1707467457,1707467458,1707467460,1707467461,0 2024-02-09T08:32:35.997 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: got ls 1707467452,1707467454,1707467455,1707467457,1707467458,1707467460,1707467461,0 2024-02-09T08:32:35.997 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: got ls 1707467455,1707467457,1707467458,1707467460,1707467461,1707467464,1707467465,0 2024-02-09T08:32:35.997 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: first now 1707467455, trimmed 2024-02-09T08:32:35.997 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.HitSetTrim (22741 ms) 2024-02-09T08:32:35.997 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2024-02-09T08:32:35.997 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: foo0 2024-02-09T08:32:35.997 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: verifying foo0 is eventually promoted 2024-02-09T08:32:35.997 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteOn2ndRead (19346 ms) 2024-02-09T08:32:35.997 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.ProxyRead 2024-02-09T08:32:35.998 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.ProxyRead (20890 ms) 2024-02-09T08:32:35.998 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.CachePin 2024-02-09T08:32:35.998 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.CachePin (25056 ms) 2024-02-09T08:32:35.998 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.SetRedirectRead 2024-02-09T08:32:35.998 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.SetRedirectRead (6680 ms) 2024-02-09T08:32:35.998 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.SetChunkRead 2024-02-09T08:32:35.998 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.SetChunkRead (4336 ms) 2024-02-09T08:32:35.998 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2024-02-09T08:32:35.998 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.ManifestPromoteRead (4871 ms) 2024-02-09T08:32:35.998 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TrySetDedupTier 2024-02-09T08:32:35.998 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TrySetDedupTier (4574 ms) 2024-02-09T08:32:35.998 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [----------] 22 tests from LibRadosTwoPoolsECPP (279380 ms total) 2024-02-09T08:32:35.998 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: 2024-02-09T08:32:35.998 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [----------] Global test environment tear-down 2024-02-09T08:32:35.999 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [==========] 77 tests from 4 test suites ran. (1706269 ms total) 2024-02-09T08:32:35.999 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ PASSED ] 77 tests. 2024-02-09T08:32:36.002 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-09T08:32:36.002 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=40866 2024-02-09T08:32:36.002 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 40866 2024-02-09T08:32:36.002 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-09T08:32:36.002 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41037 2024-02-09T08:32:36.002 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 41037 2024-02-09T08:32:36.003 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-09T08:32:36.003 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41587 2024-02-09T08:32:36.003 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 41587 2024-02-09T08:32:36.003 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-09T08:32:36.003 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41325 2024-02-09T08:32:36.003 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 41325 2024-02-09T08:32:36.003 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-09T08:32:36.003 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41173 2024-02-09T08:32:36.003 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 41173 2024-02-09T08:32:36.003 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-09T08:32:36.003 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=40947 2024-02-09T08:32:36.003 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 40947 2024-02-09T08:32:36.003 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-09T08:32:36.003 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41267 2024-02-09T08:32:36.004 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 41267 2024-02-09T08:32:36.004 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-09T08:32:36.004 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41724 2024-02-09T08:32:36.004 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 41724 2024-02-09T08:32:36.004 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-09T08:32:36.004 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41737 2024-02-09T08:32:36.004 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 41737 2024-02-09T08:32:36.004 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-09T08:32:36.004 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=40962 2024-02-09T08:32:36.004 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 40962 2024-02-09T08:32:36.004 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-09T08:32:36.004 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41627 2024-02-09T08:32:36.004 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 41627 2024-02-09T08:32:36.005 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-09T08:32:36.005 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41454 2024-02-09T08:32:36.005 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 41454 2024-02-09T08:32:36.005 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-09T08:32:36.005 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=40839 2024-02-09T08:32:36.005 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 40839 2024-02-09T08:32:36.005 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-09T08:32:36.005 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=40903 2024-02-09T08:32:36.005 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 40903 2024-02-09T08:32:36.005 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-09T08:32:36.005 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41524 2024-02-09T08:32:36.005 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 41524 2024-02-09T08:32:36.005 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-09T08:32:36.005 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=40830 2024-02-09T08:32:36.005 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 40830 2024-02-09T08:32:36.005 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-09T08:32:36.006 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=40851 2024-02-09T08:32:36.006 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 40851 2024-02-09T08:32:36.006 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-09T08:32:36.006 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41846 2024-02-09T08:32:36.006 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 41846 2024-02-09T08:32:40.285 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:30:49.691 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:40.289 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:30:49.696 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:40.305 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:30:49.711 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:40.339 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:30:49.735 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:40.342 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:30:49.738 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:40.354 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:30:49.751 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:40.357 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:30:49.763 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:40.374 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:30:49.781 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:40.388 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:30:49.794 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:45.218 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:30:54.624 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:45.221 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:30:54.628 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:45.236 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:30:54.642 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:45.273 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:30:54.669 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:45.273 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:30:54.679 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:45.274 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:30:54.671 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:45.277 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:30:54.683 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:45.284 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:30:54.681 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:32:45.287 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:30:54.694 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:00.259 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:31:09.665 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:00.264 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:31:09.670 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:00.277 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:31:09.684 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:00.314 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:31:09.710 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:00.315 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:31:09.721 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:00.315 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:31:09.711 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:00.317 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:31:09.723 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:00.330 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:31:09.726 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:00.330 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:31:09.737 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:05.270 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:31:14.677 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:05.275 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:31:14.681 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:05.285 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:31:14.692 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:05.324 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:31:14.730 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:05.324 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:31:14.721 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:05.325 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:31:14.732 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:05.325 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:31:14.722 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:05.336 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:31:14.742 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:05.337 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:31:14.733 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:20.314 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:31:29.720 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:20.315 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:31:29.722 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:20.329 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:31:29.736 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:20.359 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:31:29.755 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:20.359 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:31:29.756 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:20.365 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:31:29.771 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:20.366 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:31:29.773 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:20.372 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:31:29.769 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:20.383 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:31:29.789 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:25.319 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:31:34.726 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:25.324 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:31:34.731 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:25.334 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:31:34.741 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:25.369 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:31:34.765 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:25.369 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:31:34.776 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:25.370 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:31:34.766 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:25.372 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:31:34.779 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:25.379 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:31:34.776 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:25.382 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:31:34.789 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:40.356 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:31:49.763 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:40.358 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:31:49.765 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:40.372 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:31:49.779 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:40.407 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:31:49.803 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:40.408 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:31:49.805 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:40.409 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:31:49.816 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:40.411 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:31:49.817 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:40.421 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:31:49.818 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:40.425 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:31:49.832 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:45.322 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:31:54.729 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:45.366 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:31:54.763 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:45.367 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:31:54.764 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:45.370 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:31:54.777 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:45.379 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:31:54.776 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:45.383 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:31:54.790 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:45.448 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:31:54.854 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:45.449 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:31:54.855 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:33:45.458 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:31:54.865 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:00.404 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:32:09.811 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:00.406 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:32:09.813 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:00.421 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:32:09.827 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:00.456 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:32:09.852 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:00.457 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:32:09.864 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:00.457 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:32:09.854 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:00.458 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:32:09.865 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:00.471 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:32:09.867 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:00.480 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:32:09.886 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:05.414 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:32:14.820 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:05.418 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:32:14.825 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:05.429 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:32:14.836 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:05.468 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:32:14.865 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:05.469 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:32:14.866 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:05.480 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:32:14.876 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:05.490 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:32:14.897 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:05.492 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:32:14.899 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:05.506 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:32:14.913 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:20.474 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:32:29.881 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:20.478 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:32:29.884 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:20.498 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:32:29.905 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:20.521 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:32:29.917 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:20.523 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:32:29.920 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:20.535 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:32:29.942 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:20.539 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:32:29.946 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:20.543 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:32:29.939 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:20.560 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:32:29.966 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:21.955 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: process_1_[41722]: starting. 2024-02-09T08:34:21.955 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: process_1_[41722]: creating pool ceph_test_rados_open_pools_parallel.smithi062-41670 2024-02-09T08:34:21.955 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: process_1_[41722]: created object 0... 2024-02-09T08:34:21.955 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: process_1_[41722]: created object 25... 2024-02-09T08:34:21.955 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: process_1_[41722]: created object 49... 2024-02-09T08:34:21.956 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: process_1_[41722]: finishing. 2024-02-09T08:34:21.956 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: process_1_[41722]: shutting down. 2024-02-09T08:34:21.956 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: process_2_[41723]: starting. 2024-02-09T08:34:21.956 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: process_2_[41723]: rados_pool_create. 2024-02-09T08:34:21.956 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: process_2_[41723]: rados_ioctx_create. 2024-02-09T08:34:21.956 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: process_2_[41723]: shutting down. 2024-02-09T08:34:21.956 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: ******************************* 2024-02-09T08:34:21.956 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: process_3_[108131]: starting. 2024-02-09T08:34:21.956 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: process_3_[108131]: creating pool ceph_test_rados_open_pools_parallel.smithi062-41670 2024-02-09T08:34:21.956 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: process_3_[108131]: created object 0... 2024-02-09T08:34:21.956 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: process_3_[108131]: created object 25... 2024-02-09T08:34:21.956 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: process_3_[108131]: created object 49... 2024-02-09T08:34:21.957 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: process_3_[108131]: finishing. 2024-02-09T08:34:21.957 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: process_3_[108131]: shutting down. 2024-02-09T08:34:21.957 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: ******************************* 2024-02-09T08:34:21.957 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: process_4_[108132]: starting. 2024-02-09T08:34:21.957 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: process_4_[108132]: rados_pool_create. 2024-02-09T08:34:21.957 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: process_4_[108132]: rados_ioctx_create. 2024-02-09T08:34:21.957 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: process_4_[108132]: shutting down. 2024-02-09T08:34:21.957 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: ******************************* 2024-02-09T08:34:21.957 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: ******************************* 2024-02-09T08:34:21.957 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: ******* SUCCESS ********** 2024-02-09T08:34:26.720 INFO:tasks.workunit.client.0.smithi062.stdout: cmd: Running main() from gmock_main.cc 2024-02-09T08:34:26.720 INFO:tasks.workunit.client.0.smithi062.stdout: cmd: [==========] Running 3 tests from 1 test suite. 2024-02-09T08:34:26.720 INFO:tasks.workunit.client.0.smithi062.stdout: cmd: [----------] Global test environment set-up. 2024-02-09T08:34:26.721 INFO:tasks.workunit.client.0.smithi062.stdout: cmd: [----------] 3 tests from NeoRadosCmd 2024-02-09T08:34:26.722 INFO:tasks.workunit.client.0.smithi062.stdout: cmd: [ RUN ] NeoRadosCmd.MonDescribe 2024-02-09T08:34:26.722 INFO:tasks.workunit.client.0.smithi062.stdout: cmd: [ OK ] NeoRadosCmd.MonDescribe (5719 ms) 2024-02-09T08:34:26.723 INFO:tasks.workunit.client.0.smithi062.stdout: cmd: [ RUN ] NeoRadosCmd.OSDCmd 2024-02-09T08:34:26.723 INFO:tasks.workunit.client.0.smithi062.stdout: cmd: [ OK ] NeoRadosCmd.OSDCmd (7133 ms) 2024-02-09T08:34:26.723 INFO:tasks.workunit.client.0.smithi062.stdout: cmd: [ RUN ] NeoRadosCmd.PGCmd 2024-02-09T08:34:26.723 INFO:tasks.workunit.client.0.smithi062.stdout: cmd: [ OK ] NeoRadosCmd.PGCmd (1803843 ms) 2024-02-09T08:34:26.723 INFO:tasks.workunit.client.0.smithi062.stdout: cmd: [----------] 3 tests from NeoRadosCmd (1816695 ms total) 2024-02-09T08:34:26.723 INFO:tasks.workunit.client.0.smithi062.stdout: cmd: 2024-02-09T08:34:26.724 INFO:tasks.workunit.client.0.smithi062.stdout: cmd: [----------] Global test environment tear-down 2024-02-09T08:34:26.724 INFO:tasks.workunit.client.0.smithi062.stdout: cmd: [==========] 3 tests from 1 test suite ran. (1816695 ms total) 2024-02-09T08:34:26.724 INFO:tasks.workunit.client.0.smithi062.stdout: cmd: [ PASSED ] 3 tests. 2024-02-09T08:34:30.050 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:32:39.457 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:30.054 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:32:39.460 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:30.061 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:32:39.457 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:30.062 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:32:39.459 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:30.063 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:32:39.469 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:30.064 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:32:39.471 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:30.156 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:32:39.553 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:30.180 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:32:39.586 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:30.187 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:32:39.594 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:30.823 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:32:40.220 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:30.824 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:32:40.221 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:30.832 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:32:40.228 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:30.932 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:32:40.339 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:30.933 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:32:40.340 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:30.942 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:32:40.349 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:31.087 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:32:40.493 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:31.089 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:32:40.496 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:31.121 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:32:40.527 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:35.867 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:32:45.273 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:35.869 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:32:45.275 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:35.882 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:32:45.289 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:35.914 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:32:45.311 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:35.919 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:32:45.316 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:35.921 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:32:45.328 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:35.922 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:32:45.329 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:35.934 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:32:45.330 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:35.936 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:32:45.343 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:50.916 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:33:00.323 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:50.919 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:33:00.326 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:50.947 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:33:00.353 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:50.965 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:33:00.362 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:50.967 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:33:00.363 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:50.971 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:33:00.378 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:50.980 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:33:00.386 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:50.992 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:33:00.389 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:51.008 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:33:00.414 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:34:51.869 INFO:tasks.workunit.client.0.smithi062.stdout: misc: Running main() from gmock_main.cc 2024-02-09T08:34:51.869 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [==========] Running 12 tests from 1 test suite. 2024-02-09T08:34:51.870 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [----------] Global test environment set-up. 2024-02-09T08:34:51.870 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [----------] 12 tests from NeoRadosMisc 2024-02-09T08:34:51.870 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [ RUN ] NeoRadosMisc.Version 2024-02-09T08:34:51.870 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [ OK ] NeoRadosMisc.Version (4068 ms) 2024-02-09T08:34:51.870 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [ RUN ] NeoRadosMisc.WaitOSDMap 2024-02-09T08:34:51.870 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [ OK ] NeoRadosMisc.WaitOSDMap (4706 ms) 2024-02-09T08:34:51.870 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [ RUN ] NeoRadosMisc.LongName 2024-02-09T08:34:51.870 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [ OK ] NeoRadosMisc.LongName (1803084 ms) 2024-02-09T08:34:51.870 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [ RUN ] NeoRadosMisc.LongLocator 2024-02-09T08:34:51.870 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [ OK ] NeoRadosMisc.LongLocator (3452 ms) 2024-02-09T08:34:51.870 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [ RUN ] NeoRadosMisc.LongNamespace 2024-02-09T08:34:51.870 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [ OK ] NeoRadosMisc.LongNamespace (3549 ms) 2024-02-09T08:34:51.870 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [ RUN ] NeoRadosMisc.LongAttrName 2024-02-09T08:34:51.870 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [ OK ] NeoRadosMisc.LongAttrName (3391 ms) 2024-02-09T08:34:51.870 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [ RUN ] NeoRadosMisc.Exec 2024-02-09T08:34:51.871 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [ OK ] NeoRadosMisc.Exec (3312 ms) 2024-02-09T08:34:51.871 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [ RUN ] NeoRadosMisc.Operate1 2024-02-09T08:34:51.871 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [ OK ] NeoRadosMisc.Operate1 (3387 ms) 2024-02-09T08:34:51.871 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [ RUN ] NeoRadosMisc.Operate2 2024-02-09T08:34:51.871 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [ OK ] NeoRadosMisc.Operate2 (3371 ms) 2024-02-09T08:34:51.871 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [ RUN ] NeoRadosMisc.BigObject 2024-02-09T08:34:51.871 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [ OK ] NeoRadosMisc.BigObject (3485 ms) 2024-02-09T08:34:51.871 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [ RUN ] NeoRadosMisc.BigAttr 2024-02-09T08:34:51.871 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [ OK ] NeoRadosMisc.BigAttr (2278 ms) 2024-02-09T08:34:51.871 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [ RUN ] NeoRadosMisc.WriteSame 2024-02-09T08:34:51.871 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [ OK ] NeoRadosMisc.WriteSame (3686 ms) 2024-02-09T08:34:51.871 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [----------] 12 tests from NeoRadosMisc (1841769 ms total) 2024-02-09T08:34:51.871 INFO:tasks.workunit.client.0.smithi062.stdout: misc: 2024-02-09T08:34:51.871 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [----------] Global test environment tear-down 2024-02-09T08:34:51.871 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [==========] 12 tests from 1 test suite ran. (1841769 ms total) 2024-02-09T08:34:51.872 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [ PASSED ] 12 tests. 2024-02-09T08:34:51.874 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-09T08:34:51.874 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41082 2024-02-09T08:34:51.874 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 41082 2024-02-09T08:34:51.874 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-09T08:34:51.874 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41913 2024-02-09T08:34:51.874 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 41913 2024-02-09T08:34:51.874 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-09T08:34:51.875 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41248 2024-02-09T08:34:51.875 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 41248 2024-02-09T08:34:51.875 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-09T08:34:51.875 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41706 2024-02-09T08:34:51.875 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 41706 2024-02-09T08:34:51.875 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-09T08:34:51.875 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41962 2024-02-09T08:34:51.875 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 41962 2024-02-09T08:34:51.875 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-09T08:34:51.875 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41108 2024-02-09T08:34:51.875 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 41108 2024-02-09T08:34:51.875 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-09T08:34:51.875 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41555 2024-02-09T08:34:51.875 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 41555 2024-02-09T08:34:51.876 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-09T08:34:51.876 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41812 2024-02-09T08:34:51.876 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 41812 2024-02-09T08:34:51.876 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-09T08:34:51.876 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41666 2024-02-09T08:34:51.876 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 41666 2024-02-09T08:34:51.876 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-09T08:34:51.876 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41892 2024-02-09T08:34:51.876 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 41892 2024-02-09T08:34:51.876 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-09T08:34:51.876 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41437 2024-02-09T08:34:51.876 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 41437 2024-02-09T08:34:51.876 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-09T08:34:51.876 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41029 2024-02-09T08:34:51.876 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 41029 2024-02-09T08:34:51.877 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-09T08:34:51.877 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41946 2024-02-09T08:34:51.877 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 41946 2024-02-09T08:34:51.877 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-09T08:34:51.877 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41355 2024-02-09T08:34:51.877 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 41355 2024-02-09T08:34:51.877 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-09T08:34:51.877 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=40823 2024-02-09T08:34:51.877 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 40823 2024-02-09T08:34:51.877 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-09T08:34:51.877 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=40884 2024-02-09T08:34:51.877 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 40884 2024-02-09T08:34:51.877 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-09T08:34:51.877 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41318 2024-02-09T08:34:51.877 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 41318 2024-02-09T08:34:51.878 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-09T08:34:51.878 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=40922 2024-02-09T08:34:51.878 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 40922 2024-02-09T08:34:51.878 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-09T08:34:51.878 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41385 2024-02-09T08:34:51.878 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 41385 2024-02-09T08:34:51.878 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-09T08:34:51.878 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41413 2024-02-09T08:34:51.878 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 41413 2024-02-09T08:34:51.878 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-09T08:34:51.878 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=41752 2024-02-09T08:34:51.878 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 41752 2024-02-09T08:34:51.878 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-09T08:34:51.878 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=42006 2024-02-09T08:34:51.878 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 42006 2024-02-09T08:34:51.878 INFO:tasks.workunit.client.0.smithi062.stderr:+ exit 0 2024-02-09T08:34:51.879 INFO:tasks.workunit.client.0.smithi062.stderr:+ cleanup 2024-02-09T08:34:51.879 INFO:tasks.workunit.client.0.smithi062.stderr:+ pkill -P 40818 2024-02-09T08:34:51.892 INFO:tasks.workunit.client.0.smithi062.stderr:+ true 2024-02-09T08:34:51.893 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-09T08:34:51.893 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-02-09T08:34:51.922 INFO:tasks.workunit:Stopping ['rados/test.sh'] on client.0... 2024-02-09T08:34:51.922 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-02-09T08:34:52.257 DEBUG:teuthology.parallel:result is None 2024-02-09T08:34:52.258 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-02-09T08:34:52.287 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-02-09T08:34:52.287 DEBUG:teuthology.orchestra.run.smithi062:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-02-09T08:34:52.355 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-02-09T08:34:52.355 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-02-09T08:34:52.365 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-02-09T08:34:52.365 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-09T08:34:52.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.503+0000 7f6eda16a640 10 monclient: get_monmap_and_config 2024-02-09T08:34:52.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.503+0000 7f6eda16a640 10 monclient: build_initial_monmap 2024-02-09T08:34:52.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.503+0000 7f6eda16a640 10 monclient: monmap: 2024-02-09T08:34:52.506 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:34:52.506 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:52.506 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:34:52.504152+0000 2024-02-09T08:34:52.506 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:34:52.504152+0000 2024-02-09T08:34:52.506 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:34:52.506 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:52.506 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:34:52.506 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:34:52.506 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:34:52.506 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:34:52.506 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:34:52.506 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:52.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.503+0000 7f6eda16a640 1 Processor -- start 2024-02-09T08:34:52.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.503+0000 7f6eda16a640 1 -- start start 2024-02-09T08:34:52.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.503+0000 7f6eda16a640 10 monclient: init 2024-02-09T08:34:52.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.504+0000 7f6eda16a640 10 monclient: _reopen_session rank -1 2024-02-09T08:34:52.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.504+0000 7f6eda16a640 10 monclient: _add_conns ranks=[3,1,2,0,4] 2024-02-09T08:34:52.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.504+0000 7f6eda16a640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6ed413c8c0 0x7f6ed413f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:52.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.504+0000 7f6eda16a640 10 monclient(hunting): picked mon.noname-a con 0x7f6ed413c8c0 addr v2:172.21.15.62:3300/0 2024-02-09T08:34:52.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.504+0000 7f6eda16a640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f6ed413cca0 addr v1:172.21.15.103:6789/0 2024-02-09T08:34:52.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.504+0000 7f6eda16a640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ed40adf10 0x7f6ed4149ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:52.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.504+0000 7f6eda16a640 10 monclient(hunting): picked mon.noname-b con 0x7f6ed40adf10 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:34:52.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.504+0000 7f6eda16a640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ed4072c60 con 0x7f6ed413cca0 2024-02-09T08:34:52.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.504+0000 7f6eda16a640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:52.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.504+0000 7f6eda16a640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ed40ad100 con 0x7f6ed413c8c0 2024-02-09T08:34:52.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.504+0000 7f6eda16a640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:52.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.504+0000 7f6eda16a640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed40ae990 con 0x7f6ed40adf10 2024-02-09T08:34:52.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.504+0000 7f6eda16a640 10 monclient(hunting): _renew_subs 2024-02-09T08:34:52.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.504+0000 7f6eda16a640 10 monclient(hunting): authenticate will time out at 3335.864785s 2024-02-09T08:34:52.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.505+0000 7f6ed2ffd640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f6ed413cca0 0x7f6ed40ad800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.62:46424/0 (socket says 172.21.15.62:46424) 2024-02-09T08:34:52.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.505+0000 7f6ed2ffd640 1 -- 172.21.15.62:0/451569691 learned_addr learned my addr 172.21.15.62:0/451569691 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-09T08:34:52.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.505+0000 7f6ed3fff640 1 --2- 172.21.15.62:0/451569691 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ed40adf10 0x7f6ed4149ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:52.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.505+0000 7f6ed37fe640 1 --2- 172.21.15.62:0/451569691 >> v2:172.21.15.62:3300/0 conn(0x7f6ed413c8c0 0x7f6ed413f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:52.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.505+0000 7f6ed37fe640 10 monclient(hunting): get_auth_request con 0x7f6ed413c8c0 auth_method 0 2024-02-09T08:34:52.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.505+0000 7f6ed37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:52.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.505+0000 7f6ed37fe640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:52.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.505+0000 7f6ed37fe640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:52.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.505+0000 7f6ed3fff640 10 monclient(hunting): get_auth_request con 0x7f6ed40adf10 auth_method 0 2024-02-09T08:34:52.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.505+0000 7f6ed3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:52.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.505+0000 7f6ed3fff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:52.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.505+0000 7f6ed3fff640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:52.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.506+0000 7f6ed37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:52.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.506+0000 7f6ed37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:52.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.506+0000 7f6ed37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:52.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.506+0000 7f6ed3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:52.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.506+0000 7f6ed3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:52.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.506+0000 7f6ed3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:52.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.507+0000 7f6ed27fc640 1 -- 172.21.15.62:0/451569691 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2933102172 0 0) 0x7f6ed4072c60 con 0x7f6ed413cca0 2024-02-09T08:34:52.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.507+0000 7f6ed27fc640 10 monclient(hunting): _negotiate 2024-02-09T08:34:52.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.507+0000 7f6ed27fc640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:52.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.507+0000 7f6ed27fc640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:52.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.507+0000 7f6ed27fc640 10 monclient(hunting): my global_id is 22273 2024-02-09T08:34:52.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.507+0000 7f6ed27fc640 1 -- 172.21.15.62:0/451569691 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ebc003520 con 0x7f6ed413cca0 2024-02-09T08:34:52.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.508+0000 7f6ed37fe640 10 monclient(hunting): handle_auth_done global_id 16131 payload 274 2024-02-09T08:34:52.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.508+0000 7f6ed37fe640 1 -- 172.21.15.62:0/451569691 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ed40adf10 msgr2=0x7f6ed4149ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:34:52.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.508+0000 7f6ed37fe640 1 --2- 172.21.15.62:0/451569691 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ed40adf10 0x7f6ed4149ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:52.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.508+0000 7f6ed37fe640 1 -- 172.21.15.62:0/451569691 >> v1:172.21.15.103:6789/0 conn(0x7f6ed413cca0 legacy=0x7f6ed40ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:52.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.508+0000 7f6ed37fe640 10 monclient: _finish_hunting 0 2024-02-09T08:34:52.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.508+0000 7f6ed37fe640 1 monclient: found mon.noname-a 2024-02-09T08:34:52.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.508+0000 7f6ed37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:34:52.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.508+0000 7f6ed37fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-02-09T08:34:52.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.508+0000 7f6ed37fe640 1 -- 172.21.15.62:0/451569691 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed40ac130 con 0x7f6ed413c8c0 2024-02-09T08:34:52.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.508+0000 7f6ed3fff640 1 --2- 172.21.15.62:0/451569691 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ed40adf10 0x7f6ed4149ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-09T08:34:52.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.511+0000 7f6ed37fe640 1 --2- 172.21.15.62:0/451569691 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ed413c8c0 0x7f6ed413f940 secure :-1 s=READY pgs=3205 cs=0 l=1 rev1=1 crypto rx=0x7f6ec40097a0 tx=0x7f6ec402b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=707e6a7c3509f77a server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:34:52.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.515+0000 7f6ed27fc640 1 -- 172.21.15.62:0/451569691 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec4031780 con 0x7f6ed413c8c0 2024-02-09T08:34:52.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.515+0000 7f6ed27fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:52.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.515+0000 7f6ed27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-09T08:34:52.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.515+0000 7f6ed27fc640 10 monclient: dump: 2024-02-09T08:34:52.518 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:52.518 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:52.518 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:52.518 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:52.518 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:52.518 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:52.518 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:52.518 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:52.518 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:52.518 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:52.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.515+0000 7f6ed27fc640 10 monclient: _finish_auth 0 2024-02-09T08:34:52.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.515+0000 7f6ed27fc640 10 monclient: _check_auth_tickets 2024-02-09T08:34:52.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.515+0000 7f6ed27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:34:52.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.515+0000 7f6ed27fc640 1 -- 172.21.15.62:0/451569691 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec40318e0 con 0x7f6ed413c8c0 2024-02-09T08:34:52.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.515+0000 7f6eda16a640 5 monclient: authenticate success, global_id 16131 2024-02-09T08:34:52.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.515+0000 7f6eda16a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-02-09T08:34:52.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.515+0000 7f6ed27fc640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:34:52.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.515+0000 7f6ed27fc640 1 -- 172.21.15.62:0/451569691 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec4031c70 con 0x7f6ed413c8c0 2024-02-09T08:34:52.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.515+0000 7f6eda16a640 10 monclient: get_monmap_and_config success 2024-02-09T08:34:52.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.515+0000 7f6eda16a640 4 set_mon_vals no callback set 2024-02-09T08:34:52.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.515+0000 7f6ed27fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:52.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.515+0000 7f6ed27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-09T08:34:52.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.515+0000 7f6ed27fc640 10 monclient: dump: 2024-02-09T08:34:52.519 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:52.519 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:52.520 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:52.520 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:52.520 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:52.520 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:52.520 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:52.520 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:52.520 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:52.520 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:52.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.516+0000 7f6eda16a640 10 monclient: shutdown 2024-02-09T08:34:52.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.516+0000 7f6eda16a640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:34:52.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.516+0000 7f6eda16a640 1 -- 172.21.15.62:0/451569691 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ed413c8c0 msgr2=0x7f6ed413f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:52.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.516+0000 7f6eda16a640 1 --2- 172.21.15.62:0/451569691 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ed413c8c0 0x7f6ed413f940 secure :-1 s=READY pgs=3205 cs=0 l=1 rev1=1 crypto rx=0x7f6ec40097a0 tx=0x7f6ec402b820 comp rx=0 tx=0).stop 2024-02-09T08:34:52.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.516+0000 7f6eda16a640 1 -- 172.21.15.62:0/451569691 shutdown_connections 2024-02-09T08:34:52.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.516+0000 7f6eda16a640 1 --2- 172.21.15.62:0/451569691 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ed40adf10 0x7f6ed4149ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:52.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.516+0000 7f6eda16a640 1 --2- 172.21.15.62:0/451569691 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ed413c8c0 0x7f6ed413f940 unknown :-1 s=CLOSED pgs=3205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:52.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.516+0000 7f6eda16a640 1 -- 172.21.15.62:0/451569691 >> 172.21.15.62:0/451569691 conn(0x7f6ed40b3ef0 msgr2=0x7f6ed40b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:34:52.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.516+0000 7f6eda16a640 1 -- 172.21.15.62:0/451569691 shutdown_connections 2024-02-09T08:34:52.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.516+0000 7f6eda16a640 1 -- 172.21.15.62:0/451569691 wait complete. 2024-02-09T08:34:52.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.517+0000 7f6eda16a640 10 monclient: build_initial_monmap 2024-02-09T08:34:52.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.517+0000 7f6eda16a640 10 monclient: monmap: 2024-02-09T08:34:52.524 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:34:52.524 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:34:52.524 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:34:52.524 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:34:52.524 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:34:52.524 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:52.524 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:34:52.524 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:34:52.524 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:34:52.525 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:52.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.517+0000 7f6eda16a640 1 librados: starting msgr at 2024-02-09T08:34:52.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.517+0000 7f6eda16a640 1 librados: starting objecter 2024-02-09T08:34:52.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.517+0000 7f6eda16a640 1 Processor -- start 2024-02-09T08:34:52.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.517+0000 7f6eda16a640 1 -- start start 2024-02-09T08:34:52.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.517+0000 7f6eda16a640 1 librados: setting wanted keys 2024-02-09T08:34:52.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.517+0000 7f6eda16a640 1 librados: calling monclient init 2024-02-09T08:34:52.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.517+0000 7f6eda16a640 10 monclient: init 2024-02-09T08:34:52.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.518+0000 7f6eda16a640 10 monclient: _reopen_session rank -1 2024-02-09T08:34:52.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.518+0000 7f6eda16a640 10 monclient: _add_conns ranks=[0,1,2] 2024-02-09T08:34:52.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.518+0000 7f6eda16a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ed40adf10 0x7f6ed406def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:52.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.518+0000 7f6eda16a640 10 monclient(hunting): picked mon.noname-a con 0x7f6ed40adf10 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:34:52.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.518+0000 7f6eda16a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ed413c8c0 0x7f6ed41c8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:52.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.518+0000 7f6eda16a640 10 monclient(hunting): picked mon.noname-b con 0x7f6ed413c8c0 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:34:52.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.518+0000 7f6eda16a640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ed413cca0 0x7f6ed406e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:52.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.518+0000 7f6eda16a640 10 monclient(hunting): picked mon.noname-c con 0x7f6ed413cca0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:34:52.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.518+0000 7f6eda16a640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:52.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.518+0000 7f6eda16a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed413a500 con 0x7f6ed40adf10 2024-02-09T08:34:52.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.518+0000 7f6eda16a640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:52.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.518+0000 7f6eda16a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed40700b0 con 0x7f6ed413c8c0 2024-02-09T08:34:52.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.518+0000 7f6eda16a640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:52.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.518+0000 7f6eda16a640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed41c8da0 con 0x7f6ed413cca0 2024-02-09T08:34:52.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.518+0000 7f6eda16a640 10 monclient(hunting): _renew_subs 2024-02-09T08:34:52.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.518+0000 7f6eda16a640 10 monclient(hunting): authenticate will time out at 3335.879101s 2024-02-09T08:34:52.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.519+0000 7f6ed37fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ed40adf10 0x7f6ed406def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:52.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.519+0000 7f6ed2ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ed413c8c0 0x7f6ed41c8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:52.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.519+0000 7f6ed37fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ed40adf10 0x7f6ed406def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46372/0 (socket says 172.21.15.62:46372) 2024-02-09T08:34:52.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.519+0000 7f6ed37fe640 1 -- 172.21.15.62:0/2375033765 learned_addr learned my addr 172.21.15.62:0/2375033765 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:34:52.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.519+0000 7f6ed37fe640 10 monclient(hunting): get_auth_request con 0x7f6ed40adf10 auth_method 0 2024-02-09T08:34:52.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.519+0000 7f6ed37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:52.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.519+0000 7f6ed37fe640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:52.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.519+0000 7f6ed37fe640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:52.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.519+0000 7f6ed2ffd640 10 monclient(hunting): get_auth_request con 0x7f6ed413c8c0 auth_method 0 2024-02-09T08:34:52.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.519+0000 7f6ed2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:52.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.519+0000 7f6ed2ffd640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:52.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.519+0000 7f6ed2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:52.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.520+0000 7f6ed2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:52.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.520+0000 7f6ed2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:52.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.520+0000 7f6ed2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:52.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.520+0000 7f6ed37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:52.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.520+0000 7f6ed37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:52.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.520+0000 7f6ed37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:52.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.521+0000 7f6ed3fff640 1 --2- 172.21.15.62:0/2375033765 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ed413cca0 0x7f6ed406e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:52.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.522+0000 7f6ed3fff640 10 monclient(hunting): get_auth_request con 0x7f6ed413cca0 auth_method 0 2024-02-09T08:34:52.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.522+0000 7f6ed3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:52.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.522+0000 7f6ed3fff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:52.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.522+0000 7f6ed3fff640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:52.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.522+0000 7f6ed2ffd640 10 monclient(hunting): handle_auth_done global_id 22276 payload 824 2024-02-09T08:34:52.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.522+0000 7f6ed2ffd640 1 -- 172.21.15.62:0/2375033765 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ed413cca0 msgr2=0x7f6ed406e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:52.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.522+0000 7f6ed2ffd640 1 --2- 172.21.15.62:0/2375033765 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ed413cca0 0x7f6ed406e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:52.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.522+0000 7f6ed2ffd640 1 -- 172.21.15.62:0/2375033765 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ed40adf10 msgr2=0x7f6ed406def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:52.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.522+0000 7f6ed2ffd640 1 --2- 172.21.15.62:0/2375033765 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ed40adf10 0x7f6ed406def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:52.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.522+0000 7f6ed2ffd640 10 monclient: _finish_hunting 0 2024-02-09T08:34:52.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.522+0000 7f6ed2ffd640 1 monclient: found mon.noname-b 2024-02-09T08:34:52.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.522+0000 7f6ed2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:34:52.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.522+0000 7f6ed2ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.103:3300/0 2024-02-09T08:34:52.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.522+0000 7f6ed2ffd640 1 -- 172.21.15.62:0/2375033765 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ecc009a70 con 0x7f6ed413c8c0 2024-02-09T08:34:52.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.524+0000 7f6ed2ffd640 1 --2- 172.21.15.62:0/2375033765 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ed413c8c0 0x7f6ed41c8860 secure :-1 s=READY pgs=5650 cs=0 l=1 rev1=1 crypto rx=0x7f6ed40aefc0 tx=0x7f6ec8001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:34:52.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.525+0000 7f6ebbfff640 10 client.?.objecter ms_handle_connect 0x7f6ed413c8c0 2024-02-09T08:34:52.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.525+0000 7f6ebbfff640 10 client.?.objecter resend_mon_ops 2024-02-09T08:34:52.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.528+0000 7f6ebbfff640 1 -- 172.21.15.62:0/2375033765 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec8005ce0 con 0x7f6ed413c8c0 2024-02-09T08:34:52.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.528+0000 7f6ebbfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:52.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.528+0000 7f6ebbfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:34:52.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.528+0000 7f6ebbfff640 10 monclient: dump: 2024-02-09T08:34:52.531 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:52.531 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:52.531 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:52.532 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:52.532 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:52.532 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:52.532 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:52.532 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:52.532 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:52.532 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:52.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.528+0000 7f6ebbfff640 10 monclient: _finish_auth 0 2024-02-09T08:34:52.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.528+0000 7f6ebbfff640 10 monclient: _check_auth_tickets 2024-02-09T08:34:52.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.528+0000 7f6ebbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:34:52.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.528+0000 7f6ebbfff640 1 -- 172.21.15.62:0/2375033765 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec8005e40 con 0x7f6ed413c8c0 2024-02-09T08:34:52.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.528+0000 7f6eda16a640 5 monclient: authenticate success, global_id 22276 2024-02-09T08:34:52.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.528+0000 7f6ebbfff640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:34:52.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.528+0000 7f6ebbfff640 1 -- 172.21.15.62:0/2375033765 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec80072f0 con 0x7f6ed413c8c0 2024-02-09T08:34:52.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.528+0000 7f6eda16a640 10 monclient: _renew_subs 2024-02-09T08:34:52.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.528+0000 7f6eda16a640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:34:52.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.528+0000 7f6eda16a640 1 -- 172.21.15.62:0/2375033765 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ec4009400 con 0x7f6ed413c8c0 2024-02-09T08:34:52.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.528+0000 7f6ebbfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:52.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.528+0000 7f6ebbfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:34:52.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.528+0000 7f6ed1ffb640 4 set_mon_vals no callback set 2024-02-09T08:34:52.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.528+0000 7f6ebbfff640 10 monclient: dump: 2024-02-09T08:34:52.533 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:52.533 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:52.533 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:52.533 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:52.533 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:52.533 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:52.533 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:52.534 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:52.534 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:52.534 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:52.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.528+0000 7f6eda16a640 10 client.22276.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:34:52.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.528+0000 7f6eda16a640 10 monclient: _renew_subs 2024-02-09T08:34:52.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.528+0000 7f6eda16a640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:34:52.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.528+0000 7f6eda16a640 1 -- 172.21.15.62:0/2375033765 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ed41cb230 con 0x7f6ed413c8c0 2024-02-09T08:34:52.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.528+0000 7f6eda16a640 1 librados: init done 2024-02-09T08:34:52.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.530+0000 7f6eda16a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:34:52.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.530+0000 7f6eda16a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:34:52.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.530+0000 7f6eda16a640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:34:52.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.530+0000 7f6eda16a640 1 -- 172.21.15.62:0/2375033765 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ed406ff00 con 0x7f6ed413c8c0 2024-02-09T08:34:52.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.547+0000 7f6ebbfff640 1 -- 172.21.15.62:0/2375033765 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f6ec8007510 con 0x7f6ed413c8c0 2024-02-09T08:34:52.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.548+0000 7f6ebbfff640 1 --2- 172.21.15.62:0/2375033765 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f6ec006d1f0 0x7f6ec006f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:52.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.548+0000 7f6ed37fe640 1 --2- 172.21.15.62:0/2375033765 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f6ec006d1f0 0x7f6ec006f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:52.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.548+0000 7f6ed37fe640 10 monclient: get_auth_request con 0x7f6ec006d1f0 auth_method 0 2024-02-09T08:34:52.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.548+0000 7f6ebbfff640 10 client.22276.objecter ms_handle_connect 0x7f6ec006d1f0 2024-02-09T08:34:52.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.548+0000 7f6ed37fe640 1 --2- 172.21.15.62:0/2375033765 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f6ec006d1f0 0x7f6ec006f6b0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f6ec4000c00 tx=0x7f6ec403d040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:34:52.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.549+0000 7f6ebbfff640 1 -- 172.21.15.62:0/2375033765 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(1269..1269 src has 1104..1269) v4 ==== 6381+0+0 (secure 0 0 0) 0x7f6ec8007e20 con 0x7f6ed413c8c0 2024-02-09T08:34:52.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.549+0000 7f6ebbfff640 10 client.22276.objecter ms_dispatch 0x7f6ed4000b90 osd_map(1269..1269 src has 1104..1269) v4 2024-02-09T08:34:52.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.549+0000 7f6ebbfff640 3 client.22276.objecter handle_osd_map got epochs [1269,1269] > 0 2024-02-09T08:34:52.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.549+0000 7f6ebbfff640 3 client.22276.objecter handle_osd_map decoding full epoch 1269 2024-02-09T08:34:52.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.549+0000 7f6ebbfff640 20 client.22276.objecter dump_active .. 0 homeless 2024-02-09T08:34:52.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.782+0000 7f6ebbfff640 1 -- 172.21.15.62:0/2375033765 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6ec8054500 con 0x7f6ed413c8c0 2024-02-09T08:34:52.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.782+0000 7f6ebbfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:34:52.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.782+0000 7f6ebbfff640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:34:52.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.993+0000 7f6eda16a640 1 -- 172.21.15.62:0/2375033765 --> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6ed40af800 con 0x7f6ec006d1f0 2024-02-09T08:34:53.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:52.998+0000 7f6ebbfff640 1 -- 172.21.15.62:0/2375033765 <== mgr.4109 v2:172.21.15.103:6800/2270392189 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+151938 (secure 0 0 0) 0x7f6ed40af800 con 0x7f6ec006d1f0 2024-02-09T08:34:53.002 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T08:34:53.003 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-02-09T08:34:53.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.001+0000 7f6eda16a640 10 librados: watch_flush enter 2024-02-09T08:34:53.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.001+0000 7f6eda16a640 10 librados: watch_flush exit 2024-02-09T08:34:53.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.001+0000 7f6eda16a640 20 client.22276.objecter shutdown clearing up homeless session... 2024-02-09T08:34:53.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.001+0000 7f6eda16a640 10 client.22276.objecter successfully canceled tick 2024-02-09T08:34:53.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.001+0000 7f6eda16a640 1 -- 172.21.15.62:0/2375033765 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f6ec006d1f0 msgr2=0x7f6ec006f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:53.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.001+0000 7f6eda16a640 1 --2- 172.21.15.62:0/2375033765 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f6ec006d1f0 0x7f6ec006f6b0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f6ec4000c00 tx=0x7f6ec403d040 comp rx=0 tx=0).stop 2024-02-09T08:34:53.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.001+0000 7f6eda16a640 10 monclient: shutdown 2024-02-09T08:34:53.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.001+0000 7f6eda16a640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:34:53.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.001+0000 7f6eda16a640 1 -- 172.21.15.62:0/2375033765 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ed413c8c0 msgr2=0x7f6ed41c8860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:53.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.001+0000 7f6eda16a640 1 --2- 172.21.15.62:0/2375033765 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ed413c8c0 0x7f6ed41c8860 secure :-1 s=READY pgs=5650 cs=0 l=1 rev1=1 crypto rx=0x7f6ed40aefc0 tx=0x7f6ec8001e70 comp rx=0 tx=0).stop 2024-02-09T08:34:53.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.001+0000 7f6eda16a640 1 -- 172.21.15.62:0/2375033765 shutdown_connections 2024-02-09T08:34:53.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.001+0000 7f6eda16a640 1 --2- 172.21.15.62:0/2375033765 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f6ec006d1f0 0x7f6ec006f6b0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:53.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.001+0000 7f6eda16a640 1 --2- 172.21.15.62:0/2375033765 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ed413cca0 0x7f6ed406e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:53.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.001+0000 7f6eda16a640 1 --2- 172.21.15.62:0/2375033765 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ed413c8c0 0x7f6ed41c8860 unknown :-1 s=CLOSED pgs=5650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:53.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.001+0000 7f6eda16a640 1 --2- 172.21.15.62:0/2375033765 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ed40adf10 0x7f6ed406def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:53.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.001+0000 7f6eda16a640 1 -- 172.21.15.62:0/2375033765 >> 172.21.15.62:0/2375033765 conn(0x7f6ed40b3ef0 msgr2=0x7f6ed40af0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:34:53.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.001+0000 7f6eda16a640 1 -- 172.21.15.62:0/2375033765 shutdown_connections 2024-02-09T08:34:53.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.001+0000 7f6eda16a640 1 -- 172.21.15.62:0/2375033765 wait complete. 2024-02-09T08:34:53.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.001+0000 7f6eda16a640 1 librados: shutdown 2024-02-09T08:34:53.014 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":2232,"stamp":"2024-02-09T08:34:52.519206+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459285,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":88,"num_write":120,"num_write_kb":1379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":128,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":565412,"kb_used_data":31360,"kb_used_omap":12,"kb_used_meta":533939,"kb_avail":754409308,"statfs":{"total":773094113280,"available":772515131392,"internally_reserved":0,"allocated":32112640,"data_stored":13482614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":546754096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,1],"upper_bound":2048},"perf_stat":{"commit_latency_ms":391,"apply_latency_ms":391,"commit_latency_ns":391000000,"apply_latency_ns":391000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000755"},"pg_stats":[{"pgid":"11.1b","version":"0'0","reported_seq":2411,"reported_epoch":1267,"state":"active+clean","last_fresh":"2024-02-09T08:34:50.768338+0000","last_change":"2024-02-09T08:04:33.526805+0000","last_active":"2024-02-09T08:34:50.768338+0000","last_peered":"2024-02-09T08:34:50.768338+0000","last_clean":"2024-02-09T08:34:50.768338+0000","last_became_active":"2024-02-09T08:04:33.521240+0000","last_became_peered":"2024-02-09T08:04:33.521240+0000","last_unstale":"2024-02-09T08:34:50.768338+0000","last_undegraded":"2024-02-09T08:34:50.768338+0000","last_fullsized":"2024-02-09T08:34:50.768338+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T13:43:13.359953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":2421,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.277407+0000","last_change":"2024-02-09T08:04:40.805290+0000","last_active":"2024-02-09T08:34:47.277407+0000","last_peered":"2024-02-09T08:34:47.277407+0000","last_clean":"2024-02-09T08:34:47.277407+0000","last_became_active":"2024-02-09T08:04:40.657553+0000","last_became_peered":"2024-02-09T08:04:40.657553+0000","last_unstale":"2024-02-09T08:34:47.277407+0000","last_undegraded":"2024-02-09T08:34:47.277407+0000","last_fullsized":"2024-02-09T08:34:47.277407+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T10:06:50.567240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":2420,"reported_epoch":1265,"state":"active+clean","last_fresh":"2024-02-09T08:34:48.279837+0000","last_change":"2024-02-09T08:04:36.602734+0000","last_active":"2024-02-09T08:34:48.279837+0000","last_peered":"2024-02-09T08:34:48.279837+0000","last_clean":"2024-02-09T08:34:48.279837+0000","last_became_active":"2024-02-09T08:04:36.596835+0000","last_became_peered":"2024-02-09T08:04:36.596835+0000","last_unstale":"2024-02-09T08:34:48.279837+0000","last_undegraded":"2024-02-09T08:34:48.279837+0000","last_fullsized":"2024-02-09T08:34:48.279837+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T16:22:37.194403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":2434,"reported_epoch":1269,"state":"active+clean","last_fresh":"2024-02-09T08:34:51.900546+0000","last_change":"2024-02-09T08:05:00.789599+0000","last_active":"2024-02-09T08:34:51.900546+0000","last_peered":"2024-02-09T08:34:51.900546+0000","last_clean":"2024-02-09T08:34:51.900546+0000","last_became_active":"2024-02-09T08:05:00.783372+0000","last_became_peered":"2024-02-09T08:05:00.783372+0000","last_unstale":"2024-02-09T08:34:51.900546+0000","last_undegraded":"2024-02-09T08:34:51.900546+0000","last_fullsized":"2024-02-09T08:34:51.900546+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T19:04:41.775337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":2399,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.177779+0000","last_change":"2024-02-09T08:04:29.148658+0000","last_active":"2024-02-09T08:34:47.177779+0000","last_peered":"2024-02-09T08:34:47.177779+0000","last_clean":"2024-02-09T08:34:47.177779+0000","last_became_active":"2024-02-09T08:04:29.124225+0000","last_became_peered":"2024-02-09T08:04:29.124225+0000","last_unstale":"2024-02-09T08:34:47.177779+0000","last_undegraded":"2024-02-09T08:34:47.177779+0000","last_fullsized":"2024-02-09T08:34:47.177779+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T18:44:18.668955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":2431,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.221854+0000","last_change":"2024-02-09T08:04:39.748237+0000","last_active":"2024-02-09T08:34:47.221854+0000","last_peered":"2024-02-09T08:34:47.221854+0000","last_clean":"2024-02-09T08:34:47.221854+0000","last_became_active":"2024-02-09T08:04:39.743089+0000","last_became_peered":"2024-02-09T08:04:39.743089+0000","last_unstale":"2024-02-09T08:34:47.221854+0000","last_undegraded":"2024-02-09T08:34:47.221854+0000","last_fullsized":"2024-02-09T08:34:47.221854+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T12:00:51.961215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":2396,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.164239+0000","last_change":"2024-02-09T08:05:03.172587+0000","last_active":"2024-02-09T08:34:47.164239+0000","last_peered":"2024-02-09T08:34:47.164239+0000","last_clean":"2024-02-09T08:34:47.164239+0000","last_became_active":"2024-02-09T08:05:03.159711+0000","last_became_peered":"2024-02-09T08:05:03.159711+0000","last_unstale":"2024-02-09T08:34:47.164239+0000","last_undegraded":"2024-02-09T08:34:47.164239+0000","last_fullsized":"2024-02-09T08:34:47.164239+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T10:00:55.530401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":2405,"reported_epoch":1267,"state":"active+clean","last_fresh":"2024-02-09T08:34:50.375834+0000","last_change":"2024-02-09T08:04:30.076390+0000","last_active":"2024-02-09T08:34:50.375834+0000","last_peered":"2024-02-09T08:34:50.375834+0000","last_clean":"2024-02-09T08:34:50.375834+0000","last_became_active":"2024-02-09T08:04:30.066772+0000","last_became_peered":"2024-02-09T08:04:30.066772+0000","last_unstale":"2024-02-09T08:34:50.375834+0000","last_undegraded":"2024-02-09T08:34:50.375834+0000","last_fullsized":"2024-02-09T08:34:50.375834+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T10:57:11.649889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":2423,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.346591+0000","last_change":"2024-02-09T08:04:53.183149+0000","last_active":"2024-02-09T08:34:47.346591+0000","last_peered":"2024-02-09T08:34:47.346591+0000","last_clean":"2024-02-09T08:34:47.346591+0000","last_became_active":"2024-02-09T08:04:53.127636+0000","last_became_peered":"2024-02-09T08:04:53.127636+0000","last_unstale":"2024-02-09T08:34:47.346591+0000","last_undegraded":"2024-02-09T08:34:47.346591+0000","last_fullsized":"2024-02-09T08:34:47.346591+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T15:08:17.048446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":2428,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.207122+0000","last_change":"2024-02-09T08:04:56.560292+0000","last_active":"2024-02-09T08:34:47.207122+0000","last_peered":"2024-02-09T08:34:47.207122+0000","last_clean":"2024-02-09T08:34:47.207122+0000","last_became_active":"2024-02-09T08:04:56.548820+0000","last_became_peered":"2024-02-09T08:04:56.548820+0000","last_unstale":"2024-02-09T08:34:47.207122+0000","last_undegraded":"2024-02-09T08:34:47.207122+0000","last_fullsized":"2024-02-09T08:34:47.207122+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T10:03:15.435898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1","version":"41'7","reported_seq":2418,"reported_epoch":1267,"state":"active+clean","last_fresh":"2024-02-09T08:34:50.367021+0000","last_change":"2024-02-09T08:04:23.177797+0000","last_active":"2024-02-09T08:34:50.367021+0000","last_peered":"2024-02-09T08:34:50.367021+0000","last_clean":"2024-02-09T08:34:50.367021+0000","last_became_active":"2024-02-09T08:04:23.166119+0000","last_became_peered":"2024-02-09T08:04:23.166119+0000","last_unstale":"2024-02-09T08:34:50.367021+0000","last_undegraded":"2024-02-09T08:34:50.367021+0000","last_fullsized":"2024-02-09T08:34:50.367021+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T09:43:59.773830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":2437,"reported_epoch":1269,"state":"active+clean","last_fresh":"2024-02-09T08:34:51.902866+0000","last_change":"2024-02-09T08:05:03.863540+0000","last_active":"2024-02-09T08:34:51.902866+0000","last_peered":"2024-02-09T08:34:51.902866+0000","last_clean":"2024-02-09T08:34:51.902866+0000","last_became_active":"2024-02-09T08:05:03.857816+0000","last_became_peered":"2024-02-09T08:05:03.857816+0000","last_unstale":"2024-02-09T08:34:51.902866+0000","last_undegraded":"2024-02-09T08:34:51.902866+0000","last_fullsized":"2024-02-09T08:34:51.902866+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T16:34:58.345644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":2431,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.206152+0000","last_change":"2024-02-09T08:04:23.020050+0000","last_active":"2024-02-09T08:34:47.206152+0000","last_peered":"2024-02-09T08:34:47.206152+0000","last_clean":"2024-02-09T08:34:47.206152+0000","last_became_active":"2024-02-09T08:04:23.007209+0000","last_became_peered":"2024-02-09T08:04:23.007209+0000","last_unstale":"2024-02-09T08:34:47.206152+0000","last_undegraded":"2024-02-09T08:34:47.206152+0000","last_fullsized":"2024-02-09T08:34:47.206152+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T14:15:50.318219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"21'76","reported_seq":2533,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.134491+0000","last_change":"2024-02-09T08:02:58.788272+0000","last_active":"2024-02-09T08:34:47.134491+0000","last_peered":"2024-02-09T08:34:47.134491+0000","last_clean":"2024-02-09T08:34:47.134491+0000","last_became_active":"2024-02-09T08:02:58.754736+0000","last_became_peered":"2024-02-09T08:02:58.754736+0000","last_unstale":"2024-02-09T08:34:47.134491+0000","last_undegraded":"2024-02-09T08:34:47.134491+0000","last_fullsized":"2024-02-09T08:34:47.134491+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:02:56.594120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:02:56.594120+0000","last_clean_scrub_stamp":"2024-02-09T08:02:56.594120+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T17:35:01.118117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":2436,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.349162+0000","last_change":"2024-02-09T08:03:12.939816+0000","last_active":"2024-02-09T08:34:47.349162+0000","last_peered":"2024-02-09T08:34:47.349162+0000","last_clean":"2024-02-09T08:34:47.349162+0000","last_became_active":"2024-02-09T08:03:12.934488+0000","last_became_peered":"2024-02-09T08:03:12.934488+0000","last_unstale":"2024-02-09T08:34:47.349162+0000","last_undegraded":"2024-02-09T08:34:47.349162+0000","last_fullsized":"2024-02-09T08:34:47.349162+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_clean_scrub_stamp":"2024-02-09T08:03:10.689497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T08:15:00.733484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":2422,"reported_epoch":1265,"state":"active+clean","last_fresh":"2024-02-09T08:34:48.281622+0000","last_change":"2024-02-09T08:04:34.779296+0000","last_active":"2024-02-09T08:34:48.281622+0000","last_peered":"2024-02-09T08:34:48.281622+0000","last_clean":"2024-02-09T08:34:48.281622+0000","last_became_active":"2024-02-09T08:04:34.763206+0000","last_became_peered":"2024-02-09T08:04:34.763206+0000","last_unstale":"2024-02-09T08:34:48.281622+0000","last_undegraded":"2024-02-09T08:34:48.281622+0000","last_fullsized":"2024-02-09T08:34:48.281622+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T14:34:34.410613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2436,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.230608+0000","last_change":"2024-02-09T08:03:12.238763+0000","last_active":"2024-02-09T08:34:47.230608+0000","last_peered":"2024-02-09T08:34:47.230608+0000","last_clean":"2024-02-09T08:34:47.230608+0000","last_became_active":"2024-02-09T08:03:12.210217+0000","last_became_peered":"2024-02-09T08:03:12.210217+0000","last_unstale":"2024-02-09T08:34:47.230608+0000","last_undegraded":"2024-02-09T08:34:47.230608+0000","last_fullsized":"2024-02-09T08:34:47.230608+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_clean_scrub_stamp":"2024-02-09T08:03:10.689497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T11:36:35.345417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":2436,"reported_epoch":1269,"state":"active+clean","last_fresh":"2024-02-09T08:34:51.905833+0000","last_change":"2024-02-09T08:04:28.955676+0000","last_active":"2024-02-09T08:34:51.905833+0000","last_peered":"2024-02-09T08:34:51.905833+0000","last_clean":"2024-02-09T08:34:51.905833+0000","last_became_active":"2024-02-09T08:04:28.937638+0000","last_became_peered":"2024-02-09T08:04:28.937638+0000","last_unstale":"2024-02-09T08:34:51.905833+0000","last_undegraded":"2024-02-09T08:34:51.905833+0000","last_fullsized":"2024-02-09T08:34:51.905833+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T15:59:25.543995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2459,"reported_epoch":1269,"state":"active+clean","last_fresh":"2024-02-09T08:34:51.772334+0000","last_change":"2024-02-09T08:03:12.225325+0000","last_active":"2024-02-09T08:34:51.772334+0000","last_peered":"2024-02-09T08:34:51.772334+0000","last_clean":"2024-02-09T08:34:51.772334+0000","last_became_active":"2024-02-09T08:03:12.197237+0000","last_became_peered":"2024-02-09T08:03:12.197237+0000","last_unstale":"2024-02-09T08:34:51.772334+0000","last_undegraded":"2024-02-09T08:34:51.772334+0000","last_fullsized":"2024-02-09T08:34:51.772334+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_clean_scrub_stamp":"2024-02-09T08:03:10.689497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T09:53:22.604814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":2435,"reported_epoch":1269,"state":"active+clean","last_fresh":"2024-02-09T08:34:51.922939+0000","last_change":"2024-02-09T08:04:32.150155+0000","last_active":"2024-02-09T08:34:51.922939+0000","last_peered":"2024-02-09T08:34:51.922939+0000","last_clean":"2024-02-09T08:34:51.922939+0000","last_became_active":"2024-02-09T08:04:32.135773+0000","last_became_peered":"2024-02-09T08:04:32.135773+0000","last_unstale":"2024-02-09T08:34:51.922939+0000","last_undegraded":"2024-02-09T08:34:51.922939+0000","last_fullsized":"2024-02-09T08:34:51.922939+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T09:48:06.205102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":2436,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.274817+0000","last_change":"2024-02-09T08:03:12.541068+0000","last_active":"2024-02-09T08:34:47.274817+0000","last_peered":"2024-02-09T08:34:47.274817+0000","last_clean":"2024-02-09T08:34:47.274817+0000","last_became_active":"2024-02-09T08:03:12.535306+0000","last_became_peered":"2024-02-09T08:03:12.535306+0000","last_unstale":"2024-02-09T08:34:47.274817+0000","last_undegraded":"2024-02-09T08:34:47.274817+0000","last_fullsized":"2024-02-09T08:34:47.274817+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_clean_scrub_stamp":"2024-02-09T08:03:10.689497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T16:45:31.048468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":2445,"reported_epoch":1269,"state":"active+clean","last_fresh":"2024-02-09T08:34:51.840790+0000","last_change":"2024-02-09T08:04:35.123806+0000","last_active":"2024-02-09T08:34:51.840790+0000","last_peered":"2024-02-09T08:34:51.840790+0000","last_clean":"2024-02-09T08:34:51.840790+0000","last_became_active":"2024-02-09T08:04:35.117349+0000","last_became_peered":"2024-02-09T08:04:35.117349+0000","last_unstale":"2024-02-09T08:34:51.840790+0000","last_undegraded":"2024-02-09T08:34:51.840790+0000","last_fullsized":"2024-02-09T08:34:51.840790+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T15:28:05.326270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2444,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.224445+0000","last_change":"2024-02-09T08:03:12.601407+0000","last_active":"2024-02-09T08:34:47.224445+0000","last_peered":"2024-02-09T08:34:47.224445+0000","last_clean":"2024-02-09T08:34:47.224445+0000","last_became_active":"2024-02-09T08:03:12.568245+0000","last_became_peered":"2024-02-09T08:03:12.568245+0000","last_unstale":"2024-02-09T08:34:47.224445+0000","last_undegraded":"2024-02-09T08:34:47.224445+0000","last_fullsized":"2024-02-09T08:34:47.224445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_clean_scrub_stamp":"2024-02-09T08:03:10.689497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T13:19:50.521695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":2445,"reported_epoch":1269,"state":"active+clean","last_fresh":"2024-02-09T08:34:51.848561+0000","last_change":"2024-02-09T08:04:21.999119+0000","last_active":"2024-02-09T08:34:51.848561+0000","last_peered":"2024-02-09T08:34:51.848561+0000","last_clean":"2024-02-09T08:34:51.848561+0000","last_became_active":"2024-02-09T08:04:21.984625+0000","last_became_peered":"2024-02-09T08:04:21.984625+0000","last_unstale":"2024-02-09T08:34:51.848561+0000","last_undegraded":"2024-02-09T08:34:51.848561+0000","last_fullsized":"2024-02-09T08:34:51.848561+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T17:50:19.443534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2436,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.361726+0000","last_change":"2024-02-09T08:03:12.390430+0000","last_active":"2024-02-09T08:34:47.361726+0000","last_peered":"2024-02-09T08:34:47.361726+0000","last_clean":"2024-02-09T08:34:47.361726+0000","last_became_active":"2024-02-09T08:03:12.385148+0000","last_became_peered":"2024-02-09T08:03:12.385148+0000","last_unstale":"2024-02-09T08:34:47.361726+0000","last_undegraded":"2024-02-09T08:34:47.361726+0000","last_fullsized":"2024-02-09T08:34:47.361726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_clean_scrub_stamp":"2024-02-09T08:03:10.689497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T10:48:39.909252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":2404,"reported_epoch":1267,"state":"active+clean","last_fresh":"2024-02-09T08:34:50.392308+0000","last_change":"2024-02-09T08:04:22.608389+0000","last_active":"2024-02-09T08:34:50.392308+0000","last_peered":"2024-02-09T08:34:50.392308+0000","last_clean":"2024-02-09T08:34:50.392308+0000","last_became_active":"2024-02-09T08:04:22.589664+0000","last_became_peered":"2024-02-09T08:04:22.589664+0000","last_unstale":"2024-02-09T08:34:50.392308+0000","last_undegraded":"2024-02-09T08:34:50.392308+0000","last_fullsized":"2024-02-09T08:34:50.392308+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T18:29:06.754589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2442,"reported_epoch":1265,"state":"active+clean","last_fresh":"2024-02-09T08:34:48.315688+0000","last_change":"2024-02-09T08:03:12.975632+0000","last_active":"2024-02-09T08:34:48.315688+0000","last_peered":"2024-02-09T08:34:48.315688+0000","last_clean":"2024-02-09T08:34:48.315688+0000","last_became_active":"2024-02-09T08:03:12.943786+0000","last_became_peered":"2024-02-09T08:03:12.943786+0000","last_unstale":"2024-02-09T08:34:48.315688+0000","last_undegraded":"2024-02-09T08:34:48.315688+0000","last_fullsized":"2024-02-09T08:34:48.315688+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_clean_scrub_stamp":"2024-02-09T08:03:10.689497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T14:17:25.431442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":2395,"reported_epoch":1267,"state":"active+clean","last_fresh":"2024-02-09T08:34:50.380645+0000","last_change":"2024-02-09T08:04:47.726395+0000","last_active":"2024-02-09T08:34:50.380645+0000","last_peered":"2024-02-09T08:34:50.380645+0000","last_clean":"2024-02-09T08:34:50.380645+0000","last_became_active":"2024-02-09T08:04:47.720072+0000","last_became_peered":"2024-02-09T08:04:47.720072+0000","last_unstale":"2024-02-09T08:34:50.380645+0000","last_undegraded":"2024-02-09T08:34:50.380645+0000","last_fullsized":"2024-02-09T08:34:50.380645+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T12:05:53.782672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2433,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.395872+0000","last_change":"2024-02-09T08:03:12.925399+0000","last_active":"2024-02-09T08:34:47.395872+0000","last_peered":"2024-02-09T08:34:47.395872+0000","last_clean":"2024-02-09T08:34:47.395872+0000","last_became_active":"2024-02-09T08:03:12.920012+0000","last_became_peered":"2024-02-09T08:03:12.920012+0000","last_unstale":"2024-02-09T08:34:47.395872+0000","last_undegraded":"2024-02-09T08:34:47.395872+0000","last_fullsized":"2024-02-09T08:34:47.395872+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_clean_scrub_stamp":"2024-02-09T08:03:10.689497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T10:28:21.672589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":2412,"reported_epoch":1267,"state":"active+clean","last_fresh":"2024-02-09T08:34:50.772552+0000","last_change":"2024-02-09T08:04:33.664545+0000","last_active":"2024-02-09T08:34:50.772552+0000","last_peered":"2024-02-09T08:34:50.772552+0000","last_clean":"2024-02-09T08:34:50.772552+0000","last_became_active":"2024-02-09T08:04:33.638587+0000","last_became_peered":"2024-02-09T08:04:33.638587+0000","last_unstale":"2024-02-09T08:34:50.772552+0000","last_undegraded":"2024-02-09T08:34:50.772552+0000","last_fullsized":"2024-02-09T08:34:50.772552+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T19:30:04.222018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":2393,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.156466+0000","last_change":"2024-02-09T08:04:31.512983+0000","last_active":"2024-02-09T08:34:47.156466+0000","last_peered":"2024-02-09T08:34:47.156466+0000","last_clean":"2024-02-09T08:34:47.156466+0000","last_became_active":"2024-02-09T08:04:31.384824+0000","last_became_peered":"2024-02-09T08:04:31.384824+0000","last_unstale":"2024-02-09T08:34:47.156466+0000","last_undegraded":"2024-02-09T08:34:47.156466+0000","last_fullsized":"2024-02-09T08:34:47.156466+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T11:51:59.447668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":2424,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.393134+0000","last_change":"2024-02-09T08:04:53.877017+0000","last_active":"2024-02-09T08:34:47.393134+0000","last_peered":"2024-02-09T08:34:47.393134+0000","last_clean":"2024-02-09T08:34:47.393134+0000","last_became_active":"2024-02-09T08:04:53.837629+0000","last_became_peered":"2024-02-09T08:04:53.837629+0000","last_unstale":"2024-02-09T08:34:47.393134+0000","last_undegraded":"2024-02-09T08:34:47.393134+0000","last_fullsized":"2024-02-09T08:34:47.393134+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T18:40:04.247361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":2446,"reported_epoch":1269,"state":"active+clean","last_fresh":"2024-02-09T08:34:51.894860+0000","last_change":"2024-02-09T08:04:21.302362+0000","last_active":"2024-02-09T08:34:51.894860+0000","last_peered":"2024-02-09T08:34:51.894860+0000","last_clean":"2024-02-09T08:34:51.894860+0000","last_became_active":"2024-02-09T08:04:21.282606+0000","last_became_peered":"2024-02-09T08:04:21.282606+0000","last_unstale":"2024-02-09T08:34:51.894860+0000","last_undegraded":"2024-02-09T08:34:51.894860+0000","last_fullsized":"2024-02-09T08:34:51.894860+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T19:16:17.460982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":2431,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.189233+0000","last_change":"2024-02-09T08:04:21.475042+0000","last_active":"2024-02-09T08:34:47.189233+0000","last_peered":"2024-02-09T08:34:47.189233+0000","last_clean":"2024-02-09T08:34:47.189233+0000","last_became_active":"2024-02-09T08:04:21.467958+0000","last_became_peered":"2024-02-09T08:04:21.467958+0000","last_unstale":"2024-02-09T08:34:47.189233+0000","last_undegraded":"2024-02-09T08:34:47.189233+0000","last_fullsized":"2024-02-09T08:34:47.189233+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T19:20:44.543943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":2445,"reported_epoch":1269,"state":"active+clean","last_fresh":"2024-02-09T08:34:51.770536+0000","last_change":"2024-02-09T08:04:20.693952+0000","last_active":"2024-02-09T08:34:51.770536+0000","last_peered":"2024-02-09T08:34:51.770536+0000","last_clean":"2024-02-09T08:34:51.770536+0000","last_became_active":"2024-02-09T08:04:20.679487+0000","last_became_peered":"2024-02-09T08:04:20.679487+0000","last_unstale":"2024-02-09T08:34:51.770536+0000","last_undegraded":"2024-02-09T08:34:51.770536+0000","last_fullsized":"2024-02-09T08:34:51.770536+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T19:30:24.161882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":2411,"reported_epoch":1267,"state":"active+clean","last_fresh":"2024-02-09T08:34:50.760222+0000","last_change":"2024-02-09T08:04:31.601293+0000","last_active":"2024-02-09T08:34:50.760222+0000","last_peered":"2024-02-09T08:34:50.760222+0000","last_clean":"2024-02-09T08:34:50.760222+0000","last_became_active":"2024-02-09T08:04:31.595670+0000","last_became_peered":"2024-02-09T08:04:31.595670+0000","last_unstale":"2024-02-09T08:34:50.760222+0000","last_undegraded":"2024-02-09T08:34:50.760222+0000","last_fullsized":"2024-02-09T08:34:50.760222+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T08:48:28.458262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":2404,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.149904+0000","last_change":"2024-02-09T08:04:41.266591+0000","last_active":"2024-02-09T08:34:47.149904+0000","last_peered":"2024-02-09T08:34:47.149904+0000","last_clean":"2024-02-09T08:34:47.149904+0000","last_became_active":"2024-02-09T08:04:41.259580+0000","last_became_peered":"2024-02-09T08:04:41.259580+0000","last_unstale":"2024-02-09T08:34:47.149904+0000","last_undegraded":"2024-02-09T08:34:47.149904+0000","last_fullsized":"2024-02-09T08:34:47.149904+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T11:13:46.788829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":2421,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.374779+0000","last_change":"2024-02-09T08:04:53.258518+0000","last_active":"2024-02-09T08:34:47.374779+0000","last_peered":"2024-02-09T08:34:47.374779+0000","last_clean":"2024-02-09T08:34:47.374779+0000","last_became_active":"2024-02-09T08:04:53.248695+0000","last_became_peered":"2024-02-09T08:04:53.248695+0000","last_unstale":"2024-02-09T08:34:47.374779+0000","last_undegraded":"2024-02-09T08:34:47.374779+0000","last_fullsized":"2024-02-09T08:34:47.374779+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T19:57:41.278249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":2429,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.218929+0000","last_change":"2024-02-09T08:04:39.731324+0000","last_active":"2024-02-09T08:34:47.218929+0000","last_peered":"2024-02-09T08:34:47.218929+0000","last_clean":"2024-02-09T08:34:47.218929+0000","last_became_active":"2024-02-09T08:04:39.726089+0000","last_became_peered":"2024-02-09T08:04:39.726089+0000","last_unstale":"2024-02-09T08:34:47.218929+0000","last_undegraded":"2024-02-09T08:34:47.218929+0000","last_fullsized":"2024-02-09T08:34:47.218929+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T17:50:58.258753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":2398,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.167475+0000","last_change":"2024-02-09T08:04:18.181620+0000","last_active":"2024-02-09T08:34:47.167475+0000","last_peered":"2024-02-09T08:34:47.167475+0000","last_clean":"2024-02-09T08:34:47.167475+0000","last_became_active":"2024-02-09T08:04:18.174506+0000","last_became_peered":"2024-02-09T08:04:18.174506+0000","last_unstale":"2024-02-09T08:34:47.167475+0000","last_undegraded":"2024-02-09T08:34:47.167475+0000","last_fullsized":"2024-02-09T08:34:47.167475+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T09:26:34.210279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":2405,"reported_epoch":1267,"state":"active+clean","last_fresh":"2024-02-09T08:34:50.388422+0000","last_change":"2024-02-09T08:04:23.913333+0000","last_active":"2024-02-09T08:34:50.388422+0000","last_peered":"2024-02-09T08:34:50.388422+0000","last_clean":"2024-02-09T08:34:50.388422+0000","last_became_active":"2024-02-09T08:04:23.899068+0000","last_became_peered":"2024-02-09T08:04:23.899068+0000","last_unstale":"2024-02-09T08:34:50.388422+0000","last_undegraded":"2024-02-09T08:34:50.388422+0000","last_fullsized":"2024-02-09T08:34:50.388422+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T15:40:17.180740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":21,"seq":90194313594,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71076,"kb_used_data":3800,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94300764,"statfs":{"total":96636764160,"available":96563982336,"internally_reserved":0,"allocated":3891200,"data_stored":1575219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68876743},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":59,"apply_latency_ms":59,"commit_latency_ns":59000000,"apply_latency_ns":59000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 9 08:33:49 2024","interfaces":[{"interface":"back","average":{"1min":10.571,"5min":28.581,"15min":35.933999999999997},"min":{"1min":4.867,"5min":4.3630000000000004,"15min":4.3630000000000004},"max":{"1min":19.257999999999999,"5min":244.96000000000001,"15min":435.74099999999999},"last":5.2300000000000004},{"interface":"front","average":{"1min":9.3170000000000002,"5min":26.222000000000001,"15min":35.192},"min":{"1min":5.3419999999999996,"5min":4.5140000000000002,"15min":4.5140000000000002},"max":{"1min":17.224,"5min":327.66800000000001,"15min":530.76499999999999},"last":9.0559999999999992}]},{"osd":1,"last update":"Fri Feb 9 08:34:40 2024","interfaces":[{"interface":"back","average":{"1min":23.754000000000001,"5min":27.858000000000001,"15min":41.049999999999997},"min":{"1min":10.205,"5min":8.8209999999999997,"15min":6.3339999999999996},"max":{"1min":133.12,"5min":220.53999999999999,"15min":367.85500000000002},"last":9.7880000000000003},{"interface":"front","average":{"1min":16.032,"5min":22.309999999999999,"15min":33.643000000000001},"min":{"1min":7.2750000000000004,"5min":4.9809999999999999,"15min":4.9809999999999999},"max":{"1min":88.522000000000006,"5min":190.19399999999999,"15min":328.70400000000001},"last":15.071999999999999}]},{"osd":2,"last update":"Fri Feb 9 08:34:36 2024","interfaces":[{"interface":"back","average":{"1min":20.32,"5min":21.036999999999999,"15min":30.809999999999999},"min":{"1min":7.79,"5min":7.5300000000000002,"15min":6.8380000000000001},"max":{"1min":109.685,"5min":154.72399999999999,"15min":296.97199999999998},"last":11.036},{"interface":"front","average":{"1min":28.870000000000001,"5min":27.794,"15min":39.774999999999999},"min":{"1min":11.637,"5min":8.6769999999999996,"15min":8.6769999999999996},"max":{"1min":197.815,"5min":197.815,"15min":307.27800000000002},"last":14.441000000000001}]},{"osd":4,"last update":"Fri Feb 9 08:33:44 2024","interfaces":[{"interface":"back","average":{"1min":15.788,"5min":34.143000000000001,"15min":43.649999999999999},"min":{"1min":11.162000000000001,"5min":9.0449999999999999,"15min":7.1340000000000003},"max":{"1min":19.582000000000001,"5min":331.005,"15min":590.62699999999995},"last":11.715},{"interface":"front","average":{"1min":14.061999999999999,"5min":30.212,"15min":39.517000000000003},"min":{"1min":8.3049999999999997,"5min":8.3049999999999997,"15min":8.3049999999999997},"max":{"1min":19.045000000000002,"5min":199.39099999999999,"15min":360.63799999999998},"last":16.286000000000001}]},{"osd":5,"last update":"Fri Feb 9 08:34:19 2024","interfaces":[{"interface":"back","average":{"1min":9.4120000000000008,"5min":27.838999999999999,"15min":38.497999999999998},"min":{"1min":6.3940000000000001,"5min":6.3940000000000001,"15min":6.3179999999999996},"max":{"1min":14.587999999999999,"5min":287.38499999999999,"15min":593.90599999999995},"last":13.683},{"interface":"front","average":{"1min":15.715,"5min":37.125,"15min":46.695},"min":{"1min":10.574999999999999,"5min":10.532999999999999,"15min":7.7590000000000003},"max":{"1min":21.821000000000002,"5min":296.96100000000001,"15min":595.14099999999996},"last":12.401}]},{"osd":6,"last update":"Fri Feb 9 08:33:44 2024","interfaces":[{"interface":"back","average":{"1min":12.772,"5min":32.241999999999997,"15min":41.530999999999999},"min":{"1min":7.4219999999999997,"5min":6.585,"15min":6.585},"max":{"1min":20.042999999999999,"5min":180.024,"15min":466.93099999999998},"last":17.021000000000001},{"interface":"front","average":{"1min":14.462,"5min":36.073,"15min":42.298000000000002},"min":{"1min":9.9939999999999998,"5min":9.2439999999999998,"15min":7.5599999999999996},"max":{"1min":19.867000000000001,"5min":340.75099999999998,"15min":713.92999999999995},"last":15.701000000000001}]},{"osd":7,"last update":"Fri Feb 9 08:33:49 2024","interfaces":[{"interface":"back","average":{"1min":17.872,"5min":37.258000000000003,"15min":47.962000000000003},"min":{"1min":11.401999999999999,"5min":8.3849999999999998,"15min":8.3849999999999998},"max":{"1min":25.266999999999999,"5min":247.81800000000001,"15min":591.36599999999999},"last":17.725999999999999},{"interface":"front","average":{"1min":19.061,"5min":40.015000000000001,"15min":50.957999999999998},"min":{"1min":13.031000000000001,"5min":12.263,"15min":11.82},"max":{"1min":24.359999999999999,"5min":287.39999999999998,"15min":815.34000000000003},"last":19.597999999999999}]}]},{"osd":4,"up_from":20,"seq":85899346297,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66932,"kb_used_data":3816,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94304908,"statfs":{"total":96636764160,"available":96568225792,"internally_reserved":0,"allocated":3907584,"data_stored":1582236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":49,"apply_latency_ms":49,"commit_latency_ns":49000000,"apply_latency_ns":49000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 9 08:34:44 2024","interfaces":[{"interface":"back","average":{"1min":10.693,"5min":17.425000000000001,"15min":22.245000000000001},"min":{"1min":4.7210000000000001,"5min":4.7210000000000001,"15min":4.1289999999999996},"max":{"1min":26.428999999999998,"5min":230.53100000000001,"15min":436.31999999999999},"last":129.28800000000001},{"interface":"front","average":{"1min":11.77,"5min":14.401999999999999,"15min":20.047999999999998},"min":{"1min":5.7830000000000004,"5min":5.4669999999999996,"15min":4.6539999999999999},"max":{"1min":72.087000000000003,"5min":122.212,"15min":313.82600000000002},"last":167.53399999999999}]},{"osd":1,"last update":"Fri Feb 9 08:34:44 2024","interfaces":[{"interface":"back","average":{"1min":13.816000000000001,"5min":16.184999999999999,"15min":22.974},"min":{"1min":7.6779999999999999,"5min":7.1020000000000003,"15min":5.2560000000000002},"max":{"1min":42.305,"5min":181.512,"15min":267.11399999999998},"last":50.877000000000002},{"interface":"front","average":{"1min":17.181999999999999,"5min":24.428999999999998,"15min":27.335000000000001},"min":{"1min":9.5890000000000004,"5min":7.0650000000000004,"15min":5.282},"max":{"1min":41.612000000000002,"5min":450.27100000000002,"15min":450.27100000000002},"last":51.520000000000003}]},{"osd":2,"last update":"Fri Feb 9 08:34:44 2024","interfaces":[{"interface":"back","average":{"1min":14.859999999999999,"5min":18.300000000000001,"15min":24.43},"min":{"1min":6.4489999999999998,"5min":6.3209999999999997,"15min":6.1159999999999997},"max":{"1min":62.048000000000002,"5min":133.65600000000001,"15min":380.56599999999997},"last":91.189999999999998},{"interface":"front","average":{"1min":18.081,"5min":21.329000000000001,"15min":28.344999999999999},"min":{"1min":7.6710000000000003,"5min":6.7039999999999997,"15min":6.7039999999999997},"max":{"1min":149.84800000000001,"5min":150.18100000000001,"15min":328.28100000000001},"last":56.432000000000002}]},{"osd":3,"last update":"Fri Feb 9 08:34:45 2024","interfaces":[{"interface":"back","average":{"1min":16.779,"5min":20.786000000000001,"15min":33.490000000000002},"min":{"1min":7.3289999999999997,"5min":6.8360000000000003,"15min":6.8360000000000003},"max":{"1min":115.795,"5min":147.76900000000001,"15min":957.68299999999999},"last":92.641000000000005},{"interface":"front","average":{"1min":20.568999999999999,"5min":23.959,"15min":35.015000000000001},"min":{"1min":9.9320000000000004,"5min":8.4870000000000001,"15min":6.7359999999999998},"max":{"1min":151.346,"5min":203.74700000000001,"15min":1190.1980000000001},"last":65.085999999999999}]},{"osd":5,"last update":"Fri Feb 9 08:34:44 2024","interfaces":[{"interface":"back","average":{"1min":24.512,"5min":17.521000000000001,"15min":25.984999999999999},"min":{"1min":6.2759999999999998,"5min":6.2759999999999998,"15min":6.2759999999999998},"max":{"1min":305.34100000000001,"5min":305.34100000000001,"15min":375.72000000000003},"last":91.853999999999999},{"interface":"front","average":{"1min":21.675999999999998,"5min":22.166,"15min":26.899000000000001},"min":{"1min":10.917999999999999,"5min":10.558,"15min":6.585},"max":{"1min":128.261,"5min":141.596,"15min":429.53500000000003},"last":62.545000000000002}]},{"osd":6,"last update":"Fri Feb 9 08:34:44 2024","interfaces":[{"interface":"back","average":{"1min":24.588000000000001,"5min":25.984999999999999,"15min":30.030999999999999},"min":{"1min":12.113,"5min":11.869999999999999,"15min":8.4760000000000009},"max":{"1min":100.815,"5min":205.577,"15min":300.27100000000002},"last":64.358999999999995},{"interface":"front","average":{"1min":35.454999999999998,"5min":24.370000000000001,"15min":29.376999999999999},"min":{"1min":8.0079999999999991,"5min":7.0389999999999997,"15min":7.0389999999999997},"max":{"1min":378.00099999999998,"5min":378.00099999999998,"15min":378.00099999999998},"last":97.787999999999997}]},{"osd":7,"last update":"Fri Feb 9 08:34:44 2024","interfaces":[{"interface":"back","average":{"1min":18.373999999999999,"5min":18.158999999999999,"15min":27.742000000000001},"min":{"1min":8.9670000000000005,"5min":6.2039999999999997,"15min":6.2039999999999997},"max":{"1min":93.730000000000004,"5min":93.730000000000004,"15min":349.47500000000002},"last":63.481999999999999},{"interface":"front","average":{"1min":21.815000000000001,"5min":19.652999999999999,"15min":28.613},"min":{"1min":9.1069999999999993,"5min":9.0739999999999998,"15min":9.0739999999999998},"max":{"1min":130.899,"5min":130.899,"15min":381.80399999999997},"last":104.66800000000001}]}]},{"osd":1,"up_from":16,"seq":68719477112,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71476,"kb_used_data":4196,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94300364,"statfs":{"total":96636764160,"available":96563572736,"internally_reserved":0,"allocated":4296704,"data_stored":1973064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":56,"apply_latency_ms":56,"commit_latency_ns":56000000,"apply_latency_ns":56000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 9 08:34:05 2024","interfaces":[{"interface":"back","average":{"1min":9.9629999999999992,"5min":23.974,"15min":21.896999999999998},"min":{"1min":6.3019999999999996,"5min":5.532,"15min":4.431},"max":{"1min":17.344999999999999,"5min":206.726,"15min":212.11199999999999},"last":8.0220000000000002},{"interface":"front","average":{"1min":13.121,"5min":29.670000000000002,"15min":27.291},"min":{"1min":8.6069999999999993,"5min":7.867,"15min":4.8849999999999998},"max":{"1min":21.439,"5min":246.137,"15min":468.82799999999997},"last":11.722}]},{"osd":2,"last update":"Fri Feb 9 08:34:31 2024","interfaces":[{"interface":"back","average":{"1min":33.371000000000002,"5min":24.713999999999999,"15min":24.129000000000001},"min":{"1min":9.1159999999999997,"5min":6.2510000000000003,"15min":5.2809999999999997},"max":{"1min":202.48500000000001,"5min":202.48500000000001,"15min":264.06400000000002},"last":14.167},{"interface":"front","average":{"1min":32.582999999999998,"5min":27.651,"15min":30.681000000000001},"min":{"1min":9.7490000000000006,"5min":7.8879999999999999,"15min":7.5179999999999998},"max":{"1min":164.06299999999999,"5min":181.94900000000001,"15min":417.31599999999997},"last":15.422000000000001}]},{"osd":3,"last update":"Fri Feb 9 08:34:31 2024","interfaces":[{"interface":"back","average":{"1min":21.018000000000001,"5min":25.486000000000001,"15min":30.059000000000001},"min":{"1min":8.2370000000000001,"5min":6.2460000000000004,"15min":6.2460000000000004},"max":{"1min":146.39099999999999,"5min":237.40799999999999,"15min":421.22300000000001},"last":11.073},{"interface":"front","average":{"1min":23.954000000000001,"5min":29.001999999999999,"15min":32.527000000000001},"min":{"1min":9.7919999999999998,"5min":9.6479999999999997,"15min":8.5730000000000004},"max":{"1min":150.655,"5min":251.86199999999999,"15min":434.92500000000001},"last":12.401999999999999}]},{"osd":4,"last update":"Fri Feb 9 08:33:48 2024","interfaces":[{"interface":"back","average":{"1min":15.727,"5min":22.158000000000001,"15min":22.741},"min":{"1min":10.606,"5min":9.0600000000000005,"15min":7.8849999999999998},"max":{"1min":23.405000000000001,"5min":139.489,"15min":179.96700000000001},"last":14.807},{"interface":"front","average":{"1min":10.336,"5min":17.417000000000002,"15min":20.902000000000001},"min":{"1min":6.4489999999999998,"5min":5.6890000000000001,"15min":5.6890000000000001},"max":{"1min":24.408999999999999,"5min":151.87799999999999,"15min":179.363},"last":6.7649999999999997}]},{"osd":5,"last update":"Fri Feb 9 08:34:05 2024","interfaces":[{"interface":"back","average":{"1min":10.693,"5min":23.084,"15min":28.024999999999999},"min":{"1min":6.8529999999999998,"5min":6.3220000000000001,"15min":6.3220000000000001},"max":{"1min":16.337,"5min":195.422,"15min":455.44299999999998},"last":13.459},{"interface":"front","average":{"1min":13.891999999999999,"5min":25.102,"15min":31.346},"min":{"1min":9.3130000000000006,"5min":8.0899999999999999,"15min":8.0899999999999999},"max":{"1min":19.707999999999998,"5min":197.43199999999999,"15min":469.512},"last":8.6199999999999992}]},{"osd":6,"last update":"Fri Feb 9 08:34:31 2024","interfaces":[{"interface":"back","average":{"1min":26.119,"5min":25.067,"15min":28.399000000000001},"min":{"1min":10.398999999999999,"5min":9.6460000000000008,"15min":8.1270000000000007},"max":{"1min":175.44,"5min":175.44,"15min":345.596},"last":24.137},{"interface":"front","average":{"1min":28.597000000000001,"5min":28.733000000000001,"15min":30.506},"min":{"1min":12.433,"5min":11.949,"15min":7.7160000000000002},"max":{"1min":176.929,"5min":176.929,"15min":423.88400000000001},"last":26.404}]},{"osd":7,"last update":"Fri Feb 9 08:34:31 2024","interfaces":[{"interface":"back","average":{"1min":27.841999999999999,"5min":27.408999999999999,"15min":30.664000000000001},"min":{"1min":11.976000000000001,"5min":11.976000000000001,"15min":9.1010000000000009},"max":{"1min":128.32599999999999,"5min":159.02600000000001,"15min":418.42500000000001},"last":25.754999999999999},{"interface":"front","average":{"1min":27.018999999999998,"5min":28.265000000000001,"15min":30.824000000000002},"min":{"1min":13.486000000000001,"5min":12.634,"15min":8.8149999999999995},"max":{"1min":130.70599999999999,"5min":161.59999999999999,"15min":377.685},"last":27.038}]}]},{"osd":7,"up_from":15,"seq":64424509823,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71132,"kb_used_data":3852,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94300708,"statfs":{"total":96636764160,"available":96563924992,"internally_reserved":0,"allocated":3944448,"data_stored":1603519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":68876746},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 9 08:34:00 2024","interfaces":[{"interface":"back","average":{"1min":9.5739999999999998,"5min":20.443000000000001,"15min":19.920999999999999},"min":{"1min":4.3600000000000003,"5min":4.3600000000000003,"15min":4.3600000000000003},"max":{"1min":15.842000000000001,"5min":312.15699999999998,"15min":312.15699999999998},"last":145.61799999999999},{"interface":"front","average":{"1min":10.407,"5min":22.914000000000001,"15min":21.405000000000001},"min":{"1min":6.7590000000000003,"5min":4.5410000000000004,"15min":4.0830000000000002},"max":{"1min":17.901,"5min":315.53399999999999,"15min":315.53399999999999},"last":127.39700000000001}]},{"osd":1,"last update":"Fri Feb 9 08:34:48 2024","interfaces":[{"interface":"back","average":{"1min":16.395,"5min":21.608000000000001,"15min":33.338999999999999},"min":{"1min":6.5149999999999997,"5min":5.859,"15min":4.5279999999999996},"max":{"1min":76.780000000000001,"5min":277.971,"15min":1551.0129999999999},"last":9.1920000000000002},{"interface":"front","average":{"1min":19.09,"5min":23.619,"15min":31.817},"min":{"1min":9.5350000000000001,"5min":5.5709999999999997,"15min":5.5709999999999997},"max":{"1min":75.843999999999994,"5min":318.48500000000001,"15min":1189.5050000000001},"last":10.606999999999999}]},{"osd":2,"last update":"Fri Feb 9 08:34:00 2024","interfaces":[{"interface":"back","average":{"1min":9.8390000000000004,"5min":25.876000000000001,"15min":23.849},"min":{"1min":5.7249999999999996,"5min":5.7249999999999996,"15min":5.7249999999999996},"max":{"1min":15.551,"5min":309.161,"15min":309.161},"last":38.692999999999998},{"interface":"front","average":{"1min":13.532,"5min":29.146999999999998,"15min":25.814},"min":{"1min":7.7130000000000001,"5min":6.9539999999999997,"15min":6.9050000000000002},"max":{"1min":18.120999999999999,"5min":333.91399999999999,"15min":333.91399999999999},"last":114.569}]},{"osd":3,"last update":"Fri Feb 9 08:34:11 2024","interfaces":[{"interface":"back","average":{"1min":13.24,"5min":28.524000000000001,"15min":32.805},"min":{"1min":6.516,"5min":6.516,"15min":6.516},"max":{"1min":18.763000000000002,"5min":310.67399999999998,"15min":429.62799999999999},"last":7.2450000000000001},{"interface":"front","average":{"1min":12.640000000000001,"5min":28.494,"15min":36.866},"min":{"1min":7.9139999999999997,"5min":6.3680000000000003,"15min":6.3680000000000003},"max":{"1min":17.683,"5min":317.71699999999998,"15min":485.76100000000002},"last":11.58}]},{"osd":4,"last update":"Fri Feb 9 08:34:48 2024","interfaces":[{"interface":"back","average":{"1min":17.018999999999998,"5min":30.007000000000001,"15min":29.927},"min":{"1min":7.8369999999999997,"5min":7.7869999999999999,"15min":7.7869999999999999},"max":{"1min":47.853999999999999,"5min":324.089,"15min":345.54300000000001},"last":9.9860000000000007},{"interface":"front","average":{"1min":19.475999999999999,"5min":32.319000000000003,"15min":31.989999999999998},"min":{"1min":10.106,"5min":10.106,"15min":10.106},"max":{"1min":49.270000000000003,"5min":316.80399999999997,"15min":316.80399999999997},"last":13.393000000000001}]},{"osd":5,"last update":"Fri Feb 9 08:34:00 2024","interfaces":[{"interface":"back","average":{"1min":13.651999999999999,"5min":28.315999999999999,"15min":27.463999999999999},"min":{"1min":8.3100000000000005,"5min":6.6689999999999996,"15min":6.1459999999999999},"max":{"1min":17.518999999999998,"5min":333.00700000000001,"15min":333.00700000000001},"last":157.42500000000001},{"interface":"front","average":{"1min":14.571,"5min":33.612000000000002,"15min":28.629000000000001},"min":{"1min":9.7680000000000007,"5min":7.508,"15min":6.3499999999999996},"max":{"1min":19.318000000000001,"5min":352.358,"15min":352.358},"last":135.202}]},{"osd":6,"last update":"Fri Feb 9 08:34:00 2024","interfaces":[{"interface":"back","average":{"1min":15.510999999999999,"5min":30.286000000000001,"15min":27.253},"min":{"1min":11.512,"5min":7.2240000000000002,"15min":6.8879999999999999},"max":{"1min":21.469000000000001,"5min":338.29000000000002,"15min":338.29000000000002},"last":139.09299999999999},{"interface":"front","average":{"1min":17.114999999999998,"5min":34.948,"15min":31.806999999999999},"min":{"1min":12.204000000000001,"5min":12.204000000000001,"15min":9.3729999999999993},"max":{"1min":22.376999999999999,"5min":349.34500000000003,"15min":349.34500000000003},"last":146.25}]}]},{"osd":6,"up_from":15,"seq":64424509822,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71116,"kb_used_data":3844,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94300724,"statfs":{"total":96636764160,"available":96563941376,"internally_reserved":0,"allocated":3936256,"data_stored":1596700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,1],"upper_bound":2048},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 9 08:34:02 2024","interfaces":[{"interface":"back","average":{"1min":8.6820000000000004,"5min":18.645,"15min":24.832000000000001},"min":{"1min":4.2380000000000004,"5min":4.2380000000000004,"15min":4.1589999999999998},"max":{"1min":18.015000000000001,"5min":167.62899999999999,"15min":318.44400000000002},"last":6.5609999999999999},{"interface":"front","average":{"1min":10.906000000000001,"5min":22.431999999999999,"15min":27.635999999999999},"min":{"1min":5.8159999999999998,"5min":4.6589999999999998,"15min":4.6589999999999998},"max":{"1min":17.667999999999999,"5min":216.55000000000001,"15min":340.25599999999997},"last":8.2449999999999992}]},{"osd":1,"last update":"Fri Feb 9 08:34:08 2024","interfaces":[{"interface":"back","average":{"1min":8.4719999999999995,"5min":28.818999999999999,"15min":28.925999999999998},"min":{"1min":6.0149999999999997,"5min":5.9960000000000004,"15min":5.093},"max":{"1min":15.109,"5min":368.74200000000002,"15min":664.64300000000003},"last":9.0440000000000005},{"interface":"front","average":{"1min":11.473000000000001,"5min":30.515999999999998,"15min":29.097000000000001},"min":{"1min":8.0129999999999999,"5min":7.1449999999999996,"15min":6.5780000000000003},"max":{"1min":18.710000000000001,"5min":258.34500000000003,"15min":369.96899999999999},"last":16.323}]},{"osd":2,"last update":"Fri Feb 9 08:34:02 2024","interfaces":[{"interface":"back","average":{"1min":12.372,"5min":27.215,"15min":29.059999999999999},"min":{"1min":7.3799999999999999,"5min":6.7300000000000004,"15min":6.7300000000000004},"max":{"1min":19.559999999999999,"5min":290.71600000000001,"15min":290.71600000000001},"last":15.663},{"interface":"front","average":{"1min":13.106999999999999,"5min":26.222999999999999,"15min":28.597000000000001},"min":{"1min":8.1549999999999994,"5min":7.2320000000000002,"15min":6.6719999999999997},"max":{"1min":18.646000000000001,"5min":286.08699999999999,"15min":286.08699999999999},"last":18.234999999999999}]},{"osd":3,"last update":"Fri Feb 9 08:34:08 2024","interfaces":[{"interface":"back","average":{"1min":14.584,"5min":33.146000000000001,"15min":34.277000000000001},"min":{"1min":9.1270000000000007,"5min":8.827,"15min":7.5209999999999999},"max":{"1min":19.896000000000001,"5min":247.40700000000001,"15min":400.87099999999998},"last":14.253},{"interface":"front","average":{"1min":12.955,"5min":31.477,"15min":38.030999999999999},"min":{"1min":9.0350000000000001,"5min":6.4420000000000002,"15min":6.4420000000000002},"max":{"1min":17.111999999999998,"5min":273.38499999999999,"15min":401.97300000000001},"last":9.7759999999999998}]},{"osd":4,"last update":"Fri Feb 9 08:34:42 2024","interfaces":[{"interface":"back","average":{"1min":27.59,"5min":28.632999999999999,"15min":29.07},"min":{"1min":11.359,"5min":8.8100000000000005,"15min":6.9800000000000004},"max":{"1min":193.97499999999999,"5min":243.23599999999999,"15min":339.286},"last":11.02},{"interface":"front","average":{"1min":30.446000000000002,"5min":34.627000000000002,"15min":35.954000000000001},"min":{"1min":14.337999999999999,"5min":11.573,"15min":10.298999999999999},"max":{"1min":198.60400000000001,"5min":243.86600000000001,"15min":402.19099999999997},"last":19.166}]},{"osd":5,"last update":"Fri Feb 9 08:34:02 2024","interfaces":[{"interface":"back","average":{"1min":13.428000000000001,"5min":26.620999999999999,"15min":25.609000000000002},"min":{"1min":7.5650000000000004,"5min":6.8390000000000004,"15min":6.0170000000000003},"max":{"1min":19.347999999999999,"5min":395.89999999999998,"15min":395.89999999999998},"last":11.683999999999999},{"interface":"front","average":{"1min":18.483000000000001,"5min":39.442999999999998,"15min":34.320999999999998},"min":{"1min":14.18,"5min":8.1449999999999996,"15min":8.1449999999999996},"max":{"1min":22.501999999999999,"5min":665.33799999999997,"15min":665.33799999999997},"last":17.053999999999998}]},{"osd":7,"last update":"Fri Feb 9 08:33:52 2024","interfaces":[{"interface":"back","average":{"1min":15.175000000000001,"5min":25.763000000000002,"15min":27.503},"min":{"1min":10.571,"5min":7.9889999999999999,"15min":7.9429999999999996},"max":{"1min":22.690999999999999,"5min":264.161,"15min":326.23200000000003},"last":12.798},{"interface":"front","average":{"1min":16.957000000000001,"5min":30.276,"15min":30.678999999999998},"min":{"1min":12.988,"5min":10.56,"15min":8.7810000000000006},"max":{"1min":20.411000000000001,"5min":253.45599999999999,"15min":315.09199999999998},"last":13.538}]}]},{"osd":2,"up_from":15,"seq":64424509818,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71108,"kb_used_data":3828,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94300732,"statfs":{"total":96636764160,"available":96563949568,"internally_reserved":0,"allocated":3919872,"data_stored":1589569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 9 08:33:53 2024","interfaces":[{"interface":"back","average":{"1min":11.448,"5min":18.757999999999999,"15min":22.998999999999999},"min":{"1min":7.4720000000000004,"5min":5.6719999999999997,"15min":4.1859999999999999},"max":{"1min":14.856999999999999,"5min":236.542,"15min":240.815},"last":10.526999999999999},{"interface":"front","average":{"1min":12.445,"5min":20.640999999999998,"15min":27.609999999999999},"min":{"1min":6.8529999999999998,"5min":6.8529999999999998,"15min":5.0830000000000002},"max":{"1min":16.725000000000001,"5min":237.27000000000001,"15min":258.41800000000001},"last":16.097999999999999}]},{"osd":1,"last update":"Fri Feb 9 08:34:34 2024","interfaces":[{"interface":"back","average":{"1min":19.222999999999999,"5min":13.205,"15min":27.302},"min":{"1min":5.681,"5min":5.2800000000000002,"15min":5.2080000000000002},"max":{"1min":170.83000000000001,"5min":170.83000000000001,"15min":752.81500000000005},"last":11.952999999999999},{"interface":"front","average":{"1min":26.896999999999998,"5min":23.623999999999999,"15min":36.237000000000002},"min":{"1min":9.7539999999999996,"5min":9.5890000000000004,"15min":6.8819999999999997},"max":{"1min":169.58099999999999,"5min":202.91,"15min":752.245},"last":15.208}]},{"osd":3,"last update":"Fri Feb 9 08:33:53 2024","interfaces":[{"interface":"back","average":{"1min":14.416,"5min":32.816000000000003,"15min":38.335999999999999},"min":{"1min":8.1020000000000003,"5min":6.7709999999999999,"15min":5.7949999999999999},"max":{"1min":20.547000000000001,"5min":325.14499999999998,"15min":846.35400000000004},"last":16.936},{"interface":"front","average":{"1min":8.6099999999999994,"5min":21.760000000000002,"15min":32.759},"min":{"1min":6.0640000000000001,"5min":5.9969999999999999,"15min":5.5490000000000004},"max":{"1min":15.869999999999999,"5min":235.749,"15min":334.87900000000002},"last":8.3989999999999991}]},{"osd":4,"last update":"Fri Feb 9 08:33:53 2024","interfaces":[{"interface":"back","average":{"1min":15.02,"5min":23.645,"15min":29.68},"min":{"1min":10.976000000000001,"5min":10.058999999999999,"15min":7.7110000000000003},"max":{"1min":17.728000000000002,"5min":254.77799999999999,"15min":423.28199999999998},"last":17.792000000000002},{"interface":"front","average":{"1min":17.015000000000001,"5min":26.844000000000001,"15min":31.972999999999999},"min":{"1min":12.914999999999999,"5min":12.321999999999999,"15min":10.821999999999999},"max":{"1min":18.706,"5min":253.941,"15min":297.73399999999998},"last":19.449999999999999}]},{"osd":5,"last update":"Fri Feb 9 08:33:53 2024","interfaces":[{"interface":"back","average":{"1min":10.99,"5min":20.640000000000001,"15min":29.731999999999999},"min":{"1min":6.5439999999999996,"5min":6.5439999999999996,"15min":6.1870000000000003},"max":{"1min":20.074999999999999,"5min":150.24799999999999,"15min":319.279},"last":11.199},{"interface":"front","average":{"1min":12.898999999999999,"5min":24.216999999999999,"15min":35.200000000000003},"min":{"1min":9.1419999999999995,"5min":6.21,"15min":6.21},"max":{"1min":21.289999999999999,"5min":283.18900000000002,"15min":314.74299999999999},"last":12.616}]},{"osd":6,"last update":"Fri Feb 9 08:33:53 2024","interfaces":[{"interface":"back","average":{"1min":17.364999999999998,"5min":23.785,"15min":34.709000000000003},"min":{"1min":12.33,"5min":12.33,"15min":9.859},"max":{"1min":19.661000000000001,"5min":138.125,"15min":301.05099999999999},"last":18.789999999999999},{"interface":"front","average":{"1min":18.498000000000001,"5min":26.233000000000001,"15min":35.259999999999998},"min":{"1min":13.566000000000001,"5min":13.566000000000001,"15min":13.298},"max":{"1min":21.442,"5min":135.84399999999999,"15min":273.30500000000001},"last":20.452999999999999}]},{"osd":7,"last update":"Fri Feb 9 08:34:34 2024","interfaces":[{"interface":"back","average":{"1min":15.26,"5min":13.488,"15min":26.422999999999998},"min":{"1min":7.3300000000000001,"5min":7.3300000000000001,"15min":6.3849999999999998},"max":{"1min":86.403000000000006,"5min":88.838999999999999,"15min":303.416},"last":9.7400000000000002},{"interface":"front","average":{"1min":19.038,"5min":16.216000000000001,"15min":30.358000000000001},"min":{"1min":8.7520000000000007,"5min":8.2449999999999992,"15min":7.7999999999999998},"max":{"1min":107.05,"5min":107.05,"15min":498.34300000000002},"last":13.340999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509816,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66956,"kb_used_data":3844,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94304884,"statfs":{"total":96636764160,"available":96568201216,"internally_reserved":0,"allocated":3936256,"data_stored":1596577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":60,"apply_latency_ms":60,"commit_latency_ns":60000000,"apply_latency_ns":60000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Feb 9 08:34:30 2024","interfaces":[{"interface":"back","average":{"1min":13.795,"5min":19.091000000000001,"15min":26.939},"min":{"1min":5.9130000000000003,"5min":4.306,"15min":4.306},"max":{"1min":45.713000000000001,"5min":119.645,"15min":305.28699999999998},"last":9.7490000000000006},{"interface":"front","average":{"1min":25.221,"5min":25.786999999999999,"15min":37.503999999999998},"min":{"1min":7.8170000000000002,"5min":6.3170000000000002,"15min":6.3170000000000002},"max":{"1min":213.21299999999999,"5min":229.71100000000001,"15min":409.27699999999999},"last":16.286999999999999}]},{"osd":2,"last update":"Fri Feb 9 08:33:53 2024","interfaces":[{"interface":"back","average":{"1min":8.4039999999999999,"5min":19.187999999999999,"15min":23.126000000000001},"min":{"1min":5.9379999999999997,"5min":5.6269999999999998,"15min":4.7439999999999998},"max":{"1min":16.463999999999999,"5min":170.73500000000001,"15min":391.44600000000003},"last":5.9649999999999999},{"interface":"front","average":{"1min":9.3409999999999993,"5min":22.885000000000002,"15min":25.742000000000001},"min":{"1min":5.4619999999999997,"5min":4.5469999999999997,"15min":4.5469999999999997},"max":{"1min":13.901999999999999,"5min":291.63200000000001,"15min":312.03899999999999},"last":8.1799999999999997}]},{"osd":3,"last update":"Fri Feb 9 08:34:40 2024","interfaces":[{"interface":"back","average":{"1min":20.146999999999998,"5min":23.992999999999999,"15min":39.951999999999998},"min":{"1min":9.1579999999999995,"5min":9.1579999999999995,"15min":8.391},"max":{"1min":65.817999999999998,"5min":188.982,"15min":464.74900000000002},"last":12.709},{"interface":"front","average":{"1min":24.324999999999999,"5min":29.202000000000002,"15min":46.600000000000001},"min":{"1min":14.225,"5min":11.369999999999999,"15min":10.288},"max":{"1min":66.498999999999995,"5min":191.452,"15min":472.88},"last":17.231999999999999}]},{"osd":4,"last update":"Fri Feb 9 08:34:40 2024","interfaces":[{"interface":"back","average":{"1min":30.094000000000001,"5min":26.760999999999999,"15min":42.034999999999997},"min":{"1min":12.295999999999999,"5min":10.787000000000001,"15min":6.9569999999999999},"max":{"1min":213.91499999999999,"5min":213.91499999999999,"15min":544.02800000000002},"last":13.366},{"interface":"front","average":{"1min":16.696999999999999,"5min":19.814,"15min":31.989000000000001},"min":{"1min":6.5010000000000003,"5min":6.5010000000000003,"15min":5.8869999999999996},"max":{"1min":93.179000000000002,"5min":206.73400000000001,"15min":377.84300000000002},"last":9.1460000000000008}]},{"osd":5,"last update":"Fri Feb 9 08:34:10 2024","interfaces":[{"interface":"back","average":{"1min":17.556999999999999,"5min":37.707999999999998,"15min":39.712000000000003},"min":{"1min":14.488,"5min":11.706,"15min":7.0730000000000004},"max":{"1min":21.827000000000002,"5min":363.94499999999999,"15min":432.82999999999998},"last":18.125},{"interface":"front","average":{"1min":11.15,"5min":28.911999999999999,"15min":41.231999999999999},"min":{"1min":7.3319999999999999,"5min":6.532,"15min":6.532},"max":{"1min":15.500999999999999,"5min":327.69499999999999,"15min":357.50999999999999},"last":14.010999999999999}]},{"osd":6,"last update":"Fri Feb 9 08:34:30 2024","interfaces":[{"interface":"back","average":{"1min":13.712999999999999,"5min":24.167000000000002,"15min":37.954000000000001},"min":{"1min":7.2910000000000004,"5min":7.2910000000000004,"15min":6.399},"max":{"1min":36.033999999999999,"5min":156.667,"15min":544.94200000000001},"last":11.486000000000001},{"interface":"front","average":{"1min":16.936,"5min":21.940000000000001,"15min":39.573999999999998},"min":{"1min":10.241,"5min":7.8369999999999997,"15min":7.8369999999999997},"max":{"1min":42.064999999999998,"5min":179.739,"15min":556.30200000000002},"last":14.625}]},{"osd":7,"last update":"Fri Feb 9 08:34:05 2024","interfaces":[{"interface":"back","average":{"1min":18.141999999999999,"5min":31.879999999999999,"15min":39.683999999999997},"min":{"1min":13.984,"5min":13.481,"15min":12.752000000000001},"max":{"1min":22.928000000000001,"5min":195.91499999999999,"15min":376.91800000000001},"last":19.088999999999999},{"interface":"front","average":{"1min":13.333,"5min":24.809999999999999,"15min":28.041},"min":{"1min":8.516,"5min":7.3310000000000004,"15min":7.0880000000000001},"max":{"1min":19.937999999999999,"5min":204.74199999999999,"15min":342.79300000000001},"last":12.305999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575228,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":75616,"kb_used_data":4180,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94296224,"statfs":{"total":96636764160,"available":96559333376,"internally_reserved":0,"allocated":4280320,"data_stored":1965730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":59,"apply_latency_ms":59,"commit_latency_ns":59000000,"apply_latency_ns":59000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 9 08:34:12 2024","interfaces":[{"interface":"back","average":{"1min":8.1720000000000006,"5min":15.773999999999999,"15min":23.449000000000002},"min":{"1min":4.9909999999999997,"5min":4.5490000000000004,"15min":4.4509999999999996},"max":{"1min":16.233000000000001,"5min":146.63499999999999,"15min":403.41699999999997},"last":10.782999999999999},{"interface":"front","average":{"1min":11.595000000000001,"5min":16.646000000000001,"15min":23.884},"min":{"1min":5.1130000000000004,"5min":4.7370000000000001,"15min":4.391},"max":{"1min":21.962,"5min":194.32300000000001,"15min":279.5},"last":8.3469999999999995}]},{"osd":1,"last update":"Fri Feb 9 08:33:49 2024","interfaces":[{"interface":"back","average":{"1min":8.6229999999999993,"5min":27.541,"15min":24.477},"min":{"1min":6.0750000000000002,"5min":5.6989999999999998,"15min":5.4550000000000001},"max":{"1min":14.645,"5min":303.23500000000001,"15min":303.23500000000001},"last":9.2010000000000005},{"interface":"front","average":{"1min":13.464,"5min":34.292000000000002,"15min":29.831},"min":{"1min":8.0449999999999999,"5min":7.3390000000000004,"15min":6.7709999999999999},"max":{"1min":17.835999999999999,"5min":294.35000000000002,"15min":294.35000000000002},"last":18.908999999999999}]},{"osd":2,"last update":"Fri Feb 9 08:34:32 2024","interfaces":[{"interface":"back","average":{"1min":25.158999999999999,"5min":24.327000000000002,"15min":28.507000000000001},"min":{"1min":7.7759999999999998,"5min":6.415,"15min":6.415},"max":{"1min":174.41999999999999,"5min":287.077,"15min":364.81400000000002},"last":18.245000000000001},{"interface":"front","average":{"1min":18.797999999999998,"5min":20.239999999999998,"15min":25.591999999999999},"min":{"1min":7.3109999999999999,"5min":7.3109999999999999,"15min":6.5540000000000003},"max":{"1min":128.667,"5min":176.416,"15min":339.12700000000001},"last":21.809999999999999}]},{"osd":3,"last update":"Fri Feb 9 08:34:32 2024","interfaces":[{"interface":"back","average":{"1min":29.274999999999999,"5min":27.763000000000002,"15min":34.323999999999998},"min":{"1min":8.1790000000000003,"5min":7.1130000000000004,"15min":7.1130000000000004},"max":{"1min":212.745,"5min":282.11000000000001,"15min":342.459},"last":17.446999999999999},{"interface":"front","average":{"1min":24.997,"5min":25.640000000000001,"15min":31.324999999999999},"min":{"1min":7.7409999999999997,"5min":7.234,"15min":6.7409999999999997},"max":{"1min":162.99600000000001,"5min":277.74700000000001,"15min":323.46899999999999},"last":27.866}]},{"osd":4,"last update":"Fri Feb 9 08:34:32 2024","interfaces":[{"interface":"back","average":{"1min":23.001999999999999,"5min":24.670000000000002,"15min":29.638000000000002},"min":{"1min":8.2539999999999996,"5min":7.0880000000000001,"15min":7.0880000000000001},"max":{"1min":188.62700000000001,"5min":223.655,"15min":336.74000000000001},"last":28.52},{"interface":"front","average":{"1min":23.012,"5min":22.286000000000001,"15min":28.931999999999999},"min":{"1min":8.3960000000000008,"5min":8.0030000000000001,"15min":7.4550000000000001},"max":{"1min":189.79499999999999,"5min":189.79499999999999,"15min":334.48500000000001},"last":22.901}]},{"osd":6,"last update":"Fri Feb 9 08:34:03 2024","interfaces":[{"interface":"back","average":{"1min":16.231000000000002,"5min":21.498999999999999,"15min":30.524999999999999},"min":{"1min":11.324999999999999,"5min":8.2799999999999994,"15min":7.742},"max":{"1min":24.632999999999999,"5min":144.80699999999999,"15min":320.85500000000002},"last":10.499000000000001},{"interface":"front","average":{"1min":18.751999999999999,"5min":24.975000000000001,"15min":33.936},"min":{"1min":12.034000000000001,"5min":11.550000000000001,"15min":10.789},"max":{"1min":25.568000000000001,"5min":188.28700000000001,"15min":411.56599999999997},"last":29.936}]},{"osd":7,"last update":"Fri Feb 9 08:34:03 2024","interfaces":[{"interface":"back","average":{"1min":14.823,"5min":23.667999999999999,"15min":27.585999999999999},"min":{"1min":8.2599999999999998,"5min":7.3650000000000002,"15min":7.3650000000000002},"max":{"1min":20.978000000000002,"5min":202.65100000000001,"15min":300.56200000000001},"last":26.533000000000001},{"interface":"front","average":{"1min":16.170000000000002,"5min":26.033000000000001,"15min":29.986999999999998},"min":{"1min":10.564,"5min":10.087999999999999,"15min":9.2189999999999994},"max":{"1min":23.199999999999999,"5min":187.536,"15min":194.726},"last":9.891}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-09T08:34:53.018 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-09T08:34:53.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.116+0000 7fb0e2a0f640 10 monclient: get_monmap_and_config 2024-02-09T08:34:53.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.116+0000 7fb0e2a0f640 10 monclient: build_initial_monmap 2024-02-09T08:34:53.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.116+0000 7fb0e2a0f640 10 monclient: monmap: 2024-02-09T08:34:53.119 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:34:53.119 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:53.119 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:34:53.117333+0000 2024-02-09T08:34:53.119 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:34:53.117333+0000 2024-02-09T08:34:53.119 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:34:53.119 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:53.119 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:34:53.119 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:34:53.119 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:34:53.119 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:34:53.119 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:34:53.119 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:53.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.116+0000 7fb0e2a0f640 1 Processor -- start 2024-02-09T08:34:53.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.117+0000 7fb0e2a0f640 1 -- start start 2024-02-09T08:34:53.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.117+0000 7fb0e2a0f640 10 monclient: init 2024-02-09T08:34:53.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.117+0000 7fb0e2a0f640 10 monclient: _reopen_session rank -1 2024-02-09T08:34:53.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.117+0000 7fb0e2a0f640 10 monclient: _add_conns ranks=[1,0,2,4,3] 2024-02-09T08:34:53.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.117+0000 7fb0e2a0f640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb0dc0b5000 addr v1:172.21.15.103:6789/0 2024-02-09T08:34:53.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.117+0000 7fb0e2a0f640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb0dc0a9e30 addr v1:172.21.15.62:6789/0 2024-02-09T08:34:53.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.117+0000 7fb0e2a0f640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb0dc13fdf0 0x7fb0dc1464f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:53.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.117+0000 7fb0e2a0f640 10 monclient(hunting): picked mon.noname-b con 0x7fb0dc13fdf0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:34:53.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.117+0000 7fb0e2a0f640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0dc0aa4a0 con 0x7fb0dc0a9e30 2024-02-09T08:34:53.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.117+0000 7fb0e2a0f640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0dc0b2900 con 0x7fb0dc0b5000 2024-02-09T08:34:53.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.117+0000 7fb0e2a0f640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:53.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.117+0000 7fb0e2a0f640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0dc0b53e0 con 0x7fb0dc13fdf0 2024-02-09T08:34:53.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.117+0000 7fb0e2a0f640 10 monclient(hunting): _renew_subs 2024-02-09T08:34:53.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.117+0000 7fb0e2a0f640 10 monclient(hunting): authenticate will time out at 3336.477863s 2024-02-09T08:34:53.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.118+0000 7fb0dbfff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fb0dc0b5000 0x7fb0dc13f6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.62:46434/0 (socket says 172.21.15.62:46434) 2024-02-09T08:34:53.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.118+0000 7fb0dbfff640 1 -- 172.21.15.62:0/1249754861 learned_addr learned my addr 172.21.15.62:0/1249754861 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-09T08:34:53.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.118+0000 7fb0e0fac640 1 --2- 172.21.15.62:0/1249754861 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb0dc13fdf0 0x7fb0dc1464f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:53.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.119+0000 7fb0e0fac640 10 monclient(hunting): get_auth_request con 0x7fb0dc13fdf0 auth_method 0 2024-02-09T08:34:53.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.119+0000 7fb0e0fac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:53.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.119+0000 7fb0e0fac640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:53.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.119+0000 7fb0e0fac640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:53.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.119+0000 7fb0e0fac640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:53.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.119+0000 7fb0e0fac640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:53.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.119+0000 7fb0e0fac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:53.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.120+0000 7fb0daffd640 1 -- 172.21.15.62:0/1249754861 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 660488819 0 0) 0x7fb0dc0b2900 con 0x7fb0dc0b5000 2024-02-09T08:34:53.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.120+0000 7fb0daffd640 10 monclient(hunting): _negotiate 2024-02-09T08:34:53.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.120+0000 7fb0daffd640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:53.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.120+0000 7fb0daffd640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:53.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.120+0000 7fb0daffd640 10 monclient(hunting): my global_id is 22279 2024-02-09T08:34:53.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.120+0000 7fb0daffd640 1 -- 172.21.15.62:0/1249754861 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0c4003520 con 0x7fb0dc0b5000 2024-02-09T08:34:53.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.121+0000 7fb0e0fac640 10 monclient(hunting): handle_auth_done global_id 18578 payload 274 2024-02-09T08:34:53.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.121+0000 7fb0e0fac640 1 -- 172.21.15.62:0/1249754861 >> v1:172.21.15.103:6789/0 conn(0x7fb0dc0b5000 legacy=0x7fb0dc13f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:53.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.121+0000 7fb0e0fac640 1 -- 172.21.15.62:0/1249754861 >> v1:172.21.15.62:6789/0 conn(0x7fb0dc0a9e30 legacy=0x7fb0dc145de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:34:53.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.121+0000 7fb0e0fac640 10 monclient: _finish_hunting 0 2024-02-09T08:34:53.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.121+0000 7fb0e0fac640 1 monclient: found mon.noname-b 2024-02-09T08:34:53.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.121+0000 7fb0e0fac640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:34:53.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.121+0000 7fb0e0fac640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.62:3301/0 2024-02-09T08:34:53.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.121+0000 7fb0e0fac640 1 -- 172.21.15.62:0/1249754861 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0dc0ab5f0 con 0x7fb0dc13fdf0 2024-02-09T08:34:53.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.123+0000 7fb0e0fac640 1 --2- 172.21.15.62:0/1249754861 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb0dc13fdf0 0x7fb0dc1464f0 secure :-1 s=READY pgs=3193 cs=0 l=1 rev1=1 crypto rx=0x7fb0d4009dc0 tx=0x7fb0d402be00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21c0c0e5646d971d server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:34:53.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.128+0000 7fb0daffd640 1 -- 172.21.15.62:0/1249754861 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d402cbb0 con 0x7fb0dc13fdf0 2024-02-09T08:34:53.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.128+0000 7fb0daffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:53.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.128+0000 7fb0daffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:34:53.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.128+0000 7fb0daffd640 10 monclient: dump: 2024-02-09T08:34:53.131 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:53.131 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:53.131 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:53.131 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:53.131 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:53.131 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:53.131 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:53.131 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:53.131 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:53.131 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:53.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.128+0000 7fb0daffd640 10 monclient: _finish_auth 0 2024-02-09T08:34:53.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.128+0000 7fb0daffd640 10 monclient: _check_auth_tickets 2024-02-09T08:34:53.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.128+0000 7fb0daffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:34:53.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.128+0000 7fb0daffd640 1 -- 172.21.15.62:0/1249754861 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d402cd10 con 0x7fb0dc13fdf0 2024-02-09T08:34:53.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.128+0000 7fb0e2a0f640 5 monclient: authenticate success, global_id 18578 2024-02-09T08:34:53.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.128+0000 7fb0e2a0f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-02-09T08:34:53.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.128+0000 7fb0daffd640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:34:53.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.128+0000 7fb0e2a0f640 10 monclient: get_monmap_and_config success 2024-02-09T08:34:53.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.128+0000 7fb0e2a0f640 4 set_mon_vals no callback set 2024-02-09T08:34:53.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.128+0000 7fb0daffd640 1 -- 172.21.15.62:0/1249754861 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d4034660 con 0x7fb0dc13fdf0 2024-02-09T08:34:53.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.128+0000 7fb0daffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:53.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.128+0000 7fb0daffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-09T08:34:53.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.128+0000 7fb0daffd640 10 monclient: dump: 2024-02-09T08:34:53.132 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:53.133 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:53.133 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:53.133 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:53.133 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:53.133 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:53.133 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:53.133 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:53.133 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:53.133 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:53.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.129+0000 7fb0e2a0f640 10 monclient: shutdown 2024-02-09T08:34:53.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.129+0000 7fb0e2a0f640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:34:53.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.129+0000 7fb0e2a0f640 1 -- 172.21.15.62:0/1249754861 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb0dc13fdf0 msgr2=0x7fb0dc1464f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:53.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.129+0000 7fb0e2a0f640 1 --2- 172.21.15.62:0/1249754861 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb0dc13fdf0 0x7fb0dc1464f0 secure :-1 s=READY pgs=3193 cs=0 l=1 rev1=1 crypto rx=0x7fb0d4009dc0 tx=0x7fb0d402be00 comp rx=0 tx=0).stop 2024-02-09T08:34:53.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.129+0000 7fb0e2a0f640 1 -- 172.21.15.62:0/1249754861 shutdown_connections 2024-02-09T08:34:53.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.129+0000 7fb0e2a0f640 1 --2- 172.21.15.62:0/1249754861 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb0dc13fdf0 0x7fb0dc1464f0 unknown :-1 s=CLOSED pgs=3193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:53.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.129+0000 7fb0e2a0f640 1 -- 172.21.15.62:0/1249754861 >> 172.21.15.62:0/1249754861 conn(0x7fb0dc066bb0 msgr2=0x7fb0dc066fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:34:53.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.129+0000 7fb0e2a0f640 1 -- 172.21.15.62:0/1249754861 shutdown_connections 2024-02-09T08:34:53.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.129+0000 7fb0e2a0f640 1 -- 172.21.15.62:0/1249754861 wait complete. 2024-02-09T08:34:53.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.130+0000 7fb0e2a0f640 10 monclient: build_initial_monmap 2024-02-09T08:34:53.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.130+0000 7fb0e2a0f640 10 monclient: monmap: 2024-02-09T08:34:53.137 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:34:53.138 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:34:53.138 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:34:53.138 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:34:53.138 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:34:53.138 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:53.138 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:34:53.138 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:34:53.138 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:34:53.138 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:53.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.130+0000 7fb0e2a0f640 1 librados: starting msgr at 2024-02-09T08:34:53.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.130+0000 7fb0e2a0f640 1 librados: starting objecter 2024-02-09T08:34:53.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.130+0000 7fb0e2a0f640 1 Processor -- start 2024-02-09T08:34:53.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.130+0000 7fb0e2a0f640 1 -- start start 2024-02-09T08:34:53.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.130+0000 7fb0e2a0f640 1 librados: setting wanted keys 2024-02-09T08:34:53.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.130+0000 7fb0e2a0f640 1 librados: calling monclient init 2024-02-09T08:34:53.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.130+0000 7fb0e2a0f640 10 monclient: init 2024-02-09T08:34:53.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.131+0000 7fb0e2a0f640 10 monclient: _reopen_session rank -1 2024-02-09T08:34:53.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.131+0000 7fb0e2a0f640 10 monclient: _add_conns ranks=[1,0,2] 2024-02-09T08:34:53.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.131+0000 7fb0e2a0f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0dc0a9e30 0x7fb0dc13c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:53.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.131+0000 7fb0e2a0f640 10 monclient(hunting): picked mon.noname-b con 0x7fb0dc0a9e30 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:34:53.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.131+0000 7fb0e2a0f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0dc0b5000 0x7fb0dc142220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:53.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.131+0000 7fb0e2a0f640 10 monclient(hunting): picked mon.noname-a con 0x7fb0dc0b5000 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:34:53.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.131+0000 7fb0e2a0f640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb0dc13fdf0 0x7fb0dc142760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:53.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.131+0000 7fb0e2a0f640 10 monclient(hunting): picked mon.noname-c con 0x7fb0dc13fdf0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:34:53.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.131+0000 7fb0e2a0f640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:53.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.131+0000 7fb0e2a0f640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0dc1417b0 con 0x7fb0dc0b5000 2024-02-09T08:34:53.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.131+0000 7fb0e2a0f640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:53.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.131+0000 7fb0e2a0f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0dc141a90 con 0x7fb0dc0a9e30 2024-02-09T08:34:53.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.131+0000 7fb0e2a0f640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:53.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.131+0000 7fb0e2a0f640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0dc140460 con 0x7fb0dc13fdf0 2024-02-09T08:34:53.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.131+0000 7fb0e2a0f640 10 monclient(hunting): _renew_subs 2024-02-09T08:34:53.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.131+0000 7fb0e2a0f640 10 monclient(hunting): authenticate will time out at 3336.491631s 2024-02-09T08:34:53.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.131+0000 7fb0db7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0dc0b5000 0x7fb0dc142220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:53.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.131+0000 7fb0e0fac640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb0dc13fdf0 0x7fb0dc142760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:53.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.132+0000 7fb0dbfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0dc0a9e30 0x7fb0dc13c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:53.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.132+0000 7fb0dbfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0dc0a9e30 0x7fb0dc13c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.62:51904/0 (socket says 172.21.15.62:51904) 2024-02-09T08:34:53.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.132+0000 7fb0dbfff640 1 -- 172.21.15.62:0/1601788695 learned_addr learned my addr 172.21.15.62:0/1601788695 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:34:53.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.132+0000 7fb0dbfff640 10 monclient(hunting): get_auth_request con 0x7fb0dc0a9e30 auth_method 0 2024-02-09T08:34:53.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.132+0000 7fb0dbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:53.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.132+0000 7fb0dbfff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:53.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.132+0000 7fb0dbfff640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:53.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.132+0000 7fb0e0fac640 10 monclient(hunting): get_auth_request con 0x7fb0dc13fdf0 auth_method 0 2024-02-09T08:34:53.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.132+0000 7fb0e0fac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:53.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.132+0000 7fb0e0fac640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:53.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.132+0000 7fb0e0fac640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:53.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.132+0000 7fb0db7fe640 10 monclient(hunting): get_auth_request con 0x7fb0dc0b5000 auth_method 0 2024-02-09T08:34:53.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.132+0000 7fb0db7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:53.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.132+0000 7fb0db7fe640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:53.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.132+0000 7fb0db7fe640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:53.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.132+0000 7fb0dbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:53.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.132+0000 7fb0dbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:53.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.132+0000 7fb0dbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:53.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.132+0000 7fb0e0fac640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:53.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.132+0000 7fb0e0fac640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:53.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.133+0000 7fb0e0fac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:53.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.133+0000 7fb0db7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:53.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.133+0000 7fb0db7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:53.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.133+0000 7fb0db7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:53.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.135+0000 7fb0dbfff640 10 monclient(hunting): handle_auth_done global_id 22282 payload 824 2024-02-09T08:34:53.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.135+0000 7fb0dbfff640 1 -- 172.21.15.62:0/1601788695 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb0dc13fdf0 msgr2=0x7fb0dc142760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:53.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.135+0000 7fb0dbfff640 1 --2- 172.21.15.62:0/1601788695 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb0dc13fdf0 0x7fb0dc142760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:53.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.135+0000 7fb0dbfff640 1 -- 172.21.15.62:0/1601788695 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0dc0b5000 msgr2=0x7fb0dc142220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:53.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.135+0000 7fb0dbfff640 1 --2- 172.21.15.62:0/1601788695 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0dc0b5000 0x7fb0dc142220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:53.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.135+0000 7fb0dbfff640 10 monclient: _finish_hunting 0 2024-02-09T08:34:53.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.135+0000 7fb0dbfff640 1 monclient: found mon.noname-b 2024-02-09T08:34:53.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.135+0000 7fb0dbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:34:53.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.135+0000 7fb0dbfff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.103:3300/0 2024-02-09T08:34:53.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.135+0000 7fb0dbfff640 1 -- 172.21.15.62:0/1601788695 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d4009a70 con 0x7fb0dc0a9e30 2024-02-09T08:34:53.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.137+0000 7fb0dbfff640 1 --2- 172.21.15.62:0/1601788695 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0dc0a9e30 0x7fb0dc13c850 secure :-1 s=READY pgs=5652 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc00c430 tx=0x7fb0cc00c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:34:53.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.137+0000 7fb0d8ff9640 10 client.?.objecter ms_handle_connect 0x7fb0dc0a9e30 2024-02-09T08:34:53.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.137+0000 7fb0d8ff9640 10 client.?.objecter resend_mon_ops 2024-02-09T08:34:53.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.141+0000 7fb0d8ff9640 1 -- 172.21.15.62:0/1601788695 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc005ce0 con 0x7fb0dc0a9e30 2024-02-09T08:34:53.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.141+0000 7fb0d8ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:53.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.141+0000 7fb0d8ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:34:53.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.141+0000 7fb0d8ff9640 10 monclient: dump: 2024-02-09T08:34:53.145 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:53.145 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:53.145 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:53.145 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:53.145 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:53.145 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:53.145 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:53.145 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:53.145 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:53.145 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:53.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.141+0000 7fb0d8ff9640 10 monclient: _finish_auth 0 2024-02-09T08:34:53.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.141+0000 7fb0d8ff9640 10 monclient: _check_auth_tickets 2024-02-09T08:34:53.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.141+0000 7fb0d8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:34:53.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.141+0000 7fb0d8ff9640 1 -- 172.21.15.62:0/1601788695 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0cc005e40 con 0x7fb0dc0a9e30 2024-02-09T08:34:53.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.141+0000 7fb0d8ff9640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:34:53.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.141+0000 7fb0d8ff9640 1 -- 172.21.15.62:0/1601788695 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc0072f0 con 0x7fb0dc0a9e30 2024-02-09T08:34:53.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.141+0000 7fb0e2a0f640 5 monclient: authenticate success, global_id 22282 2024-02-09T08:34:53.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.141+0000 7fb0e2a0f640 10 monclient: _renew_subs 2024-02-09T08:34:53.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.141+0000 7fb0e2a0f640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:34:53.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.141+0000 7fb0e2a0f640 1 -- 172.21.15.62:0/1601788695 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0dc12d000 con 0x7fb0dc0a9e30 2024-02-09T08:34:53.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.141+0000 7fb0d8ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:53.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.141+0000 7fb0d8ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:34:53.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.141+0000 7fb0d8ff9640 10 monclient: dump: 2024-02-09T08:34:53.147 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:53.147 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:53.147 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:53.147 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:53.147 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:53.147 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:53.147 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:53.147 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:53.147 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:53.147 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:53.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.141+0000 7fb0da7fc640 4 set_mon_vals no callback set 2024-02-09T08:34:53.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.141+0000 7fb0e2a0f640 10 client.22282.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:34:53.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.141+0000 7fb0e2a0f640 10 monclient: _renew_subs 2024-02-09T08:34:53.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.141+0000 7fb0e2a0f640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:34:53.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.141+0000 7fb0e2a0f640 1 -- 172.21.15.62:0/1601788695 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0dc12d510 con 0x7fb0dc0a9e30 2024-02-09T08:34:53.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.141+0000 7fb0e2a0f640 1 librados: init done 2024-02-09T08:34:53.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.142+0000 7fb0e2a0f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:34:53.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.142+0000 7fb0e2a0f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:34:53.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.142+0000 7fb0e2a0f640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:34:53.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.142+0000 7fb0e2a0f640 1 -- 172.21.15.62:0/1601788695 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0dc1402c0 con 0x7fb0dc0a9e30 2024-02-09T08:34:53.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.161+0000 7fb0d8ff9640 1 -- 172.21.15.62:0/1601788695 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fb0cc007450 con 0x7fb0dc0a9e30 2024-02-09T08:34:53.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.161+0000 7fb0d8ff9640 1 --2- 172.21.15.62:0/1601788695 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fb0c806d1a0 0x7fb0c806f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:53.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.161+0000 7fb0db7fe640 1 --2- 172.21.15.62:0/1601788695 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fb0c806d1a0 0x7fb0c806f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:53.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.161+0000 7fb0db7fe640 10 monclient: get_auth_request con 0x7fb0c806d1a0 auth_method 0 2024-02-09T08:34:53.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.162+0000 7fb0db7fe640 1 --2- 172.21.15.62:0/1601788695 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fb0c806d1a0 0x7fb0c806f660 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc067000 tx=0x7fb0d0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:34:53.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.162+0000 7fb0d8ff9640 10 client.22282.objecter ms_handle_connect 0x7fb0c806d1a0 2024-02-09T08:34:53.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.163+0000 7fb0d8ff9640 1 -- 172.21.15.62:0/1601788695 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(1269..1269 src has 1104..1269) v4 ==== 6381+0+0 (secure 0 0 0) 0x7fb0cc058300 con 0x7fb0dc0a9e30 2024-02-09T08:34:53.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.163+0000 7fb0d8ff9640 10 client.22282.objecter ms_dispatch 0x7fb0dc000b90 osd_map(1269..1269 src has 1104..1269) v4 2024-02-09T08:34:53.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.163+0000 7fb0d8ff9640 3 client.22282.objecter handle_osd_map got epochs [1269,1269] > 0 2024-02-09T08:34:53.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.163+0000 7fb0d8ff9640 3 client.22282.objecter handle_osd_map decoding full epoch 1269 2024-02-09T08:34:53.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.163+0000 7fb0d8ff9640 20 client.22282.objecter dump_active .. 0 homeless 2024-02-09T08:34:53.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.400+0000 7fb0d8ff9640 1 -- 172.21.15.62:0/1601788695 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb0cc0545a0 con 0x7fb0dc0a9e30 2024-02-09T08:34:53.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.400+0000 7fb0d8ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:34:53.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.400+0000 7fb0d8ff9640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:34:53.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.577+0000 7fb0e2a0f640 1 -- 172.21.15.62:0/1601788695 --> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb0dc1402c0 con 0x7fb0c806d1a0 2024-02-09T08:34:53.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.582+0000 7fb0d8ff9640 1 -- 172.21.15.62:0/1601788695 <== mgr.4109 v2:172.21.15.103:6800/2270392189 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+151938 (secure 0 0 0) 0x7fb0dc1402c0 con 0x7fb0c806d1a0 2024-02-09T08:34:53.586 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T08:34:53.586 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-02-09T08:34:53.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.584+0000 7fb0e2a0f640 10 librados: watch_flush enter 2024-02-09T08:34:53.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.584+0000 7fb0e2a0f640 10 librados: watch_flush exit 2024-02-09T08:34:53.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.584+0000 7fb0e2a0f640 20 client.22282.objecter shutdown clearing up homeless session... 2024-02-09T08:34:53.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.584+0000 7fb0e2a0f640 10 client.22282.objecter successfully canceled tick 2024-02-09T08:34:53.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.584+0000 7fb0e2a0f640 1 -- 172.21.15.62:0/1601788695 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fb0c806d1a0 msgr2=0x7fb0c806f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:53.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.584+0000 7fb0e2a0f640 1 --2- 172.21.15.62:0/1601788695 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fb0c806d1a0 0x7fb0c806f660 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc067000 tx=0x7fb0d0009040 comp rx=0 tx=0).stop 2024-02-09T08:34:53.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.584+0000 7fb0e2a0f640 10 monclient: shutdown 2024-02-09T08:34:53.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.584+0000 7fb0e2a0f640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:34:53.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.584+0000 7fb0e2a0f640 1 -- 172.21.15.62:0/1601788695 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0dc0a9e30 msgr2=0x7fb0dc13c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:53.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.584+0000 7fb0e2a0f640 1 --2- 172.21.15.62:0/1601788695 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0dc0a9e30 0x7fb0dc13c850 secure :-1 s=READY pgs=5652 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc00c430 tx=0x7fb0cc00c8f0 comp rx=0 tx=0).stop 2024-02-09T08:34:53.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.584+0000 7fb0e2a0f640 1 -- 172.21.15.62:0/1601788695 shutdown_connections 2024-02-09T08:34:53.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.584+0000 7fb0e2a0f640 1 --2- 172.21.15.62:0/1601788695 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fb0c806d1a0 0x7fb0c806f660 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:53.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.584+0000 7fb0e2a0f640 1 --2- 172.21.15.62:0/1601788695 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb0dc13fdf0 0x7fb0dc142760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:53.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.584+0000 7fb0e2a0f640 1 --2- 172.21.15.62:0/1601788695 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0dc0b5000 0x7fb0dc142220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:53.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.584+0000 7fb0e2a0f640 1 --2- 172.21.15.62:0/1601788695 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0dc0a9e30 0x7fb0dc13c850 unknown :-1 s=CLOSED pgs=5652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:53.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.584+0000 7fb0e2a0f640 1 -- 172.21.15.62:0/1601788695 >> 172.21.15.62:0/1601788695 conn(0x7fb0dc066bb0 msgr2=0x7fb0dc0b6630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:34:53.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.584+0000 7fb0e2a0f640 1 -- 172.21.15.62:0/1601788695 shutdown_connections 2024-02-09T08:34:53.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.584+0000 7fb0e2a0f640 1 -- 172.21.15.62:0/1601788695 wait complete. 2024-02-09T08:34:53.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.584+0000 7fb0e2a0f640 1 librados: shutdown 2024-02-09T08:34:53.598 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":2232,"stamp":"2024-02-09T08:34:52.519206+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459285,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":88,"num_write":120,"num_write_kb":1379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":128,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":565412,"kb_used_data":31360,"kb_used_omap":12,"kb_used_meta":533939,"kb_avail":754409308,"statfs":{"total":773094113280,"available":772515131392,"internally_reserved":0,"allocated":32112640,"data_stored":13482614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":546754096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,1],"upper_bound":2048},"perf_stat":{"commit_latency_ms":391,"apply_latency_ms":391,"commit_latency_ns":391000000,"apply_latency_ns":391000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000755"},"pg_stats":[{"pgid":"11.1b","version":"0'0","reported_seq":2411,"reported_epoch":1267,"state":"active+clean","last_fresh":"2024-02-09T08:34:50.768338+0000","last_change":"2024-02-09T08:04:33.526805+0000","last_active":"2024-02-09T08:34:50.768338+0000","last_peered":"2024-02-09T08:34:50.768338+0000","last_clean":"2024-02-09T08:34:50.768338+0000","last_became_active":"2024-02-09T08:04:33.521240+0000","last_became_peered":"2024-02-09T08:04:33.521240+0000","last_unstale":"2024-02-09T08:34:50.768338+0000","last_undegraded":"2024-02-09T08:34:50.768338+0000","last_fullsized":"2024-02-09T08:34:50.768338+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T13:43:13.359953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":2421,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.277407+0000","last_change":"2024-02-09T08:04:40.805290+0000","last_active":"2024-02-09T08:34:47.277407+0000","last_peered":"2024-02-09T08:34:47.277407+0000","last_clean":"2024-02-09T08:34:47.277407+0000","last_became_active":"2024-02-09T08:04:40.657553+0000","last_became_peered":"2024-02-09T08:04:40.657553+0000","last_unstale":"2024-02-09T08:34:47.277407+0000","last_undegraded":"2024-02-09T08:34:47.277407+0000","last_fullsized":"2024-02-09T08:34:47.277407+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T10:06:50.567240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":2420,"reported_epoch":1265,"state":"active+clean","last_fresh":"2024-02-09T08:34:48.279837+0000","last_change":"2024-02-09T08:04:36.602734+0000","last_active":"2024-02-09T08:34:48.279837+0000","last_peered":"2024-02-09T08:34:48.279837+0000","last_clean":"2024-02-09T08:34:48.279837+0000","last_became_active":"2024-02-09T08:04:36.596835+0000","last_became_peered":"2024-02-09T08:04:36.596835+0000","last_unstale":"2024-02-09T08:34:48.279837+0000","last_undegraded":"2024-02-09T08:34:48.279837+0000","last_fullsized":"2024-02-09T08:34:48.279837+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T16:22:37.194403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":2434,"reported_epoch":1269,"state":"active+clean","last_fresh":"2024-02-09T08:34:51.900546+0000","last_change":"2024-02-09T08:05:00.789599+0000","last_active":"2024-02-09T08:34:51.900546+0000","last_peered":"2024-02-09T08:34:51.900546+0000","last_clean":"2024-02-09T08:34:51.900546+0000","last_became_active":"2024-02-09T08:05:00.783372+0000","last_became_peered":"2024-02-09T08:05:00.783372+0000","last_unstale":"2024-02-09T08:34:51.900546+0000","last_undegraded":"2024-02-09T08:34:51.900546+0000","last_fullsized":"2024-02-09T08:34:51.900546+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T19:04:41.775337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":2399,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.177779+0000","last_change":"2024-02-09T08:04:29.148658+0000","last_active":"2024-02-09T08:34:47.177779+0000","last_peered":"2024-02-09T08:34:47.177779+0000","last_clean":"2024-02-09T08:34:47.177779+0000","last_became_active":"2024-02-09T08:04:29.124225+0000","last_became_peered":"2024-02-09T08:04:29.124225+0000","last_unstale":"2024-02-09T08:34:47.177779+0000","last_undegraded":"2024-02-09T08:34:47.177779+0000","last_fullsized":"2024-02-09T08:34:47.177779+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T18:44:18.668955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":2431,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.221854+0000","last_change":"2024-02-09T08:04:39.748237+0000","last_active":"2024-02-09T08:34:47.221854+0000","last_peered":"2024-02-09T08:34:47.221854+0000","last_clean":"2024-02-09T08:34:47.221854+0000","last_became_active":"2024-02-09T08:04:39.743089+0000","last_became_peered":"2024-02-09T08:04:39.743089+0000","last_unstale":"2024-02-09T08:34:47.221854+0000","last_undegraded":"2024-02-09T08:34:47.221854+0000","last_fullsized":"2024-02-09T08:34:47.221854+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T12:00:51.961215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":2396,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.164239+0000","last_change":"2024-02-09T08:05:03.172587+0000","last_active":"2024-02-09T08:34:47.164239+0000","last_peered":"2024-02-09T08:34:47.164239+0000","last_clean":"2024-02-09T08:34:47.164239+0000","last_became_active":"2024-02-09T08:05:03.159711+0000","last_became_peered":"2024-02-09T08:05:03.159711+0000","last_unstale":"2024-02-09T08:34:47.164239+0000","last_undegraded":"2024-02-09T08:34:47.164239+0000","last_fullsized":"2024-02-09T08:34:47.164239+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T10:00:55.530401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":2405,"reported_epoch":1267,"state":"active+clean","last_fresh":"2024-02-09T08:34:50.375834+0000","last_change":"2024-02-09T08:04:30.076390+0000","last_active":"2024-02-09T08:34:50.375834+0000","last_peered":"2024-02-09T08:34:50.375834+0000","last_clean":"2024-02-09T08:34:50.375834+0000","last_became_active":"2024-02-09T08:04:30.066772+0000","last_became_peered":"2024-02-09T08:04:30.066772+0000","last_unstale":"2024-02-09T08:34:50.375834+0000","last_undegraded":"2024-02-09T08:34:50.375834+0000","last_fullsized":"2024-02-09T08:34:50.375834+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T10:57:11.649889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":2423,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.346591+0000","last_change":"2024-02-09T08:04:53.183149+0000","last_active":"2024-02-09T08:34:47.346591+0000","last_peered":"2024-02-09T08:34:47.346591+0000","last_clean":"2024-02-09T08:34:47.346591+0000","last_became_active":"2024-02-09T08:04:53.127636+0000","last_became_peered":"2024-02-09T08:04:53.127636+0000","last_unstale":"2024-02-09T08:34:47.346591+0000","last_undegraded":"2024-02-09T08:34:47.346591+0000","last_fullsized":"2024-02-09T08:34:47.346591+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T15:08:17.048446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":2428,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.207122+0000","last_change":"2024-02-09T08:04:56.560292+0000","last_active":"2024-02-09T08:34:47.207122+0000","last_peered":"2024-02-09T08:34:47.207122+0000","last_clean":"2024-02-09T08:34:47.207122+0000","last_became_active":"2024-02-09T08:04:56.548820+0000","last_became_peered":"2024-02-09T08:04:56.548820+0000","last_unstale":"2024-02-09T08:34:47.207122+0000","last_undegraded":"2024-02-09T08:34:47.207122+0000","last_fullsized":"2024-02-09T08:34:47.207122+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T10:03:15.435898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1","version":"41'7","reported_seq":2418,"reported_epoch":1267,"state":"active+clean","last_fresh":"2024-02-09T08:34:50.367021+0000","last_change":"2024-02-09T08:04:23.177797+0000","last_active":"2024-02-09T08:34:50.367021+0000","last_peered":"2024-02-09T08:34:50.367021+0000","last_clean":"2024-02-09T08:34:50.367021+0000","last_became_active":"2024-02-09T08:04:23.166119+0000","last_became_peered":"2024-02-09T08:04:23.166119+0000","last_unstale":"2024-02-09T08:34:50.367021+0000","last_undegraded":"2024-02-09T08:34:50.367021+0000","last_fullsized":"2024-02-09T08:34:50.367021+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T09:43:59.773830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":2437,"reported_epoch":1269,"state":"active+clean","last_fresh":"2024-02-09T08:34:51.902866+0000","last_change":"2024-02-09T08:05:03.863540+0000","last_active":"2024-02-09T08:34:51.902866+0000","last_peered":"2024-02-09T08:34:51.902866+0000","last_clean":"2024-02-09T08:34:51.902866+0000","last_became_active":"2024-02-09T08:05:03.857816+0000","last_became_peered":"2024-02-09T08:05:03.857816+0000","last_unstale":"2024-02-09T08:34:51.902866+0000","last_undegraded":"2024-02-09T08:34:51.902866+0000","last_fullsized":"2024-02-09T08:34:51.902866+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T16:34:58.345644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":2431,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.206152+0000","last_change":"2024-02-09T08:04:23.020050+0000","last_active":"2024-02-09T08:34:47.206152+0000","last_peered":"2024-02-09T08:34:47.206152+0000","last_clean":"2024-02-09T08:34:47.206152+0000","last_became_active":"2024-02-09T08:04:23.007209+0000","last_became_peered":"2024-02-09T08:04:23.007209+0000","last_unstale":"2024-02-09T08:34:47.206152+0000","last_undegraded":"2024-02-09T08:34:47.206152+0000","last_fullsized":"2024-02-09T08:34:47.206152+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T14:15:50.318219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"21'76","reported_seq":2533,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.134491+0000","last_change":"2024-02-09T08:02:58.788272+0000","last_active":"2024-02-09T08:34:47.134491+0000","last_peered":"2024-02-09T08:34:47.134491+0000","last_clean":"2024-02-09T08:34:47.134491+0000","last_became_active":"2024-02-09T08:02:58.754736+0000","last_became_peered":"2024-02-09T08:02:58.754736+0000","last_unstale":"2024-02-09T08:34:47.134491+0000","last_undegraded":"2024-02-09T08:34:47.134491+0000","last_fullsized":"2024-02-09T08:34:47.134491+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:02:56.594120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:02:56.594120+0000","last_clean_scrub_stamp":"2024-02-09T08:02:56.594120+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T17:35:01.118117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":2436,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.349162+0000","last_change":"2024-02-09T08:03:12.939816+0000","last_active":"2024-02-09T08:34:47.349162+0000","last_peered":"2024-02-09T08:34:47.349162+0000","last_clean":"2024-02-09T08:34:47.349162+0000","last_became_active":"2024-02-09T08:03:12.934488+0000","last_became_peered":"2024-02-09T08:03:12.934488+0000","last_unstale":"2024-02-09T08:34:47.349162+0000","last_undegraded":"2024-02-09T08:34:47.349162+0000","last_fullsized":"2024-02-09T08:34:47.349162+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_clean_scrub_stamp":"2024-02-09T08:03:10.689497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T08:15:00.733484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":2422,"reported_epoch":1265,"state":"active+clean","last_fresh":"2024-02-09T08:34:48.281622+0000","last_change":"2024-02-09T08:04:34.779296+0000","last_active":"2024-02-09T08:34:48.281622+0000","last_peered":"2024-02-09T08:34:48.281622+0000","last_clean":"2024-02-09T08:34:48.281622+0000","last_became_active":"2024-02-09T08:04:34.763206+0000","last_became_peered":"2024-02-09T08:04:34.763206+0000","last_unstale":"2024-02-09T08:34:48.281622+0000","last_undegraded":"2024-02-09T08:34:48.281622+0000","last_fullsized":"2024-02-09T08:34:48.281622+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T14:34:34.410613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2436,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.230608+0000","last_change":"2024-02-09T08:03:12.238763+0000","last_active":"2024-02-09T08:34:47.230608+0000","last_peered":"2024-02-09T08:34:47.230608+0000","last_clean":"2024-02-09T08:34:47.230608+0000","last_became_active":"2024-02-09T08:03:12.210217+0000","last_became_peered":"2024-02-09T08:03:12.210217+0000","last_unstale":"2024-02-09T08:34:47.230608+0000","last_undegraded":"2024-02-09T08:34:47.230608+0000","last_fullsized":"2024-02-09T08:34:47.230608+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_clean_scrub_stamp":"2024-02-09T08:03:10.689497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T11:36:35.345417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":2436,"reported_epoch":1269,"state":"active+clean","last_fresh":"2024-02-09T08:34:51.905833+0000","last_change":"2024-02-09T08:04:28.955676+0000","last_active":"2024-02-09T08:34:51.905833+0000","last_peered":"2024-02-09T08:34:51.905833+0000","last_clean":"2024-02-09T08:34:51.905833+0000","last_became_active":"2024-02-09T08:04:28.937638+0000","last_became_peered":"2024-02-09T08:04:28.937638+0000","last_unstale":"2024-02-09T08:34:51.905833+0000","last_undegraded":"2024-02-09T08:34:51.905833+0000","last_fullsized":"2024-02-09T08:34:51.905833+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T15:59:25.543995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2459,"reported_epoch":1269,"state":"active+clean","last_fresh":"2024-02-09T08:34:51.772334+0000","last_change":"2024-02-09T08:03:12.225325+0000","last_active":"2024-02-09T08:34:51.772334+0000","last_peered":"2024-02-09T08:34:51.772334+0000","last_clean":"2024-02-09T08:34:51.772334+0000","last_became_active":"2024-02-09T08:03:12.197237+0000","last_became_peered":"2024-02-09T08:03:12.197237+0000","last_unstale":"2024-02-09T08:34:51.772334+0000","last_undegraded":"2024-02-09T08:34:51.772334+0000","last_fullsized":"2024-02-09T08:34:51.772334+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_clean_scrub_stamp":"2024-02-09T08:03:10.689497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T09:53:22.604814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":2435,"reported_epoch":1269,"state":"active+clean","last_fresh":"2024-02-09T08:34:51.922939+0000","last_change":"2024-02-09T08:04:32.150155+0000","last_active":"2024-02-09T08:34:51.922939+0000","last_peered":"2024-02-09T08:34:51.922939+0000","last_clean":"2024-02-09T08:34:51.922939+0000","last_became_active":"2024-02-09T08:04:32.135773+0000","last_became_peered":"2024-02-09T08:04:32.135773+0000","last_unstale":"2024-02-09T08:34:51.922939+0000","last_undegraded":"2024-02-09T08:34:51.922939+0000","last_fullsized":"2024-02-09T08:34:51.922939+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T09:48:06.205102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":2436,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.274817+0000","last_change":"2024-02-09T08:03:12.541068+0000","last_active":"2024-02-09T08:34:47.274817+0000","last_peered":"2024-02-09T08:34:47.274817+0000","last_clean":"2024-02-09T08:34:47.274817+0000","last_became_active":"2024-02-09T08:03:12.535306+0000","last_became_peered":"2024-02-09T08:03:12.535306+0000","last_unstale":"2024-02-09T08:34:47.274817+0000","last_undegraded":"2024-02-09T08:34:47.274817+0000","last_fullsized":"2024-02-09T08:34:47.274817+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_clean_scrub_stamp":"2024-02-09T08:03:10.689497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T16:45:31.048468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":2445,"reported_epoch":1269,"state":"active+clean","last_fresh":"2024-02-09T08:34:51.840790+0000","last_change":"2024-02-09T08:04:35.123806+0000","last_active":"2024-02-09T08:34:51.840790+0000","last_peered":"2024-02-09T08:34:51.840790+0000","last_clean":"2024-02-09T08:34:51.840790+0000","last_became_active":"2024-02-09T08:04:35.117349+0000","last_became_peered":"2024-02-09T08:04:35.117349+0000","last_unstale":"2024-02-09T08:34:51.840790+0000","last_undegraded":"2024-02-09T08:34:51.840790+0000","last_fullsized":"2024-02-09T08:34:51.840790+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T15:28:05.326270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2444,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.224445+0000","last_change":"2024-02-09T08:03:12.601407+0000","last_active":"2024-02-09T08:34:47.224445+0000","last_peered":"2024-02-09T08:34:47.224445+0000","last_clean":"2024-02-09T08:34:47.224445+0000","last_became_active":"2024-02-09T08:03:12.568245+0000","last_became_peered":"2024-02-09T08:03:12.568245+0000","last_unstale":"2024-02-09T08:34:47.224445+0000","last_undegraded":"2024-02-09T08:34:47.224445+0000","last_fullsized":"2024-02-09T08:34:47.224445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_clean_scrub_stamp":"2024-02-09T08:03:10.689497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T13:19:50.521695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":2445,"reported_epoch":1269,"state":"active+clean","last_fresh":"2024-02-09T08:34:51.848561+0000","last_change":"2024-02-09T08:04:21.999119+0000","last_active":"2024-02-09T08:34:51.848561+0000","last_peered":"2024-02-09T08:34:51.848561+0000","last_clean":"2024-02-09T08:34:51.848561+0000","last_became_active":"2024-02-09T08:04:21.984625+0000","last_became_peered":"2024-02-09T08:04:21.984625+0000","last_unstale":"2024-02-09T08:34:51.848561+0000","last_undegraded":"2024-02-09T08:34:51.848561+0000","last_fullsized":"2024-02-09T08:34:51.848561+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T17:50:19.443534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2436,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.361726+0000","last_change":"2024-02-09T08:03:12.390430+0000","last_active":"2024-02-09T08:34:47.361726+0000","last_peered":"2024-02-09T08:34:47.361726+0000","last_clean":"2024-02-09T08:34:47.361726+0000","last_became_active":"2024-02-09T08:03:12.385148+0000","last_became_peered":"2024-02-09T08:03:12.385148+0000","last_unstale":"2024-02-09T08:34:47.361726+0000","last_undegraded":"2024-02-09T08:34:47.361726+0000","last_fullsized":"2024-02-09T08:34:47.361726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_clean_scrub_stamp":"2024-02-09T08:03:10.689497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T10:48:39.909252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":2404,"reported_epoch":1267,"state":"active+clean","last_fresh":"2024-02-09T08:34:50.392308+0000","last_change":"2024-02-09T08:04:22.608389+0000","last_active":"2024-02-09T08:34:50.392308+0000","last_peered":"2024-02-09T08:34:50.392308+0000","last_clean":"2024-02-09T08:34:50.392308+0000","last_became_active":"2024-02-09T08:04:22.589664+0000","last_became_peered":"2024-02-09T08:04:22.589664+0000","last_unstale":"2024-02-09T08:34:50.392308+0000","last_undegraded":"2024-02-09T08:34:50.392308+0000","last_fullsized":"2024-02-09T08:34:50.392308+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T18:29:06.754589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2442,"reported_epoch":1265,"state":"active+clean","last_fresh":"2024-02-09T08:34:48.315688+0000","last_change":"2024-02-09T08:03:12.975632+0000","last_active":"2024-02-09T08:34:48.315688+0000","last_peered":"2024-02-09T08:34:48.315688+0000","last_clean":"2024-02-09T08:34:48.315688+0000","last_became_active":"2024-02-09T08:03:12.943786+0000","last_became_peered":"2024-02-09T08:03:12.943786+0000","last_unstale":"2024-02-09T08:34:48.315688+0000","last_undegraded":"2024-02-09T08:34:48.315688+0000","last_fullsized":"2024-02-09T08:34:48.315688+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_clean_scrub_stamp":"2024-02-09T08:03:10.689497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T14:17:25.431442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":2395,"reported_epoch":1267,"state":"active+clean","last_fresh":"2024-02-09T08:34:50.380645+0000","last_change":"2024-02-09T08:04:47.726395+0000","last_active":"2024-02-09T08:34:50.380645+0000","last_peered":"2024-02-09T08:34:50.380645+0000","last_clean":"2024-02-09T08:34:50.380645+0000","last_became_active":"2024-02-09T08:04:47.720072+0000","last_became_peered":"2024-02-09T08:04:47.720072+0000","last_unstale":"2024-02-09T08:34:50.380645+0000","last_undegraded":"2024-02-09T08:34:50.380645+0000","last_fullsized":"2024-02-09T08:34:50.380645+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T12:05:53.782672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2433,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.395872+0000","last_change":"2024-02-09T08:03:12.925399+0000","last_active":"2024-02-09T08:34:47.395872+0000","last_peered":"2024-02-09T08:34:47.395872+0000","last_clean":"2024-02-09T08:34:47.395872+0000","last_became_active":"2024-02-09T08:03:12.920012+0000","last_became_peered":"2024-02-09T08:03:12.920012+0000","last_unstale":"2024-02-09T08:34:47.395872+0000","last_undegraded":"2024-02-09T08:34:47.395872+0000","last_fullsized":"2024-02-09T08:34:47.395872+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_clean_scrub_stamp":"2024-02-09T08:03:10.689497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T10:28:21.672589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":2412,"reported_epoch":1267,"state":"active+clean","last_fresh":"2024-02-09T08:34:50.772552+0000","last_change":"2024-02-09T08:04:33.664545+0000","last_active":"2024-02-09T08:34:50.772552+0000","last_peered":"2024-02-09T08:34:50.772552+0000","last_clean":"2024-02-09T08:34:50.772552+0000","last_became_active":"2024-02-09T08:04:33.638587+0000","last_became_peered":"2024-02-09T08:04:33.638587+0000","last_unstale":"2024-02-09T08:34:50.772552+0000","last_undegraded":"2024-02-09T08:34:50.772552+0000","last_fullsized":"2024-02-09T08:34:50.772552+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T19:30:04.222018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":2393,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.156466+0000","last_change":"2024-02-09T08:04:31.512983+0000","last_active":"2024-02-09T08:34:47.156466+0000","last_peered":"2024-02-09T08:34:47.156466+0000","last_clean":"2024-02-09T08:34:47.156466+0000","last_became_active":"2024-02-09T08:04:31.384824+0000","last_became_peered":"2024-02-09T08:04:31.384824+0000","last_unstale":"2024-02-09T08:34:47.156466+0000","last_undegraded":"2024-02-09T08:34:47.156466+0000","last_fullsized":"2024-02-09T08:34:47.156466+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T11:51:59.447668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":2424,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.393134+0000","last_change":"2024-02-09T08:04:53.877017+0000","last_active":"2024-02-09T08:34:47.393134+0000","last_peered":"2024-02-09T08:34:47.393134+0000","last_clean":"2024-02-09T08:34:47.393134+0000","last_became_active":"2024-02-09T08:04:53.837629+0000","last_became_peered":"2024-02-09T08:04:53.837629+0000","last_unstale":"2024-02-09T08:34:47.393134+0000","last_undegraded":"2024-02-09T08:34:47.393134+0000","last_fullsized":"2024-02-09T08:34:47.393134+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T18:40:04.247361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":2446,"reported_epoch":1269,"state":"active+clean","last_fresh":"2024-02-09T08:34:51.894860+0000","last_change":"2024-02-09T08:04:21.302362+0000","last_active":"2024-02-09T08:34:51.894860+0000","last_peered":"2024-02-09T08:34:51.894860+0000","last_clean":"2024-02-09T08:34:51.894860+0000","last_became_active":"2024-02-09T08:04:21.282606+0000","last_became_peered":"2024-02-09T08:04:21.282606+0000","last_unstale":"2024-02-09T08:34:51.894860+0000","last_undegraded":"2024-02-09T08:34:51.894860+0000","last_fullsized":"2024-02-09T08:34:51.894860+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T19:16:17.460982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":2431,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.189233+0000","last_change":"2024-02-09T08:04:21.475042+0000","last_active":"2024-02-09T08:34:47.189233+0000","last_peered":"2024-02-09T08:34:47.189233+0000","last_clean":"2024-02-09T08:34:47.189233+0000","last_became_active":"2024-02-09T08:04:21.467958+0000","last_became_peered":"2024-02-09T08:04:21.467958+0000","last_unstale":"2024-02-09T08:34:47.189233+0000","last_undegraded":"2024-02-09T08:34:47.189233+0000","last_fullsized":"2024-02-09T08:34:47.189233+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T19:20:44.543943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":2445,"reported_epoch":1269,"state":"active+clean","last_fresh":"2024-02-09T08:34:51.770536+0000","last_change":"2024-02-09T08:04:20.693952+0000","last_active":"2024-02-09T08:34:51.770536+0000","last_peered":"2024-02-09T08:34:51.770536+0000","last_clean":"2024-02-09T08:34:51.770536+0000","last_became_active":"2024-02-09T08:04:20.679487+0000","last_became_peered":"2024-02-09T08:04:20.679487+0000","last_unstale":"2024-02-09T08:34:51.770536+0000","last_undegraded":"2024-02-09T08:34:51.770536+0000","last_fullsized":"2024-02-09T08:34:51.770536+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T19:30:24.161882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":2411,"reported_epoch":1267,"state":"active+clean","last_fresh":"2024-02-09T08:34:50.760222+0000","last_change":"2024-02-09T08:04:31.601293+0000","last_active":"2024-02-09T08:34:50.760222+0000","last_peered":"2024-02-09T08:34:50.760222+0000","last_clean":"2024-02-09T08:34:50.760222+0000","last_became_active":"2024-02-09T08:04:31.595670+0000","last_became_peered":"2024-02-09T08:04:31.595670+0000","last_unstale":"2024-02-09T08:34:50.760222+0000","last_undegraded":"2024-02-09T08:34:50.760222+0000","last_fullsized":"2024-02-09T08:34:50.760222+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T08:48:28.458262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":2404,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.149904+0000","last_change":"2024-02-09T08:04:41.266591+0000","last_active":"2024-02-09T08:34:47.149904+0000","last_peered":"2024-02-09T08:34:47.149904+0000","last_clean":"2024-02-09T08:34:47.149904+0000","last_became_active":"2024-02-09T08:04:41.259580+0000","last_became_peered":"2024-02-09T08:04:41.259580+0000","last_unstale":"2024-02-09T08:34:47.149904+0000","last_undegraded":"2024-02-09T08:34:47.149904+0000","last_fullsized":"2024-02-09T08:34:47.149904+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T11:13:46.788829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":2421,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.374779+0000","last_change":"2024-02-09T08:04:53.258518+0000","last_active":"2024-02-09T08:34:47.374779+0000","last_peered":"2024-02-09T08:34:47.374779+0000","last_clean":"2024-02-09T08:34:47.374779+0000","last_became_active":"2024-02-09T08:04:53.248695+0000","last_became_peered":"2024-02-09T08:04:53.248695+0000","last_unstale":"2024-02-09T08:34:47.374779+0000","last_undegraded":"2024-02-09T08:34:47.374779+0000","last_fullsized":"2024-02-09T08:34:47.374779+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T19:57:41.278249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":2429,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.218929+0000","last_change":"2024-02-09T08:04:39.731324+0000","last_active":"2024-02-09T08:34:47.218929+0000","last_peered":"2024-02-09T08:34:47.218929+0000","last_clean":"2024-02-09T08:34:47.218929+0000","last_became_active":"2024-02-09T08:04:39.726089+0000","last_became_peered":"2024-02-09T08:04:39.726089+0000","last_unstale":"2024-02-09T08:34:47.218929+0000","last_undegraded":"2024-02-09T08:34:47.218929+0000","last_fullsized":"2024-02-09T08:34:47.218929+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T17:50:58.258753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":2398,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.167475+0000","last_change":"2024-02-09T08:04:18.181620+0000","last_active":"2024-02-09T08:34:47.167475+0000","last_peered":"2024-02-09T08:34:47.167475+0000","last_clean":"2024-02-09T08:34:47.167475+0000","last_became_active":"2024-02-09T08:04:18.174506+0000","last_became_peered":"2024-02-09T08:04:18.174506+0000","last_unstale":"2024-02-09T08:34:47.167475+0000","last_undegraded":"2024-02-09T08:34:47.167475+0000","last_fullsized":"2024-02-09T08:34:47.167475+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T09:26:34.210279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":2405,"reported_epoch":1267,"state":"active+clean","last_fresh":"2024-02-09T08:34:50.388422+0000","last_change":"2024-02-09T08:04:23.913333+0000","last_active":"2024-02-09T08:34:50.388422+0000","last_peered":"2024-02-09T08:34:50.388422+0000","last_clean":"2024-02-09T08:34:50.388422+0000","last_became_active":"2024-02-09T08:04:23.899068+0000","last_became_peered":"2024-02-09T08:04:23.899068+0000","last_unstale":"2024-02-09T08:34:50.388422+0000","last_undegraded":"2024-02-09T08:34:50.388422+0000","last_fullsized":"2024-02-09T08:34:50.388422+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T15:40:17.180740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":21,"seq":90194313594,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71076,"kb_used_data":3800,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94300764,"statfs":{"total":96636764160,"available":96563982336,"internally_reserved":0,"allocated":3891200,"data_stored":1575219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68876743},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":59,"apply_latency_ms":59,"commit_latency_ns":59000000,"apply_latency_ns":59000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 9 08:33:49 2024","interfaces":[{"interface":"back","average":{"1min":10.571,"5min":28.581,"15min":35.933999999999997},"min":{"1min":4.867,"5min":4.3630000000000004,"15min":4.3630000000000004},"max":{"1min":19.257999999999999,"5min":244.96000000000001,"15min":435.74099999999999},"last":5.2300000000000004},{"interface":"front","average":{"1min":9.3170000000000002,"5min":26.222000000000001,"15min":35.192},"min":{"1min":5.3419999999999996,"5min":4.5140000000000002,"15min":4.5140000000000002},"max":{"1min":17.224,"5min":327.66800000000001,"15min":530.76499999999999},"last":9.0559999999999992}]},{"osd":1,"last update":"Fri Feb 9 08:34:40 2024","interfaces":[{"interface":"back","average":{"1min":23.754000000000001,"5min":27.858000000000001,"15min":41.049999999999997},"min":{"1min":10.205,"5min":8.8209999999999997,"15min":6.3339999999999996},"max":{"1min":133.12,"5min":220.53999999999999,"15min":367.85500000000002},"last":9.7880000000000003},{"interface":"front","average":{"1min":16.032,"5min":22.309999999999999,"15min":33.643000000000001},"min":{"1min":7.2750000000000004,"5min":4.9809999999999999,"15min":4.9809999999999999},"max":{"1min":88.522000000000006,"5min":190.19399999999999,"15min":328.70400000000001},"last":15.071999999999999}]},{"osd":2,"last update":"Fri Feb 9 08:34:36 2024","interfaces":[{"interface":"back","average":{"1min":20.32,"5min":21.036999999999999,"15min":30.809999999999999},"min":{"1min":7.79,"5min":7.5300000000000002,"15min":6.8380000000000001},"max":{"1min":109.685,"5min":154.72399999999999,"15min":296.97199999999998},"last":11.036},{"interface":"front","average":{"1min":28.870000000000001,"5min":27.794,"15min":39.774999999999999},"min":{"1min":11.637,"5min":8.6769999999999996,"15min":8.6769999999999996},"max":{"1min":197.815,"5min":197.815,"15min":307.27800000000002},"last":14.441000000000001}]},{"osd":4,"last update":"Fri Feb 9 08:33:44 2024","interfaces":[{"interface":"back","average":{"1min":15.788,"5min":34.143000000000001,"15min":43.649999999999999},"min":{"1min":11.162000000000001,"5min":9.0449999999999999,"15min":7.1340000000000003},"max":{"1min":19.582000000000001,"5min":331.005,"15min":590.62699999999995},"last":11.715},{"interface":"front","average":{"1min":14.061999999999999,"5min":30.212,"15min":39.517000000000003},"min":{"1min":8.3049999999999997,"5min":8.3049999999999997,"15min":8.3049999999999997},"max":{"1min":19.045000000000002,"5min":199.39099999999999,"15min":360.63799999999998},"last":16.286000000000001}]},{"osd":5,"last update":"Fri Feb 9 08:34:19 2024","interfaces":[{"interface":"back","average":{"1min":9.4120000000000008,"5min":27.838999999999999,"15min":38.497999999999998},"min":{"1min":6.3940000000000001,"5min":6.3940000000000001,"15min":6.3179999999999996},"max":{"1min":14.587999999999999,"5min":287.38499999999999,"15min":593.90599999999995},"last":13.683},{"interface":"front","average":{"1min":15.715,"5min":37.125,"15min":46.695},"min":{"1min":10.574999999999999,"5min":10.532999999999999,"15min":7.7590000000000003},"max":{"1min":21.821000000000002,"5min":296.96100000000001,"15min":595.14099999999996},"last":12.401}]},{"osd":6,"last update":"Fri Feb 9 08:33:44 2024","interfaces":[{"interface":"back","average":{"1min":12.772,"5min":32.241999999999997,"15min":41.530999999999999},"min":{"1min":7.4219999999999997,"5min":6.585,"15min":6.585},"max":{"1min":20.042999999999999,"5min":180.024,"15min":466.93099999999998},"last":17.021000000000001},{"interface":"front","average":{"1min":14.462,"5min":36.073,"15min":42.298000000000002},"min":{"1min":9.9939999999999998,"5min":9.2439999999999998,"15min":7.5599999999999996},"max":{"1min":19.867000000000001,"5min":340.75099999999998,"15min":713.92999999999995},"last":15.701000000000001}]},{"osd":7,"last update":"Fri Feb 9 08:33:49 2024","interfaces":[{"interface":"back","average":{"1min":17.872,"5min":37.258000000000003,"15min":47.962000000000003},"min":{"1min":11.401999999999999,"5min":8.3849999999999998,"15min":8.3849999999999998},"max":{"1min":25.266999999999999,"5min":247.81800000000001,"15min":591.36599999999999},"last":17.725999999999999},{"interface":"front","average":{"1min":19.061,"5min":40.015000000000001,"15min":50.957999999999998},"min":{"1min":13.031000000000001,"5min":12.263,"15min":11.82},"max":{"1min":24.359999999999999,"5min":287.39999999999998,"15min":815.34000000000003},"last":19.597999999999999}]}]},{"osd":4,"up_from":20,"seq":85899346297,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66932,"kb_used_data":3816,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94304908,"statfs":{"total":96636764160,"available":96568225792,"internally_reserved":0,"allocated":3907584,"data_stored":1582236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":49,"apply_latency_ms":49,"commit_latency_ns":49000000,"apply_latency_ns":49000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 9 08:34:44 2024","interfaces":[{"interface":"back","average":{"1min":10.693,"5min":17.425000000000001,"15min":22.245000000000001},"min":{"1min":4.7210000000000001,"5min":4.7210000000000001,"15min":4.1289999999999996},"max":{"1min":26.428999999999998,"5min":230.53100000000001,"15min":436.31999999999999},"last":129.28800000000001},{"interface":"front","average":{"1min":11.77,"5min":14.401999999999999,"15min":20.047999999999998},"min":{"1min":5.7830000000000004,"5min":5.4669999999999996,"15min":4.6539999999999999},"max":{"1min":72.087000000000003,"5min":122.212,"15min":313.82600000000002},"last":167.53399999999999}]},{"osd":1,"last update":"Fri Feb 9 08:34:44 2024","interfaces":[{"interface":"back","average":{"1min":13.816000000000001,"5min":16.184999999999999,"15min":22.974},"min":{"1min":7.6779999999999999,"5min":7.1020000000000003,"15min":5.2560000000000002},"max":{"1min":42.305,"5min":181.512,"15min":267.11399999999998},"last":50.877000000000002},{"interface":"front","average":{"1min":17.181999999999999,"5min":24.428999999999998,"15min":27.335000000000001},"min":{"1min":9.5890000000000004,"5min":7.0650000000000004,"15min":5.282},"max":{"1min":41.612000000000002,"5min":450.27100000000002,"15min":450.27100000000002},"last":51.520000000000003}]},{"osd":2,"last update":"Fri Feb 9 08:34:44 2024","interfaces":[{"interface":"back","average":{"1min":14.859999999999999,"5min":18.300000000000001,"15min":24.43},"min":{"1min":6.4489999999999998,"5min":6.3209999999999997,"15min":6.1159999999999997},"max":{"1min":62.048000000000002,"5min":133.65600000000001,"15min":380.56599999999997},"last":91.189999999999998},{"interface":"front","average":{"1min":18.081,"5min":21.329000000000001,"15min":28.344999999999999},"min":{"1min":7.6710000000000003,"5min":6.7039999999999997,"15min":6.7039999999999997},"max":{"1min":149.84800000000001,"5min":150.18100000000001,"15min":328.28100000000001},"last":56.432000000000002}]},{"osd":3,"last update":"Fri Feb 9 08:34:45 2024","interfaces":[{"interface":"back","average":{"1min":16.779,"5min":20.786000000000001,"15min":33.490000000000002},"min":{"1min":7.3289999999999997,"5min":6.8360000000000003,"15min":6.8360000000000003},"max":{"1min":115.795,"5min":147.76900000000001,"15min":957.68299999999999},"last":92.641000000000005},{"interface":"front","average":{"1min":20.568999999999999,"5min":23.959,"15min":35.015000000000001},"min":{"1min":9.9320000000000004,"5min":8.4870000000000001,"15min":6.7359999999999998},"max":{"1min":151.346,"5min":203.74700000000001,"15min":1190.1980000000001},"last":65.085999999999999}]},{"osd":5,"last update":"Fri Feb 9 08:34:44 2024","interfaces":[{"interface":"back","average":{"1min":24.512,"5min":17.521000000000001,"15min":25.984999999999999},"min":{"1min":6.2759999999999998,"5min":6.2759999999999998,"15min":6.2759999999999998},"max":{"1min":305.34100000000001,"5min":305.34100000000001,"15min":375.72000000000003},"last":91.853999999999999},{"interface":"front","average":{"1min":21.675999999999998,"5min":22.166,"15min":26.899000000000001},"min":{"1min":10.917999999999999,"5min":10.558,"15min":6.585},"max":{"1min":128.261,"5min":141.596,"15min":429.53500000000003},"last":62.545000000000002}]},{"osd":6,"last update":"Fri Feb 9 08:34:44 2024","interfaces":[{"interface":"back","average":{"1min":24.588000000000001,"5min":25.984999999999999,"15min":30.030999999999999},"min":{"1min":12.113,"5min":11.869999999999999,"15min":8.4760000000000009},"max":{"1min":100.815,"5min":205.577,"15min":300.27100000000002},"last":64.358999999999995},{"interface":"front","average":{"1min":35.454999999999998,"5min":24.370000000000001,"15min":29.376999999999999},"min":{"1min":8.0079999999999991,"5min":7.0389999999999997,"15min":7.0389999999999997},"max":{"1min":378.00099999999998,"5min":378.00099999999998,"15min":378.00099999999998},"last":97.787999999999997}]},{"osd":7,"last update":"Fri Feb 9 08:34:44 2024","interfaces":[{"interface":"back","average":{"1min":18.373999999999999,"5min":18.158999999999999,"15min":27.742000000000001},"min":{"1min":8.9670000000000005,"5min":6.2039999999999997,"15min":6.2039999999999997},"max":{"1min":93.730000000000004,"5min":93.730000000000004,"15min":349.47500000000002},"last":63.481999999999999},{"interface":"front","average":{"1min":21.815000000000001,"5min":19.652999999999999,"15min":28.613},"min":{"1min":9.1069999999999993,"5min":9.0739999999999998,"15min":9.0739999999999998},"max":{"1min":130.899,"5min":130.899,"15min":381.80399999999997},"last":104.66800000000001}]}]},{"osd":1,"up_from":16,"seq":68719477112,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71476,"kb_used_data":4196,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94300364,"statfs":{"total":96636764160,"available":96563572736,"internally_reserved":0,"allocated":4296704,"data_stored":1973064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":56,"apply_latency_ms":56,"commit_latency_ns":56000000,"apply_latency_ns":56000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 9 08:34:05 2024","interfaces":[{"interface":"back","average":{"1min":9.9629999999999992,"5min":23.974,"15min":21.896999999999998},"min":{"1min":6.3019999999999996,"5min":5.532,"15min":4.431},"max":{"1min":17.344999999999999,"5min":206.726,"15min":212.11199999999999},"last":8.0220000000000002},{"interface":"front","average":{"1min":13.121,"5min":29.670000000000002,"15min":27.291},"min":{"1min":8.6069999999999993,"5min":7.867,"15min":4.8849999999999998},"max":{"1min":21.439,"5min":246.137,"15min":468.82799999999997},"last":11.722}]},{"osd":2,"last update":"Fri Feb 9 08:34:31 2024","interfaces":[{"interface":"back","average":{"1min":33.371000000000002,"5min":24.713999999999999,"15min":24.129000000000001},"min":{"1min":9.1159999999999997,"5min":6.2510000000000003,"15min":5.2809999999999997},"max":{"1min":202.48500000000001,"5min":202.48500000000001,"15min":264.06400000000002},"last":14.167},{"interface":"front","average":{"1min":32.582999999999998,"5min":27.651,"15min":30.681000000000001},"min":{"1min":9.7490000000000006,"5min":7.8879999999999999,"15min":7.5179999999999998},"max":{"1min":164.06299999999999,"5min":181.94900000000001,"15min":417.31599999999997},"last":15.422000000000001}]},{"osd":3,"last update":"Fri Feb 9 08:34:31 2024","interfaces":[{"interface":"back","average":{"1min":21.018000000000001,"5min":25.486000000000001,"15min":30.059000000000001},"min":{"1min":8.2370000000000001,"5min":6.2460000000000004,"15min":6.2460000000000004},"max":{"1min":146.39099999999999,"5min":237.40799999999999,"15min":421.22300000000001},"last":11.073},{"interface":"front","average":{"1min":23.954000000000001,"5min":29.001999999999999,"15min":32.527000000000001},"min":{"1min":9.7919999999999998,"5min":9.6479999999999997,"15min":8.5730000000000004},"max":{"1min":150.655,"5min":251.86199999999999,"15min":434.92500000000001},"last":12.401999999999999}]},{"osd":4,"last update":"Fri Feb 9 08:33:48 2024","interfaces":[{"interface":"back","average":{"1min":15.727,"5min":22.158000000000001,"15min":22.741},"min":{"1min":10.606,"5min":9.0600000000000005,"15min":7.8849999999999998},"max":{"1min":23.405000000000001,"5min":139.489,"15min":179.96700000000001},"last":14.807},{"interface":"front","average":{"1min":10.336,"5min":17.417000000000002,"15min":20.902000000000001},"min":{"1min":6.4489999999999998,"5min":5.6890000000000001,"15min":5.6890000000000001},"max":{"1min":24.408999999999999,"5min":151.87799999999999,"15min":179.363},"last":6.7649999999999997}]},{"osd":5,"last update":"Fri Feb 9 08:34:05 2024","interfaces":[{"interface":"back","average":{"1min":10.693,"5min":23.084,"15min":28.024999999999999},"min":{"1min":6.8529999999999998,"5min":6.3220000000000001,"15min":6.3220000000000001},"max":{"1min":16.337,"5min":195.422,"15min":455.44299999999998},"last":13.459},{"interface":"front","average":{"1min":13.891999999999999,"5min":25.102,"15min":31.346},"min":{"1min":9.3130000000000006,"5min":8.0899999999999999,"15min":8.0899999999999999},"max":{"1min":19.707999999999998,"5min":197.43199999999999,"15min":469.512},"last":8.6199999999999992}]},{"osd":6,"last update":"Fri Feb 9 08:34:31 2024","interfaces":[{"interface":"back","average":{"1min":26.119,"5min":25.067,"15min":28.399000000000001},"min":{"1min":10.398999999999999,"5min":9.6460000000000008,"15min":8.1270000000000007},"max":{"1min":175.44,"5min":175.44,"15min":345.596},"last":24.137},{"interface":"front","average":{"1min":28.597000000000001,"5min":28.733000000000001,"15min":30.506},"min":{"1min":12.433,"5min":11.949,"15min":7.7160000000000002},"max":{"1min":176.929,"5min":176.929,"15min":423.88400000000001},"last":26.404}]},{"osd":7,"last update":"Fri Feb 9 08:34:31 2024","interfaces":[{"interface":"back","average":{"1min":27.841999999999999,"5min":27.408999999999999,"15min":30.664000000000001},"min":{"1min":11.976000000000001,"5min":11.976000000000001,"15min":9.1010000000000009},"max":{"1min":128.32599999999999,"5min":159.02600000000001,"15min":418.42500000000001},"last":25.754999999999999},{"interface":"front","average":{"1min":27.018999999999998,"5min":28.265000000000001,"15min":30.824000000000002},"min":{"1min":13.486000000000001,"5min":12.634,"15min":8.8149999999999995},"max":{"1min":130.70599999999999,"5min":161.59999999999999,"15min":377.685},"last":27.038}]}]},{"osd":7,"up_from":15,"seq":64424509823,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71132,"kb_used_data":3852,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94300708,"statfs":{"total":96636764160,"available":96563924992,"internally_reserved":0,"allocated":3944448,"data_stored":1603519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":68876746},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 9 08:34:00 2024","interfaces":[{"interface":"back","average":{"1min":9.5739999999999998,"5min":20.443000000000001,"15min":19.920999999999999},"min":{"1min":4.3600000000000003,"5min":4.3600000000000003,"15min":4.3600000000000003},"max":{"1min":15.842000000000001,"5min":312.15699999999998,"15min":312.15699999999998},"last":145.61799999999999},{"interface":"front","average":{"1min":10.407,"5min":22.914000000000001,"15min":21.405000000000001},"min":{"1min":6.7590000000000003,"5min":4.5410000000000004,"15min":4.0830000000000002},"max":{"1min":17.901,"5min":315.53399999999999,"15min":315.53399999999999},"last":127.39700000000001}]},{"osd":1,"last update":"Fri Feb 9 08:34:48 2024","interfaces":[{"interface":"back","average":{"1min":16.395,"5min":21.608000000000001,"15min":33.338999999999999},"min":{"1min":6.5149999999999997,"5min":5.859,"15min":4.5279999999999996},"max":{"1min":76.780000000000001,"5min":277.971,"15min":1551.0129999999999},"last":9.1920000000000002},{"interface":"front","average":{"1min":19.09,"5min":23.619,"15min":31.817},"min":{"1min":9.5350000000000001,"5min":5.5709999999999997,"15min":5.5709999999999997},"max":{"1min":75.843999999999994,"5min":318.48500000000001,"15min":1189.5050000000001},"last":10.606999999999999}]},{"osd":2,"last update":"Fri Feb 9 08:34:00 2024","interfaces":[{"interface":"back","average":{"1min":9.8390000000000004,"5min":25.876000000000001,"15min":23.849},"min":{"1min":5.7249999999999996,"5min":5.7249999999999996,"15min":5.7249999999999996},"max":{"1min":15.551,"5min":309.161,"15min":309.161},"last":38.692999999999998},{"interface":"front","average":{"1min":13.532,"5min":29.146999999999998,"15min":25.814},"min":{"1min":7.7130000000000001,"5min":6.9539999999999997,"15min":6.9050000000000002},"max":{"1min":18.120999999999999,"5min":333.91399999999999,"15min":333.91399999999999},"last":114.569}]},{"osd":3,"last update":"Fri Feb 9 08:34:11 2024","interfaces":[{"interface":"back","average":{"1min":13.24,"5min":28.524000000000001,"15min":32.805},"min":{"1min":6.516,"5min":6.516,"15min":6.516},"max":{"1min":18.763000000000002,"5min":310.67399999999998,"15min":429.62799999999999},"last":7.2450000000000001},{"interface":"front","average":{"1min":12.640000000000001,"5min":28.494,"15min":36.866},"min":{"1min":7.9139999999999997,"5min":6.3680000000000003,"15min":6.3680000000000003},"max":{"1min":17.683,"5min":317.71699999999998,"15min":485.76100000000002},"last":11.58}]},{"osd":4,"last update":"Fri Feb 9 08:34:48 2024","interfaces":[{"interface":"back","average":{"1min":17.018999999999998,"5min":30.007000000000001,"15min":29.927},"min":{"1min":7.8369999999999997,"5min":7.7869999999999999,"15min":7.7869999999999999},"max":{"1min":47.853999999999999,"5min":324.089,"15min":345.54300000000001},"last":9.9860000000000007},{"interface":"front","average":{"1min":19.475999999999999,"5min":32.319000000000003,"15min":31.989999999999998},"min":{"1min":10.106,"5min":10.106,"15min":10.106},"max":{"1min":49.270000000000003,"5min":316.80399999999997,"15min":316.80399999999997},"last":13.393000000000001}]},{"osd":5,"last update":"Fri Feb 9 08:34:00 2024","interfaces":[{"interface":"back","average":{"1min":13.651999999999999,"5min":28.315999999999999,"15min":27.463999999999999},"min":{"1min":8.3100000000000005,"5min":6.6689999999999996,"15min":6.1459999999999999},"max":{"1min":17.518999999999998,"5min":333.00700000000001,"15min":333.00700000000001},"last":157.42500000000001},{"interface":"front","average":{"1min":14.571,"5min":33.612000000000002,"15min":28.629000000000001},"min":{"1min":9.7680000000000007,"5min":7.508,"15min":6.3499999999999996},"max":{"1min":19.318000000000001,"5min":352.358,"15min":352.358},"last":135.202}]},{"osd":6,"last update":"Fri Feb 9 08:34:00 2024","interfaces":[{"interface":"back","average":{"1min":15.510999999999999,"5min":30.286000000000001,"15min":27.253},"min":{"1min":11.512,"5min":7.2240000000000002,"15min":6.8879999999999999},"max":{"1min":21.469000000000001,"5min":338.29000000000002,"15min":338.29000000000002},"last":139.09299999999999},{"interface":"front","average":{"1min":17.114999999999998,"5min":34.948,"15min":31.806999999999999},"min":{"1min":12.204000000000001,"5min":12.204000000000001,"15min":9.3729999999999993},"max":{"1min":22.376999999999999,"5min":349.34500000000003,"15min":349.34500000000003},"last":146.25}]}]},{"osd":6,"up_from":15,"seq":64424509822,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71116,"kb_used_data":3844,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94300724,"statfs":{"total":96636764160,"available":96563941376,"internally_reserved":0,"allocated":3936256,"data_stored":1596700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,1],"upper_bound":2048},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 9 08:34:02 2024","interfaces":[{"interface":"back","average":{"1min":8.6820000000000004,"5min":18.645,"15min":24.832000000000001},"min":{"1min":4.2380000000000004,"5min":4.2380000000000004,"15min":4.1589999999999998},"max":{"1min":18.015000000000001,"5min":167.62899999999999,"15min":318.44400000000002},"last":6.5609999999999999},{"interface":"front","average":{"1min":10.906000000000001,"5min":22.431999999999999,"15min":27.635999999999999},"min":{"1min":5.8159999999999998,"5min":4.6589999999999998,"15min":4.6589999999999998},"max":{"1min":17.667999999999999,"5min":216.55000000000001,"15min":340.25599999999997},"last":8.2449999999999992}]},{"osd":1,"last update":"Fri Feb 9 08:34:08 2024","interfaces":[{"interface":"back","average":{"1min":8.4719999999999995,"5min":28.818999999999999,"15min":28.925999999999998},"min":{"1min":6.0149999999999997,"5min":5.9960000000000004,"15min":5.093},"max":{"1min":15.109,"5min":368.74200000000002,"15min":664.64300000000003},"last":9.0440000000000005},{"interface":"front","average":{"1min":11.473000000000001,"5min":30.515999999999998,"15min":29.097000000000001},"min":{"1min":8.0129999999999999,"5min":7.1449999999999996,"15min":6.5780000000000003},"max":{"1min":18.710000000000001,"5min":258.34500000000003,"15min":369.96899999999999},"last":16.323}]},{"osd":2,"last update":"Fri Feb 9 08:34:02 2024","interfaces":[{"interface":"back","average":{"1min":12.372,"5min":27.215,"15min":29.059999999999999},"min":{"1min":7.3799999999999999,"5min":6.7300000000000004,"15min":6.7300000000000004},"max":{"1min":19.559999999999999,"5min":290.71600000000001,"15min":290.71600000000001},"last":15.663},{"interface":"front","average":{"1min":13.106999999999999,"5min":26.222999999999999,"15min":28.597000000000001},"min":{"1min":8.1549999999999994,"5min":7.2320000000000002,"15min":6.6719999999999997},"max":{"1min":18.646000000000001,"5min":286.08699999999999,"15min":286.08699999999999},"last":18.234999999999999}]},{"osd":3,"last update":"Fri Feb 9 08:34:08 2024","interfaces":[{"interface":"back","average":{"1min":14.584,"5min":33.146000000000001,"15min":34.277000000000001},"min":{"1min":9.1270000000000007,"5min":8.827,"15min":7.5209999999999999},"max":{"1min":19.896000000000001,"5min":247.40700000000001,"15min":400.87099999999998},"last":14.253},{"interface":"front","average":{"1min":12.955,"5min":31.477,"15min":38.030999999999999},"min":{"1min":9.0350000000000001,"5min":6.4420000000000002,"15min":6.4420000000000002},"max":{"1min":17.111999999999998,"5min":273.38499999999999,"15min":401.97300000000001},"last":9.7759999999999998}]},{"osd":4,"last update":"Fri Feb 9 08:34:42 2024","interfaces":[{"interface":"back","average":{"1min":27.59,"5min":28.632999999999999,"15min":29.07},"min":{"1min":11.359,"5min":8.8100000000000005,"15min":6.9800000000000004},"max":{"1min":193.97499999999999,"5min":243.23599999999999,"15min":339.286},"last":11.02},{"interface":"front","average":{"1min":30.446000000000002,"5min":34.627000000000002,"15min":35.954000000000001},"min":{"1min":14.337999999999999,"5min":11.573,"15min":10.298999999999999},"max":{"1min":198.60400000000001,"5min":243.86600000000001,"15min":402.19099999999997},"last":19.166}]},{"osd":5,"last update":"Fri Feb 9 08:34:02 2024","interfaces":[{"interface":"back","average":{"1min":13.428000000000001,"5min":26.620999999999999,"15min":25.609000000000002},"min":{"1min":7.5650000000000004,"5min":6.8390000000000004,"15min":6.0170000000000003},"max":{"1min":19.347999999999999,"5min":395.89999999999998,"15min":395.89999999999998},"last":11.683999999999999},{"interface":"front","average":{"1min":18.483000000000001,"5min":39.442999999999998,"15min":34.320999999999998},"min":{"1min":14.18,"5min":8.1449999999999996,"15min":8.1449999999999996},"max":{"1min":22.501999999999999,"5min":665.33799999999997,"15min":665.33799999999997},"last":17.053999999999998}]},{"osd":7,"last update":"Fri Feb 9 08:33:52 2024","interfaces":[{"interface":"back","average":{"1min":15.175000000000001,"5min":25.763000000000002,"15min":27.503},"min":{"1min":10.571,"5min":7.9889999999999999,"15min":7.9429999999999996},"max":{"1min":22.690999999999999,"5min":264.161,"15min":326.23200000000003},"last":12.798},{"interface":"front","average":{"1min":16.957000000000001,"5min":30.276,"15min":30.678999999999998},"min":{"1min":12.988,"5min":10.56,"15min":8.7810000000000006},"max":{"1min":20.411000000000001,"5min":253.45599999999999,"15min":315.09199999999998},"last":13.538}]}]},{"osd":2,"up_from":15,"seq":64424509818,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71108,"kb_used_data":3828,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94300732,"statfs":{"total":96636764160,"available":96563949568,"internally_reserved":0,"allocated":3919872,"data_stored":1589569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 9 08:33:53 2024","interfaces":[{"interface":"back","average":{"1min":11.448,"5min":18.757999999999999,"15min":22.998999999999999},"min":{"1min":7.4720000000000004,"5min":5.6719999999999997,"15min":4.1859999999999999},"max":{"1min":14.856999999999999,"5min":236.542,"15min":240.815},"last":10.526999999999999},{"interface":"front","average":{"1min":12.445,"5min":20.640999999999998,"15min":27.609999999999999},"min":{"1min":6.8529999999999998,"5min":6.8529999999999998,"15min":5.0830000000000002},"max":{"1min":16.725000000000001,"5min":237.27000000000001,"15min":258.41800000000001},"last":16.097999999999999}]},{"osd":1,"last update":"Fri Feb 9 08:34:34 2024","interfaces":[{"interface":"back","average":{"1min":19.222999999999999,"5min":13.205,"15min":27.302},"min":{"1min":5.681,"5min":5.2800000000000002,"15min":5.2080000000000002},"max":{"1min":170.83000000000001,"5min":170.83000000000001,"15min":752.81500000000005},"last":11.952999999999999},{"interface":"front","average":{"1min":26.896999999999998,"5min":23.623999999999999,"15min":36.237000000000002},"min":{"1min":9.7539999999999996,"5min":9.5890000000000004,"15min":6.8819999999999997},"max":{"1min":169.58099999999999,"5min":202.91,"15min":752.245},"last":15.208}]},{"osd":3,"last update":"Fri Feb 9 08:33:53 2024","interfaces":[{"interface":"back","average":{"1min":14.416,"5min":32.816000000000003,"15min":38.335999999999999},"min":{"1min":8.1020000000000003,"5min":6.7709999999999999,"15min":5.7949999999999999},"max":{"1min":20.547000000000001,"5min":325.14499999999998,"15min":846.35400000000004},"last":16.936},{"interface":"front","average":{"1min":8.6099999999999994,"5min":21.760000000000002,"15min":32.759},"min":{"1min":6.0640000000000001,"5min":5.9969999999999999,"15min":5.5490000000000004},"max":{"1min":15.869999999999999,"5min":235.749,"15min":334.87900000000002},"last":8.3989999999999991}]},{"osd":4,"last update":"Fri Feb 9 08:33:53 2024","interfaces":[{"interface":"back","average":{"1min":15.02,"5min":23.645,"15min":29.68},"min":{"1min":10.976000000000001,"5min":10.058999999999999,"15min":7.7110000000000003},"max":{"1min":17.728000000000002,"5min":254.77799999999999,"15min":423.28199999999998},"last":17.792000000000002},{"interface":"front","average":{"1min":17.015000000000001,"5min":26.844000000000001,"15min":31.972999999999999},"min":{"1min":12.914999999999999,"5min":12.321999999999999,"15min":10.821999999999999},"max":{"1min":18.706,"5min":253.941,"15min":297.73399999999998},"last":19.449999999999999}]},{"osd":5,"last update":"Fri Feb 9 08:33:53 2024","interfaces":[{"interface":"back","average":{"1min":10.99,"5min":20.640000000000001,"15min":29.731999999999999},"min":{"1min":6.5439999999999996,"5min":6.5439999999999996,"15min":6.1870000000000003},"max":{"1min":20.074999999999999,"5min":150.24799999999999,"15min":319.279},"last":11.199},{"interface":"front","average":{"1min":12.898999999999999,"5min":24.216999999999999,"15min":35.200000000000003},"min":{"1min":9.1419999999999995,"5min":6.21,"15min":6.21},"max":{"1min":21.289999999999999,"5min":283.18900000000002,"15min":314.74299999999999},"last":12.616}]},{"osd":6,"last update":"Fri Feb 9 08:33:53 2024","interfaces":[{"interface":"back","average":{"1min":17.364999999999998,"5min":23.785,"15min":34.709000000000003},"min":{"1min":12.33,"5min":12.33,"15min":9.859},"max":{"1min":19.661000000000001,"5min":138.125,"15min":301.05099999999999},"last":18.789999999999999},{"interface":"front","average":{"1min":18.498000000000001,"5min":26.233000000000001,"15min":35.259999999999998},"min":{"1min":13.566000000000001,"5min":13.566000000000001,"15min":13.298},"max":{"1min":21.442,"5min":135.84399999999999,"15min":273.30500000000001},"last":20.452999999999999}]},{"osd":7,"last update":"Fri Feb 9 08:34:34 2024","interfaces":[{"interface":"back","average":{"1min":15.26,"5min":13.488,"15min":26.422999999999998},"min":{"1min":7.3300000000000001,"5min":7.3300000000000001,"15min":6.3849999999999998},"max":{"1min":86.403000000000006,"5min":88.838999999999999,"15min":303.416},"last":9.7400000000000002},{"interface":"front","average":{"1min":19.038,"5min":16.216000000000001,"15min":30.358000000000001},"min":{"1min":8.7520000000000007,"5min":8.2449999999999992,"15min":7.7999999999999998},"max":{"1min":107.05,"5min":107.05,"15min":498.34300000000002},"last":13.340999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509816,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66956,"kb_used_data":3844,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94304884,"statfs":{"total":96636764160,"available":96568201216,"internally_reserved":0,"allocated":3936256,"data_stored":1596577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":60,"apply_latency_ms":60,"commit_latency_ns":60000000,"apply_latency_ns":60000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Feb 9 08:34:30 2024","interfaces":[{"interface":"back","average":{"1min":13.795,"5min":19.091000000000001,"15min":26.939},"min":{"1min":5.9130000000000003,"5min":4.306,"15min":4.306},"max":{"1min":45.713000000000001,"5min":119.645,"15min":305.28699999999998},"last":9.7490000000000006},{"interface":"front","average":{"1min":25.221,"5min":25.786999999999999,"15min":37.503999999999998},"min":{"1min":7.8170000000000002,"5min":6.3170000000000002,"15min":6.3170000000000002},"max":{"1min":213.21299999999999,"5min":229.71100000000001,"15min":409.27699999999999},"last":16.286999999999999}]},{"osd":2,"last update":"Fri Feb 9 08:33:53 2024","interfaces":[{"interface":"back","average":{"1min":8.4039999999999999,"5min":19.187999999999999,"15min":23.126000000000001},"min":{"1min":5.9379999999999997,"5min":5.6269999999999998,"15min":4.7439999999999998},"max":{"1min":16.463999999999999,"5min":170.73500000000001,"15min":391.44600000000003},"last":5.9649999999999999},{"interface":"front","average":{"1min":9.3409999999999993,"5min":22.885000000000002,"15min":25.742000000000001},"min":{"1min":5.4619999999999997,"5min":4.5469999999999997,"15min":4.5469999999999997},"max":{"1min":13.901999999999999,"5min":291.63200000000001,"15min":312.03899999999999},"last":8.1799999999999997}]},{"osd":3,"last update":"Fri Feb 9 08:34:40 2024","interfaces":[{"interface":"back","average":{"1min":20.146999999999998,"5min":23.992999999999999,"15min":39.951999999999998},"min":{"1min":9.1579999999999995,"5min":9.1579999999999995,"15min":8.391},"max":{"1min":65.817999999999998,"5min":188.982,"15min":464.74900000000002},"last":12.709},{"interface":"front","average":{"1min":24.324999999999999,"5min":29.202000000000002,"15min":46.600000000000001},"min":{"1min":14.225,"5min":11.369999999999999,"15min":10.288},"max":{"1min":66.498999999999995,"5min":191.452,"15min":472.88},"last":17.231999999999999}]},{"osd":4,"last update":"Fri Feb 9 08:34:40 2024","interfaces":[{"interface":"back","average":{"1min":30.094000000000001,"5min":26.760999999999999,"15min":42.034999999999997},"min":{"1min":12.295999999999999,"5min":10.787000000000001,"15min":6.9569999999999999},"max":{"1min":213.91499999999999,"5min":213.91499999999999,"15min":544.02800000000002},"last":13.366},{"interface":"front","average":{"1min":16.696999999999999,"5min":19.814,"15min":31.989000000000001},"min":{"1min":6.5010000000000003,"5min":6.5010000000000003,"15min":5.8869999999999996},"max":{"1min":93.179000000000002,"5min":206.73400000000001,"15min":377.84300000000002},"last":9.1460000000000008}]},{"osd":5,"last update":"Fri Feb 9 08:34:10 2024","interfaces":[{"interface":"back","average":{"1min":17.556999999999999,"5min":37.707999999999998,"15min":39.712000000000003},"min":{"1min":14.488,"5min":11.706,"15min":7.0730000000000004},"max":{"1min":21.827000000000002,"5min":363.94499999999999,"15min":432.82999999999998},"last":18.125},{"interface":"front","average":{"1min":11.15,"5min":28.911999999999999,"15min":41.231999999999999},"min":{"1min":7.3319999999999999,"5min":6.532,"15min":6.532},"max":{"1min":15.500999999999999,"5min":327.69499999999999,"15min":357.50999999999999},"last":14.010999999999999}]},{"osd":6,"last update":"Fri Feb 9 08:34:30 2024","interfaces":[{"interface":"back","average":{"1min":13.712999999999999,"5min":24.167000000000002,"15min":37.954000000000001},"min":{"1min":7.2910000000000004,"5min":7.2910000000000004,"15min":6.399},"max":{"1min":36.033999999999999,"5min":156.667,"15min":544.94200000000001},"last":11.486000000000001},{"interface":"front","average":{"1min":16.936,"5min":21.940000000000001,"15min":39.573999999999998},"min":{"1min":10.241,"5min":7.8369999999999997,"15min":7.8369999999999997},"max":{"1min":42.064999999999998,"5min":179.739,"15min":556.30200000000002},"last":14.625}]},{"osd":7,"last update":"Fri Feb 9 08:34:05 2024","interfaces":[{"interface":"back","average":{"1min":18.141999999999999,"5min":31.879999999999999,"15min":39.683999999999997},"min":{"1min":13.984,"5min":13.481,"15min":12.752000000000001},"max":{"1min":22.928000000000001,"5min":195.91499999999999,"15min":376.91800000000001},"last":19.088999999999999},{"interface":"front","average":{"1min":13.333,"5min":24.809999999999999,"15min":28.041},"min":{"1min":8.516,"5min":7.3310000000000004,"15min":7.0880000000000001},"max":{"1min":19.937999999999999,"5min":204.74199999999999,"15min":342.79300000000001},"last":12.305999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575228,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":75616,"kb_used_data":4180,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94296224,"statfs":{"total":96636764160,"available":96559333376,"internally_reserved":0,"allocated":4280320,"data_stored":1965730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":59,"apply_latency_ms":59,"commit_latency_ns":59000000,"apply_latency_ns":59000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 9 08:34:12 2024","interfaces":[{"interface":"back","average":{"1min":8.1720000000000006,"5min":15.773999999999999,"15min":23.449000000000002},"min":{"1min":4.9909999999999997,"5min":4.5490000000000004,"15min":4.4509999999999996},"max":{"1min":16.233000000000001,"5min":146.63499999999999,"15min":403.41699999999997},"last":10.782999999999999},{"interface":"front","average":{"1min":11.595000000000001,"5min":16.646000000000001,"15min":23.884},"min":{"1min":5.1130000000000004,"5min":4.7370000000000001,"15min":4.391},"max":{"1min":21.962,"5min":194.32300000000001,"15min":279.5},"last":8.3469999999999995}]},{"osd":1,"last update":"Fri Feb 9 08:33:49 2024","interfaces":[{"interface":"back","average":{"1min":8.6229999999999993,"5min":27.541,"15min":24.477},"min":{"1min":6.0750000000000002,"5min":5.6989999999999998,"15min":5.4550000000000001},"max":{"1min":14.645,"5min":303.23500000000001,"15min":303.23500000000001},"last":9.2010000000000005},{"interface":"front","average":{"1min":13.464,"5min":34.292000000000002,"15min":29.831},"min":{"1min":8.0449999999999999,"5min":7.3390000000000004,"15min":6.7709999999999999},"max":{"1min":17.835999999999999,"5min":294.35000000000002,"15min":294.35000000000002},"last":18.908999999999999}]},{"osd":2,"last update":"Fri Feb 9 08:34:32 2024","interfaces":[{"interface":"back","average":{"1min":25.158999999999999,"5min":24.327000000000002,"15min":28.507000000000001},"min":{"1min":7.7759999999999998,"5min":6.415,"15min":6.415},"max":{"1min":174.41999999999999,"5min":287.077,"15min":364.81400000000002},"last":18.245000000000001},{"interface":"front","average":{"1min":18.797999999999998,"5min":20.239999999999998,"15min":25.591999999999999},"min":{"1min":7.3109999999999999,"5min":7.3109999999999999,"15min":6.5540000000000003},"max":{"1min":128.667,"5min":176.416,"15min":339.12700000000001},"last":21.809999999999999}]},{"osd":3,"last update":"Fri Feb 9 08:34:32 2024","interfaces":[{"interface":"back","average":{"1min":29.274999999999999,"5min":27.763000000000002,"15min":34.323999999999998},"min":{"1min":8.1790000000000003,"5min":7.1130000000000004,"15min":7.1130000000000004},"max":{"1min":212.745,"5min":282.11000000000001,"15min":342.459},"last":17.446999999999999},{"interface":"front","average":{"1min":24.997,"5min":25.640000000000001,"15min":31.324999999999999},"min":{"1min":7.7409999999999997,"5min":7.234,"15min":6.7409999999999997},"max":{"1min":162.99600000000001,"5min":277.74700000000001,"15min":323.46899999999999},"last":27.866}]},{"osd":4,"last update":"Fri Feb 9 08:34:32 2024","interfaces":[{"interface":"back","average":{"1min":23.001999999999999,"5min":24.670000000000002,"15min":29.638000000000002},"min":{"1min":8.2539999999999996,"5min":7.0880000000000001,"15min":7.0880000000000001},"max":{"1min":188.62700000000001,"5min":223.655,"15min":336.74000000000001},"last":28.52},{"interface":"front","average":{"1min":23.012,"5min":22.286000000000001,"15min":28.931999999999999},"min":{"1min":8.3960000000000008,"5min":8.0030000000000001,"15min":7.4550000000000001},"max":{"1min":189.79499999999999,"5min":189.79499999999999,"15min":334.48500000000001},"last":22.901}]},{"osd":6,"last update":"Fri Feb 9 08:34:03 2024","interfaces":[{"interface":"back","average":{"1min":16.231000000000002,"5min":21.498999999999999,"15min":30.524999999999999},"min":{"1min":11.324999999999999,"5min":8.2799999999999994,"15min":7.742},"max":{"1min":24.632999999999999,"5min":144.80699999999999,"15min":320.85500000000002},"last":10.499000000000001},{"interface":"front","average":{"1min":18.751999999999999,"5min":24.975000000000001,"15min":33.936},"min":{"1min":12.034000000000001,"5min":11.550000000000001,"15min":10.789},"max":{"1min":25.568000000000001,"5min":188.28700000000001,"15min":411.56599999999997},"last":29.936}]},{"osd":7,"last update":"Fri Feb 9 08:34:03 2024","interfaces":[{"interface":"back","average":{"1min":14.823,"5min":23.667999999999999,"15min":27.585999999999999},"min":{"1min":8.2599999999999998,"5min":7.3650000000000002,"15min":7.3650000000000002},"max":{"1min":20.978000000000002,"5min":202.65100000000001,"15min":300.56200000000001},"last":26.533000000000001},{"interface":"front","average":{"1min":16.170000000000002,"5min":26.033000000000001,"15min":29.986999999999998},"min":{"1min":10.564,"5min":10.087999999999999,"15min":9.2189999999999994},"max":{"1min":23.199999999999999,"5min":187.536,"15min":194.726},"last":9.891}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-09T08:34:53.600 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-02-09T08:34:53.601 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-09T08:34:53.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.699+0000 7ff5fc7e0640 10 monclient: get_monmap_and_config 2024-02-09T08:34:53.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.699+0000 7ff5fc7e0640 10 monclient: build_initial_monmap 2024-02-09T08:34:53.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.699+0000 7ff5fc7e0640 10 monclient: monmap: 2024-02-09T08:34:53.702 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:34:53.703 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:53.703 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:34:53.700861+0000 2024-02-09T08:34:53.703 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:34:53.700861+0000 2024-02-09T08:34:53.703 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:34:53.703 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:53.703 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:34:53.703 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:34:53.703 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:34:53.703 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:34:53.703 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:34:53.703 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:53.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.700+0000 7ff5fc7e0640 1 Processor -- start 2024-02-09T08:34:53.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.700+0000 7ff5fc7e0640 1 -- start start 2024-02-09T08:34:53.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.700+0000 7ff5fc7e0640 10 monclient: init 2024-02-09T08:34:53.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.701+0000 7ff5fc7e0640 10 monclient: _reopen_session rank -1 2024-02-09T08:34:53.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.701+0000 7ff5fc7e0640 10 monclient: _add_conns ranks=[0,3,1,2,4] 2024-02-09T08:34:53.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.701+0000 7ff5fc7e0640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff5f406c360 addr v1:172.21.15.62:6789/0 2024-02-09T08:34:53.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.701+0000 7ff5fc7e0640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff5f40b1ca0 0x7ff5f40aa0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:53.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.701+0000 7ff5fc7e0640 10 monclient(hunting): picked mon.noname-a con 0x7ff5f40b1ca0 addr v2:172.21.15.62:3300/0 2024-02-09T08:34:53.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.701+0000 7ff5fc7e0640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ff5f413f830 addr v1:172.21.15.103:6789/0 2024-02-09T08:34:53.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.701+0000 7ff5fc7e0640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5f4142c60 con 0x7ff5f406c360 2024-02-09T08:34:53.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.701+0000 7ff5fc7e0640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5f40a9930 con 0x7ff5f413f830 2024-02-09T08:34:53.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.701+0000 7ff5fc7e0640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:53.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.701+0000 7ff5fc7e0640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5f406c740 con 0x7ff5f40b1ca0 2024-02-09T08:34:53.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.701+0000 7ff5fc7e0640 10 monclient(hunting): _renew_subs 2024-02-09T08:34:53.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.701+0000 7ff5fc7e0640 10 monclient(hunting): authenticate will time out at 3337.061431s 2024-02-09T08:34:53.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.701+0000 7ff5f9d7b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff5f40b1ca0 0x7ff5f40aa0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:53.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.701+0000 7ff5fad7d640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff5f413f830 0x7ff5f414cde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.62:46438/0 (socket says 172.21.15.62:46438) 2024-02-09T08:34:53.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.701+0000 7ff5fad7d640 1 -- 172.21.15.62:0/2657278059 learned_addr learned my addr 172.21.15.62:0/2657278059 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-09T08:34:53.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.702+0000 7ff5f9d7b640 10 monclient(hunting): get_auth_request con 0x7ff5f40b1ca0 auth_method 0 2024-02-09T08:34:53.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.702+0000 7ff5f9d7b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:53.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.702+0000 7ff5f9d7b640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:53.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.702+0000 7ff5f9d7b640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:53.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.702+0000 7ff5f9d7b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:53.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.702+0000 7ff5f9d7b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:53.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.702+0000 7ff5f9d7b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:53.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.704+0000 7ff5f957a640 1 -- 172.21.15.62:0/2657278059 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4104688767 0 0) 0x7ff5f40a9930 con 0x7ff5f413f830 2024-02-09T08:34:53.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.704+0000 7ff5f957a640 10 monclient(hunting): _negotiate 2024-02-09T08:34:53.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.704+0000 7ff5f957a640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:53.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.704+0000 7ff5f957a640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:53.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.704+0000 7ff5f957a640 10 monclient(hunting): my global_id is 22285 2024-02-09T08:34:53.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.704+0000 7ff5f957a640 1 -- 172.21.15.62:0/2657278059 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5e0003520 con 0x7ff5f413f830 2024-02-09T08:34:53.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.704+0000 7ff5f9d7b640 10 monclient(hunting): handle_auth_done global_id 16140 payload 274 2024-02-09T08:34:53.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.704+0000 7ff5f9d7b640 1 -- 172.21.15.62:0/2657278059 >> v1:172.21.15.103:6789/0 conn(0x7ff5f413f830 legacy=0x7ff5f414cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:53.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.705+0000 7ff5f9d7b640 1 -- 172.21.15.62:0/2657278059 >> v1:172.21.15.62:6789/0 conn(0x7ff5f406c360 legacy=0x7ff5f4142550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:53.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.705+0000 7ff5f9d7b640 10 monclient: _finish_hunting 0 2024-02-09T08:34:53.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.705+0000 7ff5f9d7b640 1 monclient: found mon.noname-a 2024-02-09T08:34:53.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.705+0000 7ff5f9d7b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:34:53.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.705+0000 7ff5f9d7b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-02-09T08:34:53.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.705+0000 7ff5f9d7b640 1 -- 172.21.15.62:0/2657278059 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f40ab310 con 0x7ff5f40b1ca0 2024-02-09T08:34:53.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.709+0000 7ff5f9d7b640 1 --2- 172.21.15.62:0/2657278059 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5f40b1ca0 0x7ff5f40aa0f0 secure :-1 s=READY pgs=3209 cs=0 l=1 rev1=1 crypto rx=0x7ff5e40097a0 tx=0x7ff5e402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7160bc3346467dee server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:34:53.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.713+0000 7ff5f957a640 1 -- 172.21.15.62:0/2657278059 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e4031830 con 0x7ff5f40b1ca0 2024-02-09T08:34:53.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.713+0000 7ff5f957a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:53.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.713+0000 7ff5f957a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-09T08:34:53.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.713+0000 7ff5f957a640 10 monclient: dump: 2024-02-09T08:34:53.716 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:53.716 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:53.716 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:53.716 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:53.716 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:53.716 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:53.716 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:53.716 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:53.716 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:53.716 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:53.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.713+0000 7ff5f957a640 10 monclient: _finish_auth 0 2024-02-09T08:34:53.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.713+0000 7ff5f957a640 10 monclient: _check_auth_tickets 2024-02-09T08:34:53.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.713+0000 7ff5f957a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:34:53.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.713+0000 7ff5f957a640 1 -- 172.21.15.62:0/2657278059 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e4031990 con 0x7ff5f40b1ca0 2024-02-09T08:34:53.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.713+0000 7ff5f957a640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:34:53.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.713+0000 7ff5f957a640 1 -- 172.21.15.62:0/2657278059 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e4031d20 con 0x7ff5f40b1ca0 2024-02-09T08:34:53.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.713+0000 7ff5fc7e0640 5 monclient: authenticate success, global_id 16140 2024-02-09T08:34:53.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.713+0000 7ff5fc7e0640 10 monclient: get_monmap_and_config success 2024-02-09T08:34:53.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.713+0000 7ff5fc7e0640 4 set_mon_vals no callback set 2024-02-09T08:34:53.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.713+0000 7ff5f957a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:53.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.713+0000 7ff5f957a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-09T08:34:53.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.713+0000 7ff5f957a640 10 monclient: dump: 2024-02-09T08:34:53.717 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:53.717 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:53.717 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:53.717 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:53.717 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:53.717 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:53.718 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:53.718 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:53.718 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:53.718 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:53.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.713+0000 7ff5fc7e0640 10 monclient: shutdown 2024-02-09T08:34:53.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.713+0000 7ff5fc7e0640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:34:53.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.713+0000 7ff5fc7e0640 1 -- 172.21.15.62:0/2657278059 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5f40b1ca0 msgr2=0x7ff5f40aa0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:53.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.713+0000 7ff5fc7e0640 1 --2- 172.21.15.62:0/2657278059 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5f40b1ca0 0x7ff5f40aa0f0 secure :-1 s=READY pgs=3209 cs=0 l=1 rev1=1 crypto rx=0x7ff5e40097a0 tx=0x7ff5e402b8d0 comp rx=0 tx=0).stop 2024-02-09T08:34:53.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.714+0000 7ff5fc7e0640 1 -- 172.21.15.62:0/2657278059 shutdown_connections 2024-02-09T08:34:53.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.714+0000 7ff5fc7e0640 1 --2- 172.21.15.62:0/2657278059 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5f40b1ca0 0x7ff5f40aa0f0 unknown :-1 s=CLOSED pgs=3209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:53.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.714+0000 7ff5fc7e0640 1 -- 172.21.15.62:0/2657278059 >> 172.21.15.62:0/2657278059 conn(0x7ff5f40b8320 msgr2=0x7ff5f40b8730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:34:53.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.714+0000 7ff5fc7e0640 1 -- 172.21.15.62:0/2657278059 shutdown_connections 2024-02-09T08:34:53.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.714+0000 7ff5fc7e0640 1 -- 172.21.15.62:0/2657278059 wait complete. 2024-02-09T08:34:53.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.714+0000 7ff5fc7e0640 10 monclient: build_initial_monmap 2024-02-09T08:34:53.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.714+0000 7ff5fc7e0640 10 monclient: monmap: 2024-02-09T08:34:53.722 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:34:53.722 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:34:53.722 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:34:53.722 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:34:53.722 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:34:53.722 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:53.722 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:34:53.723 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:34:53.723 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:34:53.723 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:53.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.714+0000 7ff5fc7e0640 1 librados: starting msgr at 2024-02-09T08:34:53.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.714+0000 7ff5fc7e0640 1 librados: starting objecter 2024-02-09T08:34:53.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.715+0000 7ff5fc7e0640 1 Processor -- start 2024-02-09T08:34:53.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.715+0000 7ff5fc7e0640 1 -- start start 2024-02-09T08:34:53.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.715+0000 7ff5fc7e0640 1 librados: setting wanted keys 2024-02-09T08:34:53.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.715+0000 7ff5fc7e0640 1 librados: calling monclient init 2024-02-09T08:34:53.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.715+0000 7ff5fc7e0640 10 monclient: init 2024-02-09T08:34:53.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.715+0000 7ff5fc7e0640 10 monclient: _reopen_session rank -1 2024-02-09T08:34:53.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.715+0000 7ff5fc7e0640 10 monclient: _add_conns ranks=[2,1,0] 2024-02-09T08:34:53.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.715+0000 7ff5fc7e0640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff5f406c360 0x7ff5f41dade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:53.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.715+0000 7ff5fc7e0640 10 monclient(hunting): picked mon.noname-c con 0x7ff5f406c360 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:34:53.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.715+0000 7ff5fc7e0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5f40b1ca0 0x7ff5f41db320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:53.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.715+0000 7ff5fc7e0640 10 monclient(hunting): picked mon.noname-b con 0x7ff5f40b1ca0 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:34:53.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.715+0000 7ff5fc7e0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5f413f830 0x7ff5f40b0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:53.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.715+0000 7ff5fc7e0640 10 monclient(hunting): picked mon.noname-a con 0x7ff5f413f830 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:34:53.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.715+0000 7ff5fc7e0640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:53.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.715+0000 7ff5fc7e0640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f41c8da0 con 0x7ff5f413f830 2024-02-09T08:34:53.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.715+0000 7ff5fc7e0640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:53.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.715+0000 7ff5fc7e0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f41dbaa0 con 0x7ff5f40b1ca0 2024-02-09T08:34:53.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.715+0000 7ff5fc7e0640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:53.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.715+0000 7ff5fc7e0640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f41c8fa0 con 0x7ff5f406c360 2024-02-09T08:34:53.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.715+0000 7ff5fc7e0640 10 monclient(hunting): _renew_subs 2024-02-09T08:34:53.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.715+0000 7ff5fc7e0640 10 monclient(hunting): authenticate will time out at 3337.075969s 2024-02-09T08:34:53.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.716+0000 7ff5fa57c640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff5f406c360 0x7ff5f41dade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:53.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.716+0000 7ff5fad7d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5f413f830 0x7ff5f40b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:53.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.716+0000 7ff5f9d7b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5f40b1ca0 0x7ff5f41db320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:53.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.716+0000 7ff5fad7d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5f413f830 0x7ff5f40b0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46418/0 (socket says 172.21.15.62:46418) 2024-02-09T08:34:53.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.716+0000 7ff5fad7d640 1 -- 172.21.15.62:0/3480703713 learned_addr learned my addr 172.21.15.62:0/3480703713 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:34:53.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.716+0000 7ff5fad7d640 10 monclient(hunting): get_auth_request con 0x7ff5f413f830 auth_method 0 2024-02-09T08:34:53.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.716+0000 7ff5fad7d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:53.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.716+0000 7ff5fad7d640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:53.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.716+0000 7ff5fad7d640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:53.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.716+0000 7ff5f9d7b640 10 monclient(hunting): get_auth_request con 0x7ff5f40b1ca0 auth_method 0 2024-02-09T08:34:53.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.716+0000 7ff5f9d7b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:53.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.716+0000 7ff5f9d7b640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:53.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.716+0000 7ff5f9d7b640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:53.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.716+0000 7ff5fa57c640 10 monclient(hunting): get_auth_request con 0x7ff5f406c360 auth_method 0 2024-02-09T08:34:53.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.716+0000 7ff5fa57c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:53.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.716+0000 7ff5fa57c640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:53.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.716+0000 7ff5fa57c640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:53.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.717+0000 7ff5f9d7b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:53.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.717+0000 7ff5f9d7b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:53.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.717+0000 7ff5f9d7b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:53.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.717+0000 7ff5fad7d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:53.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.717+0000 7ff5fad7d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:53.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.717+0000 7ff5fad7d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:53.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.717+0000 7ff5fa57c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:53.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.717+0000 7ff5fa57c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:53.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.717+0000 7ff5fa57c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:53.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.719+0000 7ff5fa57c640 10 monclient(hunting): handle_auth_done global_id 18584 payload 824 2024-02-09T08:34:53.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.720+0000 7ff5fa57c640 1 -- 172.21.15.62:0/3480703713 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5f40b1ca0 msgr2=0x7ff5f41db320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:53.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.720+0000 7ff5fa57c640 1 --2- 172.21.15.62:0/3480703713 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5f40b1ca0 0x7ff5f41db320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:53.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.720+0000 7ff5fa57c640 1 -- 172.21.15.62:0/3480703713 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5f413f830 msgr2=0x7ff5f40b0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:53.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.720+0000 7ff5fa57c640 1 --2- 172.21.15.62:0/3480703713 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5f413f830 0x7ff5f40b0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:53.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.720+0000 7ff5fa57c640 10 monclient: _finish_hunting 0 2024-02-09T08:34:53.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.720+0000 7ff5fa57c640 1 monclient: found mon.noname-c 2024-02-09T08:34:53.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.720+0000 7ff5fa57c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:34:53.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.720+0000 7ff5fa57c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-02-09T08:34:53.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.720+0000 7ff5fa57c640 1 -- 172.21.15.62:0/3480703713 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e4009400 con 0x7ff5f406c360 2024-02-09T08:34:53.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.720+0000 7ff5f9d7b640 1 --2- 172.21.15.62:0/3480703713 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5f40b1ca0 0x7ff5f41db320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-09T08:34:53.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.722+0000 7ff5fa57c640 1 --2- 172.21.15.62:0/3480703713 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff5f406c360 0x7ff5f41dade0 secure :-1 s=READY pgs=3194 cs=0 l=1 rev1=1 crypto rx=0x7ff5f000c340 tx=0x7ff5f000c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:34:53.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.722+0000 7ff5eaffd640 10 client.?.objecter ms_handle_connect 0x7ff5f406c360 2024-02-09T08:34:53.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.722+0000 7ff5eaffd640 10 client.?.objecter resend_mon_ops 2024-02-09T08:34:53.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.724+0000 7ff5eaffd640 1 -- 172.21.15.62:0/3480703713 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f00052d0 con 0x7ff5f406c360 2024-02-09T08:34:53.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.724+0000 7ff5eaffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:53.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.724+0000 7ff5eaffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-09T08:34:53.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.724+0000 7ff5eaffd640 10 monclient: dump: 2024-02-09T08:34:53.729 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:53.729 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:53.729 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:53.729 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:53.729 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:53.729 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:53.730 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:53.730 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:53.730 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:53.730 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:53.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.724+0000 7ff5eaffd640 10 monclient: _finish_auth 0 2024-02-09T08:34:53.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.724+0000 7ff5eaffd640 10 monclient: _check_auth_tickets 2024-02-09T08:34:53.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.724+0000 7ff5eaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:34:53.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.724+0000 7ff5fc7e0640 5 monclient: authenticate success, global_id 18584 2024-02-09T08:34:53.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.724+0000 7ff5fc7e0640 10 monclient: _renew_subs 2024-02-09T08:34:53.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.724+0000 7ff5fc7e0640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:34:53.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.724+0000 7ff5fc7e0640 1 -- 172.21.15.62:0/3480703713 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5f41c9280 con 0x7ff5f406c360 2024-02-09T08:34:53.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.724+0000 7ff5fc7e0640 10 client.18584.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:34:53.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.724+0000 7ff5fc7e0640 10 monclient: _renew_subs 2024-02-09T08:34:53.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.724+0000 7ff5fc7e0640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:34:53.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.724+0000 7ff5fc7e0640 1 -- 172.21.15.62:0/3480703713 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5f40b0bd0 con 0x7ff5f406c360 2024-02-09T08:34:53.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.724+0000 7ff5fc7e0640 1 librados: init done 2024-02-09T08:34:53.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.725+0000 7ff5fc7e0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:34:53.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.725+0000 7ff5fc7e0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:34:53.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.725+0000 7ff5fc7e0640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:34:53.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.725+0000 7ff5fc7e0640 1 -- 172.21.15.62:0/3480703713 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5f404ef90 con 0x7ff5f406c360 2024-02-09T08:34:54.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.999+0000 7ff5eaffd640 1 -- 172.21.15.62:0/3480703713 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f0005430 con 0x7ff5f406c360 2024-02-09T08:34:54.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.999+0000 7ff5eaffd640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:34:54.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.999+0000 7ff5eaffd640 1 -- 172.21.15.62:0/3480703713 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f0007240 con 0x7ff5f406c360 2024-02-09T08:34:54.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.999+0000 7ff5eaffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:54.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.999+0000 7ff5eaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-09T08:34:54.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.999+0000 7ff5eaffd640 10 monclient: dump: 2024-02-09T08:34:54.003 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:54.003 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:54.003 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:54.003 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:54.003 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:54.003 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:54.003 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:54.003 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:54.003 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:54.003 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:54.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:53.999+0000 7ff5f8d79640 4 set_mon_vals no callback set 2024-02-09T08:34:54.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.000+0000 7ff5eaffd640 1 -- 172.21.15.62:0/3480703713 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7ff5f0007460 con 0x7ff5f406c360 2024-02-09T08:34:54.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.000+0000 7ff5eaffd640 1 --2- 172.21.15.62:0/3480703713 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7ff5d806d1a0 0x7ff5d806f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:54.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.001+0000 7ff5f9d7b640 1 --2- 172.21.15.62:0/3480703713 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7ff5d806d1a0 0x7ff5d806f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:54.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.001+0000 7ff5f9d7b640 10 monclient: get_auth_request con 0x7ff5d806d1a0 auth_method 0 2024-02-09T08:34:54.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.001+0000 7ff5f9d7b640 1 --2- 172.21.15.62:0/3480703713 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7ff5d806d1a0 0x7ff5d806f660 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff5e4036000 tx=0x7ff5e403c040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:34:54.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.001+0000 7ff5eaffd640 10 client.18584.objecter ms_handle_connect 0x7ff5d806d1a0 2024-02-09T08:34:54.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.013+0000 7ff5eaffd640 1 -- 172.21.15.62:0/3480703713 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(1269..1269 src has 1104..1269) v4 ==== 6381+0+0 (secure 0 0 0) 0x7ff5f0058290 con 0x7ff5f406c360 2024-02-09T08:34:54.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.013+0000 7ff5eaffd640 10 client.18584.objecter ms_dispatch 0x7ff5f4000b90 osd_map(1269..1269 src has 1104..1269) v4 2024-02-09T08:34:54.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.013+0000 7ff5eaffd640 3 client.18584.objecter handle_osd_map got epochs [1269,1269] > 0 2024-02-09T08:34:54.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.013+0000 7ff5eaffd640 3 client.18584.objecter handle_osd_map decoding full epoch 1269 2024-02-09T08:34:54.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.013+0000 7ff5eaffd640 20 client.18584.objecter dump_active .. 0 homeless 2024-02-09T08:34:54.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.013+0000 7ff5eaffd640 1 -- 172.21.15.62:0/3480703713 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff5f0054530 con 0x7ff5f406c360 2024-02-09T08:34:54.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.013+0000 7ff5eaffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:34:54.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.013+0000 7ff5eaffd640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:34:54.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.218+0000 7ff5fc7e0640 1 -- 172.21.15.62:0/3480703713 --> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff5f40a9bd0 con 0x7ff5d806d1a0 2024-02-09T08:34:54.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.223+0000 7ff5eaffd640 1 -- 172.21.15.62:0/3480703713 <== mgr.4109 v2:172.21.15.103:6800/2270392189 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+151938 (secure 0 0 0) 0x7ff5e4045410 con 0x7ff5d806d1a0 2024-02-09T08:34:54.227 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T08:34:54.227 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-02-09T08:34:54.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.225+0000 7ff5fc7e0640 10 librados: watch_flush enter 2024-02-09T08:34:54.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.225+0000 7ff5fc7e0640 10 librados: watch_flush exit 2024-02-09T08:34:54.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.225+0000 7ff5fc7e0640 20 client.18584.objecter shutdown clearing up homeless session... 2024-02-09T08:34:54.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.225+0000 7ff5fc7e0640 10 client.18584.objecter successfully canceled tick 2024-02-09T08:34:54.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.225+0000 7ff5fc7e0640 1 -- 172.21.15.62:0/3480703713 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7ff5d806d1a0 msgr2=0x7ff5d806f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:54.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.225+0000 7ff5fc7e0640 1 --2- 172.21.15.62:0/3480703713 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7ff5d806d1a0 0x7ff5d806f660 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff5e4036000 tx=0x7ff5e403c040 comp rx=0 tx=0).stop 2024-02-09T08:34:54.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.225+0000 7ff5fc7e0640 10 monclient: shutdown 2024-02-09T08:34:54.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.225+0000 7ff5fc7e0640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:34:54.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.225+0000 7ff5fc7e0640 1 -- 172.21.15.62:0/3480703713 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff5f406c360 msgr2=0x7ff5f41dade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:54.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.225+0000 7ff5fc7e0640 1 --2- 172.21.15.62:0/3480703713 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff5f406c360 0x7ff5f41dade0 secure :-1 s=READY pgs=3194 cs=0 l=1 rev1=1 crypto rx=0x7ff5f000c340 tx=0x7ff5f000c800 comp rx=0 tx=0).stop 2024-02-09T08:34:54.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.225+0000 7ff5fc7e0640 1 -- 172.21.15.62:0/3480703713 shutdown_connections 2024-02-09T08:34:54.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.225+0000 7ff5fc7e0640 1 --2- 172.21.15.62:0/3480703713 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7ff5d806d1a0 0x7ff5d806f660 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:54.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.225+0000 7ff5fc7e0640 1 --2- 172.21.15.62:0/3480703713 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5f413f830 0x7ff5f40b0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:54.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.225+0000 7ff5fc7e0640 1 --2- 172.21.15.62:0/3480703713 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5f40b1ca0 0x7ff5f41db320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:54.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.225+0000 7ff5fc7e0640 1 --2- 172.21.15.62:0/3480703713 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff5f406c360 0x7ff5f41dade0 unknown :-1 s=CLOSED pgs=3194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:54.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.225+0000 7ff5fc7e0640 1 -- 172.21.15.62:0/3480703713 >> 172.21.15.62:0/3480703713 conn(0x7ff5f40b8320 msgr2=0x7ff5f40b50f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:34:54.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.225+0000 7ff5fc7e0640 1 -- 172.21.15.62:0/3480703713 shutdown_connections 2024-02-09T08:34:54.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.225+0000 7ff5fc7e0640 1 -- 172.21.15.62:0/3480703713 wait complete. 2024-02-09T08:34:54.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.225+0000 7ff5fc7e0640 1 librados: shutdown 2024-02-09T08:34:54.238 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":2232,"stamp":"2024-02-09T08:34:52.519206+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459285,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":88,"num_write":120,"num_write_kb":1379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":128,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":565412,"kb_used_data":31360,"kb_used_omap":12,"kb_used_meta":533939,"kb_avail":754409308,"statfs":{"total":773094113280,"available":772515131392,"internally_reserved":0,"allocated":32112640,"data_stored":13482614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":546754096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,1],"upper_bound":2048},"perf_stat":{"commit_latency_ms":391,"apply_latency_ms":391,"commit_latency_ns":391000000,"apply_latency_ns":391000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000755"},"pg_stats":[{"pgid":"11.1b","version":"0'0","reported_seq":2411,"reported_epoch":1267,"state":"active+clean","last_fresh":"2024-02-09T08:34:50.768338+0000","last_change":"2024-02-09T08:04:33.526805+0000","last_active":"2024-02-09T08:34:50.768338+0000","last_peered":"2024-02-09T08:34:50.768338+0000","last_clean":"2024-02-09T08:34:50.768338+0000","last_became_active":"2024-02-09T08:04:33.521240+0000","last_became_peered":"2024-02-09T08:04:33.521240+0000","last_unstale":"2024-02-09T08:34:50.768338+0000","last_undegraded":"2024-02-09T08:34:50.768338+0000","last_fullsized":"2024-02-09T08:34:50.768338+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T13:43:13.359953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":2421,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.277407+0000","last_change":"2024-02-09T08:04:40.805290+0000","last_active":"2024-02-09T08:34:47.277407+0000","last_peered":"2024-02-09T08:34:47.277407+0000","last_clean":"2024-02-09T08:34:47.277407+0000","last_became_active":"2024-02-09T08:04:40.657553+0000","last_became_peered":"2024-02-09T08:04:40.657553+0000","last_unstale":"2024-02-09T08:34:47.277407+0000","last_undegraded":"2024-02-09T08:34:47.277407+0000","last_fullsized":"2024-02-09T08:34:47.277407+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T10:06:50.567240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":2420,"reported_epoch":1265,"state":"active+clean","last_fresh":"2024-02-09T08:34:48.279837+0000","last_change":"2024-02-09T08:04:36.602734+0000","last_active":"2024-02-09T08:34:48.279837+0000","last_peered":"2024-02-09T08:34:48.279837+0000","last_clean":"2024-02-09T08:34:48.279837+0000","last_became_active":"2024-02-09T08:04:36.596835+0000","last_became_peered":"2024-02-09T08:04:36.596835+0000","last_unstale":"2024-02-09T08:34:48.279837+0000","last_undegraded":"2024-02-09T08:34:48.279837+0000","last_fullsized":"2024-02-09T08:34:48.279837+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T16:22:37.194403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":2434,"reported_epoch":1269,"state":"active+clean","last_fresh":"2024-02-09T08:34:51.900546+0000","last_change":"2024-02-09T08:05:00.789599+0000","last_active":"2024-02-09T08:34:51.900546+0000","last_peered":"2024-02-09T08:34:51.900546+0000","last_clean":"2024-02-09T08:34:51.900546+0000","last_became_active":"2024-02-09T08:05:00.783372+0000","last_became_peered":"2024-02-09T08:05:00.783372+0000","last_unstale":"2024-02-09T08:34:51.900546+0000","last_undegraded":"2024-02-09T08:34:51.900546+0000","last_fullsized":"2024-02-09T08:34:51.900546+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T19:04:41.775337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":2399,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.177779+0000","last_change":"2024-02-09T08:04:29.148658+0000","last_active":"2024-02-09T08:34:47.177779+0000","last_peered":"2024-02-09T08:34:47.177779+0000","last_clean":"2024-02-09T08:34:47.177779+0000","last_became_active":"2024-02-09T08:04:29.124225+0000","last_became_peered":"2024-02-09T08:04:29.124225+0000","last_unstale":"2024-02-09T08:34:47.177779+0000","last_undegraded":"2024-02-09T08:34:47.177779+0000","last_fullsized":"2024-02-09T08:34:47.177779+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T18:44:18.668955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":2431,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.221854+0000","last_change":"2024-02-09T08:04:39.748237+0000","last_active":"2024-02-09T08:34:47.221854+0000","last_peered":"2024-02-09T08:34:47.221854+0000","last_clean":"2024-02-09T08:34:47.221854+0000","last_became_active":"2024-02-09T08:04:39.743089+0000","last_became_peered":"2024-02-09T08:04:39.743089+0000","last_unstale":"2024-02-09T08:34:47.221854+0000","last_undegraded":"2024-02-09T08:34:47.221854+0000","last_fullsized":"2024-02-09T08:34:47.221854+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T12:00:51.961215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":2396,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.164239+0000","last_change":"2024-02-09T08:05:03.172587+0000","last_active":"2024-02-09T08:34:47.164239+0000","last_peered":"2024-02-09T08:34:47.164239+0000","last_clean":"2024-02-09T08:34:47.164239+0000","last_became_active":"2024-02-09T08:05:03.159711+0000","last_became_peered":"2024-02-09T08:05:03.159711+0000","last_unstale":"2024-02-09T08:34:47.164239+0000","last_undegraded":"2024-02-09T08:34:47.164239+0000","last_fullsized":"2024-02-09T08:34:47.164239+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T10:00:55.530401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":2405,"reported_epoch":1267,"state":"active+clean","last_fresh":"2024-02-09T08:34:50.375834+0000","last_change":"2024-02-09T08:04:30.076390+0000","last_active":"2024-02-09T08:34:50.375834+0000","last_peered":"2024-02-09T08:34:50.375834+0000","last_clean":"2024-02-09T08:34:50.375834+0000","last_became_active":"2024-02-09T08:04:30.066772+0000","last_became_peered":"2024-02-09T08:04:30.066772+0000","last_unstale":"2024-02-09T08:34:50.375834+0000","last_undegraded":"2024-02-09T08:34:50.375834+0000","last_fullsized":"2024-02-09T08:34:50.375834+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T10:57:11.649889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":2423,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.346591+0000","last_change":"2024-02-09T08:04:53.183149+0000","last_active":"2024-02-09T08:34:47.346591+0000","last_peered":"2024-02-09T08:34:47.346591+0000","last_clean":"2024-02-09T08:34:47.346591+0000","last_became_active":"2024-02-09T08:04:53.127636+0000","last_became_peered":"2024-02-09T08:04:53.127636+0000","last_unstale":"2024-02-09T08:34:47.346591+0000","last_undegraded":"2024-02-09T08:34:47.346591+0000","last_fullsized":"2024-02-09T08:34:47.346591+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T15:08:17.048446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":2428,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.207122+0000","last_change":"2024-02-09T08:04:56.560292+0000","last_active":"2024-02-09T08:34:47.207122+0000","last_peered":"2024-02-09T08:34:47.207122+0000","last_clean":"2024-02-09T08:34:47.207122+0000","last_became_active":"2024-02-09T08:04:56.548820+0000","last_became_peered":"2024-02-09T08:04:56.548820+0000","last_unstale":"2024-02-09T08:34:47.207122+0000","last_undegraded":"2024-02-09T08:34:47.207122+0000","last_fullsized":"2024-02-09T08:34:47.207122+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T10:03:15.435898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1","version":"41'7","reported_seq":2418,"reported_epoch":1267,"state":"active+clean","last_fresh":"2024-02-09T08:34:50.367021+0000","last_change":"2024-02-09T08:04:23.177797+0000","last_active":"2024-02-09T08:34:50.367021+0000","last_peered":"2024-02-09T08:34:50.367021+0000","last_clean":"2024-02-09T08:34:50.367021+0000","last_became_active":"2024-02-09T08:04:23.166119+0000","last_became_peered":"2024-02-09T08:04:23.166119+0000","last_unstale":"2024-02-09T08:34:50.367021+0000","last_undegraded":"2024-02-09T08:34:50.367021+0000","last_fullsized":"2024-02-09T08:34:50.367021+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T09:43:59.773830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":2437,"reported_epoch":1269,"state":"active+clean","last_fresh":"2024-02-09T08:34:51.902866+0000","last_change":"2024-02-09T08:05:03.863540+0000","last_active":"2024-02-09T08:34:51.902866+0000","last_peered":"2024-02-09T08:34:51.902866+0000","last_clean":"2024-02-09T08:34:51.902866+0000","last_became_active":"2024-02-09T08:05:03.857816+0000","last_became_peered":"2024-02-09T08:05:03.857816+0000","last_unstale":"2024-02-09T08:34:51.902866+0000","last_undegraded":"2024-02-09T08:34:51.902866+0000","last_fullsized":"2024-02-09T08:34:51.902866+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T16:34:58.345644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":2431,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.206152+0000","last_change":"2024-02-09T08:04:23.020050+0000","last_active":"2024-02-09T08:34:47.206152+0000","last_peered":"2024-02-09T08:34:47.206152+0000","last_clean":"2024-02-09T08:34:47.206152+0000","last_became_active":"2024-02-09T08:04:23.007209+0000","last_became_peered":"2024-02-09T08:04:23.007209+0000","last_unstale":"2024-02-09T08:34:47.206152+0000","last_undegraded":"2024-02-09T08:34:47.206152+0000","last_fullsized":"2024-02-09T08:34:47.206152+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T14:15:50.318219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"21'76","reported_seq":2533,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.134491+0000","last_change":"2024-02-09T08:02:58.788272+0000","last_active":"2024-02-09T08:34:47.134491+0000","last_peered":"2024-02-09T08:34:47.134491+0000","last_clean":"2024-02-09T08:34:47.134491+0000","last_became_active":"2024-02-09T08:02:58.754736+0000","last_became_peered":"2024-02-09T08:02:58.754736+0000","last_unstale":"2024-02-09T08:34:47.134491+0000","last_undegraded":"2024-02-09T08:34:47.134491+0000","last_fullsized":"2024-02-09T08:34:47.134491+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:02:56.594120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:02:56.594120+0000","last_clean_scrub_stamp":"2024-02-09T08:02:56.594120+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T17:35:01.118117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":2436,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.349162+0000","last_change":"2024-02-09T08:03:12.939816+0000","last_active":"2024-02-09T08:34:47.349162+0000","last_peered":"2024-02-09T08:34:47.349162+0000","last_clean":"2024-02-09T08:34:47.349162+0000","last_became_active":"2024-02-09T08:03:12.934488+0000","last_became_peered":"2024-02-09T08:03:12.934488+0000","last_unstale":"2024-02-09T08:34:47.349162+0000","last_undegraded":"2024-02-09T08:34:47.349162+0000","last_fullsized":"2024-02-09T08:34:47.349162+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_clean_scrub_stamp":"2024-02-09T08:03:10.689497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T08:15:00.733484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":2422,"reported_epoch":1265,"state":"active+clean","last_fresh":"2024-02-09T08:34:48.281622+0000","last_change":"2024-02-09T08:04:34.779296+0000","last_active":"2024-02-09T08:34:48.281622+0000","last_peered":"2024-02-09T08:34:48.281622+0000","last_clean":"2024-02-09T08:34:48.281622+0000","last_became_active":"2024-02-09T08:04:34.763206+0000","last_became_peered":"2024-02-09T08:04:34.763206+0000","last_unstale":"2024-02-09T08:34:48.281622+0000","last_undegraded":"2024-02-09T08:34:48.281622+0000","last_fullsized":"2024-02-09T08:34:48.281622+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T14:34:34.410613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2436,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.230608+0000","last_change":"2024-02-09T08:03:12.238763+0000","last_active":"2024-02-09T08:34:47.230608+0000","last_peered":"2024-02-09T08:34:47.230608+0000","last_clean":"2024-02-09T08:34:47.230608+0000","last_became_active":"2024-02-09T08:03:12.210217+0000","last_became_peered":"2024-02-09T08:03:12.210217+0000","last_unstale":"2024-02-09T08:34:47.230608+0000","last_undegraded":"2024-02-09T08:34:47.230608+0000","last_fullsized":"2024-02-09T08:34:47.230608+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_clean_scrub_stamp":"2024-02-09T08:03:10.689497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T11:36:35.345417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":2436,"reported_epoch":1269,"state":"active+clean","last_fresh":"2024-02-09T08:34:51.905833+0000","last_change":"2024-02-09T08:04:28.955676+0000","last_active":"2024-02-09T08:34:51.905833+0000","last_peered":"2024-02-09T08:34:51.905833+0000","last_clean":"2024-02-09T08:34:51.905833+0000","last_became_active":"2024-02-09T08:04:28.937638+0000","last_became_peered":"2024-02-09T08:04:28.937638+0000","last_unstale":"2024-02-09T08:34:51.905833+0000","last_undegraded":"2024-02-09T08:34:51.905833+0000","last_fullsized":"2024-02-09T08:34:51.905833+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T15:59:25.543995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2459,"reported_epoch":1269,"state":"active+clean","last_fresh":"2024-02-09T08:34:51.772334+0000","last_change":"2024-02-09T08:03:12.225325+0000","last_active":"2024-02-09T08:34:51.772334+0000","last_peered":"2024-02-09T08:34:51.772334+0000","last_clean":"2024-02-09T08:34:51.772334+0000","last_became_active":"2024-02-09T08:03:12.197237+0000","last_became_peered":"2024-02-09T08:03:12.197237+0000","last_unstale":"2024-02-09T08:34:51.772334+0000","last_undegraded":"2024-02-09T08:34:51.772334+0000","last_fullsized":"2024-02-09T08:34:51.772334+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_clean_scrub_stamp":"2024-02-09T08:03:10.689497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T09:53:22.604814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":2435,"reported_epoch":1269,"state":"active+clean","last_fresh":"2024-02-09T08:34:51.922939+0000","last_change":"2024-02-09T08:04:32.150155+0000","last_active":"2024-02-09T08:34:51.922939+0000","last_peered":"2024-02-09T08:34:51.922939+0000","last_clean":"2024-02-09T08:34:51.922939+0000","last_became_active":"2024-02-09T08:04:32.135773+0000","last_became_peered":"2024-02-09T08:04:32.135773+0000","last_unstale":"2024-02-09T08:34:51.922939+0000","last_undegraded":"2024-02-09T08:34:51.922939+0000","last_fullsized":"2024-02-09T08:34:51.922939+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T09:48:06.205102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":2436,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.274817+0000","last_change":"2024-02-09T08:03:12.541068+0000","last_active":"2024-02-09T08:34:47.274817+0000","last_peered":"2024-02-09T08:34:47.274817+0000","last_clean":"2024-02-09T08:34:47.274817+0000","last_became_active":"2024-02-09T08:03:12.535306+0000","last_became_peered":"2024-02-09T08:03:12.535306+0000","last_unstale":"2024-02-09T08:34:47.274817+0000","last_undegraded":"2024-02-09T08:34:47.274817+0000","last_fullsized":"2024-02-09T08:34:47.274817+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_clean_scrub_stamp":"2024-02-09T08:03:10.689497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T16:45:31.048468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":2445,"reported_epoch":1269,"state":"active+clean","last_fresh":"2024-02-09T08:34:51.840790+0000","last_change":"2024-02-09T08:04:35.123806+0000","last_active":"2024-02-09T08:34:51.840790+0000","last_peered":"2024-02-09T08:34:51.840790+0000","last_clean":"2024-02-09T08:34:51.840790+0000","last_became_active":"2024-02-09T08:04:35.117349+0000","last_became_peered":"2024-02-09T08:04:35.117349+0000","last_unstale":"2024-02-09T08:34:51.840790+0000","last_undegraded":"2024-02-09T08:34:51.840790+0000","last_fullsized":"2024-02-09T08:34:51.840790+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T15:28:05.326270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2444,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.224445+0000","last_change":"2024-02-09T08:03:12.601407+0000","last_active":"2024-02-09T08:34:47.224445+0000","last_peered":"2024-02-09T08:34:47.224445+0000","last_clean":"2024-02-09T08:34:47.224445+0000","last_became_active":"2024-02-09T08:03:12.568245+0000","last_became_peered":"2024-02-09T08:03:12.568245+0000","last_unstale":"2024-02-09T08:34:47.224445+0000","last_undegraded":"2024-02-09T08:34:47.224445+0000","last_fullsized":"2024-02-09T08:34:47.224445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_clean_scrub_stamp":"2024-02-09T08:03:10.689497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T13:19:50.521695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":2445,"reported_epoch":1269,"state":"active+clean","last_fresh":"2024-02-09T08:34:51.848561+0000","last_change":"2024-02-09T08:04:21.999119+0000","last_active":"2024-02-09T08:34:51.848561+0000","last_peered":"2024-02-09T08:34:51.848561+0000","last_clean":"2024-02-09T08:34:51.848561+0000","last_became_active":"2024-02-09T08:04:21.984625+0000","last_became_peered":"2024-02-09T08:04:21.984625+0000","last_unstale":"2024-02-09T08:34:51.848561+0000","last_undegraded":"2024-02-09T08:34:51.848561+0000","last_fullsized":"2024-02-09T08:34:51.848561+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T17:50:19.443534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2436,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.361726+0000","last_change":"2024-02-09T08:03:12.390430+0000","last_active":"2024-02-09T08:34:47.361726+0000","last_peered":"2024-02-09T08:34:47.361726+0000","last_clean":"2024-02-09T08:34:47.361726+0000","last_became_active":"2024-02-09T08:03:12.385148+0000","last_became_peered":"2024-02-09T08:03:12.385148+0000","last_unstale":"2024-02-09T08:34:47.361726+0000","last_undegraded":"2024-02-09T08:34:47.361726+0000","last_fullsized":"2024-02-09T08:34:47.361726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_clean_scrub_stamp":"2024-02-09T08:03:10.689497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T10:48:39.909252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":2404,"reported_epoch":1267,"state":"active+clean","last_fresh":"2024-02-09T08:34:50.392308+0000","last_change":"2024-02-09T08:04:22.608389+0000","last_active":"2024-02-09T08:34:50.392308+0000","last_peered":"2024-02-09T08:34:50.392308+0000","last_clean":"2024-02-09T08:34:50.392308+0000","last_became_active":"2024-02-09T08:04:22.589664+0000","last_became_peered":"2024-02-09T08:04:22.589664+0000","last_unstale":"2024-02-09T08:34:50.392308+0000","last_undegraded":"2024-02-09T08:34:50.392308+0000","last_fullsized":"2024-02-09T08:34:50.392308+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T18:29:06.754589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2442,"reported_epoch":1265,"state":"active+clean","last_fresh":"2024-02-09T08:34:48.315688+0000","last_change":"2024-02-09T08:03:12.975632+0000","last_active":"2024-02-09T08:34:48.315688+0000","last_peered":"2024-02-09T08:34:48.315688+0000","last_clean":"2024-02-09T08:34:48.315688+0000","last_became_active":"2024-02-09T08:03:12.943786+0000","last_became_peered":"2024-02-09T08:03:12.943786+0000","last_unstale":"2024-02-09T08:34:48.315688+0000","last_undegraded":"2024-02-09T08:34:48.315688+0000","last_fullsized":"2024-02-09T08:34:48.315688+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_clean_scrub_stamp":"2024-02-09T08:03:10.689497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T14:17:25.431442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":2395,"reported_epoch":1267,"state":"active+clean","last_fresh":"2024-02-09T08:34:50.380645+0000","last_change":"2024-02-09T08:04:47.726395+0000","last_active":"2024-02-09T08:34:50.380645+0000","last_peered":"2024-02-09T08:34:50.380645+0000","last_clean":"2024-02-09T08:34:50.380645+0000","last_became_active":"2024-02-09T08:04:47.720072+0000","last_became_peered":"2024-02-09T08:04:47.720072+0000","last_unstale":"2024-02-09T08:34:50.380645+0000","last_undegraded":"2024-02-09T08:34:50.380645+0000","last_fullsized":"2024-02-09T08:34:50.380645+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T12:05:53.782672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2433,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.395872+0000","last_change":"2024-02-09T08:03:12.925399+0000","last_active":"2024-02-09T08:34:47.395872+0000","last_peered":"2024-02-09T08:34:47.395872+0000","last_clean":"2024-02-09T08:34:47.395872+0000","last_became_active":"2024-02-09T08:03:12.920012+0000","last_became_peered":"2024-02-09T08:03:12.920012+0000","last_unstale":"2024-02-09T08:34:47.395872+0000","last_undegraded":"2024-02-09T08:34:47.395872+0000","last_fullsized":"2024-02-09T08:34:47.395872+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_clean_scrub_stamp":"2024-02-09T08:03:10.689497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T10:28:21.672589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":2412,"reported_epoch":1267,"state":"active+clean","last_fresh":"2024-02-09T08:34:50.772552+0000","last_change":"2024-02-09T08:04:33.664545+0000","last_active":"2024-02-09T08:34:50.772552+0000","last_peered":"2024-02-09T08:34:50.772552+0000","last_clean":"2024-02-09T08:34:50.772552+0000","last_became_active":"2024-02-09T08:04:33.638587+0000","last_became_peered":"2024-02-09T08:04:33.638587+0000","last_unstale":"2024-02-09T08:34:50.772552+0000","last_undegraded":"2024-02-09T08:34:50.772552+0000","last_fullsized":"2024-02-09T08:34:50.772552+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T19:30:04.222018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":2393,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.156466+0000","last_change":"2024-02-09T08:04:31.512983+0000","last_active":"2024-02-09T08:34:47.156466+0000","last_peered":"2024-02-09T08:34:47.156466+0000","last_clean":"2024-02-09T08:34:47.156466+0000","last_became_active":"2024-02-09T08:04:31.384824+0000","last_became_peered":"2024-02-09T08:04:31.384824+0000","last_unstale":"2024-02-09T08:34:47.156466+0000","last_undegraded":"2024-02-09T08:34:47.156466+0000","last_fullsized":"2024-02-09T08:34:47.156466+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T11:51:59.447668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":2424,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.393134+0000","last_change":"2024-02-09T08:04:53.877017+0000","last_active":"2024-02-09T08:34:47.393134+0000","last_peered":"2024-02-09T08:34:47.393134+0000","last_clean":"2024-02-09T08:34:47.393134+0000","last_became_active":"2024-02-09T08:04:53.837629+0000","last_became_peered":"2024-02-09T08:04:53.837629+0000","last_unstale":"2024-02-09T08:34:47.393134+0000","last_undegraded":"2024-02-09T08:34:47.393134+0000","last_fullsized":"2024-02-09T08:34:47.393134+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T18:40:04.247361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":2446,"reported_epoch":1269,"state":"active+clean","last_fresh":"2024-02-09T08:34:51.894860+0000","last_change":"2024-02-09T08:04:21.302362+0000","last_active":"2024-02-09T08:34:51.894860+0000","last_peered":"2024-02-09T08:34:51.894860+0000","last_clean":"2024-02-09T08:34:51.894860+0000","last_became_active":"2024-02-09T08:04:21.282606+0000","last_became_peered":"2024-02-09T08:04:21.282606+0000","last_unstale":"2024-02-09T08:34:51.894860+0000","last_undegraded":"2024-02-09T08:34:51.894860+0000","last_fullsized":"2024-02-09T08:34:51.894860+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T19:16:17.460982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":2431,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.189233+0000","last_change":"2024-02-09T08:04:21.475042+0000","last_active":"2024-02-09T08:34:47.189233+0000","last_peered":"2024-02-09T08:34:47.189233+0000","last_clean":"2024-02-09T08:34:47.189233+0000","last_became_active":"2024-02-09T08:04:21.467958+0000","last_became_peered":"2024-02-09T08:04:21.467958+0000","last_unstale":"2024-02-09T08:34:47.189233+0000","last_undegraded":"2024-02-09T08:34:47.189233+0000","last_fullsized":"2024-02-09T08:34:47.189233+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T19:20:44.543943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":2445,"reported_epoch":1269,"state":"active+clean","last_fresh":"2024-02-09T08:34:51.770536+0000","last_change":"2024-02-09T08:04:20.693952+0000","last_active":"2024-02-09T08:34:51.770536+0000","last_peered":"2024-02-09T08:34:51.770536+0000","last_clean":"2024-02-09T08:34:51.770536+0000","last_became_active":"2024-02-09T08:04:20.679487+0000","last_became_peered":"2024-02-09T08:04:20.679487+0000","last_unstale":"2024-02-09T08:34:51.770536+0000","last_undegraded":"2024-02-09T08:34:51.770536+0000","last_fullsized":"2024-02-09T08:34:51.770536+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T19:30:24.161882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":2411,"reported_epoch":1267,"state":"active+clean","last_fresh":"2024-02-09T08:34:50.760222+0000","last_change":"2024-02-09T08:04:31.601293+0000","last_active":"2024-02-09T08:34:50.760222+0000","last_peered":"2024-02-09T08:34:50.760222+0000","last_clean":"2024-02-09T08:34:50.760222+0000","last_became_active":"2024-02-09T08:04:31.595670+0000","last_became_peered":"2024-02-09T08:04:31.595670+0000","last_unstale":"2024-02-09T08:34:50.760222+0000","last_undegraded":"2024-02-09T08:34:50.760222+0000","last_fullsized":"2024-02-09T08:34:50.760222+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T08:48:28.458262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":2404,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.149904+0000","last_change":"2024-02-09T08:04:41.266591+0000","last_active":"2024-02-09T08:34:47.149904+0000","last_peered":"2024-02-09T08:34:47.149904+0000","last_clean":"2024-02-09T08:34:47.149904+0000","last_became_active":"2024-02-09T08:04:41.259580+0000","last_became_peered":"2024-02-09T08:04:41.259580+0000","last_unstale":"2024-02-09T08:34:47.149904+0000","last_undegraded":"2024-02-09T08:34:47.149904+0000","last_fullsized":"2024-02-09T08:34:47.149904+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T11:13:46.788829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":2421,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.374779+0000","last_change":"2024-02-09T08:04:53.258518+0000","last_active":"2024-02-09T08:34:47.374779+0000","last_peered":"2024-02-09T08:34:47.374779+0000","last_clean":"2024-02-09T08:34:47.374779+0000","last_became_active":"2024-02-09T08:04:53.248695+0000","last_became_peered":"2024-02-09T08:04:53.248695+0000","last_unstale":"2024-02-09T08:34:47.374779+0000","last_undegraded":"2024-02-09T08:34:47.374779+0000","last_fullsized":"2024-02-09T08:34:47.374779+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T19:57:41.278249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":2429,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.218929+0000","last_change":"2024-02-09T08:04:39.731324+0000","last_active":"2024-02-09T08:34:47.218929+0000","last_peered":"2024-02-09T08:34:47.218929+0000","last_clean":"2024-02-09T08:34:47.218929+0000","last_became_active":"2024-02-09T08:04:39.726089+0000","last_became_peered":"2024-02-09T08:04:39.726089+0000","last_unstale":"2024-02-09T08:34:47.218929+0000","last_undegraded":"2024-02-09T08:34:47.218929+0000","last_fullsized":"2024-02-09T08:34:47.218929+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T17:50:58.258753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":2398,"reported_epoch":1264,"state":"active+clean","last_fresh":"2024-02-09T08:34:47.167475+0000","last_change":"2024-02-09T08:04:18.181620+0000","last_active":"2024-02-09T08:34:47.167475+0000","last_peered":"2024-02-09T08:34:47.167475+0000","last_clean":"2024-02-09T08:34:47.167475+0000","last_became_active":"2024-02-09T08:04:18.174506+0000","last_became_peered":"2024-02-09T08:04:18.174506+0000","last_unstale":"2024-02-09T08:34:47.167475+0000","last_undegraded":"2024-02-09T08:34:47.167475+0000","last_fullsized":"2024-02-09T08:34:47.167475+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T09:26:34.210279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":2405,"reported_epoch":1267,"state":"active+clean","last_fresh":"2024-02-09T08:34:50.388422+0000","last_change":"2024-02-09T08:04:23.913333+0000","last_active":"2024-02-09T08:34:50.388422+0000","last_peered":"2024-02-09T08:34:50.388422+0000","last_clean":"2024-02-09T08:34:50.388422+0000","last_became_active":"2024-02-09T08:04:23.899068+0000","last_became_peered":"2024-02-09T08:04:23.899068+0000","last_unstale":"2024-02-09T08:34:50.388422+0000","last_undegraded":"2024-02-09T08:34:50.388422+0000","last_fullsized":"2024-02-09T08:34:50.388422+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T15:40:17.180740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":21,"seq":90194313594,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71076,"kb_used_data":3800,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94300764,"statfs":{"total":96636764160,"available":96563982336,"internally_reserved":0,"allocated":3891200,"data_stored":1575219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68876743},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":59,"apply_latency_ms":59,"commit_latency_ns":59000000,"apply_latency_ns":59000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 9 08:33:49 2024","interfaces":[{"interface":"back","average":{"1min":10.571,"5min":28.581,"15min":35.933999999999997},"min":{"1min":4.867,"5min":4.3630000000000004,"15min":4.3630000000000004},"max":{"1min":19.257999999999999,"5min":244.96000000000001,"15min":435.74099999999999},"last":5.2300000000000004},{"interface":"front","average":{"1min":9.3170000000000002,"5min":26.222000000000001,"15min":35.192},"min":{"1min":5.3419999999999996,"5min":4.5140000000000002,"15min":4.5140000000000002},"max":{"1min":17.224,"5min":327.66800000000001,"15min":530.76499999999999},"last":9.0559999999999992}]},{"osd":1,"last update":"Fri Feb 9 08:34:40 2024","interfaces":[{"interface":"back","average":{"1min":23.754000000000001,"5min":27.858000000000001,"15min":41.049999999999997},"min":{"1min":10.205,"5min":8.8209999999999997,"15min":6.3339999999999996},"max":{"1min":133.12,"5min":220.53999999999999,"15min":367.85500000000002},"last":9.7880000000000003},{"interface":"front","average":{"1min":16.032,"5min":22.309999999999999,"15min":33.643000000000001},"min":{"1min":7.2750000000000004,"5min":4.9809999999999999,"15min":4.9809999999999999},"max":{"1min":88.522000000000006,"5min":190.19399999999999,"15min":328.70400000000001},"last":15.071999999999999}]},{"osd":2,"last update":"Fri Feb 9 08:34:36 2024","interfaces":[{"interface":"back","average":{"1min":20.32,"5min":21.036999999999999,"15min":30.809999999999999},"min":{"1min":7.79,"5min":7.5300000000000002,"15min":6.8380000000000001},"max":{"1min":109.685,"5min":154.72399999999999,"15min":296.97199999999998},"last":11.036},{"interface":"front","average":{"1min":28.870000000000001,"5min":27.794,"15min":39.774999999999999},"min":{"1min":11.637,"5min":8.6769999999999996,"15min":8.6769999999999996},"max":{"1min":197.815,"5min":197.815,"15min":307.27800000000002},"last":14.441000000000001}]},{"osd":4,"last update":"Fri Feb 9 08:33:44 2024","interfaces":[{"interface":"back","average":{"1min":15.788,"5min":34.143000000000001,"15min":43.649999999999999},"min":{"1min":11.162000000000001,"5min":9.0449999999999999,"15min":7.1340000000000003},"max":{"1min":19.582000000000001,"5min":331.005,"15min":590.62699999999995},"last":11.715},{"interface":"front","average":{"1min":14.061999999999999,"5min":30.212,"15min":39.517000000000003},"min":{"1min":8.3049999999999997,"5min":8.3049999999999997,"15min":8.3049999999999997},"max":{"1min":19.045000000000002,"5min":199.39099999999999,"15min":360.63799999999998},"last":16.286000000000001}]},{"osd":5,"last update":"Fri Feb 9 08:34:19 2024","interfaces":[{"interface":"back","average":{"1min":9.4120000000000008,"5min":27.838999999999999,"15min":38.497999999999998},"min":{"1min":6.3940000000000001,"5min":6.3940000000000001,"15min":6.3179999999999996},"max":{"1min":14.587999999999999,"5min":287.38499999999999,"15min":593.90599999999995},"last":13.683},{"interface":"front","average":{"1min":15.715,"5min":37.125,"15min":46.695},"min":{"1min":10.574999999999999,"5min":10.532999999999999,"15min":7.7590000000000003},"max":{"1min":21.821000000000002,"5min":296.96100000000001,"15min":595.14099999999996},"last":12.401}]},{"osd":6,"last update":"Fri Feb 9 08:33:44 2024","interfaces":[{"interface":"back","average":{"1min":12.772,"5min":32.241999999999997,"15min":41.530999999999999},"min":{"1min":7.4219999999999997,"5min":6.585,"15min":6.585},"max":{"1min":20.042999999999999,"5min":180.024,"15min":466.93099999999998},"last":17.021000000000001},{"interface":"front","average":{"1min":14.462,"5min":36.073,"15min":42.298000000000002},"min":{"1min":9.9939999999999998,"5min":9.2439999999999998,"15min":7.5599999999999996},"max":{"1min":19.867000000000001,"5min":340.75099999999998,"15min":713.92999999999995},"last":15.701000000000001}]},{"osd":7,"last update":"Fri Feb 9 08:33:49 2024","interfaces":[{"interface":"back","average":{"1min":17.872,"5min":37.258000000000003,"15min":47.962000000000003},"min":{"1min":11.401999999999999,"5min":8.3849999999999998,"15min":8.3849999999999998},"max":{"1min":25.266999999999999,"5min":247.81800000000001,"15min":591.36599999999999},"last":17.725999999999999},{"interface":"front","average":{"1min":19.061,"5min":40.015000000000001,"15min":50.957999999999998},"min":{"1min":13.031000000000001,"5min":12.263,"15min":11.82},"max":{"1min":24.359999999999999,"5min":287.39999999999998,"15min":815.34000000000003},"last":19.597999999999999}]}]},{"osd":4,"up_from":20,"seq":85899346297,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66932,"kb_used_data":3816,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94304908,"statfs":{"total":96636764160,"available":96568225792,"internally_reserved":0,"allocated":3907584,"data_stored":1582236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":49,"apply_latency_ms":49,"commit_latency_ns":49000000,"apply_latency_ns":49000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 9 08:34:44 2024","interfaces":[{"interface":"back","average":{"1min":10.693,"5min":17.425000000000001,"15min":22.245000000000001},"min":{"1min":4.7210000000000001,"5min":4.7210000000000001,"15min":4.1289999999999996},"max":{"1min":26.428999999999998,"5min":230.53100000000001,"15min":436.31999999999999},"last":129.28800000000001},{"interface":"front","average":{"1min":11.77,"5min":14.401999999999999,"15min":20.047999999999998},"min":{"1min":5.7830000000000004,"5min":5.4669999999999996,"15min":4.6539999999999999},"max":{"1min":72.087000000000003,"5min":122.212,"15min":313.82600000000002},"last":167.53399999999999}]},{"osd":1,"last update":"Fri Feb 9 08:34:44 2024","interfaces":[{"interface":"back","average":{"1min":13.816000000000001,"5min":16.184999999999999,"15min":22.974},"min":{"1min":7.6779999999999999,"5min":7.1020000000000003,"15min":5.2560000000000002},"max":{"1min":42.305,"5min":181.512,"15min":267.11399999999998},"last":50.877000000000002},{"interface":"front","average":{"1min":17.181999999999999,"5min":24.428999999999998,"15min":27.335000000000001},"min":{"1min":9.5890000000000004,"5min":7.0650000000000004,"15min":5.282},"max":{"1min":41.612000000000002,"5min":450.27100000000002,"15min":450.27100000000002},"last":51.520000000000003}]},{"osd":2,"last update":"Fri Feb 9 08:34:44 2024","interfaces":[{"interface":"back","average":{"1min":14.859999999999999,"5min":18.300000000000001,"15min":24.43},"min":{"1min":6.4489999999999998,"5min":6.3209999999999997,"15min":6.1159999999999997},"max":{"1min":62.048000000000002,"5min":133.65600000000001,"15min":380.56599999999997},"last":91.189999999999998},{"interface":"front","average":{"1min":18.081,"5min":21.329000000000001,"15min":28.344999999999999},"min":{"1min":7.6710000000000003,"5min":6.7039999999999997,"15min":6.7039999999999997},"max":{"1min":149.84800000000001,"5min":150.18100000000001,"15min":328.28100000000001},"last":56.432000000000002}]},{"osd":3,"last update":"Fri Feb 9 08:34:45 2024","interfaces":[{"interface":"back","average":{"1min":16.779,"5min":20.786000000000001,"15min":33.490000000000002},"min":{"1min":7.3289999999999997,"5min":6.8360000000000003,"15min":6.8360000000000003},"max":{"1min":115.795,"5min":147.76900000000001,"15min":957.68299999999999},"last":92.641000000000005},{"interface":"front","average":{"1min":20.568999999999999,"5min":23.959,"15min":35.015000000000001},"min":{"1min":9.9320000000000004,"5min":8.4870000000000001,"15min":6.7359999999999998},"max":{"1min":151.346,"5min":203.74700000000001,"15min":1190.1980000000001},"last":65.085999999999999}]},{"osd":5,"last update":"Fri Feb 9 08:34:44 2024","interfaces":[{"interface":"back","average":{"1min":24.512,"5min":17.521000000000001,"15min":25.984999999999999},"min":{"1min":6.2759999999999998,"5min":6.2759999999999998,"15min":6.2759999999999998},"max":{"1min":305.34100000000001,"5min":305.34100000000001,"15min":375.72000000000003},"last":91.853999999999999},{"interface":"front","average":{"1min":21.675999999999998,"5min":22.166,"15min":26.899000000000001},"min":{"1min":10.917999999999999,"5min":10.558,"15min":6.585},"max":{"1min":128.261,"5min":141.596,"15min":429.53500000000003},"last":62.545000000000002}]},{"osd":6,"last update":"Fri Feb 9 08:34:44 2024","interfaces":[{"interface":"back","average":{"1min":24.588000000000001,"5min":25.984999999999999,"15min":30.030999999999999},"min":{"1min":12.113,"5min":11.869999999999999,"15min":8.4760000000000009},"max":{"1min":100.815,"5min":205.577,"15min":300.27100000000002},"last":64.358999999999995},{"interface":"front","average":{"1min":35.454999999999998,"5min":24.370000000000001,"15min":29.376999999999999},"min":{"1min":8.0079999999999991,"5min":7.0389999999999997,"15min":7.0389999999999997},"max":{"1min":378.00099999999998,"5min":378.00099999999998,"15min":378.00099999999998},"last":97.787999999999997}]},{"osd":7,"last update":"Fri Feb 9 08:34:44 2024","interfaces":[{"interface":"back","average":{"1min":18.373999999999999,"5min":18.158999999999999,"15min":27.742000000000001},"min":{"1min":8.9670000000000005,"5min":6.2039999999999997,"15min":6.2039999999999997},"max":{"1min":93.730000000000004,"5min":93.730000000000004,"15min":349.47500000000002},"last":63.481999999999999},{"interface":"front","average":{"1min":21.815000000000001,"5min":19.652999999999999,"15min":28.613},"min":{"1min":9.1069999999999993,"5min":9.0739999999999998,"15min":9.0739999999999998},"max":{"1min":130.899,"5min":130.899,"15min":381.80399999999997},"last":104.66800000000001}]}]},{"osd":1,"up_from":16,"seq":68719477112,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71476,"kb_used_data":4196,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94300364,"statfs":{"total":96636764160,"available":96563572736,"internally_reserved":0,"allocated":4296704,"data_stored":1973064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":56,"apply_latency_ms":56,"commit_latency_ns":56000000,"apply_latency_ns":56000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 9 08:34:05 2024","interfaces":[{"interface":"back","average":{"1min":9.9629999999999992,"5min":23.974,"15min":21.896999999999998},"min":{"1min":6.3019999999999996,"5min":5.532,"15min":4.431},"max":{"1min":17.344999999999999,"5min":206.726,"15min":212.11199999999999},"last":8.0220000000000002},{"interface":"front","average":{"1min":13.121,"5min":29.670000000000002,"15min":27.291},"min":{"1min":8.6069999999999993,"5min":7.867,"15min":4.8849999999999998},"max":{"1min":21.439,"5min":246.137,"15min":468.82799999999997},"last":11.722}]},{"osd":2,"last update":"Fri Feb 9 08:34:31 2024","interfaces":[{"interface":"back","average":{"1min":33.371000000000002,"5min":24.713999999999999,"15min":24.129000000000001},"min":{"1min":9.1159999999999997,"5min":6.2510000000000003,"15min":5.2809999999999997},"max":{"1min":202.48500000000001,"5min":202.48500000000001,"15min":264.06400000000002},"last":14.167},{"interface":"front","average":{"1min":32.582999999999998,"5min":27.651,"15min":30.681000000000001},"min":{"1min":9.7490000000000006,"5min":7.8879999999999999,"15min":7.5179999999999998},"max":{"1min":164.06299999999999,"5min":181.94900000000001,"15min":417.31599999999997},"last":15.422000000000001}]},{"osd":3,"last update":"Fri Feb 9 08:34:31 2024","interfaces":[{"interface":"back","average":{"1min":21.018000000000001,"5min":25.486000000000001,"15min":30.059000000000001},"min":{"1min":8.2370000000000001,"5min":6.2460000000000004,"15min":6.2460000000000004},"max":{"1min":146.39099999999999,"5min":237.40799999999999,"15min":421.22300000000001},"last":11.073},{"interface":"front","average":{"1min":23.954000000000001,"5min":29.001999999999999,"15min":32.527000000000001},"min":{"1min":9.7919999999999998,"5min":9.6479999999999997,"15min":8.5730000000000004},"max":{"1min":150.655,"5min":251.86199999999999,"15min":434.92500000000001},"last":12.401999999999999}]},{"osd":4,"last update":"Fri Feb 9 08:33:48 2024","interfaces":[{"interface":"back","average":{"1min":15.727,"5min":22.158000000000001,"15min":22.741},"min":{"1min":10.606,"5min":9.0600000000000005,"15min":7.8849999999999998},"max":{"1min":23.405000000000001,"5min":139.489,"15min":179.96700000000001},"last":14.807},{"interface":"front","average":{"1min":10.336,"5min":17.417000000000002,"15min":20.902000000000001},"min":{"1min":6.4489999999999998,"5min":5.6890000000000001,"15min":5.6890000000000001},"max":{"1min":24.408999999999999,"5min":151.87799999999999,"15min":179.363},"last":6.7649999999999997}]},{"osd":5,"last update":"Fri Feb 9 08:34:05 2024","interfaces":[{"interface":"back","average":{"1min":10.693,"5min":23.084,"15min":28.024999999999999},"min":{"1min":6.8529999999999998,"5min":6.3220000000000001,"15min":6.3220000000000001},"max":{"1min":16.337,"5min":195.422,"15min":455.44299999999998},"last":13.459},{"interface":"front","average":{"1min":13.891999999999999,"5min":25.102,"15min":31.346},"min":{"1min":9.3130000000000006,"5min":8.0899999999999999,"15min":8.0899999999999999},"max":{"1min":19.707999999999998,"5min":197.43199999999999,"15min":469.512},"last":8.6199999999999992}]},{"osd":6,"last update":"Fri Feb 9 08:34:31 2024","interfaces":[{"interface":"back","average":{"1min":26.119,"5min":25.067,"15min":28.399000000000001},"min":{"1min":10.398999999999999,"5min":9.6460000000000008,"15min":8.1270000000000007},"max":{"1min":175.44,"5min":175.44,"15min":345.596},"last":24.137},{"interface":"front","average":{"1min":28.597000000000001,"5min":28.733000000000001,"15min":30.506},"min":{"1min":12.433,"5min":11.949,"15min":7.7160000000000002},"max":{"1min":176.929,"5min":176.929,"15min":423.88400000000001},"last":26.404}]},{"osd":7,"last update":"Fri Feb 9 08:34:31 2024","interfaces":[{"interface":"back","average":{"1min":27.841999999999999,"5min":27.408999999999999,"15min":30.664000000000001},"min":{"1min":11.976000000000001,"5min":11.976000000000001,"15min":9.1010000000000009},"max":{"1min":128.32599999999999,"5min":159.02600000000001,"15min":418.42500000000001},"last":25.754999999999999},{"interface":"front","average":{"1min":27.018999999999998,"5min":28.265000000000001,"15min":30.824000000000002},"min":{"1min":13.486000000000001,"5min":12.634,"15min":8.8149999999999995},"max":{"1min":130.70599999999999,"5min":161.59999999999999,"15min":377.685},"last":27.038}]}]},{"osd":7,"up_from":15,"seq":64424509823,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71132,"kb_used_data":3852,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94300708,"statfs":{"total":96636764160,"available":96563924992,"internally_reserved":0,"allocated":3944448,"data_stored":1603519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":68876746},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 9 08:34:00 2024","interfaces":[{"interface":"back","average":{"1min":9.5739999999999998,"5min":20.443000000000001,"15min":19.920999999999999},"min":{"1min":4.3600000000000003,"5min":4.3600000000000003,"15min":4.3600000000000003},"max":{"1min":15.842000000000001,"5min":312.15699999999998,"15min":312.15699999999998},"last":145.61799999999999},{"interface":"front","average":{"1min":10.407,"5min":22.914000000000001,"15min":21.405000000000001},"min":{"1min":6.7590000000000003,"5min":4.5410000000000004,"15min":4.0830000000000002},"max":{"1min":17.901,"5min":315.53399999999999,"15min":315.53399999999999},"last":127.39700000000001}]},{"osd":1,"last update":"Fri Feb 9 08:34:48 2024","interfaces":[{"interface":"back","average":{"1min":16.395,"5min":21.608000000000001,"15min":33.338999999999999},"min":{"1min":6.5149999999999997,"5min":5.859,"15min":4.5279999999999996},"max":{"1min":76.780000000000001,"5min":277.971,"15min":1551.0129999999999},"last":9.1920000000000002},{"interface":"front","average":{"1min":19.09,"5min":23.619,"15min":31.817},"min":{"1min":9.5350000000000001,"5min":5.5709999999999997,"15min":5.5709999999999997},"max":{"1min":75.843999999999994,"5min":318.48500000000001,"15min":1189.5050000000001},"last":10.606999999999999}]},{"osd":2,"last update":"Fri Feb 9 08:34:00 2024","interfaces":[{"interface":"back","average":{"1min":9.8390000000000004,"5min":25.876000000000001,"15min":23.849},"min":{"1min":5.7249999999999996,"5min":5.7249999999999996,"15min":5.7249999999999996},"max":{"1min":15.551,"5min":309.161,"15min":309.161},"last":38.692999999999998},{"interface":"front","average":{"1min":13.532,"5min":29.146999999999998,"15min":25.814},"min":{"1min":7.7130000000000001,"5min":6.9539999999999997,"15min":6.9050000000000002},"max":{"1min":18.120999999999999,"5min":333.91399999999999,"15min":333.91399999999999},"last":114.569}]},{"osd":3,"last update":"Fri Feb 9 08:34:11 2024","interfaces":[{"interface":"back","average":{"1min":13.24,"5min":28.524000000000001,"15min":32.805},"min":{"1min":6.516,"5min":6.516,"15min":6.516},"max":{"1min":18.763000000000002,"5min":310.67399999999998,"15min":429.62799999999999},"last":7.2450000000000001},{"interface":"front","average":{"1min":12.640000000000001,"5min":28.494,"15min":36.866},"min":{"1min":7.9139999999999997,"5min":6.3680000000000003,"15min":6.3680000000000003},"max":{"1min":17.683,"5min":317.71699999999998,"15min":485.76100000000002},"last":11.58}]},{"osd":4,"last update":"Fri Feb 9 08:34:48 2024","interfaces":[{"interface":"back","average":{"1min":17.018999999999998,"5min":30.007000000000001,"15min":29.927},"min":{"1min":7.8369999999999997,"5min":7.7869999999999999,"15min":7.7869999999999999},"max":{"1min":47.853999999999999,"5min":324.089,"15min":345.54300000000001},"last":9.9860000000000007},{"interface":"front","average":{"1min":19.475999999999999,"5min":32.319000000000003,"15min":31.989999999999998},"min":{"1min":10.106,"5min":10.106,"15min":10.106},"max":{"1min":49.270000000000003,"5min":316.80399999999997,"15min":316.80399999999997},"last":13.393000000000001}]},{"osd":5,"last update":"Fri Feb 9 08:34:00 2024","interfaces":[{"interface":"back","average":{"1min":13.651999999999999,"5min":28.315999999999999,"15min":27.463999999999999},"min":{"1min":8.3100000000000005,"5min":6.6689999999999996,"15min":6.1459999999999999},"max":{"1min":17.518999999999998,"5min":333.00700000000001,"15min":333.00700000000001},"last":157.42500000000001},{"interface":"front","average":{"1min":14.571,"5min":33.612000000000002,"15min":28.629000000000001},"min":{"1min":9.7680000000000007,"5min":7.508,"15min":6.3499999999999996},"max":{"1min":19.318000000000001,"5min":352.358,"15min":352.358},"last":135.202}]},{"osd":6,"last update":"Fri Feb 9 08:34:00 2024","interfaces":[{"interface":"back","average":{"1min":15.510999999999999,"5min":30.286000000000001,"15min":27.253},"min":{"1min":11.512,"5min":7.2240000000000002,"15min":6.8879999999999999},"max":{"1min":21.469000000000001,"5min":338.29000000000002,"15min":338.29000000000002},"last":139.09299999999999},{"interface":"front","average":{"1min":17.114999999999998,"5min":34.948,"15min":31.806999999999999},"min":{"1min":12.204000000000001,"5min":12.204000000000001,"15min":9.3729999999999993},"max":{"1min":22.376999999999999,"5min":349.34500000000003,"15min":349.34500000000003},"last":146.25}]}]},{"osd":6,"up_from":15,"seq":64424509822,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71116,"kb_used_data":3844,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94300724,"statfs":{"total":96636764160,"available":96563941376,"internally_reserved":0,"allocated":3936256,"data_stored":1596700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,1],"upper_bound":2048},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 9 08:34:02 2024","interfaces":[{"interface":"back","average":{"1min":8.6820000000000004,"5min":18.645,"15min":24.832000000000001},"min":{"1min":4.2380000000000004,"5min":4.2380000000000004,"15min":4.1589999999999998},"max":{"1min":18.015000000000001,"5min":167.62899999999999,"15min":318.44400000000002},"last":6.5609999999999999},{"interface":"front","average":{"1min":10.906000000000001,"5min":22.431999999999999,"15min":27.635999999999999},"min":{"1min":5.8159999999999998,"5min":4.6589999999999998,"15min":4.6589999999999998},"max":{"1min":17.667999999999999,"5min":216.55000000000001,"15min":340.25599999999997},"last":8.2449999999999992}]},{"osd":1,"last update":"Fri Feb 9 08:34:08 2024","interfaces":[{"interface":"back","average":{"1min":8.4719999999999995,"5min":28.818999999999999,"15min":28.925999999999998},"min":{"1min":6.0149999999999997,"5min":5.9960000000000004,"15min":5.093},"max":{"1min":15.109,"5min":368.74200000000002,"15min":664.64300000000003},"last":9.0440000000000005},{"interface":"front","average":{"1min":11.473000000000001,"5min":30.515999999999998,"15min":29.097000000000001},"min":{"1min":8.0129999999999999,"5min":7.1449999999999996,"15min":6.5780000000000003},"max":{"1min":18.710000000000001,"5min":258.34500000000003,"15min":369.96899999999999},"last":16.323}]},{"osd":2,"last update":"Fri Feb 9 08:34:02 2024","interfaces":[{"interface":"back","average":{"1min":12.372,"5min":27.215,"15min":29.059999999999999},"min":{"1min":7.3799999999999999,"5min":6.7300000000000004,"15min":6.7300000000000004},"max":{"1min":19.559999999999999,"5min":290.71600000000001,"15min":290.71600000000001},"last":15.663},{"interface":"front","average":{"1min":13.106999999999999,"5min":26.222999999999999,"15min":28.597000000000001},"min":{"1min":8.1549999999999994,"5min":7.2320000000000002,"15min":6.6719999999999997},"max":{"1min":18.646000000000001,"5min":286.08699999999999,"15min":286.08699999999999},"last":18.234999999999999}]},{"osd":3,"last update":"Fri Feb 9 08:34:08 2024","interfaces":[{"interface":"back","average":{"1min":14.584,"5min":33.146000000000001,"15min":34.277000000000001},"min":{"1min":9.1270000000000007,"5min":8.827,"15min":7.5209999999999999},"max":{"1min":19.896000000000001,"5min":247.40700000000001,"15min":400.87099999999998},"last":14.253},{"interface":"front","average":{"1min":12.955,"5min":31.477,"15min":38.030999999999999},"min":{"1min":9.0350000000000001,"5min":6.4420000000000002,"15min":6.4420000000000002},"max":{"1min":17.111999999999998,"5min":273.38499999999999,"15min":401.97300000000001},"last":9.7759999999999998}]},{"osd":4,"last update":"Fri Feb 9 08:34:42 2024","interfaces":[{"interface":"back","average":{"1min":27.59,"5min":28.632999999999999,"15min":29.07},"min":{"1min":11.359,"5min":8.8100000000000005,"15min":6.9800000000000004},"max":{"1min":193.97499999999999,"5min":243.23599999999999,"15min":339.286},"last":11.02},{"interface":"front","average":{"1min":30.446000000000002,"5min":34.627000000000002,"15min":35.954000000000001},"min":{"1min":14.337999999999999,"5min":11.573,"15min":10.298999999999999},"max":{"1min":198.60400000000001,"5min":243.86600000000001,"15min":402.19099999999997},"last":19.166}]},{"osd":5,"last update":"Fri Feb 9 08:34:02 2024","interfaces":[{"interface":"back","average":{"1min":13.428000000000001,"5min":26.620999999999999,"15min":25.609000000000002},"min":{"1min":7.5650000000000004,"5min":6.8390000000000004,"15min":6.0170000000000003},"max":{"1min":19.347999999999999,"5min":395.89999999999998,"15min":395.89999999999998},"last":11.683999999999999},{"interface":"front","average":{"1min":18.483000000000001,"5min":39.442999999999998,"15min":34.320999999999998},"min":{"1min":14.18,"5min":8.1449999999999996,"15min":8.1449999999999996},"max":{"1min":22.501999999999999,"5min":665.33799999999997,"15min":665.33799999999997},"last":17.053999999999998}]},{"osd":7,"last update":"Fri Feb 9 08:33:52 2024","interfaces":[{"interface":"back","average":{"1min":15.175000000000001,"5min":25.763000000000002,"15min":27.503},"min":{"1min":10.571,"5min":7.9889999999999999,"15min":7.9429999999999996},"max":{"1min":22.690999999999999,"5min":264.161,"15min":326.23200000000003},"last":12.798},{"interface":"front","average":{"1min":16.957000000000001,"5min":30.276,"15min":30.678999999999998},"min":{"1min":12.988,"5min":10.56,"15min":8.7810000000000006},"max":{"1min":20.411000000000001,"5min":253.45599999999999,"15min":315.09199999999998},"last":13.538}]}]},{"osd":2,"up_from":15,"seq":64424509818,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71108,"kb_used_data":3828,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94300732,"statfs":{"total":96636764160,"available":96563949568,"internally_reserved":0,"allocated":3919872,"data_stored":1589569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 9 08:33:53 2024","interfaces":[{"interface":"back","average":{"1min":11.448,"5min":18.757999999999999,"15min":22.998999999999999},"min":{"1min":7.4720000000000004,"5min":5.6719999999999997,"15min":4.1859999999999999},"max":{"1min":14.856999999999999,"5min":236.542,"15min":240.815},"last":10.526999999999999},{"interface":"front","average":{"1min":12.445,"5min":20.640999999999998,"15min":27.609999999999999},"min":{"1min":6.8529999999999998,"5min":6.8529999999999998,"15min":5.0830000000000002},"max":{"1min":16.725000000000001,"5min":237.27000000000001,"15min":258.41800000000001},"last":16.097999999999999}]},{"osd":1,"last update":"Fri Feb 9 08:34:34 2024","interfaces":[{"interface":"back","average":{"1min":19.222999999999999,"5min":13.205,"15min":27.302},"min":{"1min":5.681,"5min":5.2800000000000002,"15min":5.2080000000000002},"max":{"1min":170.83000000000001,"5min":170.83000000000001,"15min":752.81500000000005},"last":11.952999999999999},{"interface":"front","average":{"1min":26.896999999999998,"5min":23.623999999999999,"15min":36.237000000000002},"min":{"1min":9.7539999999999996,"5min":9.5890000000000004,"15min":6.8819999999999997},"max":{"1min":169.58099999999999,"5min":202.91,"15min":752.245},"last":15.208}]},{"osd":3,"last update":"Fri Feb 9 08:33:53 2024","interfaces":[{"interface":"back","average":{"1min":14.416,"5min":32.816000000000003,"15min":38.335999999999999},"min":{"1min":8.1020000000000003,"5min":6.7709999999999999,"15min":5.7949999999999999},"max":{"1min":20.547000000000001,"5min":325.14499999999998,"15min":846.35400000000004},"last":16.936},{"interface":"front","average":{"1min":8.6099999999999994,"5min":21.760000000000002,"15min":32.759},"min":{"1min":6.0640000000000001,"5min":5.9969999999999999,"15min":5.5490000000000004},"max":{"1min":15.869999999999999,"5min":235.749,"15min":334.87900000000002},"last":8.3989999999999991}]},{"osd":4,"last update":"Fri Feb 9 08:33:53 2024","interfaces":[{"interface":"back","average":{"1min":15.02,"5min":23.645,"15min":29.68},"min":{"1min":10.976000000000001,"5min":10.058999999999999,"15min":7.7110000000000003},"max":{"1min":17.728000000000002,"5min":254.77799999999999,"15min":423.28199999999998},"last":17.792000000000002},{"interface":"front","average":{"1min":17.015000000000001,"5min":26.844000000000001,"15min":31.972999999999999},"min":{"1min":12.914999999999999,"5min":12.321999999999999,"15min":10.821999999999999},"max":{"1min":18.706,"5min":253.941,"15min":297.73399999999998},"last":19.449999999999999}]},{"osd":5,"last update":"Fri Feb 9 08:33:53 2024","interfaces":[{"interface":"back","average":{"1min":10.99,"5min":20.640000000000001,"15min":29.731999999999999},"min":{"1min":6.5439999999999996,"5min":6.5439999999999996,"15min":6.1870000000000003},"max":{"1min":20.074999999999999,"5min":150.24799999999999,"15min":319.279},"last":11.199},{"interface":"front","average":{"1min":12.898999999999999,"5min":24.216999999999999,"15min":35.200000000000003},"min":{"1min":9.1419999999999995,"5min":6.21,"15min":6.21},"max":{"1min":21.289999999999999,"5min":283.18900000000002,"15min":314.74299999999999},"last":12.616}]},{"osd":6,"last update":"Fri Feb 9 08:33:53 2024","interfaces":[{"interface":"back","average":{"1min":17.364999999999998,"5min":23.785,"15min":34.709000000000003},"min":{"1min":12.33,"5min":12.33,"15min":9.859},"max":{"1min":19.661000000000001,"5min":138.125,"15min":301.05099999999999},"last":18.789999999999999},{"interface":"front","average":{"1min":18.498000000000001,"5min":26.233000000000001,"15min":35.259999999999998},"min":{"1min":13.566000000000001,"5min":13.566000000000001,"15min":13.298},"max":{"1min":21.442,"5min":135.84399999999999,"15min":273.30500000000001},"last":20.452999999999999}]},{"osd":7,"last update":"Fri Feb 9 08:34:34 2024","interfaces":[{"interface":"back","average":{"1min":15.26,"5min":13.488,"15min":26.422999999999998},"min":{"1min":7.3300000000000001,"5min":7.3300000000000001,"15min":6.3849999999999998},"max":{"1min":86.403000000000006,"5min":88.838999999999999,"15min":303.416},"last":9.7400000000000002},{"interface":"front","average":{"1min":19.038,"5min":16.216000000000001,"15min":30.358000000000001},"min":{"1min":8.7520000000000007,"5min":8.2449999999999992,"15min":7.7999999999999998},"max":{"1min":107.05,"5min":107.05,"15min":498.34300000000002},"last":13.340999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509816,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66956,"kb_used_data":3844,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94304884,"statfs":{"total":96636764160,"available":96568201216,"internally_reserved":0,"allocated":3936256,"data_stored":1596577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":60,"apply_latency_ms":60,"commit_latency_ns":60000000,"apply_latency_ns":60000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Feb 9 08:34:30 2024","interfaces":[{"interface":"back","average":{"1min":13.795,"5min":19.091000000000001,"15min":26.939},"min":{"1min":5.9130000000000003,"5min":4.306,"15min":4.306},"max":{"1min":45.713000000000001,"5min":119.645,"15min":305.28699999999998},"last":9.7490000000000006},{"interface":"front","average":{"1min":25.221,"5min":25.786999999999999,"15min":37.503999999999998},"min":{"1min":7.8170000000000002,"5min":6.3170000000000002,"15min":6.3170000000000002},"max":{"1min":213.21299999999999,"5min":229.71100000000001,"15min":409.27699999999999},"last":16.286999999999999}]},{"osd":2,"last update":"Fri Feb 9 08:33:53 2024","interfaces":[{"interface":"back","average":{"1min":8.4039999999999999,"5min":19.187999999999999,"15min":23.126000000000001},"min":{"1min":5.9379999999999997,"5min":5.6269999999999998,"15min":4.7439999999999998},"max":{"1min":16.463999999999999,"5min":170.73500000000001,"15min":391.44600000000003},"last":5.9649999999999999},{"interface":"front","average":{"1min":9.3409999999999993,"5min":22.885000000000002,"15min":25.742000000000001},"min":{"1min":5.4619999999999997,"5min":4.5469999999999997,"15min":4.5469999999999997},"max":{"1min":13.901999999999999,"5min":291.63200000000001,"15min":312.03899999999999},"last":8.1799999999999997}]},{"osd":3,"last update":"Fri Feb 9 08:34:40 2024","interfaces":[{"interface":"back","average":{"1min":20.146999999999998,"5min":23.992999999999999,"15min":39.951999999999998},"min":{"1min":9.1579999999999995,"5min":9.1579999999999995,"15min":8.391},"max":{"1min":65.817999999999998,"5min":188.982,"15min":464.74900000000002},"last":12.709},{"interface":"front","average":{"1min":24.324999999999999,"5min":29.202000000000002,"15min":46.600000000000001},"min":{"1min":14.225,"5min":11.369999999999999,"15min":10.288},"max":{"1min":66.498999999999995,"5min":191.452,"15min":472.88},"last":17.231999999999999}]},{"osd":4,"last update":"Fri Feb 9 08:34:40 2024","interfaces":[{"interface":"back","average":{"1min":30.094000000000001,"5min":26.760999999999999,"15min":42.034999999999997},"min":{"1min":12.295999999999999,"5min":10.787000000000001,"15min":6.9569999999999999},"max":{"1min":213.91499999999999,"5min":213.91499999999999,"15min":544.02800000000002},"last":13.366},{"interface":"front","average":{"1min":16.696999999999999,"5min":19.814,"15min":31.989000000000001},"min":{"1min":6.5010000000000003,"5min":6.5010000000000003,"15min":5.8869999999999996},"max":{"1min":93.179000000000002,"5min":206.73400000000001,"15min":377.84300000000002},"last":9.1460000000000008}]},{"osd":5,"last update":"Fri Feb 9 08:34:10 2024","interfaces":[{"interface":"back","average":{"1min":17.556999999999999,"5min":37.707999999999998,"15min":39.712000000000003},"min":{"1min":14.488,"5min":11.706,"15min":7.0730000000000004},"max":{"1min":21.827000000000002,"5min":363.94499999999999,"15min":432.82999999999998},"last":18.125},{"interface":"front","average":{"1min":11.15,"5min":28.911999999999999,"15min":41.231999999999999},"min":{"1min":7.3319999999999999,"5min":6.532,"15min":6.532},"max":{"1min":15.500999999999999,"5min":327.69499999999999,"15min":357.50999999999999},"last":14.010999999999999}]},{"osd":6,"last update":"Fri Feb 9 08:34:30 2024","interfaces":[{"interface":"back","average":{"1min":13.712999999999999,"5min":24.167000000000002,"15min":37.954000000000001},"min":{"1min":7.2910000000000004,"5min":7.2910000000000004,"15min":6.399},"max":{"1min":36.033999999999999,"5min":156.667,"15min":544.94200000000001},"last":11.486000000000001},{"interface":"front","average":{"1min":16.936,"5min":21.940000000000001,"15min":39.573999999999998},"min":{"1min":10.241,"5min":7.8369999999999997,"15min":7.8369999999999997},"max":{"1min":42.064999999999998,"5min":179.739,"15min":556.30200000000002},"last":14.625}]},{"osd":7,"last update":"Fri Feb 9 08:34:05 2024","interfaces":[{"interface":"back","average":{"1min":18.141999999999999,"5min":31.879999999999999,"15min":39.683999999999997},"min":{"1min":13.984,"5min":13.481,"15min":12.752000000000001},"max":{"1min":22.928000000000001,"5min":195.91499999999999,"15min":376.91800000000001},"last":19.088999999999999},{"interface":"front","average":{"1min":13.333,"5min":24.809999999999999,"15min":28.041},"min":{"1min":8.516,"5min":7.3310000000000004,"15min":7.0880000000000001},"max":{"1min":19.937999999999999,"5min":204.74199999999999,"15min":342.79300000000001},"last":12.305999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575228,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":75616,"kb_used_data":4180,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94296224,"statfs":{"total":96636764160,"available":96559333376,"internally_reserved":0,"allocated":4280320,"data_stored":1965730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":59,"apply_latency_ms":59,"commit_latency_ns":59000000,"apply_latency_ns":59000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 9 08:34:12 2024","interfaces":[{"interface":"back","average":{"1min":8.1720000000000006,"5min":15.773999999999999,"15min":23.449000000000002},"min":{"1min":4.9909999999999997,"5min":4.5490000000000004,"15min":4.4509999999999996},"max":{"1min":16.233000000000001,"5min":146.63499999999999,"15min":403.41699999999997},"last":10.782999999999999},{"interface":"front","average":{"1min":11.595000000000001,"5min":16.646000000000001,"15min":23.884},"min":{"1min":5.1130000000000004,"5min":4.7370000000000001,"15min":4.391},"max":{"1min":21.962,"5min":194.32300000000001,"15min":279.5},"last":8.3469999999999995}]},{"osd":1,"last update":"Fri Feb 9 08:33:49 2024","interfaces":[{"interface":"back","average":{"1min":8.6229999999999993,"5min":27.541,"15min":24.477},"min":{"1min":6.0750000000000002,"5min":5.6989999999999998,"15min":5.4550000000000001},"max":{"1min":14.645,"5min":303.23500000000001,"15min":303.23500000000001},"last":9.2010000000000005},{"interface":"front","average":{"1min":13.464,"5min":34.292000000000002,"15min":29.831},"min":{"1min":8.0449999999999999,"5min":7.3390000000000004,"15min":6.7709999999999999},"max":{"1min":17.835999999999999,"5min":294.35000000000002,"15min":294.35000000000002},"last":18.908999999999999}]},{"osd":2,"last update":"Fri Feb 9 08:34:32 2024","interfaces":[{"interface":"back","average":{"1min":25.158999999999999,"5min":24.327000000000002,"15min":28.507000000000001},"min":{"1min":7.7759999999999998,"5min":6.415,"15min":6.415},"max":{"1min":174.41999999999999,"5min":287.077,"15min":364.81400000000002},"last":18.245000000000001},{"interface":"front","average":{"1min":18.797999999999998,"5min":20.239999999999998,"15min":25.591999999999999},"min":{"1min":7.3109999999999999,"5min":7.3109999999999999,"15min":6.5540000000000003},"max":{"1min":128.667,"5min":176.416,"15min":339.12700000000001},"last":21.809999999999999}]},{"osd":3,"last update":"Fri Feb 9 08:34:32 2024","interfaces":[{"interface":"back","average":{"1min":29.274999999999999,"5min":27.763000000000002,"15min":34.323999999999998},"min":{"1min":8.1790000000000003,"5min":7.1130000000000004,"15min":7.1130000000000004},"max":{"1min":212.745,"5min":282.11000000000001,"15min":342.459},"last":17.446999999999999},{"interface":"front","average":{"1min":24.997,"5min":25.640000000000001,"15min":31.324999999999999},"min":{"1min":7.7409999999999997,"5min":7.234,"15min":6.7409999999999997},"max":{"1min":162.99600000000001,"5min":277.74700000000001,"15min":323.46899999999999},"last":27.866}]},{"osd":4,"last update":"Fri Feb 9 08:34:32 2024","interfaces":[{"interface":"back","average":{"1min":23.001999999999999,"5min":24.670000000000002,"15min":29.638000000000002},"min":{"1min":8.2539999999999996,"5min":7.0880000000000001,"15min":7.0880000000000001},"max":{"1min":188.62700000000001,"5min":223.655,"15min":336.74000000000001},"last":28.52},{"interface":"front","average":{"1min":23.012,"5min":22.286000000000001,"15min":28.931999999999999},"min":{"1min":8.3960000000000008,"5min":8.0030000000000001,"15min":7.4550000000000001},"max":{"1min":189.79499999999999,"5min":189.79499999999999,"15min":334.48500000000001},"last":22.901}]},{"osd":6,"last update":"Fri Feb 9 08:34:03 2024","interfaces":[{"interface":"back","average":{"1min":16.231000000000002,"5min":21.498999999999999,"15min":30.524999999999999},"min":{"1min":11.324999999999999,"5min":8.2799999999999994,"15min":7.742},"max":{"1min":24.632999999999999,"5min":144.80699999999999,"15min":320.85500000000002},"last":10.499000000000001},{"interface":"front","average":{"1min":18.751999999999999,"5min":24.975000000000001,"15min":33.936},"min":{"1min":12.034000000000001,"5min":11.550000000000001,"15min":10.789},"max":{"1min":25.568000000000001,"5min":188.28700000000001,"15min":411.56599999999997},"last":29.936}]},{"osd":7,"last update":"Fri Feb 9 08:34:03 2024","interfaces":[{"interface":"back","average":{"1min":14.823,"5min":23.667999999999999,"15min":27.585999999999999},"min":{"1min":8.2599999999999998,"5min":7.3650000000000002,"15min":7.3650000000000002},"max":{"1min":20.978000000000002,"5min":202.65100000000001,"15min":300.56200000000001},"last":26.533000000000001},{"interface":"front","average":{"1min":16.170000000000002,"5min":26.033000000000001,"15min":29.986999999999998},"min":{"1min":10.564,"5min":10.087999999999999,"15min":9.2189999999999994},"max":{"1min":23.199999999999999,"5min":187.536,"15min":194.726},"last":9.891}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-09T08:34:54.242 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-09T08:34:54.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.342+0000 7fc744295640 10 monclient: get_monmap_and_config 2024-02-09T08:34:54.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.342+0000 7fc744295640 10 monclient: build_initial_monmap 2024-02-09T08:34:54.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.342+0000 7fc744295640 10 monclient: monmap: 2024-02-09T08:34:54.345 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:34:54.345 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:54.345 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:34:54.343617+0000 2024-02-09T08:34:54.345 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:34:54.343617+0000 2024-02-09T08:34:54.345 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:34:54.345 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:54.345 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:34:54.345 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:34:54.346 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:34:54.346 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:34:54.346 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:34:54.346 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:54.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.343+0000 7fc744295640 1 Processor -- start 2024-02-09T08:34:54.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.343+0000 7fc744295640 1 -- start start 2024-02-09T08:34:54.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.343+0000 7fc744295640 10 monclient: init 2024-02-09T08:34:54.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.343+0000 7fc744295640 10 monclient: _reopen_session rank -1 2024-02-09T08:34:54.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.343+0000 7fc744295640 10 monclient: _add_conns ranks=[1,4,2,3,0] 2024-02-09T08:34:54.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.343+0000 7fc744295640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc73c06c360 addr v1:172.21.15.103:6789/0 2024-02-09T08:34:54.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.343+0000 7fc744295640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc73c0b1ca0 0x7fc73c0aa0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:54.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.343+0000 7fc744295640 10 monclient(hunting): picked mon.noname-c con 0x7fc73c0b1ca0 addr v2:172.21.15.103:3300/0 2024-02-09T08:34:54.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.343+0000 7fc744295640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc73c13f830 0x7fc73c13fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:54.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.343+0000 7fc744295640 10 monclient(hunting): picked mon.noname-b con 0x7fc73c13f830 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:34:54.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.343+0000 7fc744295640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc73c1401b0 con 0x7fc73c06c360 2024-02-09T08:34:54.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.343+0000 7fc744295640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:54.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.343+0000 7fc744295640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc73c06c740 con 0x7fc73c0b1ca0 2024-02-09T08:34:54.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.343+0000 7fc744295640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:54.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.343+0000 7fc744295640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc73c142c60 con 0x7fc73c13f830 2024-02-09T08:34:54.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.343+0000 7fc744295640 10 monclient(hunting): _renew_subs 2024-02-09T08:34:54.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.343+0000 7fc744295640 10 monclient(hunting): authenticate will time out at 3337.704218s 2024-02-09T08:34:54.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.344+0000 7fc741830640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc73c0b1ca0 0x7fc73c0aa0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:54.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.344+0000 7fc742832640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc73c13f830 0x7fc73c13fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:54.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.344+0000 7fc742832640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc73c13f830 0x7fc73c13fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:45666/0 (socket says 172.21.15.62:45666) 2024-02-09T08:34:54.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.344+0000 7fc742832640 1 -- 172.21.15.62:0/2149715711 learned_addr learned my addr 172.21.15.62:0/2149715711 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:34:54.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.344+0000 7fc742832640 10 monclient(hunting): get_auth_request con 0x7fc73c13f830 auth_method 0 2024-02-09T08:34:54.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.344+0000 7fc742832640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:54.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.344+0000 7fc742832640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:54.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.344+0000 7fc742832640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:54.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.344+0000 7fc741830640 10 monclient(hunting): get_auth_request con 0x7fc73c0b1ca0 auth_method 0 2024-02-09T08:34:54.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.344+0000 7fc741830640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:54.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.344+0000 7fc741830640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:54.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.345+0000 7fc741830640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:54.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.345+0000 7fc741830640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:54.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.345+0000 7fc741830640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:54.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.345+0000 7fc741830640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:54.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.345+0000 7fc742832640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:54.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.345+0000 7fc742832640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:54.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.345+0000 7fc742832640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:54.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.346+0000 7fc741830640 10 monclient(hunting): handle_auth_done global_id 22291 payload 274 2024-02-09T08:34:54.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.346+0000 7fc741830640 1 -- 172.21.15.62:0/2149715711 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc73c13f830 msgr2=0x7fc73c13fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:34:54.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.346+0000 7fc741830640 1 --2- 172.21.15.62:0/2149715711 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc73c13f830 0x7fc73c13fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:54.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.346+0000 7fc741830640 1 -- 172.21.15.62:0/2149715711 >> v1:172.21.15.103:6789/0 conn(0x7fc73c06c360 legacy=0x7fc73c142550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:34:54.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.346+0000 7fc741830640 10 monclient: _finish_hunting 0 2024-02-09T08:34:54.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.346+0000 7fc741830640 1 monclient: found mon.noname-c 2024-02-09T08:34:54.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.346+0000 7fc741830640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:34:54.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.346+0000 7fc741830640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.103:3300/0 2024-02-09T08:34:54.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.346+0000 7fc741830640 1 -- 172.21.15.62:0/2149715711 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc73c0a9930 con 0x7fc73c0b1ca0 2024-02-09T08:34:54.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.350+0000 7fc741830640 1 --2- 172.21.15.62:0/2149715711 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc73c0b1ca0 0x7fc73c0aa0f0 secure :-1 s=READY pgs=5654 cs=0 l=1 rev1=1 crypto rx=0x7fc72c0097a0 tx=0x7fc72c02b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8c2c14631360ea7 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:34:54.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.353+0000 7fc74102f640 1 -- 172.21.15.62:0/2149715711 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72c02f050 con 0x7fc73c0b1ca0 2024-02-09T08:34:54.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.353+0000 7fc74102f640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:54.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.353+0000 7fc74102f640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-09T08:34:54.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.353+0000 7fc74102f640 10 monclient: dump: 2024-02-09T08:34:54.357 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:54.357 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:54.357 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:54.357 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:54.357 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:54.357 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:54.358 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:54.358 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:54.358 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:54.358 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:54.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.353+0000 7fc74102f640 10 monclient: _finish_auth 0 2024-02-09T08:34:54.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.353+0000 7fc74102f640 10 monclient: _check_auth_tickets 2024-02-09T08:34:54.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.353+0000 7fc74102f640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:34:54.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.353+0000 7fc74102f640 1 -- 172.21.15.62:0/2149715711 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc72c031700 con 0x7fc73c0b1ca0 2024-02-09T08:34:54.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.353+0000 7fc744295640 5 monclient: authenticate success, global_id 22291 2024-02-09T08:34:54.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.353+0000 7fc744295640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-02-09T08:34:54.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.353+0000 7fc74102f640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:34:54.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.353+0000 7fc744295640 10 monclient: get_monmap_and_config success 2024-02-09T08:34:54.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.353+0000 7fc74102f640 1 -- 172.21.15.62:0/2149715711 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72c031a90 con 0x7fc73c0b1ca0 2024-02-09T08:34:54.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.353+0000 7fc744295640 4 set_mon_vals no callback set 2024-02-09T08:34:54.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.353+0000 7fc74102f640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:54.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.353+0000 7fc74102f640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:34:54.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.353+0000 7fc74102f640 10 monclient: dump: 2024-02-09T08:34:54.359 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:54.359 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:54.359 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:54.359 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:54.359 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:54.359 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:54.359 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:54.360 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:54.360 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:54.360 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:54.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.354+0000 7fc744295640 10 monclient: shutdown 2024-02-09T08:34:54.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.354+0000 7fc744295640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:34:54.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.354+0000 7fc744295640 1 -- 172.21.15.62:0/2149715711 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc73c0b1ca0 msgr2=0x7fc73c0aa0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:54.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.354+0000 7fc744295640 1 --2- 172.21.15.62:0/2149715711 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc73c0b1ca0 0x7fc73c0aa0f0 secure :-1 s=READY pgs=5654 cs=0 l=1 rev1=1 crypto rx=0x7fc72c0097a0 tx=0x7fc72c02b7a0 comp rx=0 tx=0).stop 2024-02-09T08:34:54.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.354+0000 7fc744295640 1 -- 172.21.15.62:0/2149715711 shutdown_connections 2024-02-09T08:34:54.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.354+0000 7fc744295640 1 --2- 172.21.15.62:0/2149715711 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc73c13f830 0x7fc73c13fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:54.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.354+0000 7fc744295640 1 --2- 172.21.15.62:0/2149715711 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc73c0b1ca0 0x7fc73c0aa0f0 unknown :-1 s=CLOSED pgs=5654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:54.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.354+0000 7fc744295640 1 -- 172.21.15.62:0/2149715711 >> 172.21.15.62:0/2149715711 conn(0x7fc73c0b8320 msgr2=0x7fc73c0b8730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:34:54.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.354+0000 7fc744295640 1 -- 172.21.15.62:0/2149715711 shutdown_connections 2024-02-09T08:34:54.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.354+0000 7fc744295640 1 -- 172.21.15.62:0/2149715711 wait complete. 2024-02-09T08:34:54.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.355+0000 7fc744295640 10 monclient: build_initial_monmap 2024-02-09T08:34:54.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.355+0000 7fc744295640 10 monclient: monmap: 2024-02-09T08:34:54.364 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:34:54.365 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:34:54.365 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:34:54.365 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:34:54.365 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:34:54.365 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:54.365 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:34:54.365 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:34:54.365 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:34:54.365 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:54.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.355+0000 7fc744295640 1 librados: starting msgr at 2024-02-09T08:34:54.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.355+0000 7fc744295640 1 librados: starting objecter 2024-02-09T08:34:54.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.355+0000 7fc744295640 1 Processor -- start 2024-02-09T08:34:54.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.355+0000 7fc744295640 1 -- start start 2024-02-09T08:34:54.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.355+0000 7fc744295640 1 librados: setting wanted keys 2024-02-09T08:34:54.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.355+0000 7fc744295640 1 librados: calling monclient init 2024-02-09T08:34:54.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.355+0000 7fc744295640 10 monclient: init 2024-02-09T08:34:54.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.356+0000 7fc744295640 10 monclient: _reopen_session rank -1 2024-02-09T08:34:54.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.356+0000 7fc744295640 10 monclient: _add_conns ranks=[1,2,0] 2024-02-09T08:34:54.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.356+0000 7fc744295640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc73c06c360 0x7fc73c142140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:54.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.356+0000 7fc744295640 10 monclient(hunting): picked mon.noname-b con 0x7fc73c06c360 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:34:54.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.356+0000 7fc744295640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc73c0b1ca0 0x7fc73c141660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:54.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.356+0000 7fc744295640 10 monclient(hunting): picked mon.noname-c con 0x7fc73c0b1ca0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:34:54.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.356+0000 7fc744295640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc73c13f830 0x7fc73c13b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:54.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.356+0000 7fc744295640 10 monclient(hunting): picked mon.noname-a con 0x7fc73c13f830 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:34:54.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.356+0000 7fc744295640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:54.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.356+0000 7fc744295640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc73c139e90 con 0x7fc73c13f830 2024-02-09T08:34:54.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.356+0000 7fc744295640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:54.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.356+0000 7fc744295640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc73c13a950 con 0x7fc73c06c360 2024-02-09T08:34:54.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.356+0000 7fc744295640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:54.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.356+0000 7fc744295640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc73c13abc0 con 0x7fc73c0b1ca0 2024-02-09T08:34:54.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.356+0000 7fc744295640 10 monclient(hunting): _renew_subs 2024-02-09T08:34:54.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.356+0000 7fc744295640 10 monclient(hunting): authenticate will time out at 3337.716481s 2024-02-09T08:34:54.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.356+0000 7fc741830640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc73c0b1ca0 0x7fc73c141660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:54.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.356+0000 7fc742031640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc73c06c360 0x7fc73c142140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:54.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.357+0000 7fc742832640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc73c13f830 0x7fc73c13b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:54.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.357+0000 7fc742031640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc73c06c360 0x7fc73c142140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.62:51940/0 (socket says 172.21.15.62:51940) 2024-02-09T08:34:54.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.357+0000 7fc742031640 1 -- 172.21.15.62:0/1807400622 learned_addr learned my addr 172.21.15.62:0/1807400622 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:34:54.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.357+0000 7fc742031640 10 monclient(hunting): get_auth_request con 0x7fc73c06c360 auth_method 0 2024-02-09T08:34:54.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.357+0000 7fc742031640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:54.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.357+0000 7fc742031640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:54.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.357+0000 7fc742031640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:54.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.357+0000 7fc741830640 10 monclient(hunting): get_auth_request con 0x7fc73c0b1ca0 auth_method 0 2024-02-09T08:34:54.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.357+0000 7fc741830640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:54.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.357+0000 7fc741830640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:54.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.357+0000 7fc741830640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:54.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.357+0000 7fc742832640 10 monclient(hunting): get_auth_request con 0x7fc73c13f830 auth_method 0 2024-02-09T08:34:54.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.357+0000 7fc742832640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:54.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.357+0000 7fc742832640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:54.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.357+0000 7fc742832640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:54.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.357+0000 7fc742031640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:54.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.357+0000 7fc742031640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:54.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.357+0000 7fc742031640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:54.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.357+0000 7fc741830640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:54.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.357+0000 7fc741830640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:54.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.357+0000 7fc741830640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:54.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.358+0000 7fc742832640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:54.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.358+0000 7fc742832640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:54.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.358+0000 7fc742832640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:54.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.360+0000 7fc742031640 10 monclient(hunting): handle_auth_done global_id 22294 payload 824 2024-02-09T08:34:54.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.360+0000 7fc742031640 1 -- 172.21.15.62:0/1807400622 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc73c0b1ca0 msgr2=0x7fc73c141660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:54.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.360+0000 7fc742031640 1 --2- 172.21.15.62:0/1807400622 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc73c0b1ca0 0x7fc73c141660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:54.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.360+0000 7fc742031640 1 -- 172.21.15.62:0/1807400622 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc73c13f830 msgr2=0x7fc73c13b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:54.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.360+0000 7fc742031640 1 --2- 172.21.15.62:0/1807400622 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc73c13f830 0x7fc73c13b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:54.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.360+0000 7fc742031640 10 monclient: _finish_hunting 0 2024-02-09T08:34:54.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.360+0000 7fc742031640 1 monclient: found mon.noname-b 2024-02-09T08:34:54.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.360+0000 7fc742031640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:34:54.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.360+0000 7fc742031640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.103:3300/0 2024-02-09T08:34:54.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.360+0000 7fc742031640 1 -- 172.21.15.62:0/1807400622 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc72c009400 con 0x7fc73c06c360 2024-02-09T08:34:54.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.362+0000 7fc742031640 1 --2- 172.21.15.62:0/1807400622 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc73c06c360 0x7fc73c142140 secure :-1 s=READY pgs=5655 cs=0 l=1 rev1=1 crypto rx=0x7fc73800c440 tx=0x7fc73800c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:34:54.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.362+0000 7fc732ffd640 10 client.?.objecter ms_handle_connect 0x7fc73c06c360 2024-02-09T08:34:54.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.362+0000 7fc732ffd640 10 client.?.objecter resend_mon_ops 2024-02-09T08:34:54.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.365+0000 7fc732ffd640 1 -- 172.21.15.62:0/1807400622 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc738005480 con 0x7fc73c06c360 2024-02-09T08:34:54.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.365+0000 7fc732ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:54.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.365+0000 7fc732ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:34:54.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.365+0000 7fc732ffd640 10 monclient: dump: 2024-02-09T08:34:54.372 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:54.372 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:54.372 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:54.372 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:54.372 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:54.372 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:54.372 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:54.372 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:54.372 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:54.372 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:54.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.365+0000 7fc732ffd640 10 monclient: _finish_auth 0 2024-02-09T08:34:54.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.365+0000 7fc732ffd640 10 monclient: _check_auth_tickets 2024-02-09T08:34:54.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.365+0000 7fc732ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:34:54.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.365+0000 7fc732ffd640 1 -- 172.21.15.62:0/1807400622 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7380035f0 con 0x7fc73c06c360 2024-02-09T08:34:54.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.365+0000 7fc732ffd640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:34:54.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.365+0000 7fc744295640 5 monclient: authenticate success, global_id 22294 2024-02-09T08:34:54.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.365+0000 7fc732ffd640 1 -- 172.21.15.62:0/1807400622 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7380039c0 con 0x7fc73c06c360 2024-02-09T08:34:54.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.365+0000 7fc744295640 10 monclient: _renew_subs 2024-02-09T08:34:54.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.365+0000 7fc744295640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:34:54.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.365+0000 7fc744295640 1 -- 172.21.15.62:0/1807400622 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc73c141ba0 con 0x7fc73c06c360 2024-02-09T08:34:54.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.365+0000 7fc732ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:54.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.365+0000 7fc74082e640 4 set_mon_vals no callback set 2024-02-09T08:34:54.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.366+0000 7fc732ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:34:54.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.366+0000 7fc732ffd640 10 monclient: dump: 2024-02-09T08:34:54.373 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:54.373 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:54.373 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:54.373 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:54.374 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:54.374 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:54.374 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:54.374 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:54.374 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:54.374 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:54.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.366+0000 7fc744295640 10 client.22294.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:34:54.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.366+0000 7fc744295640 10 monclient: _renew_subs 2024-02-09T08:34:54.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.366+0000 7fc744295640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:34:54.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.366+0000 7fc744295640 1 -- 172.21.15.62:0/1807400622 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc73c1373e0 con 0x7fc73c06c360 2024-02-09T08:34:54.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.366+0000 7fc744295640 1 librados: init done 2024-02-09T08:34:54.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.366+0000 7fc744295640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:34:54.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.366+0000 7fc744295640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:34:54.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.366+0000 7fc744295640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:34:54.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.366+0000 7fc744295640 1 -- 172.21.15.62:0/1807400622 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc73c14cda0 con 0x7fc73c06c360 2024-02-09T08:34:54.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.384+0000 7fc732ffd640 1 -- 172.21.15.62:0/1807400622 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fc73801b3b0 con 0x7fc73c06c360 2024-02-09T08:34:54.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.385+0000 7fc732ffd640 1 --2- 172.21.15.62:0/1807400622 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fc72006d1f0 0x7fc72006f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:54.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.385+0000 7fc741830640 1 --2- 172.21.15.62:0/1807400622 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fc72006d1f0 0x7fc72006f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:54.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.385+0000 7fc741830640 10 monclient: get_auth_request con 0x7fc72006d1f0 auth_method 0 2024-02-09T08:34:54.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.386+0000 7fc741830640 1 --2- 172.21.15.62:0/1807400622 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fc72006d1f0 0x7fc72006f6b0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fc72c035000 tx=0x7fc72c008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:34:54.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.386+0000 7fc732ffd640 10 client.22294.objecter ms_handle_connect 0x7fc72006d1f0 2024-02-09T08:34:54.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.386+0000 7fc732ffd640 1 -- 172.21.15.62:0/1807400622 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(1269..1269 src has 1104..1269) v4 ==== 6381+0+0 (secure 0 0 0) 0x7fc7380010c0 con 0x7fc73c06c360 2024-02-09T08:34:54.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.386+0000 7fc732ffd640 10 client.22294.objecter ms_dispatch 0x7fc73c000b90 osd_map(1269..1269 src has 1104..1269) v4 2024-02-09T08:34:54.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.386+0000 7fc732ffd640 3 client.22294.objecter handle_osd_map got epochs [1269,1269] > 0 2024-02-09T08:34:54.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.386+0000 7fc732ffd640 3 client.22294.objecter handle_osd_map decoding full epoch 1269 2024-02-09T08:34:54.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.386+0000 7fc732ffd640 20 client.22294.objecter dump_active .. 0 homeless 2024-02-09T08:34:54.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.634+0000 7fc732ffd640 1 -- 172.21.15.62:0/1807400622 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc738054440 con 0x7fc73c06c360 2024-02-09T08:34:54.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.634+0000 7fc732ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:34:54.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.634+0000 7fc732ffd640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:34:54.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.816+0000 7fc744295640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-02-09T08:34:54.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.816+0000 7fc744295640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-02-09T08:34:54.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.816+0000 7fc744295640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:34:54.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.816+0000 7fc744295640 1 -- 172.21.15.62:0/1807400622 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc73c1373e0 con 0x7fc73c06c360 2024-02-09T08:34:54.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.853+0000 7fc732ffd640 1 -- 172.21.15.62:0/1807400622 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v1269) v1 ==== 74+0+17790 (secure 0 0 0) 0x7fc73c1373e0 con 0x7fc73c06c360 2024-02-09T08:34:54.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.853+0000 7fc732ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-02-09T08:34:54.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.853+0000 7fc732ffd640 10 monclient: _finish_command 2 = system:0 2024-02-09T08:34:54.856 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T08:34:54.856 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":1269,"fsid":"981c5564-eb76-49a1-80ab-97c7647bc34a","created":"2024-02-09T08:02:07.866410+0000","modified":"2024-02-09T08:34:51.690805+0000","last_up_change":"2024-02-09T08:03:05.958254+0000","last_in_change":"2024-02-09T08:02:13.770858+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":109,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":341,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-09T08:02:56.035293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-09T08:03:10.267347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"ceph_test_rados_api_asio","create_time":"2024-02-09T08:04:10.688267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0e3b17d4-a50f-41d9-b455-0bc1606a5c86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":1266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":3842068700},{"type":"v1","addr":"172.21.15.62:6809","nonce":3842068700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3842068700},{"type":"v1","addr":"172.21.15.62:6811","nonce":3842068700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3842068700},{"type":"v1","addr":"172.21.15.62:6815","nonce":3842068700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3842068700},{"type":"v1","addr":"172.21.15.62:6813","nonce":3842068700}]},"public_addr":"172.21.15.62:6809/3842068700","cluster_addr":"172.21.15.62:6811/3842068700","heartbeat_back_addr":"172.21.15.62:6815/3842068700","heartbeat_front_addr":"172.21.15.62:6813/3842068700","state":["exists","up"]},{"osd":1,"uuid":"a0077e6c-220d-46f4-9be2-a707d1710890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":1266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":3837949327},{"type":"v1","addr":"172.21.15.62:6801","nonce":3837949327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":3837949327},{"type":"v1","addr":"172.21.15.62:6803","nonce":3837949327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":3837949327},{"type":"v1","addr":"172.21.15.62:6807","nonce":3837949327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":3837949327},{"type":"v1","addr":"172.21.15.62:6805","nonce":3837949327}]},"public_addr":"172.21.15.62:6801/3837949327","cluster_addr":"172.21.15.62:6803/3837949327","heartbeat_back_addr":"172.21.15.62:6807/3837949327","heartbeat_front_addr":"172.21.15.62:6805/3837949327","state":["exists","up"]},{"osd":2,"uuid":"3739882a-5263-4113-840a-afd6acdcf15e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":1264,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":2695503114},{"type":"v1","addr":"172.21.15.62:6817","nonce":2695503114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2695503114},{"type":"v1","addr":"172.21.15.62:6819","nonce":2695503114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2695503114},{"type":"v1","addr":"172.21.15.62:6823","nonce":2695503114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":2695503114},{"type":"v1","addr":"172.21.15.62:6821","nonce":2695503114}]},"public_addr":"172.21.15.62:6817/2695503114","cluster_addr":"172.21.15.62:6819/2695503114","heartbeat_back_addr":"172.21.15.62:6823/2695503114","heartbeat_front_addr":"172.21.15.62:6821/2695503114","state":["exists","up"]},{"osd":3,"uuid":"3657c103-db3d-46c5-8afc-2b0b9da1e2e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":1266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":556356316},{"type":"v1","addr":"172.21.15.62:6825","nonce":556356316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":556356316},{"type":"v1","addr":"172.21.15.62:6827","nonce":556356316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":556356316},{"type":"v1","addr":"172.21.15.62:6831","nonce":556356316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":556356316},{"type":"v1","addr":"172.21.15.62:6829","nonce":556356316}]},"public_addr":"172.21.15.62:6825/556356316","cluster_addr":"172.21.15.62:6827/556356316","heartbeat_back_addr":"172.21.15.62:6831/556356316","heartbeat_front_addr":"172.21.15.62:6829/556356316","state":["exists","up"]},{"osd":4,"uuid":"faf5e721-fa06-43f8-9b72-36ca8132ffea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":20,"up_thru":1266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2442009417},{"type":"v1","addr":"172.21.15.103:6811","nonce":2442009417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2442009417},{"type":"v1","addr":"172.21.15.103:6815","nonce":2442009417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2442009417},{"type":"v1","addr":"172.21.15.103:6822","nonce":2442009417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2442009417},{"type":"v1","addr":"172.21.15.103:6818","nonce":2442009417}]},"public_addr":"172.21.15.103:6811/2442009417","cluster_addr":"172.21.15.103:6815/2442009417","heartbeat_back_addr":"172.21.15.103:6822/2442009417","heartbeat_front_addr":"172.21.15.103:6818/2442009417","state":["exists","up"]},{"osd":5,"uuid":"5c96dba1-53d2-4c0c-8928-5f09ea17a984","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":1266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":262591034},{"type":"v1","addr":"172.21.15.103:6803","nonce":262591034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":262591034},{"type":"v1","addr":"172.21.15.103:6805","nonce":262591034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":262591034},{"type":"v1","addr":"172.21.15.103:6809","nonce":262591034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":262591034},{"type":"v1","addr":"172.21.15.103:6807","nonce":262591034}]},"public_addr":"172.21.15.103:6803/262591034","cluster_addr":"172.21.15.103:6805/262591034","heartbeat_back_addr":"172.21.15.103:6809/262591034","heartbeat_front_addr":"172.21.15.103:6807/262591034","state":["exists","up"]},{"osd":6,"uuid":"3473844d-d631-4ea4-96fb-638eccee5cb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":1266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3983655111},{"type":"v1","addr":"172.21.15.103:6827","nonce":3983655111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3983655111},{"type":"v1","addr":"172.21.15.103:6829","nonce":3983655111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3983655111},{"type":"v1","addr":"172.21.15.103:6833","nonce":3983655111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3983655111},{"type":"v1","addr":"172.21.15.103:6831","nonce":3983655111}]},"public_addr":"172.21.15.103:6827/3983655111","cluster_addr":"172.21.15.103:6829/3983655111","heartbeat_back_addr":"172.21.15.103:6833/3983655111","heartbeat_front_addr":"172.21.15.103:6831/3983655111","state":["exists","up"]},{"osd":7,"uuid":"d31bdb4b-8938-4da9-8bf1-57cf730e839d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":1266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":1369132028},{"type":"v1","addr":"172.21.15.103:6813","nonce":1369132028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":1369132028},{"type":"v1","addr":"172.21.15.103:6819","nonce":1369132028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1369132028},{"type":"v1","addr":"172.21.15.103:6825","nonce":1369132028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6821","nonce":1369132028},{"type":"v1","addr":"172.21.15.103:6823","nonce":1369132028}]},"public_addr":"172.21.15.103:6813/1369132028","cluster_addr":"172.21.15.103:6819/1369132028","heartbeat_back_addr":"172.21.15.103:6825/1369132028","heartbeat_front_addr":"172.21.15.103:6823/1369132028","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T08:02:53.044658+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T08:02:52.943983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T08:02:53.834176+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T08:02:53.238626+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T08:02:51.878057+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T08:02:50.950607+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T08:02:52.166722+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-09T08:02:52.154749+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":15,"snaps":[{"begin":1,"length":6}]},{"pool":18,"snaps":[{"begin":1,"length":1}]},{"pool":34,"snaps":[{"begin":3,"length":2}]},{"pool":63,"snaps":[{"begin":1,"length":1}]},{"pool":74,"snaps":[{"begin":9,"length":2},{"begin":14,"length":1}]},{"pool":76,"snaps":[{"begin":1,"length":1}]},{"pool":79,"snaps":[{"begin":7,"length":2}]},{"pool":85,"snaps":[{"begin":1,"length":2}]},{"pool":89,"snaps":[{"begin":3,"length":1}]},{"pool":104,"snaps":[{"begin":2,"length":2}]},{"pool":109,"snaps":[{"begin":1,"length":4}]},{"pool":110,"snaps":[{"begin":2,"length":3}]},{"pool":116,"snaps":[{"begin":2,"length":2}]},{"pool":119,"snaps":[{"begin":3,"length":1}]},{"pool":121,"snaps":[{"begin":4,"length":2}]},{"pool":122,"snaps":[{"begin":2,"length":1}]},{"pool":139,"snaps":[{"begin":3,"length":2}]},{"pool":157,"snaps":[{"begin":4,"length":4}]},{"pool":251,"snaps":[{"begin":7,"length":1}]},{"pool":262,"snaps":[{"begin":8,"length":1}]},{"pool":265,"snaps":[{"begin":10,"length":1}]},{"pool":266,"snaps":[{"begin":11,"length":2}]},{"pool":269,"snaps":[{"begin":14,"length":1}]},{"pool":312,"snaps":[{"begin":2,"length":1}]},{"pool":313,"snaps":[{"begin":3,"length":1}]},{"pool":316,"snaps":[{"begin":4,"length":1}]},{"pool":320,"snaps":[{"begin":6,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-09T08:34:54.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.854+0000 7fc744295640 10 librados: watch_flush enter 2024-02-09T08:34:54.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.854+0000 7fc744295640 10 librados: watch_flush exit 2024-02-09T08:34:54.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.854+0000 7fc744295640 20 client.22294.objecter shutdown clearing up homeless session... 2024-02-09T08:34:54.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.855+0000 7fc744295640 10 client.22294.objecter successfully canceled tick 2024-02-09T08:34:54.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.855+0000 7fc744295640 1 -- 172.21.15.62:0/1807400622 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fc72006d1f0 msgr2=0x7fc72006f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:54.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.855+0000 7fc744295640 1 --2- 172.21.15.62:0/1807400622 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fc72006d1f0 0x7fc72006f6b0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fc72c035000 tx=0x7fc72c008030 comp rx=0 tx=0).stop 2024-02-09T08:34:54.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.855+0000 7fc744295640 10 monclient: shutdown 2024-02-09T08:34:54.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.855+0000 7fc744295640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:34:54.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.855+0000 7fc744295640 1 -- 172.21.15.62:0/1807400622 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc73c06c360 msgr2=0x7fc73c142140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:54.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.855+0000 7fc744295640 1 --2- 172.21.15.62:0/1807400622 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc73c06c360 0x7fc73c142140 secure :-1 s=READY pgs=5655 cs=0 l=1 rev1=1 crypto rx=0x7fc73800c440 tx=0x7fc73800c900 comp rx=0 tx=0).stop 2024-02-09T08:34:54.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.855+0000 7fc744295640 1 -- 172.21.15.62:0/1807400622 shutdown_connections 2024-02-09T08:34:54.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.855+0000 7fc744295640 1 --2- 172.21.15.62:0/1807400622 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fc72006d1f0 0x7fc72006f6b0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:54.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.855+0000 7fc744295640 1 --2- 172.21.15.62:0/1807400622 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc73c13f830 0x7fc73c13b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:54.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.855+0000 7fc744295640 1 --2- 172.21.15.62:0/1807400622 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc73c0b1ca0 0x7fc73c141660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:54.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.855+0000 7fc744295640 1 --2- 172.21.15.62:0/1807400622 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc73c06c360 0x7fc73c142140 unknown :-1 s=CLOSED pgs=5655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:54.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.855+0000 7fc744295640 1 -- 172.21.15.62:0/1807400622 >> 172.21.15.62:0/1807400622 conn(0x7fc73c0b8320 msgr2=0x7fc73c13d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:34:54.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.855+0000 7fc744295640 1 -- 172.21.15.62:0/1807400622 shutdown_connections 2024-02-09T08:34:54.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.855+0000 7fc744295640 1 -- 172.21.15.62:0/1807400622 wait complete. 2024-02-09T08:34:54.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:54.855+0000 7fc744295640 1 librados: shutdown 2024-02-09T08:34:55.870 INFO:tasks.ceph:Scrubbing osd.0 2024-02-09T08:34:55.870 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-02-09T08:34:55.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.980+0000 7fc521c60640 10 monclient: get_monmap_and_config 2024-02-09T08:34:55.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.980+0000 7fc521c60640 10 monclient: build_initial_monmap 2024-02-09T08:34:55.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.980+0000 7fc521c60640 10 monclient: monmap: 2024-02-09T08:34:55.984 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:34:55.984 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:55.984 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:34:55.981983+0000 2024-02-09T08:34:55.984 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:34:55.981983+0000 2024-02-09T08:34:55.984 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:34:55.984 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:55.984 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:34:55.984 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:34:55.984 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:34:55.984 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:34:55.985 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:34:55.985 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:55.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.981+0000 7fc521c60640 1 Processor -- start 2024-02-09T08:34:55.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.981+0000 7fc521c60640 1 -- start start 2024-02-09T08:34:55.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.981+0000 7fc521c60640 10 monclient: init 2024-02-09T08:34:55.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.982+0000 7fc521c60640 10 monclient: _reopen_session rank -1 2024-02-09T08:34:55.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.982+0000 7fc521c60640 10 monclient: _add_conns ranks=[1,3,2,0,4] 2024-02-09T08:34:55.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.982+0000 7fc521c60640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc51c06be10 addr v1:172.21.15.103:6789/0 2024-02-09T08:34:55.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.982+0000 7fc521c60640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc51c0b44c0 0x7fc51c13f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:55.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.982+0000 7fc521c60640 10 monclient(hunting): picked mon.noname-a con 0x7fc51c0b44c0 addr v2:172.21.15.62:3300/0 2024-02-09T08:34:55.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.982+0000 7fc521c60640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc51c13fd70 0x7fc51c145a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:55.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.982+0000 7fc521c60640 10 monclient(hunting): picked mon.noname-b con 0x7fc51c13fd70 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:34:55.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.982+0000 7fc521c60640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc51c1401a0 con 0x7fc51c06be10 2024-02-09T08:34:55.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.982+0000 7fc521c60640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:55.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.982+0000 7fc521c60640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc51c06c1f0 con 0x7fc51c0b44c0 2024-02-09T08:34:55.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.982+0000 7fc521c60640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:55.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.982+0000 7fc521c60640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc51c0a9e90 con 0x7fc51c13fd70 2024-02-09T08:34:55.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.982+0000 7fc521c60640 10 monclient(hunting): _renew_subs 2024-02-09T08:34:55.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.982+0000 7fc521c60640 10 monclient(hunting): authenticate will time out at 3339.342561s 2024-02-09T08:34:55.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.982+0000 7fc51affd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc51c0b44c0 0x7fc51c13f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:55.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.982+0000 7fc51bfff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc51c13fd70 0x7fc51c145a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:55.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.983+0000 7fc51b7fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fc51c06be10 0x7fc51c0a9670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.62:46466/0 (socket says 172.21.15.62:46466) 2024-02-09T08:34:55.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.983+0000 7fc51b7fe640 1 -- 172.21.15.62:0/1589948532 learned_addr learned my addr 172.21.15.62:0/1589948532 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-09T08:34:55.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.983+0000 7fc51bfff640 10 monclient(hunting): get_auth_request con 0x7fc51c13fd70 auth_method 0 2024-02-09T08:34:55.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.983+0000 7fc51bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:55.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.983+0000 7fc51bfff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:55.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.983+0000 7fc51bfff640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:55.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.983+0000 7fc51affd640 10 monclient(hunting): get_auth_request con 0x7fc51c0b44c0 auth_method 0 2024-02-09T08:34:55.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.983+0000 7fc51affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:55.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.983+0000 7fc51affd640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:55.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.983+0000 7fc51affd640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:55.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.983+0000 7fc51bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:55.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.983+0000 7fc51bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:55.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.983+0000 7fc51bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:55.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.983+0000 7fc51affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:55.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.983+0000 7fc51affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:55.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.983+0000 7fc51affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:55.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.985+0000 7fc51a7fc640 1 -- 172.21.15.62:0/1589948532 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 411145796 0 0) 0x7fc51c1401a0 con 0x7fc51c06be10 2024-02-09T08:34:55.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.985+0000 7fc51a7fc640 10 monclient(hunting): _negotiate 2024-02-09T08:34:55.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.985+0000 7fc51a7fc640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:55.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.985+0000 7fc51a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:55.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.985+0000 7fc51a7fc640 10 monclient(hunting): my global_id is 22297 2024-02-09T08:34:55.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.985+0000 7fc51a7fc640 1 -- 172.21.15.62:0/1589948532 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc504003520 con 0x7fc51c06be10 2024-02-09T08:34:55.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.985+0000 7fc51bfff640 10 monclient(hunting): handle_auth_done global_id 18593 payload 274 2024-02-09T08:34:55.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.985+0000 7fc51bfff640 1 -- 172.21.15.62:0/1589948532 >> v2:172.21.15.62:3300/0 conn(0x7fc51c0b44c0 msgr2=0x7fc51c13f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:34:55.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.985+0000 7fc51bfff640 1 --2- 172.21.15.62:0/1589948532 >> v2:172.21.15.62:3300/0 conn(0x7fc51c0b44c0 0x7fc51c13f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:55.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.985+0000 7fc51bfff640 1 -- 172.21.15.62:0/1589948532 >> v1:172.21.15.103:6789/0 conn(0x7fc51c06be10 legacy=0x7fc51c0a9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:55.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.985+0000 7fc51bfff640 10 monclient: _finish_hunting 0 2024-02-09T08:34:55.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.985+0000 7fc51bfff640 1 monclient: found mon.noname-b 2024-02-09T08:34:55.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.985+0000 7fc51bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:34:55.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.985+0000 7fc51bfff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.62:3301/0 2024-02-09T08:34:55.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.985+0000 7fc51bfff640 1 -- 172.21.15.62:0/1589948532 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc51c145f90 con 0x7fc51c13fd70 2024-02-09T08:34:55.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.985+0000 7fc51affd640 1 --2- 172.21.15.62:0/1589948532 >> v2:172.21.15.62:3300/0 conn(0x7fc51c0b44c0 0x7fc51c13f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-09T08:34:55.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.987+0000 7fc51bfff640 1 --2- 172.21.15.62:0/1589948532 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc51c13fd70 0x7fc51c145a50 secure :-1 s=READY pgs=3195 cs=0 l=1 rev1=1 crypto rx=0x7fc5140097a0 tx=0x7fc51402b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=862fa7872c82d735 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:34:55.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.991+0000 7fc51a7fc640 1 -- 172.21.15.62:0/1589948532 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51402e070 con 0x7fc51c13fd70 2024-02-09T08:34:55.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.991+0000 7fc51a7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:55.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.991+0000 7fc51a7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:34:55.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.991+0000 7fc51a7fc640 10 monclient: dump: 2024-02-09T08:34:55.995 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:55.995 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:55.995 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:55.995 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:55.995 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:55.995 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:55.996 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:55.996 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:55.996 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:55.996 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:55.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.991+0000 7fc51a7fc640 10 monclient: _finish_auth 0 2024-02-09T08:34:55.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.991+0000 7fc51a7fc640 10 monclient: _check_auth_tickets 2024-02-09T08:34:55.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.991+0000 7fc51a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:34:55.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.991+0000 7fc51a7fc640 1 -- 172.21.15.62:0/1589948532 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5140315a0 con 0x7fc51c13fd70 2024-02-09T08:34:55.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.991+0000 7fc51a7fc640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:34:55.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.991+0000 7fc51a7fc640 1 -- 172.21.15.62:0/1589948532 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc514031930 con 0x7fc51c13fd70 2024-02-09T08:34:55.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.991+0000 7fc521c60640 5 monclient: authenticate success, global_id 18593 2024-02-09T08:34:55.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.991+0000 7fc521c60640 10 monclient: get_monmap_and_config success 2024-02-09T08:34:55.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.991+0000 7fc521c60640 4 set_mon_vals no callback set 2024-02-09T08:34:55.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.991+0000 7fc51a7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:55.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.991+0000 7fc51a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-09T08:34:55.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.991+0000 7fc51a7fc640 10 monclient: dump: 2024-02-09T08:34:55.997 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:55.997 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:55.997 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:55.997 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:55.997 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:55.998 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:55.998 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:55.998 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:55.998 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:55.998 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:55.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.991+0000 7fc521c60640 10 monclient: shutdown 2024-02-09T08:34:55.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.991+0000 7fc521c60640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:34:55.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.991+0000 7fc521c60640 1 -- 172.21.15.62:0/1589948532 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc51c13fd70 msgr2=0x7fc51c145a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:55.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.991+0000 7fc521c60640 1 --2- 172.21.15.62:0/1589948532 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc51c13fd70 0x7fc51c145a50 secure :-1 s=READY pgs=3195 cs=0 l=1 rev1=1 crypto rx=0x7fc5140097a0 tx=0x7fc51402b840 comp rx=0 tx=0).stop 2024-02-09T08:34:55.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.991+0000 7fc521c60640 1 -- 172.21.15.62:0/1589948532 shutdown_connections 2024-02-09T08:34:55.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.991+0000 7fc521c60640 1 --2- 172.21.15.62:0/1589948532 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc51c13fd70 0x7fc51c145a50 unknown :-1 s=CLOSED pgs=3195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:55.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.991+0000 7fc521c60640 1 --2- 172.21.15.62:0/1589948532 >> v2:172.21.15.62:3300/0 conn(0x7fc51c0b44c0 0x7fc51c13f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:55.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.991+0000 7fc521c60640 1 -- 172.21.15.62:0/1589948532 >> 172.21.15.62:0/1589948532 conn(0x7fc51c0b8070 msgr2=0x7fc51c0b8480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:34:55.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.992+0000 7fc521c60640 1 -- 172.21.15.62:0/1589948532 shutdown_connections 2024-02-09T08:34:55.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.992+0000 7fc521c60640 1 -- 172.21.15.62:0/1589948532 wait complete. 2024-02-09T08:34:56.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.992+0000 7fc521c60640 10 monclient: build_initial_monmap 2024-02-09T08:34:56.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.992+0000 7fc521c60640 10 monclient: monmap: 2024-02-09T08:34:56.003 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:34:56.003 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:34:56.003 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:34:56.003 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:34:56.003 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:34:56.003 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:56.003 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:34:56.003 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:34:56.003 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:34:56.003 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:56.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.993+0000 7fc521c60640 1 librados: starting msgr at 2024-02-09T08:34:56.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.993+0000 7fc521c60640 1 librados: starting objecter 2024-02-09T08:34:56.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.993+0000 7fc521c60640 1 Processor -- start 2024-02-09T08:34:56.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.993+0000 7fc521c60640 1 -- start start 2024-02-09T08:34:56.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.993+0000 7fc521c60640 1 librados: setting wanted keys 2024-02-09T08:34:56.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.993+0000 7fc521c60640 1 librados: calling monclient init 2024-02-09T08:34:56.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.993+0000 7fc521c60640 10 monclient: init 2024-02-09T08:34:56.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.994+0000 7fc521c60640 10 monclient: _reopen_session rank -1 2024-02-09T08:34:56.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.994+0000 7fc521c60640 10 monclient: _add_conns ranks=[0,2,1] 2024-02-09T08:34:56.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.994+0000 7fc521c60640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc51c06be10 0x7fc51c141100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:56.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.994+0000 7fc521c60640 10 monclient(hunting): picked mon.noname-a con 0x7fc51c06be10 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:34:56.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.994+0000 7fc521c60640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc51c0b44c0 0x7fc51c13aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:56.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.994+0000 7fc521c60640 10 monclient(hunting): picked mon.noname-c con 0x7fc51c0b44c0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:34:56.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.994+0000 7fc521c60640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc51c13fd70 0x7fc51c13af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:56.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.994+0000 7fc521c60640 10 monclient(hunting): picked mon.noname-b con 0x7fc51c13fd70 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:34:56.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.994+0000 7fc521c60640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:56.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.994+0000 7fc521c60640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc51c141ad0 con 0x7fc51c06be10 2024-02-09T08:34:56.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.994+0000 7fc521c60640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:56.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.994+0000 7fc521c60640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc51c142570 con 0x7fc51c13fd70 2024-02-09T08:34:56.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.994+0000 7fc521c60640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:56.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.994+0000 7fc521c60640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc51c1427c0 con 0x7fc51c0b44c0 2024-02-09T08:34:56.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.994+0000 7fc521c60640 10 monclient(hunting): _renew_subs 2024-02-09T08:34:56.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.994+0000 7fc521c60640 10 monclient(hunting): authenticate will time out at 3339.354344s 2024-02-09T08:34:56.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.994+0000 7fc51affd640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc51c0b44c0 0x7fc51c13aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:56.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.994+0000 7fc51b7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc51c06be10 0x7fc51c141100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:56.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.994+0000 7fc51bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc51c13fd70 0x7fc51c13af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:56.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.994+0000 7fc51affd640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc51c0b44c0 0x7fc51c13aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:45702/0 (socket says 172.21.15.62:45702) 2024-02-09T08:34:56.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.994+0000 7fc51affd640 1 -- 172.21.15.62:0/1681600759 learned_addr learned my addr 172.21.15.62:0/1681600759 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:34:56.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.994+0000 7fc51affd640 10 monclient(hunting): get_auth_request con 0x7fc51c0b44c0 auth_method 0 2024-02-09T08:34:56.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.994+0000 7fc51affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:56.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.994+0000 7fc51affd640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:56.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.994+0000 7fc51affd640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:56.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.994+0000 7fc51b7fe640 10 monclient(hunting): get_auth_request con 0x7fc51c06be10 auth_method 0 2024-02-09T08:34:56.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.994+0000 7fc51b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:56.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.994+0000 7fc51b7fe640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:56.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.994+0000 7fc51b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:56.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.995+0000 7fc51bfff640 10 monclient(hunting): get_auth_request con 0x7fc51c13fd70 auth_method 0 2024-02-09T08:34:56.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.995+0000 7fc51bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:56.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.995+0000 7fc51bfff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:56.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.995+0000 7fc51bfff640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:56.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.995+0000 7fc51affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:56.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.995+0000 7fc51affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:56.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.995+0000 7fc51affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:56.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.995+0000 7fc51b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:56.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.995+0000 7fc51b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:56.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.995+0000 7fc51b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:56.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.995+0000 7fc51bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:56.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.995+0000 7fc51bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:56.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.995+0000 7fc51bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:56.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.998+0000 7fc51bfff640 10 monclient(hunting): handle_auth_done global_id 22300 payload 824 2024-02-09T08:34:56.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.998+0000 7fc51bfff640 1 -- 172.21.15.62:0/1681600759 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc51c0b44c0 msgr2=0x7fc51c13aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:56.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.998+0000 7fc51bfff640 1 --2- 172.21.15.62:0/1681600759 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc51c0b44c0 0x7fc51c13aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:56.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.998+0000 7fc51bfff640 1 -- 172.21.15.62:0/1681600759 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc51c06be10 msgr2=0x7fc51c141100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:56.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.998+0000 7fc51bfff640 1 --2- 172.21.15.62:0/1681600759 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc51c06be10 0x7fc51c141100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:56.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.998+0000 7fc51bfff640 10 monclient: _finish_hunting 0 2024-02-09T08:34:56.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.998+0000 7fc51bfff640 1 monclient: found mon.noname-b 2024-02-09T08:34:56.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.998+0000 7fc51bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:34:56.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.998+0000 7fc51bfff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.103:3300/0 2024-02-09T08:34:56.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:55.998+0000 7fc51bfff640 1 -- 172.21.15.62:0/1681600759 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc510009a70 con 0x7fc51c13fd70 2024-02-09T08:34:56.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.000+0000 7fc51bfff640 1 --2- 172.21.15.62:0/1681600759 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc51c13fd70 0x7fc51c13af50 secure :-1 s=READY pgs=5657 cs=0 l=1 rev1=1 crypto rx=0x7fc514033000 tx=0x7fc5140046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:34:56.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.000+0000 7fc503fff640 10 client.?.objecter ms_handle_connect 0x7fc51c13fd70 2024-02-09T08:34:56.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.000+0000 7fc503fff640 10 client.?.objecter resend_mon_ops 2024-02-09T08:34:56.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.004+0000 7fc503fff640 1 -- 172.21.15.62:0/1681600759 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc514032840 con 0x7fc51c13fd70 2024-02-09T08:34:56.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.004+0000 7fc503fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:56.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.004+0000 7fc503fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:34:56.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.004+0000 7fc503fff640 10 monclient: dump: 2024-02-09T08:34:56.011 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:56.011 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:56.011 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:56.011 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:56.011 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:56.011 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:56.011 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:56.011 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:56.011 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:56.012 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:56.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.004+0000 7fc503fff640 10 monclient: _finish_auth 0 2024-02-09T08:34:56.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.004+0000 7fc503fff640 10 monclient: _check_auth_tickets 2024-02-09T08:34:56.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.004+0000 7fc503fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:34:56.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.004+0000 7fc503fff640 1 -- 172.21.15.62:0/1681600759 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5140329e0 con 0x7fc51c13fd70 2024-02-09T08:34:56.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.004+0000 7fc503fff640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:34:56.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.004+0000 7fc503fff640 1 -- 172.21.15.62:0/1681600759 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc514032d90 con 0x7fc51c13fd70 2024-02-09T08:34:56.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.004+0000 7fc521c60640 5 monclient: authenticate success, global_id 22300 2024-02-09T08:34:56.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.004+0000 7fc521c60640 10 monclient: _renew_subs 2024-02-09T08:34:56.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.004+0000 7fc521c60640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:34:56.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.004+0000 7fc521c60640 1 -- 172.21.15.62:0/1681600759 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc514009400 con 0x7fc51c13fd70 2024-02-09T08:34:56.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.004+0000 7fc503fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:56.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.004+0000 7fc503fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:34:56.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.004+0000 7fc519ffb640 4 set_mon_vals no callback set 2024-02-09T08:34:56.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.004+0000 7fc503fff640 10 monclient: dump: 2024-02-09T08:34:56.013 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:56.013 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:56.013 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:56.013 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:56.013 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:56.013 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:56.013 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:56.013 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:56.014 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:56.014 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:56.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.004+0000 7fc521c60640 10 client.22300.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:34:56.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.004+0000 7fc521c60640 10 monclient: _renew_subs 2024-02-09T08:34:56.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.004+0000 7fc521c60640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:34:56.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.004+0000 7fc521c60640 1 -- 172.21.15.62:0/1681600759 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc51c141640 con 0x7fc51c13fd70 2024-02-09T08:34:56.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.004+0000 7fc521c60640 1 librados: init done 2024-02-09T08:34:56.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.005+0000 7fc521c60640 10 client.22300.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:34:56.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.005+0000 7fc521c60640 15 client.22300.objecter _session_command_op_assign -1 1 2024-02-09T08:34:56.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.005+0000 7fc521c60640 20 client.22300.objecter _get_session osd=-1 returning homeless 2024-02-09T08:34:56.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.005+0000 7fc521c60640 10 client.22300.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:34:56.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.005+0000 7fc521c60640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:34:56.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.005+0000 7fc521c60640 1 -- 172.21.15.62:0/1681600759 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc51c14cd80 con 0x7fc51c13fd70 2024-02-09T08:34:56.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.023+0000 7fc503fff640 1 -- 172.21.15.62:0/1681600759 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fc51404e400 con 0x7fc51c13fd70 2024-02-09T08:34:56.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.024+0000 7fc503fff640 1 --2- 172.21.15.62:0/1681600759 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fc50806d1f0 0x7fc50806f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:56.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.024+0000 7fc51b7fe640 1 --2- 172.21.15.62:0/1681600759 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fc50806d1f0 0x7fc50806f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:56.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.024+0000 7fc51b7fe640 10 monclient: get_auth_request con 0x7fc50806d1f0 auth_method 0 2024-02-09T08:34:56.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.024+0000 7fc51b7fe640 1 --2- 172.21.15.62:0/1681600759 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fc50806d1f0 0x7fc50806f6b0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fc50c005880 tx=0x7fc50c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:34:56.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.024+0000 7fc503fff640 10 client.22300.objecter ms_handle_connect 0x7fc50806d1f0 2024-02-09T08:34:56.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.027+0000 7fc503fff640 1 -- 172.21.15.62:0/1681600759 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(1270..1270 src has 1104..1270) v4 ==== 6381+0+0 (secure 0 0 0) 0x7fc51407a8f0 con 0x7fc51c13fd70 2024-02-09T08:34:56.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.027+0000 7fc503fff640 10 client.22300.objecter ms_dispatch 0x7fc51c000b90 osd_map(1270..1270 src has 1104..1270) v4 2024-02-09T08:34:56.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.027+0000 7fc503fff640 3 client.22300.objecter handle_osd_map got epochs [1270,1270] > 0 2024-02-09T08:34:56.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.027+0000 7fc503fff640 3 client.22300.objecter handle_osd_map decoding full epoch 1270 2024-02-09T08:34:56.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.027+0000 7fc503fff640 10 client.22300.objecter checking command 1 2024-02-09T08:34:56.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.027+0000 7fc503fff640 1 --2- 172.21.15.62:0/1681600759 >> [v2:172.21.15.62:6808/3842068700,v1:172.21.15.62:6809/3842068700] conn(0x7fc508074f80 0x7fc508077420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:56.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.027+0000 7fc503fff640 20 client.22300.objecter _get_session s=0x7fc5080748b0 osd=0 3 2024-02-09T08:34:56.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.027+0000 7fc503fff640 20 client.22300.objecter put_session s=0x7fc5080748b0 osd=0 3 2024-02-09T08:34:56.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.027+0000 7fc503fff640 15 client.22300.objecter _session_command_op_remove -1 1 2024-02-09T08:34:56.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.027+0000 7fc503fff640 20 client.22300.objecter _get_session s=0x7fc5080748b0 osd=0 3 2024-02-09T08:34:56.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.027+0000 7fc503fff640 20 client.22300.objecter get_session s=0x7fc5080748b0 osd=0 3 2024-02-09T08:34:56.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.027+0000 7fc503fff640 15 client.22300.objecter _session_command_op_assign 0 1 2024-02-09T08:34:56.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.027+0000 7fc503fff640 20 client.22300.objecter put_session s=0x7fc5080748b0 osd=0 4 2024-02-09T08:34:56.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.027+0000 7fc503fff640 10 client.22300.objecter _send_command 1 2024-02-09T08:34:56.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.027+0000 7fc503fff640 1 -- 172.21.15.62:0/1681600759 --> [v2:172.21.15.62:6808/3842068700,v1:172.21.15.62:6809/3842068700] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc508077af0 con 0x7fc508074f80 2024-02-09T08:34:56.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.027+0000 7fc503fff640 20 client.22300.objecter dump_active .. 0 homeless 2024-02-09T08:34:56.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.027+0000 7fc51affd640 1 --2- 172.21.15.62:0/1681600759 >> [v2:172.21.15.62:6808/3842068700,v1:172.21.15.62:6809/3842068700] conn(0x7fc508074f80 0x7fc508077420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:56.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.028+0000 7fc51affd640 10 monclient: get_auth_request con 0x7fc508074f80 auth_method 0 2024-02-09T08:34:56.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.028+0000 7fc503fff640 1 -- 172.21.15.62:0/1681600759 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=1270) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc514076b90 con 0x7fc51c13fd70 2024-02-09T08:34:56.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.028+0000 7fc503fff640 10 monclient: handle_get_version_reply finishing 1 version 1270 2024-02-09T08:34:56.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.030+0000 7fc503fff640 10 client.22300.objecter ms_handle_connect 0x7fc508074f80 2024-02-09T08:34:56.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.030+0000 7fc51affd640 1 --2- 172.21.15.62:0/1681600759 >> [v2:172.21.15.62:6808/3842068700,v1:172.21.15.62:6809/3842068700] conn(0x7fc508074f80 0x7fc508077420 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:34:56.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.055+0000 7fc503fff640 1 -- 172.21.15.62:0/1681600759 <== osd.0 v2:172.21.15.62:6808/3842068700 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fc508077af0 con 0x7fc508074f80 2024-02-09T08:34:56.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.055+0000 7fc503fff640 10 client.22300.objecter ms_dispatch 0x7fc51c000b90 command_reply(tid 1: 0 ) v1 2024-02-09T08:34:56.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.055+0000 7fc503fff640 10 client.22300.objecter _finish_command 1 = system:0 2024-02-09T08:34:56.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.055+0000 7fc503fff640 20 client.22300.objecter put_session s=0x7fc5080748b0 osd=0 4 2024-02-09T08:34:56.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.055+0000 7fc503fff640 15 client.22300.objecter _session_command_op_remove 0 1 2024-02-09T08:34:56.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.068+0000 7fc521c60640 10 client.22300.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2024-02-09T08:34:56.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.068+0000 7fc521c60640 15 client.22300.objecter _session_command_op_assign -1 2 2024-02-09T08:34:56.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.068+0000 7fc521c60640 20 client.22300.objecter _get_session s=0x7fc5080748b0 osd=0 3 2024-02-09T08:34:56.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.068+0000 7fc521c60640 20 client.22300.objecter put_session s=0x7fc5080748b0 osd=0 3 2024-02-09T08:34:56.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.068+0000 7fc521c60640 20 client.22300.objecter _get_session s=0x7fc5080748b0 osd=0 3 2024-02-09T08:34:56.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.068+0000 7fc521c60640 15 client.22300.objecter _session_command_op_remove -1 2 2024-02-09T08:34:56.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.068+0000 7fc521c60640 20 client.22300.objecter get_session s=0x7fc5080748b0 osd=0 3 2024-02-09T08:34:56.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.068+0000 7fc521c60640 15 client.22300.objecter _session_command_op_assign 0 2 2024-02-09T08:34:56.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.068+0000 7fc521c60640 20 client.22300.objecter put_session s=0x7fc5080748b0 osd=0 4 2024-02-09T08:34:56.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.068+0000 7fc521c60640 10 client.22300.objecter _send_command 2 2024-02-09T08:34:56.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.068+0000 7fc521c60640 1 -- 172.21.15.62:0/1681600759 --> [v2:172.21.15.62:6808/3842068700,v1:172.21.15.62:6809/3842068700] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc51c141c80 con 0x7fc508074f80 2024-02-09T08:34:56.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.082+0000 7fc503fff640 1 -- 172.21.15.62:0/1681600759 <== osd.0 v2:172.21.15.62:6808/3842068700 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fc51c141c80 con 0x7fc508074f80 2024-02-09T08:34:56.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.082+0000 7fc503fff640 10 client.22300.objecter ms_dispatch 0x7fc51c000b90 command_reply(tid 2: 0 ) v1 2024-02-09T08:34:56.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.082+0000 7fc503fff640 10 client.22300.objecter _finish_command 2 = system:0 2024-02-09T08:34:56.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.082+0000 7fc503fff640 20 client.22300.objecter put_session s=0x7fc5080748b0 osd=0 4 2024-02-09T08:34:56.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.082+0000 7fc503fff640 15 client.22300.objecter _session_command_op_remove 0 2 2024-02-09T08:34:56.085 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-02-09T08:34:56.085 INFO:teuthology.orchestra.run.smithi062.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-09T08:34:56.085 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-02-09T08:34:56.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.082+0000 7fc521c60640 10 librados: watch_flush enter 2024-02-09T08:34:56.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.082+0000 7fc521c60640 10 librados: watch_flush exit 2024-02-09T08:34:56.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.082+0000 7fc521c60640 10 client.22300.objecter close_session for osd.0 2024-02-09T08:34:56.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.082+0000 7fc521c60640 1 -- 172.21.15.62:0/1681600759 >> [v2:172.21.15.62:6808/3842068700,v1:172.21.15.62:6809/3842068700] conn(0x7fc508074f80 msgr2=0x7fc508077420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:56.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.082+0000 7fc521c60640 1 --2- 172.21.15.62:0/1681600759 >> [v2:172.21.15.62:6808/3842068700,v1:172.21.15.62:6809/3842068700] conn(0x7fc508074f80 0x7fc508077420 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:56.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.082+0000 7fc521c60640 20 client.22300.objecter put_session s=0x7fc5080748b0 osd=0 1 2024-02-09T08:34:56.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.082+0000 7fc521c60640 20 client.22300.objecter shutdown clearing up homeless session... 2024-02-09T08:34:56.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.082+0000 7fc521c60640 10 client.22300.objecter successfully canceled tick 2024-02-09T08:34:56.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.082+0000 7fc521c60640 1 -- 172.21.15.62:0/1681600759 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fc50806d1f0 msgr2=0x7fc50806f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:56.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.082+0000 7fc521c60640 1 --2- 172.21.15.62:0/1681600759 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fc50806d1f0 0x7fc50806f6b0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fc50c005880 tx=0x7fc50c009040 comp rx=0 tx=0).stop 2024-02-09T08:34:56.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.082+0000 7fc521c60640 10 monclient: shutdown 2024-02-09T08:34:56.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.082+0000 7fc521c60640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:34:56.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.082+0000 7fc521c60640 1 -- 172.21.15.62:0/1681600759 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc51c13fd70 msgr2=0x7fc51c13af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:56.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.082+0000 7fc521c60640 1 --2- 172.21.15.62:0/1681600759 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc51c13fd70 0x7fc51c13af50 secure :-1 s=READY pgs=5657 cs=0 l=1 rev1=1 crypto rx=0x7fc514033000 tx=0x7fc5140046c0 comp rx=0 tx=0).stop 2024-02-09T08:34:56.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.082+0000 7fc51bfff640 1 -- 172.21.15.62:0/1681600759 reap_dead start 2024-02-09T08:34:56.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.082+0000 7fc521c60640 1 -- 172.21.15.62:0/1681600759 shutdown_connections 2024-02-09T08:34:56.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.082+0000 7fc521c60640 1 -- 172.21.15.62:0/1681600759 >> 172.21.15.62:0/1681600759 conn(0x7fc51c0b8070 msgr2=0x7fc51c0b7620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:34:56.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.083+0000 7fc521c60640 1 -- 172.21.15.62:0/1681600759 shutdown_connections 2024-02-09T08:34:56.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.083+0000 7fc521c60640 1 -- 172.21.15.62:0/1681600759 wait complete. 2024-02-09T08:34:56.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.083+0000 7fc521c60640 1 librados: shutdown 2024-02-09T08:34:56.095 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-02-09T08:34:56.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.197+0000 7f06a3de0640 10 monclient: get_monmap_and_config 2024-02-09T08:34:56.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.197+0000 7f06a3de0640 10 monclient: build_initial_monmap 2024-02-09T08:34:56.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.197+0000 7f06a3de0640 10 monclient: monmap: 2024-02-09T08:34:56.199 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:34:56.199 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:56.199 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:34:56.198283+0000 2024-02-09T08:34:56.200 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:34:56.198283+0000 2024-02-09T08:34:56.200 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:34:56.200 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:56.200 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:34:56.200 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:34:56.200 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:34:56.200 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:34:56.200 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:34:56.200 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:56.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.197+0000 7f06a3de0640 1 Processor -- start 2024-02-09T08:34:56.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.198+0000 7f06a3de0640 1 -- start start 2024-02-09T08:34:56.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.198+0000 7f06a3de0640 10 monclient: init 2024-02-09T08:34:56.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.198+0000 7f06a3de0640 10 monclient: _reopen_session rank -1 2024-02-09T08:34:56.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.198+0000 7f06a3de0640 10 monclient: _add_conns ranks=[0,3,4,2,1] 2024-02-09T08:34:56.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.198+0000 7f06a3de0640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f069c0b5000 addr v1:172.21.15.62:6789/0 2024-02-09T08:34:56.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.198+0000 7f06a3de0640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f069c0a9e30 0x7f069c145de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:56.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.198+0000 7f06a3de0640 10 monclient(hunting): picked mon.noname-a con 0x7f069c0a9e30 addr v2:172.21.15.62:3300/0 2024-02-09T08:34:56.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.198+0000 7f06a3de0640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f069c13fdf0 0x7f069c146320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:56.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.198+0000 7f06a3de0640 10 monclient(hunting): picked mon.noname-c con 0x7f069c13fdf0 addr v2:172.21.15.103:3300/0 2024-02-09T08:34:56.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.198+0000 7f06a3de0640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f069c0aa4a0 con 0x7f069c0b5000 2024-02-09T08:34:56.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.198+0000 7f06a3de0640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:56.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.198+0000 7f06a3de0640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f069c0b53e0 con 0x7f069c0a9e30 2024-02-09T08:34:56.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.198+0000 7f06a3de0640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:56.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.198+0000 7f06a3de0640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f069c146860 con 0x7f069c13fdf0 2024-02-09T08:34:56.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.198+0000 7f06a3de0640 10 monclient(hunting): _renew_subs 2024-02-09T08:34:56.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.198+0000 7f06a3de0640 10 monclient(hunting): authenticate will time out at 3339.558862s 2024-02-09T08:34:56.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.236+0000 7f06a137b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f069c0a9e30 0x7f069c145de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:56.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.238+0000 7f06a237d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f069c13fdf0 0x7f069c146320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:56.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.238+0000 7f06a237d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f069c13fdf0 0x7f069c146320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.62:51966/0 (socket says 172.21.15.62:51966) 2024-02-09T08:34:56.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.238+0000 7f06a237d640 1 -- 172.21.15.62:0/976946053 learned_addr learned my addr 172.21.15.62:0/976946053 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:34:56.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.238+0000 7f06a237d640 10 monclient(hunting): get_auth_request con 0x7f069c13fdf0 auth_method 0 2024-02-09T08:34:56.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.238+0000 7f06a237d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:56.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.238+0000 7f06a237d640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:56.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.238+0000 7f06a237d640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:56.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.238+0000 7f06a137b640 10 monclient(hunting): get_auth_request con 0x7f069c0a9e30 auth_method 0 2024-02-09T08:34:56.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.238+0000 7f06a137b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:56.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.238+0000 7f06a137b640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:56.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.238+0000 7f06a137b640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:56.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.239+0000 7f06a237d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:56.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.239+0000 7f06a237d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:56.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.239+0000 7f06a237d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:56.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.240+0000 7f06a137b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:56.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.240+0000 7f06a137b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:56.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.240+0000 7f06a137b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:56.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.241+0000 7f06a237d640 10 monclient(hunting): handle_auth_done global_id 22303 payload 274 2024-02-09T08:34:56.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.241+0000 7f06a237d640 1 -- 172.21.15.62:0/976946053 >> v2:172.21.15.62:3300/0 conn(0x7f069c0a9e30 msgr2=0x7f069c145de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:34:56.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.241+0000 7f06a237d640 1 --2- 172.21.15.62:0/976946053 >> v2:172.21.15.62:3300/0 conn(0x7f069c0a9e30 0x7f069c145de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:56.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.241+0000 7f06a237d640 1 -- 172.21.15.62:0/976946053 >> v1:172.21.15.62:6789/0 conn(0x7f069c0b5000 legacy=0x7f069c13f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:56.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.241+0000 7f06a237d640 10 monclient: _finish_hunting 0 2024-02-09T08:34:56.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.241+0000 7f06a237d640 1 monclient: found mon.noname-c 2024-02-09T08:34:56.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.241+0000 7f06a237d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:34:56.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.241+0000 7f06a237d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.103:3300/0 2024-02-09T08:34:56.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.241+0000 7f06a237d640 1 -- 172.21.15.62:0/976946053 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f069c0b2900 con 0x7f069c13fdf0 2024-02-09T08:34:56.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.243+0000 7f06a237d640 1 --2- 172.21.15.62:0/976946053 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f069c13fdf0 0x7f069c146320 secure :-1 s=READY pgs=5658 cs=0 l=1 rev1=1 crypto rx=0x7f069c0b4070 tx=0x7f069402bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c49d874871c68ea0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:34:56.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.247+0000 7f06a0b7a640 1 -- 172.21.15.62:0/976946053 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069402ca80 con 0x7f069c13fdf0 2024-02-09T08:34:56.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.247+0000 7f06a0b7a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:56.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.247+0000 7f06a0b7a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-09T08:34:56.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.247+0000 7f06a0b7a640 10 monclient: dump: 2024-02-09T08:34:56.250 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:56.250 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:56.250 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:56.250 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:56.250 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:56.250 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:56.250 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:56.250 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:56.250 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:56.250 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:56.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.247+0000 7f06a0b7a640 10 monclient: _finish_auth 0 2024-02-09T08:34:56.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.247+0000 7f06a0b7a640 10 monclient: _check_auth_tickets 2024-02-09T08:34:56.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.247+0000 7f06a0b7a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:34:56.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.247+0000 7f06a0b7a640 1 -- 172.21.15.62:0/976946053 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f069402cbe0 con 0x7f069c13fdf0 2024-02-09T08:34:56.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.247+0000 7f06a3de0640 5 monclient: authenticate success, global_id 22303 2024-02-09T08:34:56.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.247+0000 7f06a3de0640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-02-09T08:34:56.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.247+0000 7f06a0b7a640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:34:56.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.247+0000 7f06a3de0640 10 monclient: get_monmap_and_config success 2024-02-09T08:34:56.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.247+0000 7f06a0b7a640 1 -- 172.21.15.62:0/976946053 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06940343f0 con 0x7f069c13fdf0 2024-02-09T08:34:56.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.247+0000 7f06a3de0640 4 set_mon_vals no callback set 2024-02-09T08:34:56.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.247+0000 7f06a0b7a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:56.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.247+0000 7f06a0b7a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:34:56.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.247+0000 7f06a0b7a640 10 monclient: dump: 2024-02-09T08:34:56.251 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:56.251 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:56.251 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:56.251 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:56.252 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:56.252 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:56.252 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:56.252 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:56.252 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:56.252 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:56.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.247+0000 7f06a3de0640 10 monclient: shutdown 2024-02-09T08:34:56.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.247+0000 7f06a3de0640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:34:56.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.247+0000 7f06a3de0640 1 -- 172.21.15.62:0/976946053 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f069c13fdf0 msgr2=0x7f069c146320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:56.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.247+0000 7f06a3de0640 1 --2- 172.21.15.62:0/976946053 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f069c13fdf0 0x7f069c146320 secure :-1 s=READY pgs=5658 cs=0 l=1 rev1=1 crypto rx=0x7f069c0b4070 tx=0x7f069402bee0 comp rx=0 tx=0).stop 2024-02-09T08:34:56.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.247+0000 7f06a3de0640 1 -- 172.21.15.62:0/976946053 shutdown_connections 2024-02-09T08:34:56.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.247+0000 7f06a3de0640 1 --2- 172.21.15.62:0/976946053 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f069c13fdf0 0x7f069c146320 unknown :-1 s=CLOSED pgs=5658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:56.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.247+0000 7f06a3de0640 1 --2- 172.21.15.62:0/976946053 >> v2:172.21.15.62:3300/0 conn(0x7f069c0a9e30 0x7f069c145de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:56.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.247+0000 7f06a3de0640 1 -- 172.21.15.62:0/976946053 >> 172.21.15.62:0/976946053 conn(0x7f069c066bb0 msgr2=0x7f069c066fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:34:56.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.248+0000 7f06a3de0640 1 -- 172.21.15.62:0/976946053 shutdown_connections 2024-02-09T08:34:56.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.248+0000 7f06a3de0640 1 -- 172.21.15.62:0/976946053 wait complete. 2024-02-09T08:34:56.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.248+0000 7f06a3de0640 10 monclient: build_initial_monmap 2024-02-09T08:34:56.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.248+0000 7f06a3de0640 10 monclient: monmap: 2024-02-09T08:34:56.256 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:34:56.256 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:34:56.256 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:34:56.256 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:34:56.256 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:34:56.256 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:56.257 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:34:56.257 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:34:56.257 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:34:56.257 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:56.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.249+0000 7f06a3de0640 1 librados: starting msgr at 2024-02-09T08:34:56.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.249+0000 7f06a3de0640 1 librados: starting objecter 2024-02-09T08:34:56.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.249+0000 7f06a3de0640 1 Processor -- start 2024-02-09T08:34:56.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.249+0000 7f06a3de0640 1 -- start start 2024-02-09T08:34:56.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.249+0000 7f06a3de0640 1 librados: setting wanted keys 2024-02-09T08:34:56.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.249+0000 7f06a3de0640 1 librados: calling monclient init 2024-02-09T08:34:56.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.249+0000 7f06a3de0640 10 monclient: init 2024-02-09T08:34:56.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.249+0000 7f06a3de0640 10 monclient: _reopen_session rank -1 2024-02-09T08:34:56.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.249+0000 7f06a3de0640 10 monclient: _add_conns ranks=[0,1,2] 2024-02-09T08:34:56.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.249+0000 7f06a3de0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f069c0a9e30 0x7f069c1402c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:56.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.250+0000 7f06a3de0640 10 monclient(hunting): picked mon.noname-a con 0x7f069c0a9e30 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:34:56.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.250+0000 7f06a3de0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f069c0b5000 0x7f069c142d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:56.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.250+0000 7f06a3de0640 10 monclient(hunting): picked mon.noname-b con 0x7f069c0b5000 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:34:56.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.250+0000 7f06a3de0640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f069c13fdf0 0x7f069c130bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:56.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.250+0000 7f06a3de0640 10 monclient(hunting): picked mon.noname-c con 0x7f069c13fdf0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:34:56.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.250+0000 7f06a3de0640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:56.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.250+0000 7f06a3de0640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069c13cca0 con 0x7f069c0a9e30 2024-02-09T08:34:56.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.250+0000 7f06a3de0640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:56.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.250+0000 7f06a3de0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069c1320e0 con 0x7f069c0b5000 2024-02-09T08:34:56.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.250+0000 7f06a3de0640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:56.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.250+0000 7f06a3de0640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f069c142010 con 0x7f069c13fdf0 2024-02-09T08:34:56.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.250+0000 7f06a3de0640 10 monclient(hunting): _renew_subs 2024-02-09T08:34:56.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.250+0000 7f06a3de0640 10 monclient(hunting): authenticate will time out at 3339.610298s 2024-02-09T08:34:56.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.250+0000 7f06a237d640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f069c13fdf0 0x7f069c130bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:56.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.250+0000 7f06a1b7c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f069c0a9e30 0x7f069c1402c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:56.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.250+0000 7f06a137b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f069c0b5000 0x7f069c142d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:56.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.250+0000 7f06a1b7c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f069c0a9e30 0x7f069c1402c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46454/0 (socket says 172.21.15.62:46454) 2024-02-09T08:34:56.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.250+0000 7f06a1b7c640 1 -- 172.21.15.62:0/690119265 learned_addr learned my addr 172.21.15.62:0/690119265 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:34:56.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.250+0000 7f06a1b7c640 10 monclient(hunting): get_auth_request con 0x7f069c0a9e30 auth_method 0 2024-02-09T08:34:56.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.250+0000 7f06a1b7c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:56.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.250+0000 7f06a1b7c640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:56.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.250+0000 7f06a1b7c640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:56.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.250+0000 7f06a237d640 10 monclient(hunting): get_auth_request con 0x7f069c13fdf0 auth_method 0 2024-02-09T08:34:56.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.250+0000 7f06a237d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:56.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.250+0000 7f06a237d640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:56.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.250+0000 7f06a237d640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:56.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.251+0000 7f06a137b640 10 monclient(hunting): get_auth_request con 0x7f069c0b5000 auth_method 0 2024-02-09T08:34:56.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.251+0000 7f06a137b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:56.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.251+0000 7f06a137b640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:56.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.251+0000 7f06a137b640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:56.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.251+0000 7f06a1b7c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:56.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.251+0000 7f06a1b7c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:56.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.251+0000 7f06a1b7c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:56.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.251+0000 7f06a237d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:56.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.251+0000 7f06a237d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:56.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.251+0000 7f06a237d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:56.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.251+0000 7f06a137b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:56.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.251+0000 7f06a137b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:56.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.251+0000 7f06a137b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:56.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.254+0000 7f06a137b640 10 monclient(hunting): handle_auth_done global_id 22306 payload 824 2024-02-09T08:34:56.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.254+0000 7f06a137b640 1 -- 172.21.15.62:0/690119265 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f069c13fdf0 msgr2=0x7f069c130bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:56.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.254+0000 7f06a137b640 1 --2- 172.21.15.62:0/690119265 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f069c13fdf0 0x7f069c130bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:56.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.254+0000 7f06a137b640 1 -- 172.21.15.62:0/690119265 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f069c0a9e30 msgr2=0x7f069c1402c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:56.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.254+0000 7f06a137b640 1 --2- 172.21.15.62:0/690119265 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f069c0a9e30 0x7f069c1402c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:56.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.254+0000 7f06a137b640 10 monclient: _finish_hunting 0 2024-02-09T08:34:56.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.254+0000 7f06a137b640 1 monclient: found mon.noname-b 2024-02-09T08:34:56.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.254+0000 7f06a137b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:34:56.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.254+0000 7f06a137b640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.103:3300/0 2024-02-09T08:34:56.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.254+0000 7f06a137b640 1 -- 172.21.15.62:0/690119265 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0694009b30 con 0x7f069c0b5000 2024-02-09T08:34:56.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.256+0000 7f06a137b640 1 --2- 172.21.15.62:0/690119265 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f069c0b5000 0x7f069c142d40 secure :-1 s=READY pgs=5659 cs=0 l=1 rev1=1 crypto rx=0x7f068c00e850 tx=0x7f068c00ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:34:56.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.256+0000 7f06927fc640 10 client.?.objecter ms_handle_connect 0x7f069c0b5000 2024-02-09T08:34:56.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.256+0000 7f06927fc640 10 client.?.objecter resend_mon_ops 2024-02-09T08:34:56.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.259+0000 7f06927fc640 1 -- 172.21.15.62:0/690119265 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068c0095b0 con 0x7f069c0b5000 2024-02-09T08:34:56.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.259+0000 7f06927fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:56.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.259+0000 7f06927fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:34:56.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.259+0000 7f06927fc640 10 monclient: dump: 2024-02-09T08:34:56.264 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:56.264 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:56.264 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:56.264 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:56.264 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:56.264 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:56.264 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:56.264 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:56.264 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:56.264 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:56.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.259+0000 7f06927fc640 10 monclient: _finish_auth 0 2024-02-09T08:34:56.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.259+0000 7f06927fc640 10 monclient: _check_auth_tickets 2024-02-09T08:34:56.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.259+0000 7f06927fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:34:56.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.259+0000 7f06927fc640 1 -- 172.21.15.62:0/690119265 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f068c00c940 con 0x7f069c0b5000 2024-02-09T08:34:56.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.259+0000 7f06a3de0640 5 monclient: authenticate success, global_id 22306 2024-02-09T08:34:56.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.259+0000 7f06a3de0640 10 monclient: _renew_subs 2024-02-09T08:34:56.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.259+0000 7f06a3de0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:34:56.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.259+0000 7f06a3de0640 1 -- 172.21.15.62:0/690119265 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f069c0b4870 con 0x7f069c0b5000 2024-02-09T08:34:56.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.259+0000 7f06927fc640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:34:56.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.259+0000 7f06927fc640 1 -- 172.21.15.62:0/690119265 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068c00ccd0 con 0x7f069c0b5000 2024-02-09T08:34:56.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.259+0000 7f06927fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:56.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.259+0000 7f06927fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:34:56.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.259+0000 7f06927fc640 10 monclient: dump: 2024-02-09T08:34:56.265 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:56.265 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:56.265 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:56.265 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:56.266 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:56.266 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:56.266 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:56.266 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:56.266 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:56.266 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:56.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.259+0000 7f0693fff640 4 set_mon_vals no callback set 2024-02-09T08:34:56.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.259+0000 7f06a3de0640 10 client.22306.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:34:56.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.259+0000 7f06a3de0640 10 monclient: _renew_subs 2024-02-09T08:34:56.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.259+0000 7f06a3de0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:34:56.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.259+0000 7f06a3de0640 1 -- 172.21.15.62:0/690119265 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f069c143280 con 0x7f069c0b5000 2024-02-09T08:34:56.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.259+0000 7f06a3de0640 1 librados: init done 2024-02-09T08:34:56.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.260+0000 7f06a3de0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:34:56.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.260+0000 7f06a3de0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:34:56.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.260+0000 7f06a3de0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:34:56.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.260+0000 7f06a3de0640 1 -- 172.21.15.62:0/690119265 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f069c143500 con 0x7f069c0b5000 2024-02-09T08:34:56.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.511+0000 7f06927fc640 1 -- 172.21.15.62:0/690119265 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f068c013470 con 0x7f069c0b5000 2024-02-09T08:34:56.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.512+0000 7f06927fc640 1 --2- 172.21.15.62:0/690119265 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f068006d1a0 0x7f068006f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:56.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.512+0000 7f06a1b7c640 1 --2- 172.21.15.62:0/690119265 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f068006d1a0 0x7f068006f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:56.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.512+0000 7f06a1b7c640 10 monclient: get_auth_request con 0x7f068006d1a0 auth_method 0 2024-02-09T08:34:56.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.512+0000 7f06a1b7c640 1 --2- 172.21.15.62:0/690119265 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f068006d1a0 0x7f068006f660 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f069c13f360 tx=0x7f0698009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:34:56.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.512+0000 7f06927fc640 10 client.22306.objecter ms_handle_connect 0x7f068006d1a0 2024-02-09T08:34:56.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.515+0000 7f06927fc640 1 -- 172.21.15.62:0/690119265 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(1270..1270 src has 1104..1270) v4 ==== 6381+0+0 (secure 0 0 0) 0x7f068c00ce30 con 0x7f069c0b5000 2024-02-09T08:34:56.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.515+0000 7f06927fc640 10 client.22306.objecter ms_dispatch 0x7f069c000b90 osd_map(1270..1270 src has 1104..1270) v4 2024-02-09T08:34:56.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.515+0000 7f06927fc640 3 client.22306.objecter handle_osd_map got epochs [1270,1270] > 0 2024-02-09T08:34:56.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.515+0000 7f06927fc640 3 client.22306.objecter handle_osd_map decoding full epoch 1270 2024-02-09T08:34:56.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.515+0000 7f06927fc640 20 client.22306.objecter dump_active .. 0 homeless 2024-02-09T08:34:56.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.525+0000 7f06927fc640 1 -- 172.21.15.62:0/690119265 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f068c055590 con 0x7f069c0b5000 2024-02-09T08:34:56.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.525+0000 7f06927fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:34:56.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.525+0000 7f06927fc640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:34:56.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.709+0000 7f06a3de0640 1 -- 172.21.15.62:0/690119265 --> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f069c14cdb0 con 0x7f068006d1a0 2024-02-09T08:34:56.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.710+0000 7f06927fc640 1 -- 172.21.15.62:0/690119265 <== mgr.4109 v2:172.21.15.103:6800/2270392189 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0698001500 con 0x7f068006d1a0 2024-02-09T08:34:56.712 INFO:teuthology.orchestra.run.smithi062.stderr:instructed osd(s) 0 to deep-scrub 2024-02-09T08:34:56.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.711+0000 7f06a3de0640 10 librados: watch_flush enter 2024-02-09T08:34:56.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.711+0000 7f06a3de0640 10 librados: watch_flush exit 2024-02-09T08:34:56.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.711+0000 7f06a3de0640 20 client.22306.objecter shutdown clearing up homeless session... 2024-02-09T08:34:56.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.711+0000 7f06a3de0640 10 client.22306.objecter successfully canceled tick 2024-02-09T08:34:56.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.711+0000 7f06a3de0640 1 -- 172.21.15.62:0/690119265 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f068006d1a0 msgr2=0x7f068006f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:56.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.711+0000 7f06a3de0640 1 --2- 172.21.15.62:0/690119265 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f068006d1a0 0x7f068006f660 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f069c13f360 tx=0x7f0698009040 comp rx=0 tx=0).stop 2024-02-09T08:34:56.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.711+0000 7f06a3de0640 10 monclient: shutdown 2024-02-09T08:34:56.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.711+0000 7f06a3de0640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:34:56.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.711+0000 7f06a3de0640 1 -- 172.21.15.62:0/690119265 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f069c0b5000 msgr2=0x7f069c142d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:56.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.711+0000 7f06a3de0640 1 --2- 172.21.15.62:0/690119265 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f069c0b5000 0x7f069c142d40 secure :-1 s=READY pgs=5659 cs=0 l=1 rev1=1 crypto rx=0x7f068c00e850 tx=0x7f068c00ed10 comp rx=0 tx=0).stop 2024-02-09T08:34:56.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.712+0000 7f06a3de0640 1 -- 172.21.15.62:0/690119265 shutdown_connections 2024-02-09T08:34:56.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.712+0000 7f06a3de0640 1 --2- 172.21.15.62:0/690119265 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f068006d1a0 0x7f068006f660 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:56.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.712+0000 7f06a3de0640 1 --2- 172.21.15.62:0/690119265 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f069c13fdf0 0x7f069c130bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:56.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.712+0000 7f06a3de0640 1 --2- 172.21.15.62:0/690119265 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f069c0b5000 0x7f069c142d40 unknown :-1 s=CLOSED pgs=5659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:56.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.712+0000 7f06a3de0640 1 --2- 172.21.15.62:0/690119265 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f069c0a9e30 0x7f069c1402c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:56.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.712+0000 7f06a3de0640 1 -- 172.21.15.62:0/690119265 >> 172.21.15.62:0/690119265 conn(0x7f069c066bb0 msgr2=0x7f069c0b8700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:34:56.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.712+0000 7f06a3de0640 1 -- 172.21.15.62:0/690119265 shutdown_connections 2024-02-09T08:34:56.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.712+0000 7f06a3de0640 1 -- 172.21.15.62:0/690119265 wait complete. 2024-02-09T08:34:56.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.712+0000 7f06a3de0640 1 librados: shutdown 2024-02-09T08:34:56.725 INFO:tasks.ceph:Scrubbing osd.1 2024-02-09T08:34:56.725 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-02-09T08:34:56.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.829+0000 7fe2d6cde640 10 monclient: get_monmap_and_config 2024-02-09T08:34:56.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.829+0000 7fe2d6cde640 10 monclient: build_initial_monmap 2024-02-09T08:34:56.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.829+0000 7fe2d6cde640 10 monclient: monmap: 2024-02-09T08:34:56.832 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:34:56.832 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:56.832 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:34:56.830707+0000 2024-02-09T08:34:56.832 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:34:56.830707+0000 2024-02-09T08:34:56.832 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:34:56.832 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:56.832 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:34:56.832 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:34:56.833 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:34:56.833 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:34:56.833 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:34:56.833 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:56.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.830+0000 7fe2d6cde640 1 Processor -- start 2024-02-09T08:34:56.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.830+0000 7fe2d6cde640 1 -- start start 2024-02-09T08:34:56.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.830+0000 7fe2d6cde640 10 monclient: init 2024-02-09T08:34:56.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.831+0000 7fe2d6cde640 10 monclient: _reopen_session rank -1 2024-02-09T08:34:56.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.831+0000 7fe2d6cde640 10 monclient: _add_conns ranks=[3,2,4,1,0] 2024-02-09T08:34:56.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.831+0000 7fe2d6cde640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe2d00b48b0 0x7fe2d00a9460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:56.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.831+0000 7fe2d6cde640 10 monclient(hunting): picked mon.noname-a con 0x7fe2d00b48b0 addr v2:172.21.15.62:3300/0 2024-02-09T08:34:56.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.831+0000 7fe2d6cde640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe2d00b4c90 0x7fe2d0142550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:56.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.831+0000 7fe2d6cde640 10 monclient(hunting): picked mon.noname-b con 0x7fe2d00b4c90 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:34:56.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.831+0000 7fe2d6cde640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe2d00b1c70 0x7fe2d00b0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:56.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.831+0000 7fe2d6cde640 10 monclient(hunting): picked mon.noname-c con 0x7fe2d00b1c70 addr v2:172.21.15.103:3300/0 2024-02-09T08:34:56.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.831+0000 7fe2d6cde640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:56.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.831+0000 7fe2d6cde640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2d00aab50 con 0x7fe2d00b48b0 2024-02-09T08:34:56.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.831+0000 7fe2d6cde640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:56.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.831+0000 7fe2d6cde640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2d00a9b30 con 0x7fe2d00b1c70 2024-02-09T08:34:56.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.831+0000 7fe2d6cde640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:56.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.831+0000 7fe2d6cde640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d00aada0 con 0x7fe2d00b4c90 2024-02-09T08:34:56.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.831+0000 7fe2d6cde640 10 monclient(hunting): _renew_subs 2024-02-09T08:34:56.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.831+0000 7fe2d6cde640 10 monclient(hunting): authenticate will time out at 3340.191340s 2024-02-09T08:34:56.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.831+0000 7fe2d4a7a640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe2d00b48b0 0x7fe2d00a9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:56.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.831+0000 7fe2cffff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe2d00b4c90 0x7fe2d0142550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:56.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.831+0000 7fe2d527b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe2d00b1c70 0x7fe2d00b0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:56.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.832+0000 7fe2cffff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe2d00b4c90 0x7fe2d0142550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:45724/0 (socket says 172.21.15.62:45724) 2024-02-09T08:34:56.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.832+0000 7fe2cffff640 1 -- 172.21.15.62:0/625215024 learned_addr learned my addr 172.21.15.62:0/625215024 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:34:56.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.832+0000 7fe2cffff640 10 monclient(hunting): get_auth_request con 0x7fe2d00b4c90 auth_method 0 2024-02-09T08:34:56.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.832+0000 7fe2cffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:56.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.832+0000 7fe2cffff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:56.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.832+0000 7fe2cffff640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:56.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.832+0000 7fe2d527b640 10 monclient(hunting): get_auth_request con 0x7fe2d00b1c70 auth_method 0 2024-02-09T08:34:56.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.832+0000 7fe2d527b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:56.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.832+0000 7fe2d527b640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:56.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.832+0000 7fe2d527b640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:56.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.832+0000 7fe2d4a7a640 10 monclient(hunting): get_auth_request con 0x7fe2d00b48b0 auth_method 0 2024-02-09T08:34:56.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.832+0000 7fe2d4a7a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:56.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.832+0000 7fe2d4a7a640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:56.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.832+0000 7fe2d4a7a640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:56.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.832+0000 7fe2cffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:56.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.832+0000 7fe2cffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:56.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.832+0000 7fe2cffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:56.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.832+0000 7fe2d527b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:56.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.832+0000 7fe2d527b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:56.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.832+0000 7fe2d527b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:56.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.832+0000 7fe2d4a7a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:56.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.832+0000 7fe2d4a7a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:56.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.832+0000 7fe2d4a7a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:56.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.834+0000 7fe2d527b640 10 monclient(hunting): handle_auth_done global_id 22309 payload 274 2024-02-09T08:34:56.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.834+0000 7fe2d527b640 1 -- 172.21.15.62:0/625215024 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe2d00b4c90 msgr2=0x7fe2d0142550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:34:56.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.834+0000 7fe2d527b640 1 --2- 172.21.15.62:0/625215024 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe2d00b4c90 0x7fe2d0142550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:56.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.834+0000 7fe2d527b640 1 -- 172.21.15.62:0/625215024 >> v2:172.21.15.62:3300/0 conn(0x7fe2d00b48b0 msgr2=0x7fe2d00a9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:34:56.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.834+0000 7fe2d527b640 1 --2- 172.21.15.62:0/625215024 >> v2:172.21.15.62:3300/0 conn(0x7fe2d00b48b0 0x7fe2d00a9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:56.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.834+0000 7fe2d527b640 10 monclient: _finish_hunting 0 2024-02-09T08:34:56.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.834+0000 7fe2d527b640 1 monclient: found mon.noname-c 2024-02-09T08:34:56.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.834+0000 7fe2d527b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:34:56.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.834+0000 7fe2d527b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.103:3300/0 2024-02-09T08:34:56.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.834+0000 7fe2d527b640 1 -- 172.21.15.62:0/625215024 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d00ab080 con 0x7fe2d00b1c70 2024-02-09T08:34:56.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.836+0000 7fe2d527b640 1 --2- 172.21.15.62:0/625215024 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2d00b1c70 0x7fe2d00b0eb0 secure :-1 s=READY pgs=5660 cs=0 l=1 rev1=1 crypto rx=0x7fe2d01435e0 tx=0x7fe2c802bd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19190e161373afc1 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:34:56.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.840+0000 7fe2cf7fe640 1 -- 172.21.15.62:0/625215024 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c802cb40 con 0x7fe2d00b1c70 2024-02-09T08:34:56.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.840+0000 7fe2cf7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:56.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.840+0000 7fe2cf7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-09T08:34:56.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.840+0000 7fe2cf7fe640 10 monclient: dump: 2024-02-09T08:34:56.844 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:56.844 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:56.844 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:56.844 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:56.844 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:56.844 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:56.844 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:56.844 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:56.844 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:56.844 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:56.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.840+0000 7fe2cf7fe640 10 monclient: _finish_auth 0 2024-02-09T08:34:56.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.840+0000 7fe2cf7fe640 10 monclient: _check_auth_tickets 2024-02-09T08:34:56.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.840+0000 7fe2cf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:34:56.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.840+0000 7fe2cf7fe640 1 -- 172.21.15.62:0/625215024 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c802cca0 con 0x7fe2d00b1c70 2024-02-09T08:34:56.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.840+0000 7fe2d6cde640 5 monclient: authenticate success, global_id 22309 2024-02-09T08:34:56.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.840+0000 7fe2d6cde640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-02-09T08:34:56.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.840+0000 7fe2cf7fe640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:34:56.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.840+0000 7fe2d6cde640 10 monclient: get_monmap_and_config success 2024-02-09T08:34:56.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.840+0000 7fe2d6cde640 4 set_mon_vals no callback set 2024-02-09T08:34:56.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.840+0000 7fe2cf7fe640 1 -- 172.21.15.62:0/625215024 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c8034660 con 0x7fe2d00b1c70 2024-02-09T08:34:56.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.840+0000 7fe2cf7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:56.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.840+0000 7fe2cf7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:34:56.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.840+0000 7fe2cf7fe640 10 monclient: dump: 2024-02-09T08:34:56.845 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:56.845 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:56.845 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:56.845 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:56.846 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:56.846 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:56.846 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:56.846 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:56.846 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:56.846 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:56.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.840+0000 7fe2d6cde640 10 monclient: shutdown 2024-02-09T08:34:56.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.840+0000 7fe2d6cde640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:34:56.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.840+0000 7fe2d6cde640 1 -- 172.21.15.62:0/625215024 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2d00b1c70 msgr2=0x7fe2d00b0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:56.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.840+0000 7fe2d6cde640 1 --2- 172.21.15.62:0/625215024 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2d00b1c70 0x7fe2d00b0eb0 secure :-1 s=READY pgs=5660 cs=0 l=1 rev1=1 crypto rx=0x7fe2d01435e0 tx=0x7fe2c802bd90 comp rx=0 tx=0).stop 2024-02-09T08:34:56.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.840+0000 7fe2d6cde640 1 -- 172.21.15.62:0/625215024 shutdown_connections 2024-02-09T08:34:56.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.840+0000 7fe2d6cde640 1 --2- 172.21.15.62:0/625215024 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2d00b1c70 0x7fe2d00b0eb0 unknown :-1 s=CLOSED pgs=5660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:56.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.840+0000 7fe2d6cde640 1 --2- 172.21.15.62:0/625215024 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe2d00b4c90 0x7fe2d0142550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:56.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.840+0000 7fe2d6cde640 1 --2- 172.21.15.62:0/625215024 >> v2:172.21.15.62:3300/0 conn(0x7fe2d00b48b0 0x7fe2d00a9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:56.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.840+0000 7fe2d6cde640 1 -- 172.21.15.62:0/625215024 >> 172.21.15.62:0/625215024 conn(0x7fe2d006bbc0 msgr2=0x7fe2d006bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:34:56.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.840+0000 7fe2d6cde640 1 -- 172.21.15.62:0/625215024 shutdown_connections 2024-02-09T08:34:56.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.840+0000 7fe2d6cde640 1 -- 172.21.15.62:0/625215024 wait complete. 2024-02-09T08:34:56.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.841+0000 7fe2d6cde640 10 monclient: build_initial_monmap 2024-02-09T08:34:56.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.841+0000 7fe2d6cde640 10 monclient: monmap: 2024-02-09T08:34:56.847 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:34:56.847 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:34:56.847 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:34:56.847 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:34:56.847 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:34:56.847 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:56.847 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:34:56.847 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:34:56.847 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:34:56.847 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:56.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.841+0000 7fe2d6cde640 1 librados: starting msgr at 2024-02-09T08:34:56.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.841+0000 7fe2d6cde640 1 librados: starting objecter 2024-02-09T08:34:56.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.841+0000 7fe2d6cde640 1 Processor -- start 2024-02-09T08:34:56.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.841+0000 7fe2d6cde640 1 -- start start 2024-02-09T08:34:56.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.841+0000 7fe2d6cde640 1 librados: setting wanted keys 2024-02-09T08:34:56.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.841+0000 7fe2d6cde640 1 librados: calling monclient init 2024-02-09T08:34:56.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.841+0000 7fe2d6cde640 10 monclient: init 2024-02-09T08:34:56.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.842+0000 7fe2d6cde640 10 monclient: _reopen_session rank -1 2024-02-09T08:34:56.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.842+0000 7fe2d6cde640 10 monclient: _add_conns ranks=[0,1,2] 2024-02-09T08:34:56.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.842+0000 7fe2d6cde640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2d00b1c70 0x7fe2d00afca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:56.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.842+0000 7fe2d6cde640 10 monclient(hunting): picked mon.noname-a con 0x7fe2d00b1c70 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:34:56.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.842+0000 7fe2d6cde640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2d00b48b0 0x7fe2d011ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:56.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.842+0000 7fe2d6cde640 10 monclient(hunting): picked mon.noname-b con 0x7fe2d00b48b0 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:34:56.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.842+0000 7fe2d6cde640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe2d0120500 0x7fe2d01db060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:56.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.842+0000 7fe2d6cde640 10 monclient(hunting): picked mon.noname-c con 0x7fe2d0120500 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:34:56.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.842+0000 7fe2d6cde640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:56.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.842+0000 7fe2d6cde640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d0123c00 con 0x7fe2d00b1c70 2024-02-09T08:34:56.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.842+0000 7fe2d6cde640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:56.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.842+0000 7fe2d6cde640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d011fba0 con 0x7fe2d00b48b0 2024-02-09T08:34:56.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.842+0000 7fe2d6cde640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:56.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.842+0000 7fe2d6cde640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d0120970 con 0x7fe2d0120500 2024-02-09T08:34:56.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.842+0000 7fe2d6cde640 10 monclient(hunting): _renew_subs 2024-02-09T08:34:56.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.842+0000 7fe2d6cde640 10 monclient(hunting): authenticate will time out at 3340.202898s 2024-02-09T08:34:56.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.843+0000 7fe2d4a7a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2d00b1c70 0x7fe2d00afca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:56.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.843+0000 7fe2d527b640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe2d0120500 0x7fe2d01db060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:56.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.843+0000 7fe2cffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2d00b48b0 0x7fe2d011ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:56.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.843+0000 7fe2d527b640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe2d0120500 0x7fe2d01db060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:45736/0 (socket says 172.21.15.62:45736) 2024-02-09T08:34:56.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.843+0000 7fe2d527b640 1 -- 172.21.15.62:0/4021525681 learned_addr learned my addr 172.21.15.62:0/4021525681 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:34:56.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.843+0000 7fe2d527b640 10 monclient(hunting): get_auth_request con 0x7fe2d0120500 auth_method 0 2024-02-09T08:34:56.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.843+0000 7fe2d527b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:56.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.843+0000 7fe2d527b640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:56.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.843+0000 7fe2d527b640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:56.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.843+0000 7fe2d4a7a640 10 monclient(hunting): get_auth_request con 0x7fe2d00b1c70 auth_method 0 2024-02-09T08:34:56.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.843+0000 7fe2d4a7a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:56.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.843+0000 7fe2d4a7a640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:56.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.843+0000 7fe2d4a7a640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:56.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.843+0000 7fe2cffff640 10 monclient(hunting): get_auth_request con 0x7fe2d00b48b0 auth_method 0 2024-02-09T08:34:56.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.843+0000 7fe2cffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:56.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.843+0000 7fe2cffff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:56.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.843+0000 7fe2cffff640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:56.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.844+0000 7fe2cffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:56.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.844+0000 7fe2cffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:56.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.844+0000 7fe2cffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:56.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.844+0000 7fe2d527b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:56.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.844+0000 7fe2d527b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:56.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.844+0000 7fe2d527b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:56.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.844+0000 7fe2d4a7a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:56.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.844+0000 7fe2d4a7a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:56.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.844+0000 7fe2d4a7a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:56.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.846+0000 7fe2d527b640 10 monclient(hunting): handle_auth_done global_id 18605 payload 824 2024-02-09T08:34:56.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.846+0000 7fe2d527b640 1 -- 172.21.15.62:0/4021525681 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2d00b48b0 msgr2=0x7fe2d011ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:56.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.846+0000 7fe2d527b640 1 --2- 172.21.15.62:0/4021525681 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2d00b48b0 0x7fe2d011ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:56.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.846+0000 7fe2d527b640 1 -- 172.21.15.62:0/4021525681 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2d00b1c70 msgr2=0x7fe2d00afca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:56.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.846+0000 7fe2d527b640 1 --2- 172.21.15.62:0/4021525681 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2d00b1c70 0x7fe2d00afca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:56.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.846+0000 7fe2d527b640 10 monclient: _finish_hunting 0 2024-02-09T08:34:56.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.846+0000 7fe2d527b640 1 monclient: found mon.noname-c 2024-02-09T08:34:56.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.846+0000 7fe2d527b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:34:56.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.846+0000 7fe2d527b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-02-09T08:34:56.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.846+0000 7fe2d527b640 1 -- 172.21.15.62:0/4021525681 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c8009a70 con 0x7fe2d0120500 2024-02-09T08:34:56.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.849+0000 7fe2d527b640 1 --2- 172.21.15.62:0/4021525681 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe2d0120500 0x7fe2d01db060 secure :-1 s=READY pgs=3196 cs=0 l=1 rev1=1 crypto rx=0x7fe2c802c3a0 tx=0x7fe2c8004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:34:56.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.849+0000 7fe2cd7fa640 10 client.?.objecter ms_handle_connect 0x7fe2d0120500 2024-02-09T08:34:56.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.849+0000 7fe2cd7fa640 10 client.?.objecter resend_mon_ops 2024-02-09T08:34:56.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.852+0000 7fe2cd7fa640 1 -- 172.21.15.62:0/4021525681 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c8040650 con 0x7fe2d0120500 2024-02-09T08:34:56.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.852+0000 7fe2cd7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:56.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.852+0000 7fe2cd7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-09T08:34:56.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.852+0000 7fe2cd7fa640 10 monclient: dump: 2024-02-09T08:34:56.856 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:56.856 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:56.856 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:56.856 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:56.856 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:56.856 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:56.856 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:56.857 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:56.857 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:56.857 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:56.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.852+0000 7fe2cd7fa640 10 monclient: _finish_auth 0 2024-02-09T08:34:56.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.852+0000 7fe2cd7fa640 10 monclient: _check_auth_tickets 2024-02-09T08:34:56.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.852+0000 7fe2cd7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:34:56.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.852+0000 7fe2cd7fa640 1 -- 172.21.15.62:0/4021525681 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c80407b0 con 0x7fe2d0120500 2024-02-09T08:34:56.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.852+0000 7fe2cd7fa640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:34:56.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.852+0000 7fe2cd7fa640 1 -- 172.21.15.62:0/4021525681 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c8040b60 con 0x7fe2d0120500 2024-02-09T08:34:56.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.852+0000 7fe2d6cde640 5 monclient: authenticate success, global_id 18605 2024-02-09T08:34:56.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.852+0000 7fe2d6cde640 10 monclient: _renew_subs 2024-02-09T08:34:56.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.852+0000 7fe2d6cde640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:34:56.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.852+0000 7fe2d6cde640 1 -- 172.21.15.62:0/4021525681 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2d01214a0 con 0x7fe2d0120500 2024-02-09T08:34:56.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.852+0000 7fe2ce7fc640 4 set_mon_vals no callback set 2024-02-09T08:34:56.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.852+0000 7fe2cd7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:56.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.852+0000 7fe2cd7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-09T08:34:56.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.852+0000 7fe2cd7fa640 10 monclient: dump: 2024-02-09T08:34:56.858 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:56.858 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:56.858 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:56.858 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:56.858 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:56.858 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:56.858 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:56.858 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:56.858 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:56.858 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:56.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.852+0000 7fe2d6cde640 10 client.18605.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:34:56.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.852+0000 7fe2d6cde640 10 monclient: _renew_subs 2024-02-09T08:34:56.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.852+0000 7fe2d6cde640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:34:56.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.852+0000 7fe2d6cde640 1 -- 172.21.15.62:0/4021525681 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2d01db780 con 0x7fe2d0120500 2024-02-09T08:34:56.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.852+0000 7fe2d6cde640 1 librados: init done 2024-02-09T08:34:56.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.853+0000 7fe2d6cde640 10 client.18605.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:34:56.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.853+0000 7fe2d6cde640 15 client.18605.objecter _session_command_op_assign -1 1 2024-02-09T08:34:56.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.853+0000 7fe2d6cde640 20 client.18605.objecter _get_session osd=-1 returning homeless 2024-02-09T08:34:56.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.853+0000 7fe2d6cde640 10 client.18605.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:34:56.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.853+0000 7fe2d6cde640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:34:56.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.853+0000 7fe2d6cde640 1 -- 172.21.15.62:0/4021525681 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe2d00b2820 con 0x7fe2d0120500 2024-02-09T08:34:56.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.872+0000 7fe2cd7fa640 1 -- 172.21.15.62:0/4021525681 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fe2c8040cc0 con 0x7fe2d0120500 2024-02-09T08:34:56.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.873+0000 7fe2cd7fa640 1 --2- 172.21.15.62:0/4021525681 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fe2b406d1a0 0x7fe2b406f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:56.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.873+0000 7fe2d4a7a640 1 --2- 172.21.15.62:0/4021525681 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fe2b406d1a0 0x7fe2b406f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:56.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.873+0000 7fe2d4a7a640 10 monclient: get_auth_request con 0x7fe2b406d1a0 auth_method 0 2024-02-09T08:34:56.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.874+0000 7fe2d4a7a640 1 --2- 172.21.15.62:0/4021525681 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fe2b406d1a0 0x7fe2b406f660 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fe2c4009b40 tx=0x7fe2c4009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:34:56.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.874+0000 7fe2cd7fa640 10 client.18605.objecter ms_handle_connect 0x7fe2b406d1a0 2024-02-09T08:34:56.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.876+0000 7fe2cd7fa640 1 -- 172.21.15.62:0/4021525681 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(1270..1270 src has 1104..1270) v4 ==== 6381+0+0 (secure 0 0 0) 0x7fe2c807bab0 con 0x7fe2d0120500 2024-02-09T08:34:56.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.876+0000 7fe2cd7fa640 10 client.18605.objecter ms_dispatch 0x7fe2d0000b90 osd_map(1270..1270 src has 1104..1270) v4 2024-02-09T08:34:56.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.876+0000 7fe2cd7fa640 3 client.18605.objecter handle_osd_map got epochs [1270,1270] > 0 2024-02-09T08:34:56.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.876+0000 7fe2cd7fa640 3 client.18605.objecter handle_osd_map decoding full epoch 1270 2024-02-09T08:34:56.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.876+0000 7fe2cd7fa640 10 client.18605.objecter checking command 1 2024-02-09T08:34:56.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.876+0000 7fe2cd7fa640 1 --2- 172.21.15.62:0/4021525681 >> [v2:172.21.15.62:6800/3837949327,v1:172.21.15.62:6801/3837949327] conn(0x7fe2b4074f30 0x7fe2b40773d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:56.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.876+0000 7fe2cd7fa640 20 client.18605.objecter _get_session s=0x7fe2b4074860 osd=1 3 2024-02-09T08:34:56.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.876+0000 7fe2cd7fa640 20 client.18605.objecter put_session s=0x7fe2b4074860 osd=1 3 2024-02-09T08:34:56.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.876+0000 7fe2cd7fa640 15 client.18605.objecter _session_command_op_remove -1 1 2024-02-09T08:34:56.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.876+0000 7fe2cd7fa640 20 client.18605.objecter _get_session s=0x7fe2b4074860 osd=1 3 2024-02-09T08:34:56.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.876+0000 7fe2cd7fa640 20 client.18605.objecter get_session s=0x7fe2b4074860 osd=1 3 2024-02-09T08:34:56.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.876+0000 7fe2cd7fa640 15 client.18605.objecter _session_command_op_assign 1 1 2024-02-09T08:34:56.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.876+0000 7fe2cd7fa640 20 client.18605.objecter put_session s=0x7fe2b4074860 osd=1 4 2024-02-09T08:34:56.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.876+0000 7fe2cd7fa640 10 client.18605.objecter _send_command 1 2024-02-09T08:34:56.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.876+0000 7fe2cd7fa640 1 -- 172.21.15.62:0/4021525681 --> [v2:172.21.15.62:6800/3837949327,v1:172.21.15.62:6801/3837949327] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe2b4077aa0 con 0x7fe2b4074f30 2024-02-09T08:34:56.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.876+0000 7fe2cd7fa640 20 client.18605.objecter dump_active .. 0 homeless 2024-02-09T08:34:56.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.876+0000 7fe2cd7fa640 1 -- 172.21.15.62:0/4021525681 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_get_version_reply(handle=1 version=1270) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe2c8077d50 con 0x7fe2d0120500 2024-02-09T08:34:56.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.876+0000 7fe2cd7fa640 10 monclient: handle_get_version_reply finishing 1 version 1270 2024-02-09T08:34:56.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.876+0000 7fe2cffff640 1 --2- 172.21.15.62:0/4021525681 >> [v2:172.21.15.62:6800/3837949327,v1:172.21.15.62:6801/3837949327] conn(0x7fe2b4074f30 0x7fe2b40773d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:56.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.877+0000 7fe2cffff640 10 monclient: get_auth_request con 0x7fe2b4074f30 auth_method 0 2024-02-09T08:34:56.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.880+0000 7fe2cffff640 1 --2- 172.21.15.62:0/4021525681 >> [v2:172.21.15.62:6800/3837949327,v1:172.21.15.62:6801/3837949327] conn(0x7fe2b4074f30 0x7fe2b40773d0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:34:56.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.880+0000 7fe2cd7fa640 10 client.18605.objecter ms_handle_connect 0x7fe2b4074f30 2024-02-09T08:34:56.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.904+0000 7fe2cd7fa640 1 -- 172.21.15.62:0/4021525681 <== osd.1 v2:172.21.15.62:6800/3837949327 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fe2b4077aa0 con 0x7fe2b4074f30 2024-02-09T08:34:56.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.904+0000 7fe2cd7fa640 10 client.18605.objecter ms_dispatch 0x7fe2d0000b90 command_reply(tid 1: 0 ) v1 2024-02-09T08:34:56.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.904+0000 7fe2cd7fa640 10 client.18605.objecter _finish_command 1 = system:0 2024-02-09T08:34:56.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.904+0000 7fe2cd7fa640 20 client.18605.objecter put_session s=0x7fe2b4074860 osd=1 4 2024-02-09T08:34:56.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.904+0000 7fe2cd7fa640 15 client.18605.objecter _session_command_op_remove 1 1 2024-02-09T08:34:56.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.918+0000 7fe2d6cde640 10 client.18605.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2024-02-09T08:34:56.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.918+0000 7fe2d6cde640 15 client.18605.objecter _session_command_op_assign -1 2 2024-02-09T08:34:56.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.918+0000 7fe2d6cde640 20 client.18605.objecter _get_session s=0x7fe2b4074860 osd=1 3 2024-02-09T08:34:56.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.918+0000 7fe2d6cde640 20 client.18605.objecter put_session s=0x7fe2b4074860 osd=1 3 2024-02-09T08:34:56.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.918+0000 7fe2d6cde640 20 client.18605.objecter _get_session s=0x7fe2b4074860 osd=1 3 2024-02-09T08:34:56.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.918+0000 7fe2d6cde640 15 client.18605.objecter _session_command_op_remove -1 2 2024-02-09T08:34:56.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.918+0000 7fe2d6cde640 20 client.18605.objecter get_session s=0x7fe2b4074860 osd=1 3 2024-02-09T08:34:56.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.918+0000 7fe2d6cde640 15 client.18605.objecter _session_command_op_assign 1 2 2024-02-09T08:34:56.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.918+0000 7fe2d6cde640 20 client.18605.objecter put_session s=0x7fe2b4074860 osd=1 4 2024-02-09T08:34:56.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.918+0000 7fe2d6cde640 10 client.18605.objecter _send_command 2 2024-02-09T08:34:56.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.918+0000 7fe2d6cde640 1 -- 172.21.15.62:0/4021525681 --> [v2:172.21.15.62:6800/3837949327,v1:172.21.15.62:6801/3837949327] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe2d011fce0 con 0x7fe2b4074f30 2024-02-09T08:34:56.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.931+0000 7fe2cd7fa640 1 -- 172.21.15.62:0/4021525681 <== osd.1 v2:172.21.15.62:6800/3837949327 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fe2d011fce0 con 0x7fe2b4074f30 2024-02-09T08:34:56.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.931+0000 7fe2cd7fa640 10 client.18605.objecter ms_dispatch 0x7fe2d0000b90 command_reply(tid 2: 0 ) v1 2024-02-09T08:34:56.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.931+0000 7fe2cd7fa640 10 client.18605.objecter _finish_command 2 = system:0 2024-02-09T08:34:56.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.931+0000 7fe2cd7fa640 20 client.18605.objecter put_session s=0x7fe2b4074860 osd=1 4 2024-02-09T08:34:56.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.931+0000 7fe2cd7fa640 15 client.18605.objecter _session_command_op_remove 1 2 2024-02-09T08:34:56.937 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-02-09T08:34:56.937 INFO:teuthology.orchestra.run.smithi062.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-09T08:34:56.937 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-02-09T08:34:56.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.931+0000 7fe2d6cde640 10 librados: watch_flush enter 2024-02-09T08:34:56.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.931+0000 7fe2d6cde640 10 librados: watch_flush exit 2024-02-09T08:34:56.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.931+0000 7fe2d6cde640 10 client.18605.objecter close_session for osd.1 2024-02-09T08:34:56.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.931+0000 7fe2d6cde640 1 -- 172.21.15.62:0/4021525681 >> [v2:172.21.15.62:6800/3837949327,v1:172.21.15.62:6801/3837949327] conn(0x7fe2b4074f30 msgr2=0x7fe2b40773d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:56.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.932+0000 7fe2d6cde640 1 --2- 172.21.15.62:0/4021525681 >> [v2:172.21.15.62:6800/3837949327,v1:172.21.15.62:6801/3837949327] conn(0x7fe2b4074f30 0x7fe2b40773d0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:56.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.932+0000 7fe2d6cde640 20 client.18605.objecter put_session s=0x7fe2b4074860 osd=1 1 2024-02-09T08:34:56.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.932+0000 7fe2d6cde640 20 client.18605.objecter shutdown clearing up homeless session... 2024-02-09T08:34:56.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.932+0000 7fe2d6cde640 10 client.18605.objecter successfully canceled tick 2024-02-09T08:34:56.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.932+0000 7fe2d6cde640 1 -- 172.21.15.62:0/4021525681 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fe2b406d1a0 msgr2=0x7fe2b406f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:56.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.932+0000 7fe2d6cde640 1 --2- 172.21.15.62:0/4021525681 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fe2b406d1a0 0x7fe2b406f660 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fe2c4009b40 tx=0x7fe2c4009190 comp rx=0 tx=0).stop 2024-02-09T08:34:56.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.932+0000 7fe2d6cde640 10 monclient: shutdown 2024-02-09T08:34:56.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.932+0000 7fe2d6cde640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:34:56.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.932+0000 7fe2d6cde640 1 -- 172.21.15.62:0/4021525681 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe2d0120500 msgr2=0x7fe2d01db060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:56.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.932+0000 7fe2d6cde640 1 --2- 172.21.15.62:0/4021525681 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe2d0120500 0x7fe2d01db060 secure :-1 s=READY pgs=3196 cs=0 l=1 rev1=1 crypto rx=0x7fe2c802c3a0 tx=0x7fe2c8004a40 comp rx=0 tx=0).stop 2024-02-09T08:34:56.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.932+0000 7fe2d527b640 1 -- 172.21.15.62:0/4021525681 reap_dead start 2024-02-09T08:34:56.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.932+0000 7fe2d6cde640 1 -- 172.21.15.62:0/4021525681 shutdown_connections 2024-02-09T08:34:56.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.932+0000 7fe2d6cde640 1 -- 172.21.15.62:0/4021525681 >> 172.21.15.62:0/4021525681 conn(0x7fe2d006bbc0 msgr2=0x7fe2d0141b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:34:56.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.932+0000 7fe2d6cde640 1 -- 172.21.15.62:0/4021525681 shutdown_connections 2024-02-09T08:34:56.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.932+0000 7fe2d6cde640 1 -- 172.21.15.62:0/4021525681 wait complete. 2024-02-09T08:34:56.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:56.932+0000 7fe2d6cde640 1 librados: shutdown 2024-02-09T08:34:56.945 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-02-09T08:34:57.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.044+0000 7f0386c1c640 10 monclient: get_monmap_and_config 2024-02-09T08:34:57.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.044+0000 7f0386c1c640 10 monclient: build_initial_monmap 2024-02-09T08:34:57.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.044+0000 7f0386c1c640 10 monclient: monmap: 2024-02-09T08:34:57.047 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:34:57.047 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:57.047 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:34:57.045185+0000 2024-02-09T08:34:57.047 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:34:57.045185+0000 2024-02-09T08:34:57.047 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:34:57.047 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:57.047 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:34:57.047 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:34:57.047 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:34:57.047 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:34:57.047 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:34:57.047 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:57.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.044+0000 7f0386c1c640 1 Processor -- start 2024-02-09T08:34:57.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.044+0000 7f0386c1c640 1 -- start start 2024-02-09T08:34:57.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.044+0000 7f0386c1c640 10 monclient: init 2024-02-09T08:34:57.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.045+0000 7f0386c1c640 10 monclient: _reopen_session rank -1 2024-02-09T08:34:57.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.045+0000 7f0386c1c640 10 monclient: _add_conns ranks=[2,3,4,0,1] 2024-02-09T08:34:57.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.045+0000 7f0386c1c640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0380067110 0x7f03800a9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:57.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.045+0000 7f0386c1c640 10 monclient(hunting): picked mon.noname-b con 0x7f0380067110 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:34:57.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.045+0000 7f0386c1c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f038013f830 0x7f038013fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:57.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.045+0000 7f0386c1c640 10 monclient(hunting): picked mon.noname-a con 0x7f038013f830 addr v2:172.21.15.62:3300/0 2024-02-09T08:34:57.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.045+0000 7f0386c1c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f03801424c0 0x7f0380142930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:57.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.045+0000 7f0386c1c640 10 monclient(hunting): picked mon.noname-c con 0x7f03801424c0 addr v2:172.21.15.103:3300/0 2024-02-09T08:34:57.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.045+0000 7f0386c1c640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:57.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.045+0000 7f0386c1c640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03800674f0 con 0x7f038013f830 2024-02-09T08:34:57.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.045+0000 7f0386c1c640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:57.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.045+0000 7f0386c1c640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03800aa090 con 0x7f03801424c0 2024-02-09T08:34:57.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.045+0000 7f0386c1c640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:57.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.045+0000 7f0386c1c640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03800ab5b0 con 0x7f0380067110 2024-02-09T08:34:57.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.045+0000 7f0386c1c640 10 monclient(hunting): _renew_subs 2024-02-09T08:34:57.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.045+0000 7f0386c1c640 10 monclient(hunting): authenticate will time out at 3340.405761s 2024-02-09T08:34:57.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.046+0000 7f03849b8640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0380067110 0x7f03800a9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:57.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.046+0000 7f03851b9640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f03801424c0 0x7f0380142930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:57.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.046+0000 7f037ffff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f038013f830 0x7f038013fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:57.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.046+0000 7f03851b9640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f03801424c0 0x7f0380142930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.62:51990/0 (socket says 172.21.15.62:51990) 2024-02-09T08:34:57.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.046+0000 7f03851b9640 1 -- 172.21.15.62:0/251352412 learned_addr learned my addr 172.21.15.62:0/251352412 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:34:57.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.046+0000 7f03851b9640 10 monclient(hunting): get_auth_request con 0x7f03801424c0 auth_method 0 2024-02-09T08:34:57.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.046+0000 7f03851b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:57.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.046+0000 7f03851b9640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:57.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.046+0000 7f03851b9640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:57.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.046+0000 7f037ffff640 10 monclient(hunting): get_auth_request con 0x7f038013f830 auth_method 0 2024-02-09T08:34:57.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.046+0000 7f037ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:57.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.046+0000 7f037ffff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:57.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.046+0000 7f037ffff640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:57.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.046+0000 7f03849b8640 10 monclient(hunting): get_auth_request con 0x7f0380067110 auth_method 0 2024-02-09T08:34:57.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.046+0000 7f03849b8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:57.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.046+0000 7f03849b8640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:57.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.046+0000 7f03849b8640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:57.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.046+0000 7f03851b9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:57.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.046+0000 7f03851b9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:57.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.046+0000 7f03851b9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:57.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.047+0000 7f037ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:57.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.047+0000 7f037ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:57.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.047+0000 7f037ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:57.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.047+0000 7f03849b8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:57.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.047+0000 7f03849b8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:57.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.047+0000 7f03849b8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:57.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.048+0000 7f03851b9640 10 monclient(hunting): handle_auth_done global_id 22315 payload 274 2024-02-09T08:34:57.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.048+0000 7f03851b9640 1 -- 172.21.15.62:0/251352412 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0380067110 msgr2=0x7f03800a9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:34:57.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.048+0000 7f03851b9640 1 --2- 172.21.15.62:0/251352412 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0380067110 0x7f03800a9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:57.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.048+0000 7f03851b9640 1 -- 172.21.15.62:0/251352412 >> v2:172.21.15.62:3300/0 conn(0x7f038013f830 msgr2=0x7f038013fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:34:57.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.048+0000 7f03851b9640 1 --2- 172.21.15.62:0/251352412 >> v2:172.21.15.62:3300/0 conn(0x7f038013f830 0x7f038013fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:57.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.048+0000 7f03851b9640 10 monclient: _finish_hunting 0 2024-02-09T08:34:57.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.048+0000 7f03851b9640 1 monclient: found mon.noname-c 2024-02-09T08:34:57.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.048+0000 7f03851b9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:34:57.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.048+0000 7f03851b9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.103:3300/0 2024-02-09T08:34:57.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.048+0000 7f03851b9640 1 -- 172.21.15.62:0/251352412 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03800b4720 con 0x7f03801424c0 2024-02-09T08:34:57.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.050+0000 7f03851b9640 1 --2- 172.21.15.62:0/251352412 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03801424c0 0x7f0380142930 secure :-1 s=READY pgs=5661 cs=0 l=1 rev1=1 crypto rx=0x7f03800b3bb0 tx=0x7f037002b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db5463cb95792b3 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:34:57.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.053+0000 7f037f7fe640 1 -- 172.21.15.62:0/251352412 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03700317e0 con 0x7f03801424c0 2024-02-09T08:34:57.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.054+0000 7f037f7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:57.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.054+0000 7f037f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-09T08:34:57.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.054+0000 7f037f7fe640 10 monclient: dump: 2024-02-09T08:34:57.056 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:57.056 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:57.056 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:57.057 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:57.057 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:57.057 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:57.057 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:57.057 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:57.057 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:57.057 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:57.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.054+0000 7f037f7fe640 10 monclient: _finish_auth 0 2024-02-09T08:34:57.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.054+0000 7f037f7fe640 10 monclient: _check_auth_tickets 2024-02-09T08:34:57.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.054+0000 7f037f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:34:57.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.054+0000 7f037f7fe640 1 -- 172.21.15.62:0/251352412 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0370031940 con 0x7f03801424c0 2024-02-09T08:34:57.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.054+0000 7f037f7fe640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:34:57.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.054+0000 7f037f7fe640 1 -- 172.21.15.62:0/251352412 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0370031cd0 con 0x7f03801424c0 2024-02-09T08:34:57.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.054+0000 7f0386c1c640 5 monclient: authenticate success, global_id 22315 2024-02-09T08:34:57.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.054+0000 7f0386c1c640 10 monclient: get_monmap_and_config success 2024-02-09T08:34:57.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.054+0000 7f0386c1c640 4 set_mon_vals no callback set 2024-02-09T08:34:57.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.054+0000 7f037f7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:57.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.054+0000 7f037f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:34:57.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.054+0000 7f037f7fe640 10 monclient: dump: 2024-02-09T08:34:57.058 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:57.058 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:57.058 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:57.058 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:57.058 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:57.058 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:57.058 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:57.058 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:57.058 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:57.058 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:57.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.054+0000 7f0386c1c640 10 monclient: shutdown 2024-02-09T08:34:57.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.054+0000 7f0386c1c640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:34:57.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.054+0000 7f0386c1c640 1 -- 172.21.15.62:0/251352412 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03801424c0 msgr2=0x7f0380142930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:57.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.054+0000 7f0386c1c640 1 --2- 172.21.15.62:0/251352412 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03801424c0 0x7f0380142930 secure :-1 s=READY pgs=5661 cs=0 l=1 rev1=1 crypto rx=0x7f03800b3bb0 tx=0x7f037002b880 comp rx=0 tx=0).stop 2024-02-09T08:34:57.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.054+0000 7f0386c1c640 1 -- 172.21.15.62:0/251352412 shutdown_connections 2024-02-09T08:34:57.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.054+0000 7f0386c1c640 1 --2- 172.21.15.62:0/251352412 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03801424c0 0x7f0380142930 unknown :-1 s=CLOSED pgs=5661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:57.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.054+0000 7f0386c1c640 1 --2- 172.21.15.62:0/251352412 >> v2:172.21.15.62:3300/0 conn(0x7f038013f830 0x7f038013fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:57.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.054+0000 7f0386c1c640 1 --2- 172.21.15.62:0/251352412 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0380067110 0x7f03800a9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:57.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.054+0000 7f0386c1c640 1 -- 172.21.15.62:0/251352412 >> 172.21.15.62:0/251352412 conn(0x7f03800b4e20 msgr2=0x7f03800b5230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:34:57.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.054+0000 7f0386c1c640 1 -- 172.21.15.62:0/251352412 shutdown_connections 2024-02-09T08:34:57.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.054+0000 7f0386c1c640 1 -- 172.21.15.62:0/251352412 wait complete. 2024-02-09T08:34:57.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.055+0000 7f0386c1c640 10 monclient: build_initial_monmap 2024-02-09T08:34:57.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.055+0000 7f0386c1c640 10 monclient: monmap: 2024-02-09T08:34:57.062 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:34:57.062 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:34:57.063 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:34:57.063 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:34:57.063 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:34:57.063 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:57.063 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:34:57.063 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:34:57.063 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:34:57.063 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:57.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.055+0000 7f0386c1c640 1 librados: starting msgr at 2024-02-09T08:34:57.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.055+0000 7f0386c1c640 1 librados: starting objecter 2024-02-09T08:34:57.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.055+0000 7f0386c1c640 1 Processor -- start 2024-02-09T08:34:57.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.055+0000 7f0386c1c640 1 -- start start 2024-02-09T08:34:57.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.055+0000 7f0386c1c640 1 librados: setting wanted keys 2024-02-09T08:34:57.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.055+0000 7f0386c1c640 1 librados: calling monclient init 2024-02-09T08:34:57.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.055+0000 7f0386c1c640 10 monclient: init 2024-02-09T08:34:57.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.056+0000 7f0386c1c640 10 monclient: _reopen_session rank -1 2024-02-09T08:34:57.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.056+0000 7f0386c1c640 10 monclient: _add_conns ranks=[1,0,2] 2024-02-09T08:34:57.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.056+0000 7f0386c1c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0380067110 0x7f03800b8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:57.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.056+0000 7f0386c1c640 10 monclient(hunting): picked mon.noname-b con 0x7f0380067110 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:34:57.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.056+0000 7f0386c1c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f038013f830 0x7f03800abcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:57.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.056+0000 7f0386c1c640 10 monclient(hunting): picked mon.noname-a con 0x7f038013f830 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:34:57.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.056+0000 7f0386c1c640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03801424c0 0x7f03801dade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:57.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.056+0000 7f0386c1c640 10 monclient(hunting): picked mon.noname-c con 0x7f03801424c0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:34:57.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.056+0000 7f0386c1c640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:57.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.056+0000 7f0386c1c640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03800ac210 con 0x7f038013f830 2024-02-09T08:34:57.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.056+0000 7f0386c1c640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:57.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.056+0000 7f0386c1c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03801da900 con 0x7f0380067110 2024-02-09T08:34:57.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.056+0000 7f0386c1c640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:57.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.056+0000 7f0386c1c640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03800ad360 con 0x7f03801424c0 2024-02-09T08:34:57.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.056+0000 7f0386c1c640 10 monclient(hunting): _renew_subs 2024-02-09T08:34:57.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.056+0000 7f0386c1c640 10 monclient(hunting): authenticate will time out at 3340.416794s 2024-02-09T08:34:57.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.057+0000 7f03851b9640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03801424c0 0x7f03801dade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:57.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.057+0000 7f037ffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f038013f830 0x7f03800abcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:57.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.057+0000 7f03849b8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0380067110 0x7f03800b8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:57.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.057+0000 7f037ffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f038013f830 0x7f03800abcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46484/0 (socket says 172.21.15.62:46484) 2024-02-09T08:34:57.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.057+0000 7f03851b9640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03801424c0 0x7f03801dade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:45752/0 (socket says 172.21.15.62:45752) 2024-02-09T08:34:57.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.057+0000 7f037ffff640 1 -- 172.21.15.62:0/2023144762 learned_addr learned my addr 172.21.15.62:0/2023144762 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:34:57.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.057+0000 7f037ffff640 10 monclient(hunting): get_auth_request con 0x7f038013f830 auth_method 0 2024-02-09T08:34:57.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.057+0000 7f037ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:57.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.057+0000 7f037ffff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:57.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.057+0000 7f037ffff640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:57.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.057+0000 7f03851b9640 10 monclient(hunting): get_auth_request con 0x7f03801424c0 auth_method 0 2024-02-09T08:34:57.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.057+0000 7f03851b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:57.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.057+0000 7f03851b9640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:57.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.057+0000 7f03851b9640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:57.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.057+0000 7f03849b8640 10 monclient(hunting): get_auth_request con 0x7f0380067110 auth_method 0 2024-02-09T08:34:57.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.057+0000 7f03849b8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:57.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.057+0000 7f03849b8640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:57.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.057+0000 7f03849b8640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:57.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.058+0000 7f03849b8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:57.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.058+0000 7f03849b8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:57.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.058+0000 7f03849b8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:57.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.058+0000 7f037ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:57.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.058+0000 7f037ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:57.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.058+0000 7f037ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:57.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.058+0000 7f03851b9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:57.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.058+0000 7f03851b9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:57.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.058+0000 7f03851b9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:57.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.060+0000 7f03849b8640 10 monclient(hunting): handle_auth_done global_id 22318 payload 824 2024-02-09T08:34:57.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.060+0000 7f03849b8640 1 -- 172.21.15.62:0/2023144762 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03801424c0 msgr2=0x7f03801dade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:57.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.060+0000 7f03849b8640 1 --2- 172.21.15.62:0/2023144762 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03801424c0 0x7f03801dade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:57.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.060+0000 7f03849b8640 1 -- 172.21.15.62:0/2023144762 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f038013f830 msgr2=0x7f03800abcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:57.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.060+0000 7f03849b8640 1 --2- 172.21.15.62:0/2023144762 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f038013f830 0x7f03800abcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:57.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.060+0000 7f03849b8640 10 monclient: _finish_hunting 0 2024-02-09T08:34:57.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.060+0000 7f03849b8640 1 monclient: found mon.noname-b 2024-02-09T08:34:57.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.060+0000 7f03849b8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:34:57.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.060+0000 7f03849b8640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.103:3300/0 2024-02-09T08:34:57.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.060+0000 7f03849b8640 1 -- 172.21.15.62:0/2023144762 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03700094d0 con 0x7f0380067110 2024-02-09T08:34:57.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.062+0000 7f03849b8640 1 --2- 172.21.15.62:0/2023144762 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0380067110 0x7f03800b8650 secure :-1 s=READY pgs=5662 cs=0 l=1 rev1=1 crypto rx=0x7f037800ef00 tx=0x7f037800b480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:34:57.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.063+0000 7f037d7fa640 10 client.?.objecter ms_handle_connect 0x7f0380067110 2024-02-09T08:34:57.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.063+0000 7f037d7fa640 10 client.?.objecter resend_mon_ops 2024-02-09T08:34:57.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.066+0000 7f037d7fa640 1 -- 172.21.15.62:0/2023144762 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0378010040 con 0x7f0380067110 2024-02-09T08:34:57.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.066+0000 7f037d7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:57.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.066+0000 7f037d7fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:34:57.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.066+0000 7f037d7fa640 10 monclient: dump: 2024-02-09T08:34:57.070 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:57.070 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:57.070 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:57.070 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:57.070 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:57.070 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:57.070 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:57.070 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:57.070 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:57.070 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:57.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.066+0000 7f037d7fa640 10 monclient: _finish_auth 0 2024-02-09T08:34:57.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.066+0000 7f037d7fa640 10 monclient: _check_auth_tickets 2024-02-09T08:34:57.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.066+0000 7f037d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:34:57.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.066+0000 7f037d7fa640 1 -- 172.21.15.62:0/2023144762 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0378009e80 con 0x7f0380067110 2024-02-09T08:34:57.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.066+0000 7f0386c1c640 5 monclient: authenticate success, global_id 22318 2024-02-09T08:34:57.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.066+0000 7f0386c1c640 10 monclient: _renew_subs 2024-02-09T08:34:57.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.066+0000 7f0386c1c640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:34:57.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.066+0000 7f0386c1c640 1 -- 172.21.15.62:0/2023144762 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03800b8bf0 con 0x7f0380067110 2024-02-09T08:34:57.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.066+0000 7f037d7fa640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:34:57.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.066+0000 7f037d7fa640 1 -- 172.21.15.62:0/2023144762 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0378014620 con 0x7f0380067110 2024-02-09T08:34:57.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.066+0000 7f037d7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:57.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.066+0000 7f037d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:34:57.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.066+0000 7f037d7fa640 10 monclient: dump: 2024-02-09T08:34:57.071 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:57.071 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:57.072 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:57.072 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:57.072 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:57.072 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:57.072 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:57.072 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:57.072 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:57.072 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:57.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.066+0000 7f037effd640 4 set_mon_vals no callback set 2024-02-09T08:34:57.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.066+0000 7f0386c1c640 10 client.22318.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:34:57.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.066+0000 7f0386c1c640 10 monclient: _renew_subs 2024-02-09T08:34:57.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.066+0000 7f0386c1c640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:34:57.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.066+0000 7f0386c1c640 1 -- 172.21.15.62:0/2023144762 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03801db320 con 0x7f0380067110 2024-02-09T08:34:57.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.066+0000 7f0386c1c640 1 librados: init done 2024-02-09T08:34:57.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.067+0000 7f0386c1c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:34:57.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.067+0000 7f0386c1c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:34:57.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.067+0000 7f0386c1c640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:34:57.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.067+0000 7f0386c1c640 1 -- 172.21.15.62:0/2023144762 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f038004ef90 con 0x7f0380067110 2024-02-09T08:34:57.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.084+0000 7f037d7fa640 1 -- 172.21.15.62:0/2023144762 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f0378014780 con 0x7f0380067110 2024-02-09T08:34:57.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.085+0000 7f037d7fa640 1 --2- 172.21.15.62:0/2023144762 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f036c06d1f0 0x7f036c06f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:57.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.085+0000 7f037ffff640 1 --2- 172.21.15.62:0/2023144762 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f036c06d1f0 0x7f036c06f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:57.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.085+0000 7f037ffff640 10 monclient: get_auth_request con 0x7f036c06d1f0 auth_method 0 2024-02-09T08:34:57.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.085+0000 7f037d7fa640 10 client.22318.objecter ms_handle_connect 0x7f036c06d1f0 2024-02-09T08:34:57.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.085+0000 7f037ffff640 1 --2- 172.21.15.62:0/2023144762 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f036c06d1f0 0x7f036c06f6b0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f03800accd0 tx=0x7f0374009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:34:57.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.088+0000 7f037d7fa640 1 -- 172.21.15.62:0/2023144762 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(1270..1270 src has 1104..1270) v4 ==== 6381+0+0 (secure 0 0 0) 0x7f03780599a0 con 0x7f0380067110 2024-02-09T08:34:57.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.088+0000 7f037d7fa640 10 client.22318.objecter ms_dispatch 0x7f0380000b90 osd_map(1270..1270 src has 1104..1270) v4 2024-02-09T08:34:57.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.088+0000 7f037d7fa640 3 client.22318.objecter handle_osd_map got epochs [1270,1270] > 0 2024-02-09T08:34:57.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.088+0000 7f037d7fa640 3 client.22318.objecter handle_osd_map decoding full epoch 1270 2024-02-09T08:34:57.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.088+0000 7f037d7fa640 20 client.22318.objecter dump_active .. 0 homeless 2024-02-09T08:34:57.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.323+0000 7f037d7fa640 1 -- 172.21.15.62:0/2023144762 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0378055c40 con 0x7f0380067110 2024-02-09T08:34:57.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.323+0000 7f037d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:34:57.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.323+0000 7f037d7fa640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:34:57.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.548+0000 7f0386c1c640 1 -- 172.21.15.62:0/2023144762 --> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f03801daa90 con 0x7f036c06d1f0 2024-02-09T08:34:57.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.549+0000 7f037d7fa640 1 -- 172.21.15.62:0/2023144762 <== mgr.4109 v2:172.21.15.103:6800/2270392189 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0374011af0 con 0x7f036c06d1f0 2024-02-09T08:34:57.551 INFO:teuthology.orchestra.run.smithi062.stderr:instructed osd(s) 1 to deep-scrub 2024-02-09T08:34:57.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.550+0000 7f0386c1c640 10 librados: watch_flush enter 2024-02-09T08:34:57.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.550+0000 7f0386c1c640 10 librados: watch_flush exit 2024-02-09T08:34:57.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.550+0000 7f0386c1c640 20 client.22318.objecter shutdown clearing up homeless session... 2024-02-09T08:34:57.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.550+0000 7f0386c1c640 10 client.22318.objecter successfully canceled tick 2024-02-09T08:34:57.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.550+0000 7f0386c1c640 1 -- 172.21.15.62:0/2023144762 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f036c06d1f0 msgr2=0x7f036c06f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:57.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.550+0000 7f0386c1c640 1 --2- 172.21.15.62:0/2023144762 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f036c06d1f0 0x7f036c06f6b0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f03800accd0 tx=0x7f0374009190 comp rx=0 tx=0).stop 2024-02-09T08:34:57.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.550+0000 7f0386c1c640 10 monclient: shutdown 2024-02-09T08:34:57.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.550+0000 7f0386c1c640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:34:57.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.550+0000 7f0386c1c640 1 -- 172.21.15.62:0/2023144762 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0380067110 msgr2=0x7f03800b8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:57.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.550+0000 7f0386c1c640 1 --2- 172.21.15.62:0/2023144762 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0380067110 0x7f03800b8650 secure :-1 s=READY pgs=5662 cs=0 l=1 rev1=1 crypto rx=0x7f037800ef00 tx=0x7f037800b480 comp rx=0 tx=0).stop 2024-02-09T08:34:57.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.551+0000 7f0386c1c640 1 -- 172.21.15.62:0/2023144762 shutdown_connections 2024-02-09T08:34:57.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.551+0000 7f0386c1c640 1 --2- 172.21.15.62:0/2023144762 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f036c06d1f0 0x7f036c06f6b0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:57.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.551+0000 7f0386c1c640 1 --2- 172.21.15.62:0/2023144762 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03801424c0 0x7f03801dade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:57.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.551+0000 7f0386c1c640 1 --2- 172.21.15.62:0/2023144762 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f038013f830 0x7f03800abcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:57.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.551+0000 7f0386c1c640 1 --2- 172.21.15.62:0/2023144762 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0380067110 0x7f03800b8650 unknown :-1 s=CLOSED pgs=5662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:57.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.551+0000 7f0386c1c640 1 -- 172.21.15.62:0/2023144762 >> 172.21.15.62:0/2023144762 conn(0x7f03800b4e20 msgr2=0x7f0380069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:34:57.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.551+0000 7f0386c1c640 1 -- 172.21.15.62:0/2023144762 shutdown_connections 2024-02-09T08:34:57.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.551+0000 7f0386c1c640 1 -- 172.21.15.62:0/2023144762 wait complete. 2024-02-09T08:34:57.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.551+0000 7f0386c1c640 1 librados: shutdown 2024-02-09T08:34:57.564 INFO:tasks.ceph:Scrubbing osd.2 2024-02-09T08:34:57.564 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-02-09T08:34:57.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.670+0000 7f2d73eb0640 10 monclient: get_monmap_and_config 2024-02-09T08:34:57.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.670+0000 7f2d73eb0640 10 monclient: build_initial_monmap 2024-02-09T08:34:57.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.670+0000 7f2d73eb0640 10 monclient: monmap: 2024-02-09T08:34:57.672 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:34:57.672 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:57.672 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:34:57.671132+0000 2024-02-09T08:34:57.672 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:34:57.671132+0000 2024-02-09T08:34:57.673 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:34:57.673 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:57.673 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:34:57.673 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:34:57.673 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:34:57.673 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:34:57.673 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:34:57.673 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:57.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.670+0000 7f2d73eb0640 1 Processor -- start 2024-02-09T08:34:57.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.670+0000 7f2d73eb0640 1 -- start start 2024-02-09T08:34:57.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.670+0000 7f2d73eb0640 10 monclient: init 2024-02-09T08:34:57.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.671+0000 7f2d73eb0640 10 monclient: _reopen_session rank -1 2024-02-09T08:34:57.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.671+0000 7f2d73eb0640 10 monclient: _add_conns ranks=[0,4,3,2,1] 2024-02-09T08:34:57.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.671+0000 7f2d73eb0640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f2d6c06be10 addr v1:172.21.15.62:6789/0 2024-02-09T08:34:57.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.671+0000 7f2d73eb0640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2d6c0b44c0 0x7f2d6c13f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:57.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.671+0000 7f2d73eb0640 10 monclient(hunting): picked mon.noname-c con 0x7f2d6c0b44c0 addr v2:172.21.15.103:3300/0 2024-02-09T08:34:57.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.671+0000 7f2d73eb0640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2d6c13fd70 0x7f2d6c145a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:57.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.671+0000 7f2d73eb0640 10 monclient(hunting): picked mon.noname-a con 0x7f2d6c13fd70 addr v2:172.21.15.62:3300/0 2024-02-09T08:34:57.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.671+0000 7f2d73eb0640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d6c1401a0 con 0x7f2d6c06be10 2024-02-09T08:34:57.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.671+0000 7f2d73eb0640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:57.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.671+0000 7f2d73eb0640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d6c06c1f0 con 0x7f2d6c13fd70 2024-02-09T08:34:57.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.671+0000 7f2d73eb0640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:57.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.671+0000 7f2d73eb0640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d6c0a9e90 con 0x7f2d6c0b44c0 2024-02-09T08:34:57.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.671+0000 7f2d73eb0640 10 monclient(hunting): _renew_subs 2024-02-09T08:34:57.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.671+0000 7f2d73eb0640 10 monclient(hunting): authenticate will time out at 3341.031810s 2024-02-09T08:34:57.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.672+0000 7f2d7244d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2d6c13fd70 0x7f2d6c145a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:57.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.672+0000 7f2d7144b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2d6c0b44c0 0x7f2d6c13f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:57.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.672+0000 7f2d7144b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2d6c0b44c0 0x7f2d6c13f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.62:52014/0 (socket says 172.21.15.62:52014) 2024-02-09T08:34:57.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.672+0000 7f2d7144b640 1 -- 172.21.15.62:0/2370840665 learned_addr learned my addr 172.21.15.62:0/2370840665 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:34:57.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.672+0000 7f2d7144b640 10 monclient(hunting): get_auth_request con 0x7f2d6c0b44c0 auth_method 0 2024-02-09T08:34:57.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.672+0000 7f2d7144b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:57.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.672+0000 7f2d7144b640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:57.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.672+0000 7f2d7144b640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:57.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.672+0000 7f2d7244d640 10 monclient(hunting): get_auth_request con 0x7f2d6c13fd70 auth_method 0 2024-02-09T08:34:57.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.672+0000 7f2d7244d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:57.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.672+0000 7f2d7244d640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:57.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.672+0000 7f2d7244d640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:57.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.673+0000 7f2d7144b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:57.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.673+0000 7f2d7144b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:57.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.673+0000 7f2d7144b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:57.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.673+0000 7f2d7244d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:57.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.673+0000 7f2d7244d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:57.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.673+0000 7f2d7244d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:57.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.674+0000 7f2d7144b640 10 monclient(hunting): handle_auth_done global_id 22321 payload 274 2024-02-09T08:34:57.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.674+0000 7f2d7144b640 1 -- 172.21.15.62:0/2370840665 >> v2:172.21.15.62:3300/0 conn(0x7f2d6c13fd70 msgr2=0x7f2d6c145a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:34:57.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.674+0000 7f2d7144b640 1 --2- 172.21.15.62:0/2370840665 >> v2:172.21.15.62:3300/0 conn(0x7f2d6c13fd70 0x7f2d6c145a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:57.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.674+0000 7f2d7144b640 1 -- 172.21.15.62:0/2370840665 >> v1:172.21.15.62:6789/0 conn(0x7f2d6c06be10 legacy=0x7f2d6c0a9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:57.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.674+0000 7f2d7144b640 10 monclient: _finish_hunting 0 2024-02-09T08:34:57.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.674+0000 7f2d7144b640 1 monclient: found mon.noname-c 2024-02-09T08:34:57.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.674+0000 7f2d7144b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:34:57.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.674+0000 7f2d7144b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.103:3300/0 2024-02-09T08:34:57.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.674+0000 7f2d7144b640 1 -- 172.21.15.62:0/2370840665 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d6c145f90 con 0x7f2d6c0b44c0 2024-02-09T08:34:57.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.676+0000 7f2d7144b640 1 --2- 172.21.15.62:0/2370840665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d6c0b44c0 0x7f2d6c13f830 secure :-1 s=READY pgs=5663 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c0b48a0 tx=0x7f2d6802b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbcf895a9d4a6535 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:34:57.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.680+0000 7f2d70c4a640 1 -- 172.21.15.62:0/2370840665 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d68031870 con 0x7f2d6c0b44c0 2024-02-09T08:34:57.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.680+0000 7f2d70c4a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:57.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.680+0000 7f2d70c4a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-09T08:34:57.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.680+0000 7f2d70c4a640 10 monclient: dump: 2024-02-09T08:34:57.683 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:57.683 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:57.683 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:57.683 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:57.683 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:57.683 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:57.683 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:57.683 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:57.683 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:57.683 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:57.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.680+0000 7f2d70c4a640 10 monclient: _finish_auth 0 2024-02-09T08:34:57.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.680+0000 7f2d70c4a640 10 monclient: _check_auth_tickets 2024-02-09T08:34:57.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.680+0000 7f2d70c4a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:34:57.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.680+0000 7f2d70c4a640 1 -- 172.21.15.62:0/2370840665 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d680319d0 con 0x7f2d6c0b44c0 2024-02-09T08:34:57.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.680+0000 7f2d73eb0640 5 monclient: authenticate success, global_id 22321 2024-02-09T08:34:57.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.680+0000 7f2d73eb0640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-02-09T08:34:57.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.680+0000 7f2d70c4a640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:34:57.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.680+0000 7f2d73eb0640 10 monclient: get_monmap_and_config success 2024-02-09T08:34:57.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.680+0000 7f2d73eb0640 4 set_mon_vals no callback set 2024-02-09T08:34:57.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.680+0000 7f2d70c4a640 1 -- 172.21.15.62:0/2370840665 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d68031d60 con 0x7f2d6c0b44c0 2024-02-09T08:34:57.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.680+0000 7f2d70c4a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:57.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.680+0000 7f2d70c4a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:34:57.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.680+0000 7f2d70c4a640 10 monclient: dump: 2024-02-09T08:34:57.684 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:57.684 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:57.685 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:57.685 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:57.685 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:57.685 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:57.685 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:57.685 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:57.685 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:57.685 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:57.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.680+0000 7f2d73eb0640 10 monclient: shutdown 2024-02-09T08:34:57.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.680+0000 7f2d73eb0640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:34:57.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.680+0000 7f2d73eb0640 1 -- 172.21.15.62:0/2370840665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d6c0b44c0 msgr2=0x7f2d6c13f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:57.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.680+0000 7f2d73eb0640 1 --2- 172.21.15.62:0/2370840665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d6c0b44c0 0x7f2d6c13f830 secure :-1 s=READY pgs=5663 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c0b48a0 tx=0x7f2d6802b910 comp rx=0 tx=0).stop 2024-02-09T08:34:57.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.680+0000 7f2d73eb0640 1 -- 172.21.15.62:0/2370840665 shutdown_connections 2024-02-09T08:34:57.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.680+0000 7f2d73eb0640 1 --2- 172.21.15.62:0/2370840665 >> v2:172.21.15.62:3300/0 conn(0x7f2d6c13fd70 0x7f2d6c145a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:57.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.680+0000 7f2d73eb0640 1 --2- 172.21.15.62:0/2370840665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d6c0b44c0 0x7f2d6c13f830 unknown :-1 s=CLOSED pgs=5663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:57.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.680+0000 7f2d73eb0640 1 -- 172.21.15.62:0/2370840665 >> 172.21.15.62:0/2370840665 conn(0x7f2d6c0b8070 msgr2=0x7f2d6c0b8480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:34:57.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.681+0000 7f2d73eb0640 1 -- 172.21.15.62:0/2370840665 shutdown_connections 2024-02-09T08:34:57.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.681+0000 7f2d73eb0640 1 -- 172.21.15.62:0/2370840665 wait complete. 2024-02-09T08:34:57.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.681+0000 7f2d73eb0640 10 monclient: build_initial_monmap 2024-02-09T08:34:57.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.681+0000 7f2d73eb0640 10 monclient: monmap: 2024-02-09T08:34:57.690 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:34:57.690 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:34:57.690 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:34:57.690 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:34:57.690 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:34:57.690 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:57.690 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:34:57.690 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:34:57.690 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:34:57.690 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:57.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.681+0000 7f2d73eb0640 1 librados: starting msgr at 2024-02-09T08:34:57.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.681+0000 7f2d73eb0640 1 librados: starting objecter 2024-02-09T08:34:57.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.682+0000 7f2d73eb0640 1 Processor -- start 2024-02-09T08:34:57.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.682+0000 7f2d73eb0640 1 -- start start 2024-02-09T08:34:57.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.682+0000 7f2d73eb0640 1 librados: setting wanted keys 2024-02-09T08:34:57.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.682+0000 7f2d73eb0640 1 librados: calling monclient init 2024-02-09T08:34:57.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.682+0000 7f2d73eb0640 10 monclient: init 2024-02-09T08:34:57.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.682+0000 7f2d73eb0640 10 monclient: _reopen_session rank -1 2024-02-09T08:34:57.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.682+0000 7f2d73eb0640 10 monclient: _add_conns ranks=[1,0,2] 2024-02-09T08:34:57.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.682+0000 7f2d73eb0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d6c06be10 0x7f2d6c1db420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:57.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.682+0000 7f2d73eb0640 10 monclient(hunting): picked mon.noname-b con 0x7f2d6c06be10 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:34:57.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.682+0000 7f2d73eb0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d6c0b44c0 0x7f2d6c13a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:57.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.682+0000 7f2d73eb0640 10 monclient(hunting): picked mon.noname-a con 0x7f2d6c0b44c0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:34:57.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.682+0000 7f2d73eb0640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2d6c13fd70 0x7f2d6c13abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:57.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.682+0000 7f2d73eb0640 10 monclient(hunting): picked mon.noname-c con 0x7f2d6c13fd70 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:34:57.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.682+0000 7f2d73eb0640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:57.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.682+0000 7f2d73eb0640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6c1dbb20 con 0x7f2d6c0b44c0 2024-02-09T08:34:57.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.682+0000 7f2d73eb0640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:57.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.682+0000 7f2d73eb0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6c145320 con 0x7f2d6c06be10 2024-02-09T08:34:57.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.682+0000 7f2d73eb0640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:57.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.682+0000 7f2d73eb0640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6c145600 con 0x7f2d6c13fd70 2024-02-09T08:34:57.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.682+0000 7f2d73eb0640 10 monclient(hunting): _renew_subs 2024-02-09T08:34:57.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.682+0000 7f2d73eb0640 10 monclient(hunting): authenticate will time out at 3341.042875s 2024-02-09T08:34:57.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.683+0000 7f2d7144b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d6c0b44c0 0x7f2d6c13a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:57.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.683+0000 7f2d7244d640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2d6c13fd70 0x7f2d6c13abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:57.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.683+0000 7f2d71c4c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d6c06be10 0x7f2d6c1db420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:57.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.683+0000 7f2d71c4c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d6c06be10 0x7f2d6c1db420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.62:52026/0 (socket says 172.21.15.62:52026) 2024-02-09T08:34:57.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.683+0000 7f2d71c4c640 1 -- 172.21.15.62:0/512718800 learned_addr learned my addr 172.21.15.62:0/512718800 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:34:57.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.683+0000 7f2d71c4c640 10 monclient(hunting): get_auth_request con 0x7f2d6c06be10 auth_method 0 2024-02-09T08:34:57.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.683+0000 7f2d71c4c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:57.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.683+0000 7f2d71c4c640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:57.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.683+0000 7f2d71c4c640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:57.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.683+0000 7f2d7144b640 10 monclient(hunting): get_auth_request con 0x7f2d6c0b44c0 auth_method 0 2024-02-09T08:34:57.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.683+0000 7f2d7144b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:57.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.683+0000 7f2d7144b640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:57.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.683+0000 7f2d7144b640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:57.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.683+0000 7f2d7244d640 10 monclient(hunting): get_auth_request con 0x7f2d6c13fd70 auth_method 0 2024-02-09T08:34:57.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.683+0000 7f2d7244d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:57.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.683+0000 7f2d7244d640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:57.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.683+0000 7f2d7244d640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:57.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.684+0000 7f2d71c4c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:57.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.684+0000 7f2d71c4c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:57.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.684+0000 7f2d71c4c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:57.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.684+0000 7f2d7144b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:57.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.684+0000 7f2d7144b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:57.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.684+0000 7f2d7144b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:57.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.684+0000 7f2d7244d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:57.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.684+0000 7f2d7244d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:57.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.684+0000 7f2d7244d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:57.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.686+0000 7f2d71c4c640 10 monclient(hunting): handle_auth_done global_id 22324 payload 824 2024-02-09T08:34:57.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.686+0000 7f2d71c4c640 1 -- 172.21.15.62:0/512718800 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2d6c13fd70 msgr2=0x7f2d6c13abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:57.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.686+0000 7f2d71c4c640 1 --2- 172.21.15.62:0/512718800 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2d6c13fd70 0x7f2d6c13abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:57.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.686+0000 7f2d71c4c640 1 -- 172.21.15.62:0/512718800 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d6c0b44c0 msgr2=0x7f2d6c13a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:57.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.686+0000 7f2d71c4c640 1 --2- 172.21.15.62:0/512718800 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d6c0b44c0 0x7f2d6c13a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:57.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.686+0000 7f2d71c4c640 10 monclient: _finish_hunting 0 2024-02-09T08:34:57.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.686+0000 7f2d71c4c640 1 monclient: found mon.noname-b 2024-02-09T08:34:57.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.686+0000 7f2d71c4c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:34:57.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.686+0000 7f2d71c4c640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.103:3300/0 2024-02-09T08:34:57.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.686+0000 7f2d71c4c640 1 -- 172.21.15.62:0/512718800 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d680094d0 con 0x7f2d6c06be10 2024-02-09T08:34:57.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.688+0000 7f2d71c4c640 1 --2- 172.21.15.62:0/512718800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d6c06be10 0x7f2d6c1db420 secure :-1 s=READY pgs=5664 cs=0 l=1 rev1=1 crypto rx=0x7f2d6000c400 tx=0x7f2d6000c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:34:57.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.688+0000 7f2d5e7fc640 10 client.?.objecter ms_handle_connect 0x7f2d6c06be10 2024-02-09T08:34:57.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.688+0000 7f2d5e7fc640 10 client.?.objecter resend_mon_ops 2024-02-09T08:34:57.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.692+0000 7f2d5e7fc640 1 -- 172.21.15.62:0/512718800 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d600052d0 con 0x7f2d6c06be10 2024-02-09T08:34:57.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.692+0000 7f2d5e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:57.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.692+0000 7f2d5e7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:34:57.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.692+0000 7f2d5e7fc640 10 monclient: dump: 2024-02-09T08:34:57.696 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:57.696 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:57.696 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:57.697 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:57.697 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:57.697 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:57.697 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:57.697 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:57.697 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:57.697 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:57.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.692+0000 7f2d5e7fc640 10 monclient: _finish_auth 0 2024-02-09T08:34:57.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.692+0000 7f2d5e7fc640 10 monclient: _check_auth_tickets 2024-02-09T08:34:57.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.692+0000 7f2d5e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:34:57.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.692+0000 7f2d5e7fc640 1 -- 172.21.15.62:0/512718800 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d60005450 con 0x7f2d6c06be10 2024-02-09T08:34:57.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.692+0000 7f2d5e7fc640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:34:57.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.692+0000 7f2d5e7fc640 1 -- 172.21.15.62:0/512718800 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d60007260 con 0x7f2d6c06be10 2024-02-09T08:34:57.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.692+0000 7f2d73eb0640 5 monclient: authenticate success, global_id 22324 2024-02-09T08:34:57.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.692+0000 7f2d73eb0640 10 monclient: _renew_subs 2024-02-09T08:34:57.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.692+0000 7f2d73eb0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:34:57.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.692+0000 7f2d73eb0640 1 -- 172.21.15.62:0/512718800 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d6c1458e0 con 0x7f2d6c06be10 2024-02-09T08:34:57.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.692+0000 7f2d5e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:57.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.692+0000 7f2d5ffff640 4 set_mon_vals no callback set 2024-02-09T08:34:57.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.692+0000 7f2d5e7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:34:57.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.692+0000 7f2d5e7fc640 10 monclient: dump: 2024-02-09T08:34:57.698 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:57.698 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:57.698 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:57.698 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:57.698 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:57.698 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:57.698 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:57.698 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:57.699 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:57.699 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:57.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.692+0000 7f2d73eb0640 10 client.22324.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:34:57.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.692+0000 7f2d73eb0640 10 monclient: _renew_subs 2024-02-09T08:34:57.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.692+0000 7f2d73eb0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:34:57.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.692+0000 7f2d73eb0640 1 -- 172.21.15.62:0/512718800 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d6c1dbf40 con 0x7f2d6c06be10 2024-02-09T08:34:57.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.692+0000 7f2d73eb0640 1 librados: init done 2024-02-09T08:34:57.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.693+0000 7f2d73eb0640 10 client.22324.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:34:57.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.693+0000 7f2d73eb0640 15 client.22324.objecter _session_command_op_assign -1 1 2024-02-09T08:34:57.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.693+0000 7f2d73eb0640 20 client.22324.objecter _get_session osd=-1 returning homeless 2024-02-09T08:34:57.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.693+0000 7f2d73eb0640 10 client.22324.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:34:57.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.693+0000 7f2d73eb0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:34:57.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.693+0000 7f2d73eb0640 1 -- 172.21.15.62:0/512718800 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2d6c14cd80 con 0x7f2d6c06be10 2024-02-09T08:34:57.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.713+0000 7f2d5e7fc640 1 -- 172.21.15.62:0/512718800 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f2d600073c0 con 0x7f2d6c06be10 2024-02-09T08:34:57.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.713+0000 7f2d5e7fc640 1 --2- 172.21.15.62:0/512718800 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f2d5006d1a0 0x7f2d5006f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:57.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.714+0000 7f2d7144b640 1 --2- 172.21.15.62:0/512718800 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f2d5006d1a0 0x7f2d5006f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:57.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.714+0000 7f2d7144b640 10 monclient: get_auth_request con 0x7f2d5006d1a0 auth_method 0 2024-02-09T08:34:57.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.714+0000 7f2d7144b640 1 --2- 172.21.15.62:0/512718800 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f2d5006d1a0 0x7f2d5006f660 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f2d68036000 tx=0x7f2d6803c040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:34:57.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.714+0000 7f2d5e7fc640 10 client.22324.objecter ms_handle_connect 0x7f2d5006d1a0 2024-02-09T08:34:57.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.717+0000 7f2d5e7fc640 1 -- 172.21.15.62:0/512718800 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(1270..1270 src has 1104..1270) v4 ==== 6381+0+0 (secure 0 0 0) 0x7f2d60007670 con 0x7f2d6c06be10 2024-02-09T08:34:57.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.717+0000 7f2d5e7fc640 10 client.22324.objecter ms_dispatch 0x7f2d6c000b90 osd_map(1270..1270 src has 1104..1270) v4 2024-02-09T08:34:57.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.717+0000 7f2d5e7fc640 3 client.22324.objecter handle_osd_map got epochs [1270,1270] > 0 2024-02-09T08:34:57.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.717+0000 7f2d5e7fc640 3 client.22324.objecter handle_osd_map decoding full epoch 1270 2024-02-09T08:34:57.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.717+0000 7f2d5e7fc640 10 client.22324.objecter checking command 1 2024-02-09T08:34:57.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.717+0000 7f2d5e7fc640 1 --2- 172.21.15.62:0/512718800 >> [v2:172.21.15.62:6816/2695503114,v1:172.21.15.62:6817/2695503114] conn(0x7f2d50074ea0 0x7f2d50077340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:57.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.717+0000 7f2d5e7fc640 20 client.22324.objecter _get_session s=0x7f2d500747d0 osd=2 3 2024-02-09T08:34:57.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.717+0000 7f2d5e7fc640 20 client.22324.objecter put_session s=0x7f2d500747d0 osd=2 3 2024-02-09T08:34:57.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.717+0000 7f2d5e7fc640 15 client.22324.objecter _session_command_op_remove -1 1 2024-02-09T08:34:57.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.717+0000 7f2d5e7fc640 20 client.22324.objecter _get_session s=0x7f2d500747d0 osd=2 3 2024-02-09T08:34:57.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.717+0000 7f2d5e7fc640 20 client.22324.objecter get_session s=0x7f2d500747d0 osd=2 3 2024-02-09T08:34:57.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.717+0000 7f2d5e7fc640 15 client.22324.objecter _session_command_op_assign 2 1 2024-02-09T08:34:57.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.717+0000 7f2d5e7fc640 20 client.22324.objecter put_session s=0x7f2d500747d0 osd=2 4 2024-02-09T08:34:57.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.717+0000 7f2d5e7fc640 10 client.22324.objecter _send_command 1 2024-02-09T08:34:57.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.717+0000 7f2d5e7fc640 1 -- 172.21.15.62:0/512718800 --> [v2:172.21.15.62:6816/2695503114,v1:172.21.15.62:6817/2695503114] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2d50077a10 con 0x7f2d50074ea0 2024-02-09T08:34:57.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.717+0000 7f2d5e7fc640 20 client.22324.objecter dump_active .. 0 homeless 2024-02-09T08:34:57.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.718+0000 7f2d7244d640 1 --2- 172.21.15.62:0/512718800 >> [v2:172.21.15.62:6816/2695503114,v1:172.21.15.62:6817/2695503114] conn(0x7f2d50074ea0 0x7f2d50077340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:57.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.718+0000 7f2d7244d640 10 monclient: get_auth_request con 0x7f2d50074ea0 auth_method 0 2024-02-09T08:34:57.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.719+0000 7f2d5e7fc640 1 -- 172.21.15.62:0/512718800 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=1270) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d60054bc0 con 0x7f2d6c06be10 2024-02-09T08:34:57.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.719+0000 7f2d5e7fc640 10 monclient: handle_get_version_reply finishing 1 version 1270 2024-02-09T08:34:57.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.721+0000 7f2d7244d640 1 --2- 172.21.15.62:0/512718800 >> [v2:172.21.15.62:6816/2695503114,v1:172.21.15.62:6817/2695503114] conn(0x7f2d50074ea0 0x7f2d50077340 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:34:57.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.721+0000 7f2d5e7fc640 10 client.22324.objecter ms_handle_connect 0x7f2d50074ea0 2024-02-09T08:34:57.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.746+0000 7f2d5e7fc640 1 -- 172.21.15.62:0/512718800 <== osd.2 v2:172.21.15.62:6816/2695503114 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f2d50077a10 con 0x7f2d50074ea0 2024-02-09T08:34:57.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.746+0000 7f2d5e7fc640 10 client.22324.objecter ms_dispatch 0x7f2d6c000b90 command_reply(tid 1: 0 ) v1 2024-02-09T08:34:57.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.746+0000 7f2d5e7fc640 10 client.22324.objecter _finish_command 1 = system:0 2024-02-09T08:34:57.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.746+0000 7f2d5e7fc640 20 client.22324.objecter put_session s=0x7f2d500747d0 osd=2 4 2024-02-09T08:34:57.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.746+0000 7f2d5e7fc640 15 client.22324.objecter _session_command_op_remove 2 1 2024-02-09T08:34:57.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.760+0000 7f2d73eb0640 10 client.22324.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2024-02-09T08:34:57.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.760+0000 7f2d73eb0640 15 client.22324.objecter _session_command_op_assign -1 2 2024-02-09T08:34:57.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.760+0000 7f2d73eb0640 20 client.22324.objecter _get_session s=0x7f2d500747d0 osd=2 3 2024-02-09T08:34:57.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.760+0000 7f2d73eb0640 20 client.22324.objecter put_session s=0x7f2d500747d0 osd=2 3 2024-02-09T08:34:57.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.760+0000 7f2d73eb0640 20 client.22324.objecter _get_session s=0x7f2d500747d0 osd=2 3 2024-02-09T08:34:57.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.760+0000 7f2d73eb0640 15 client.22324.objecter _session_command_op_remove -1 2 2024-02-09T08:34:57.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.760+0000 7f2d73eb0640 20 client.22324.objecter get_session s=0x7f2d500747d0 osd=2 3 2024-02-09T08:34:57.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.760+0000 7f2d73eb0640 15 client.22324.objecter _session_command_op_assign 2 2 2024-02-09T08:34:57.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.760+0000 7f2d73eb0640 20 client.22324.objecter put_session s=0x7f2d500747d0 osd=2 4 2024-02-09T08:34:57.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.760+0000 7f2d73eb0640 10 client.22324.objecter _send_command 2 2024-02-09T08:34:57.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.760+0000 7f2d73eb0640 1 -- 172.21.15.62:0/512718800 --> [v2:172.21.15.62:6816/2695503114,v1:172.21.15.62:6817/2695503114] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2d6c1dbd90 con 0x7f2d50074ea0 2024-02-09T08:34:57.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.773+0000 7f2d5e7fc640 1 -- 172.21.15.62:0/512718800 <== osd.2 v2:172.21.15.62:6816/2695503114 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f2d6c1dbd90 con 0x7f2d50074ea0 2024-02-09T08:34:57.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.773+0000 7f2d5e7fc640 10 client.22324.objecter ms_dispatch 0x7f2d6c000b90 command_reply(tid 2: 0 ) v1 2024-02-09T08:34:57.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.773+0000 7f2d5e7fc640 10 client.22324.objecter _finish_command 2 = system:0 2024-02-09T08:34:57.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.773+0000 7f2d5e7fc640 20 client.22324.objecter put_session s=0x7f2d500747d0 osd=2 4 2024-02-09T08:34:57.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.773+0000 7f2d5e7fc640 15 client.22324.objecter _session_command_op_remove 2 2 2024-02-09T08:34:57.776 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-02-09T08:34:57.777 INFO:teuthology.orchestra.run.smithi062.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-09T08:34:57.777 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-02-09T08:34:57.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.774+0000 7f2d73eb0640 10 librados: watch_flush enter 2024-02-09T08:34:57.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.774+0000 7f2d73eb0640 10 librados: watch_flush exit 2024-02-09T08:34:57.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.774+0000 7f2d73eb0640 10 client.22324.objecter close_session for osd.2 2024-02-09T08:34:57.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.774+0000 7f2d73eb0640 1 -- 172.21.15.62:0/512718800 >> [v2:172.21.15.62:6816/2695503114,v1:172.21.15.62:6817/2695503114] conn(0x7f2d50074ea0 msgr2=0x7f2d50077340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:57.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.774+0000 7f2d73eb0640 1 --2- 172.21.15.62:0/512718800 >> [v2:172.21.15.62:6816/2695503114,v1:172.21.15.62:6817/2695503114] conn(0x7f2d50074ea0 0x7f2d50077340 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:57.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.774+0000 7f2d73eb0640 20 client.22324.objecter put_session s=0x7f2d500747d0 osd=2 1 2024-02-09T08:34:57.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.774+0000 7f2d73eb0640 20 client.22324.objecter shutdown clearing up homeless session... 2024-02-09T08:34:57.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.774+0000 7f2d73eb0640 10 client.22324.objecter successfully canceled tick 2024-02-09T08:34:57.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.774+0000 7f2d73eb0640 1 -- 172.21.15.62:0/512718800 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f2d5006d1a0 msgr2=0x7f2d5006f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:57.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.774+0000 7f2d73eb0640 1 --2- 172.21.15.62:0/512718800 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f2d5006d1a0 0x7f2d5006f660 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f2d68036000 tx=0x7f2d6803c040 comp rx=0 tx=0).stop 2024-02-09T08:34:57.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.774+0000 7f2d73eb0640 10 monclient: shutdown 2024-02-09T08:34:57.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.774+0000 7f2d73eb0640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:34:57.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.774+0000 7f2d73eb0640 1 -- 172.21.15.62:0/512718800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d6c06be10 msgr2=0x7f2d6c1db420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:57.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.774+0000 7f2d73eb0640 1 --2- 172.21.15.62:0/512718800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d6c06be10 0x7f2d6c1db420 secure :-1 s=READY pgs=5664 cs=0 l=1 rev1=1 crypto rx=0x7f2d6000c400 tx=0x7f2d6000c8c0 comp rx=0 tx=0).stop 2024-02-09T08:34:57.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.774+0000 7f2d7244d640 1 -- 172.21.15.62:0/512718800 reap_dead start 2024-02-09T08:34:57.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.774+0000 7f2d73eb0640 1 -- 172.21.15.62:0/512718800 shutdown_connections 2024-02-09T08:34:57.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.774+0000 7f2d73eb0640 1 -- 172.21.15.62:0/512718800 >> 172.21.15.62:0/512718800 conn(0x7f2d6c0b8070 msgr2=0x7f2d6c0b71b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:34:57.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.774+0000 7f2d73eb0640 1 -- 172.21.15.62:0/512718800 shutdown_connections 2024-02-09T08:34:57.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.774+0000 7f2d73eb0640 1 -- 172.21.15.62:0/512718800 wait complete. 2024-02-09T08:34:57.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.774+0000 7f2d73eb0640 1 librados: shutdown 2024-02-09T08:34:57.787 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-02-09T08:34:57.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.889+0000 7f82792de640 10 monclient: get_monmap_and_config 2024-02-09T08:34:57.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.889+0000 7f82792de640 10 monclient: build_initial_monmap 2024-02-09T08:34:57.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.889+0000 7f82792de640 10 monclient: monmap: 2024-02-09T08:34:57.892 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:34:57.892 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:57.893 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:34:57.891002+0000 2024-02-09T08:34:57.893 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:34:57.891002+0000 2024-02-09T08:34:57.893 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:34:57.893 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:57.893 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:34:57.893 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:34:57.893 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:34:57.893 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:34:57.893 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:34:57.893 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:57.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.890+0000 7f82792de640 1 Processor -- start 2024-02-09T08:34:57.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.890+0000 7f82792de640 1 -- start start 2024-02-09T08:34:57.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.890+0000 7f82792de640 10 monclient: init 2024-02-09T08:34:57.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.891+0000 7f82792de640 10 monclient: _reopen_session rank -1 2024-02-09T08:34:57.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.891+0000 7f82792de640 10 monclient: _add_conns ranks=[4,3,1,2,0] 2024-02-09T08:34:57.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.891+0000 7f82792de640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f82740b5000 0x7f827413f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:57.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.891+0000 7f82792de640 10 monclient(hunting): picked mon.noname-c con 0x7f82740b5000 addr v2:172.21.15.103:3300/0 2024-02-09T08:34:57.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.891+0000 7f82792de640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f82740a9e30 0x7f827413fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:57.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.891+0000 7f82792de640 10 monclient(hunting): picked mon.noname-a con 0x7f82740a9e30 addr v2:172.21.15.62:3300/0 2024-02-09T08:34:57.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.891+0000 7f82792de640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f8274145de0 addr v1:172.21.15.103:6789/0 2024-02-09T08:34:57.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.891+0000 7f82792de640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82740aa4a0 con 0x7f8274145de0 2024-02-09T08:34:57.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.891+0000 7f82792de640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:57.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.891+0000 7f82792de640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8274140160 con 0x7f82740a9e30 2024-02-09T08:34:57.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.891+0000 7f82792de640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:57.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.891+0000 7f82792de640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82740b53e0 con 0x7f82740b5000 2024-02-09T08:34:57.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.891+0000 7f82792de640 10 monclient(hunting): _renew_subs 2024-02-09T08:34:57.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.891+0000 7f82792de640 10 monclient(hunting): authenticate will time out at 3341.251497s 2024-02-09T08:34:57.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.891+0000 7f82727fc640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f82740a9e30 0x7f827413fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:57.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.891+0000 7f8272ffd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f82740b5000 0x7f827413f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:57.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.892+0000 7f82727fc640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f82740a9e30 0x7f827413fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46514/0 (socket says 172.21.15.62:46514) 2024-02-09T08:34:57.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.892+0000 7f82727fc640 1 -- 172.21.15.62:0/1007017283 learned_addr learned my addr 172.21.15.62:0/1007017283 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:34:57.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.892+0000 7f82727fc640 10 monclient(hunting): get_auth_request con 0x7f82740a9e30 auth_method 0 2024-02-09T08:34:57.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.892+0000 7f82727fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:57.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.892+0000 7f82727fc640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:57.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.892+0000 7f82727fc640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:57.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.892+0000 7f8272ffd640 10 monclient(hunting): get_auth_request con 0x7f82740b5000 auth_method 0 2024-02-09T08:34:57.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.892+0000 7f8272ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:57.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.892+0000 7f8272ffd640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:57.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.892+0000 7f8272ffd640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:57.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.892+0000 7f82727fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:57.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.892+0000 7f82727fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:57.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.892+0000 7f82727fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:57.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.892+0000 7f8272ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:57.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.892+0000 7f8272ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:57.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.892+0000 7f8272ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:57.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.894+0000 7f8272ffd640 10 monclient(hunting): handle_auth_done global_id 22327 payload 274 2024-02-09T08:34:57.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.894+0000 7f8272ffd640 1 -- 172.21.15.62:0/1007017283 >> v2:172.21.15.62:3300/0 conn(0x7f82740a9e30 msgr2=0x7f827413fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:34:57.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.894+0000 7f8272ffd640 1 --2- 172.21.15.62:0/1007017283 >> v2:172.21.15.62:3300/0 conn(0x7f82740a9e30 0x7f827413fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:57.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.894+0000 7f8272ffd640 1 -- 172.21.15.62:0/1007017283 >> v1:172.21.15.103:6789/0 conn(0x7f8274145de0 legacy=0x7f8274146250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:34:57.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.894+0000 7f8272ffd640 10 monclient: _finish_hunting 0 2024-02-09T08:34:57.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.894+0000 7f8272ffd640 1 monclient: found mon.noname-c 2024-02-09T08:34:57.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.894+0000 7f8272ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:34:57.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.894+0000 7f8272ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.103:3300/0 2024-02-09T08:34:57.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.894+0000 7f8272ffd640 1 -- 172.21.15.62:0/1007017283 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82740b2900 con 0x7f82740b5000 2024-02-09T08:34:57.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.896+0000 7f8272ffd640 1 --2- 172.21.15.62:0/1007017283 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82740b5000 0x7f827413f6e0 secure :-1 s=READY pgs=5665 cs=0 l=1 rev1=1 crypto rx=0x7f82740b56c0 tx=0x7f825c02b7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f390428939c3e79 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:34:57.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.901+0000 7f8271ffb640 1 -- 172.21.15.62:0/1007017283 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825c031710 con 0x7f82740b5000 2024-02-09T08:34:57.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.901+0000 7f8271ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:57.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.901+0000 7f8271ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-09T08:34:57.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.901+0000 7f8271ffb640 10 monclient: dump: 2024-02-09T08:34:57.903 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:57.903 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:57.904 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:57.904 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:57.904 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:57.904 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:57.904 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:57.904 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:57.904 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:57.904 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:57.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.901+0000 7f8271ffb640 10 monclient: _finish_auth 0 2024-02-09T08:34:57.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.901+0000 7f8271ffb640 10 monclient: _check_auth_tickets 2024-02-09T08:34:57.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.901+0000 7f8271ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:34:57.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.901+0000 7f8271ffb640 1 -- 172.21.15.62:0/1007017283 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f825c02f050 con 0x7f82740b5000 2024-02-09T08:34:57.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.901+0000 7f8271ffb640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:34:57.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.901+0000 7f8271ffb640 1 -- 172.21.15.62:0/1007017283 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825c031a90 con 0x7f82740b5000 2024-02-09T08:34:57.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.901+0000 7f82792de640 5 monclient: authenticate success, global_id 22327 2024-02-09T08:34:57.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.901+0000 7f82792de640 10 monclient: get_monmap_and_config success 2024-02-09T08:34:57.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.901+0000 7f82792de640 4 set_mon_vals no callback set 2024-02-09T08:34:57.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.901+0000 7f8271ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:57.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.901+0000 7f8271ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:34:57.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.901+0000 7f8271ffb640 10 monclient: dump: 2024-02-09T08:34:57.905 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:57.905 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:57.905 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:57.905 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:57.905 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:57.905 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:57.905 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:57.906 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:57.906 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:57.906 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:57.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.901+0000 7f82792de640 10 monclient: shutdown 2024-02-09T08:34:57.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.901+0000 7f82792de640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:34:57.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.901+0000 7f82792de640 1 -- 172.21.15.62:0/1007017283 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82740b5000 msgr2=0x7f827413f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:57.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.901+0000 7f82792de640 1 --2- 172.21.15.62:0/1007017283 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82740b5000 0x7f827413f6e0 secure :-1 s=READY pgs=5665 cs=0 l=1 rev1=1 crypto rx=0x7f82740b56c0 tx=0x7f825c02b7b0 comp rx=0 tx=0).stop 2024-02-09T08:34:57.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.901+0000 7f82792de640 1 -- 172.21.15.62:0/1007017283 shutdown_connections 2024-02-09T08:34:57.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.901+0000 7f82792de640 1 --2- 172.21.15.62:0/1007017283 >> v2:172.21.15.62:3300/0 conn(0x7f82740a9e30 0x7f827413fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:57.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.901+0000 7f82792de640 1 --2- 172.21.15.62:0/1007017283 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82740b5000 0x7f827413f6e0 unknown :-1 s=CLOSED pgs=5665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:57.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.901+0000 7f82792de640 1 -- 172.21.15.62:0/1007017283 >> 172.21.15.62:0/1007017283 conn(0x7f8274066bb0 msgr2=0x7f8274066fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:34:57.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.901+0000 7f82792de640 1 -- 172.21.15.62:0/1007017283 shutdown_connections 2024-02-09T08:34:57.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.901+0000 7f82792de640 1 -- 172.21.15.62:0/1007017283 wait complete. 2024-02-09T08:34:57.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.902+0000 7f82792de640 10 monclient: build_initial_monmap 2024-02-09T08:34:57.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.902+0000 7f82792de640 10 monclient: monmap: 2024-02-09T08:34:57.910 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:34:57.910 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:34:57.910 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:34:57.910 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:34:57.910 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:34:57.910 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:57.910 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:34:57.910 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:34:57.910 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:34:57.910 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:57.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.902+0000 7f82792de640 1 librados: starting msgr at 2024-02-09T08:34:57.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.902+0000 7f82792de640 1 librados: starting objecter 2024-02-09T08:34:57.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.902+0000 7f82792de640 1 Processor -- start 2024-02-09T08:34:57.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.903+0000 7f82792de640 1 -- start start 2024-02-09T08:34:57.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.903+0000 7f82792de640 1 librados: setting wanted keys 2024-02-09T08:34:57.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.903+0000 7f82792de640 1 librados: calling monclient init 2024-02-09T08:34:57.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.903+0000 7f82792de640 10 monclient: init 2024-02-09T08:34:57.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.903+0000 7f82792de640 10 monclient: _reopen_session rank -1 2024-02-09T08:34:57.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.903+0000 7f82792de640 10 monclient: _add_conns ranks=[1,2,0] 2024-02-09T08:34:57.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.903+0000 7f82792de640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82740a9e30 0x7f8274133300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:57.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.903+0000 7f82792de640 10 monclient(hunting): picked mon.noname-b con 0x7f82740a9e30 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:34:57.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.903+0000 7f82792de640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f82740b5000 0x7f8274135590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:57.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.903+0000 7f82792de640 10 monclient(hunting): picked mon.noname-c con 0x7f82740b5000 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:34:57.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.903+0000 7f82792de640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8274145de0 0x7f82741321f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:57.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.903+0000 7f82792de640 10 monclient(hunting): picked mon.noname-a con 0x7f8274145de0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:34:57.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.903+0000 7f82792de640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:57.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.903+0000 7f82792de640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8274133080 con 0x7f8274145de0 2024-02-09T08:34:57.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.903+0000 7f82792de640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:57.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.903+0000 7f82792de640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8274138f30 con 0x7f82740a9e30 2024-02-09T08:34:57.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.903+0000 7f82792de640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:57.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.903+0000 7f82792de640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8274134e00 con 0x7f82740b5000 2024-02-09T08:34:57.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.903+0000 7f82792de640 10 monclient(hunting): _renew_subs 2024-02-09T08:34:57.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.903+0000 7f82792de640 10 monclient(hunting): authenticate will time out at 3341.263807s 2024-02-09T08:34:57.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.904+0000 7f82737fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8274145de0 0x7f82741321f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:57.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.904+0000 7f82727fc640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f82740b5000 0x7f8274135590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:57.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.904+0000 7f8272ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82740a9e30 0x7f8274133300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:57.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.904+0000 7f82737fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8274145de0 0x7f82741321f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46520/0 (socket says 172.21.15.62:46520) 2024-02-09T08:34:57.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.904+0000 7f82737fe640 1 -- 172.21.15.62:0/570207191 learned_addr learned my addr 172.21.15.62:0/570207191 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:34:57.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.904+0000 7f82727fc640 10 monclient(hunting): get_auth_request con 0x7f82740b5000 auth_method 0 2024-02-09T08:34:57.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.904+0000 7f82727fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:57.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.904+0000 7f82727fc640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:57.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.904+0000 7f82727fc640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:57.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.904+0000 7f82737fe640 10 monclient(hunting): get_auth_request con 0x7f8274145de0 auth_method 0 2024-02-09T08:34:57.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.904+0000 7f82737fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:57.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.904+0000 7f82737fe640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:57.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.904+0000 7f82737fe640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:57.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.904+0000 7f8272ffd640 10 monclient(hunting): get_auth_request con 0x7f82740a9e30 auth_method 0 2024-02-09T08:34:57.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.904+0000 7f8272ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:57.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.904+0000 7f8272ffd640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:57.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.904+0000 7f8272ffd640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:57.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.905+0000 7f8272ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:57.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.905+0000 7f8272ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:57.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.905+0000 7f8272ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:57.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.905+0000 7f82737fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:57.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.905+0000 7f82737fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:57.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.905+0000 7f82737fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:57.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.905+0000 7f82727fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:57.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.905+0000 7f82727fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:57.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.905+0000 7f82727fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:57.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.908+0000 7f8272ffd640 10 monclient(hunting): handle_auth_done global_id 22330 payload 824 2024-02-09T08:34:57.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.908+0000 7f8272ffd640 1 -- 172.21.15.62:0/570207191 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f82740b5000 msgr2=0x7f8274135590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:57.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.908+0000 7f8272ffd640 1 --2- 172.21.15.62:0/570207191 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f82740b5000 0x7f8274135590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:57.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.908+0000 7f8272ffd640 1 -- 172.21.15.62:0/570207191 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8274145de0 msgr2=0x7f82741321f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:57.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.908+0000 7f8272ffd640 1 --2- 172.21.15.62:0/570207191 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8274145de0 0x7f82741321f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:57.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.908+0000 7f8272ffd640 10 monclient: _finish_hunting 0 2024-02-09T08:34:57.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.908+0000 7f8272ffd640 1 monclient: found mon.noname-b 2024-02-09T08:34:57.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.908+0000 7f8272ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:34:57.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.908+0000 7f8272ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.103:3300/0 2024-02-09T08:34:57.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.908+0000 7f8272ffd640 1 -- 172.21.15.62:0/570207191 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f825c009400 con 0x7f82740a9e30 2024-02-09T08:34:57.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.910+0000 7f8272ffd640 1 --2- 172.21.15.62:0/570207191 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82740a9e30 0x7f8274133300 secure :-1 s=READY pgs=5666 cs=0 l=1 rev1=1 crypto rx=0x7f82740ab1c0 tx=0x7f825c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:34:57.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.910+0000 7f826b7fe640 10 client.?.objecter ms_handle_connect 0x7f82740a9e30 2024-02-09T08:34:57.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.910+0000 7f826b7fe640 10 client.?.objecter resend_mon_ops 2024-02-09T08:34:57.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.914+0000 7f826b7fe640 1 -- 172.21.15.62:0/570207191 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825c03c8d0 con 0x7f82740a9e30 2024-02-09T08:34:57.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.914+0000 7f826b7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:57.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.914+0000 7f826b7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:34:57.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.914+0000 7f826b7fe640 10 monclient: dump: 2024-02-09T08:34:57.917 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:57.917 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:57.917 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:57.917 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:57.917 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:57.917 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:57.917 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:57.917 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:57.917 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:57.917 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:57.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.914+0000 7f826b7fe640 10 monclient: _finish_auth 0 2024-02-09T08:34:57.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.914+0000 7f826b7fe640 10 monclient: _check_auth_tickets 2024-02-09T08:34:57.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.914+0000 7f826b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:34:57.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.914+0000 7f826b7fe640 1 -- 172.21.15.62:0/570207191 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f825c03ca50 con 0x7f82740a9e30 2024-02-09T08:34:57.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.914+0000 7f826b7fe640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:34:57.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.914+0000 7f826b7fe640 1 -- 172.21.15.62:0/570207191 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825c03ce00 con 0x7f82740a9e30 2024-02-09T08:34:57.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.914+0000 7f826b7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:57.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.914+0000 7f826b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:34:57.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.914+0000 7f826b7fe640 10 monclient: dump: 2024-02-09T08:34:57.918 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:57.918 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:57.918 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:57.918 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:57.918 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:57.918 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:57.918 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:57.919 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:57.919 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:57.919 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:57.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.914+0000 7f82792de640 5 monclient: authenticate success, global_id 22330 2024-02-09T08:34:57.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.914+0000 7f82792de640 10 monclient: _renew_subs 2024-02-09T08:34:57.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.914+0000 7f82792de640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:34:57.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.914+0000 7f82792de640 1 -- 172.21.15.62:0/570207191 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82740b4870 con 0x7f82740a9e30 2024-02-09T08:34:57.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.914+0000 7f82717fa640 4 set_mon_vals no callback set 2024-02-09T08:34:57.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.914+0000 7f82792de640 10 client.22330.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:34:57.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.914+0000 7f82792de640 10 monclient: _renew_subs 2024-02-09T08:34:57.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.914+0000 7f82792de640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:34:57.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.914+0000 7f82792de640 1 -- 172.21.15.62:0/570207191 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8274133840 con 0x7f82740a9e30 2024-02-09T08:34:57.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.914+0000 7f82792de640 1 librados: init done 2024-02-09T08:34:57.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.915+0000 7f82792de640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:34:57.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.915+0000 7f82792de640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:34:57.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.915+0000 7f82792de640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:34:57.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.915+0000 7f82792de640 1 -- 172.21.15.62:0/570207191 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82740b4670 con 0x7f82740a9e30 2024-02-09T08:34:57.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.935+0000 7f826b7fe640 1 -- 172.21.15.62:0/570207191 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f825c03a040 con 0x7f82740a9e30 2024-02-09T08:34:57.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.935+0000 7f826b7fe640 1 --2- 172.21.15.62:0/570207191 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f825406d1f0 0x7f825406f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:57.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.936+0000 7f82727fc640 1 --2- 172.21.15.62:0/570207191 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f825406d1f0 0x7f825406f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:57.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.936+0000 7f82727fc640 10 monclient: get_auth_request con 0x7f825406d1f0 auth_method 0 2024-02-09T08:34:57.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.936+0000 7f82727fc640 1 --2- 172.21.15.62:0/570207191 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f825406d1f0 0x7f825406f6b0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f8274137d00 tx=0x7f8264009240 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:34:57.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:57.936+0000 7f826b7fe640 10 client.22330.objecter ms_handle_connect 0x7f825406d1f0 2024-02-09T08:34:58.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.163+0000 7f826b7fe640 1 -- 172.21.15.62:0/570207191 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(1270..1270 src has 1104..1270) v4 ==== 6381+0+0 (secure 0 0 0) 0x7f825c042030 con 0x7f82740a9e30 2024-02-09T08:34:58.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.163+0000 7f826b7fe640 10 client.22330.objecter ms_dispatch 0x7f8274000b90 osd_map(1270..1270 src has 1104..1270) v4 2024-02-09T08:34:58.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.163+0000 7f826b7fe640 3 client.22330.objecter handle_osd_map got epochs [1270,1270] > 0 2024-02-09T08:34:58.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.163+0000 7f826b7fe640 3 client.22330.objecter handle_osd_map decoding full epoch 1270 2024-02-09T08:34:58.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.163+0000 7f826b7fe640 20 client.22330.objecter dump_active .. 0 homeless 2024-02-09T08:34:58.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.173+0000 7f826b7fe640 1 -- 172.21.15.62:0/570207191 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f825c0760c0 con 0x7f82740a9e30 2024-02-09T08:34:58.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.173+0000 7f826b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:34:58.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.173+0000 7f826b7fe640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:34:58.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.361+0000 7f82792de640 1 -- 172.21.15.62:0/570207191 --> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f8274134f70 con 0x7f825406d1f0 2024-02-09T08:34:58.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.361+0000 7f826b7fe640 1 -- 172.21.15.62:0/570207191 <== mgr.4109 v2:172.21.15.103:6800/2270392189 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8274134f70 con 0x7f825406d1f0 2024-02-09T08:34:58.364 INFO:teuthology.orchestra.run.smithi062.stderr:instructed osd(s) 2 to deep-scrub 2024-02-09T08:34:58.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.363+0000 7f82792de640 10 librados: watch_flush enter 2024-02-09T08:34:58.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.363+0000 7f82792de640 10 librados: watch_flush exit 2024-02-09T08:34:58.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.363+0000 7f82792de640 20 client.22330.objecter shutdown clearing up homeless session... 2024-02-09T08:34:58.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.363+0000 7f82792de640 10 client.22330.objecter successfully canceled tick 2024-02-09T08:34:58.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.363+0000 7f82792de640 1 -- 172.21.15.62:0/570207191 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f825406d1f0 msgr2=0x7f825406f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:58.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.363+0000 7f82792de640 1 --2- 172.21.15.62:0/570207191 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f825406d1f0 0x7f825406f6b0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f8274137d00 tx=0x7f8264009240 comp rx=0 tx=0).stop 2024-02-09T08:34:58.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.363+0000 7f82792de640 10 monclient: shutdown 2024-02-09T08:34:58.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.363+0000 7f82792de640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:34:58.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.363+0000 7f82792de640 1 -- 172.21.15.62:0/570207191 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82740a9e30 msgr2=0x7f8274133300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:58.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.363+0000 7f82792de640 1 --2- 172.21.15.62:0/570207191 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82740a9e30 0x7f8274133300 secure :-1 s=READY pgs=5666 cs=0 l=1 rev1=1 crypto rx=0x7f82740ab1c0 tx=0x7f825c0046c0 comp rx=0 tx=0).stop 2024-02-09T08:34:58.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.363+0000 7f82792de640 1 -- 172.21.15.62:0/570207191 shutdown_connections 2024-02-09T08:34:58.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.363+0000 7f82792de640 1 --2- 172.21.15.62:0/570207191 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f825406d1f0 0x7f825406f6b0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:58.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.363+0000 7f82792de640 1 --2- 172.21.15.62:0/570207191 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8274145de0 0x7f82741321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:58.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.363+0000 7f82792de640 1 --2- 172.21.15.62:0/570207191 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f82740b5000 0x7f8274135590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:58.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.363+0000 7f82792de640 1 --2- 172.21.15.62:0/570207191 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82740a9e30 0x7f8274133300 unknown :-1 s=CLOSED pgs=5666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:58.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.363+0000 7f82792de640 1 -- 172.21.15.62:0/570207191 >> 172.21.15.62:0/570207191 conn(0x7f8274066bb0 msgr2=0x7f827413f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:34:58.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.364+0000 7f82792de640 1 -- 172.21.15.62:0/570207191 shutdown_connections 2024-02-09T08:34:58.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.364+0000 7f82792de640 1 -- 172.21.15.62:0/570207191 wait complete. 2024-02-09T08:34:58.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.364+0000 7f82792de640 1 librados: shutdown 2024-02-09T08:34:58.382 INFO:tasks.ceph:Scrubbing osd.3 2024-02-09T08:34:58.382 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-02-09T08:34:58.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.487+0000 7fcf7a2de640 10 monclient: get_monmap_and_config 2024-02-09T08:34:58.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.487+0000 7fcf7a2de640 10 monclient: build_initial_monmap 2024-02-09T08:34:58.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.488+0000 7fcf7a2de640 10 monclient: monmap: 2024-02-09T08:34:58.490 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:34:58.490 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:58.490 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:34:58.489066+0000 2024-02-09T08:34:58.491 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:34:58.489066+0000 2024-02-09T08:34:58.491 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:34:58.491 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:58.491 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:34:58.491 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:34:58.491 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:34:58.491 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:34:58.491 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:34:58.491 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:58.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.488+0000 7fcf7a2de640 1 Processor -- start 2024-02-09T08:34:58.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.488+0000 7fcf7a2de640 1 -- start start 2024-02-09T08:34:58.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.488+0000 7fcf7a2de640 10 monclient: init 2024-02-09T08:34:58.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.489+0000 7fcf7a2de640 10 monclient: _reopen_session rank -1 2024-02-09T08:34:58.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.489+0000 7fcf7a2de640 10 monclient: _add_conns ranks=[2,1,3,0,4] 2024-02-09T08:34:58.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.489+0000 7fcf7a2de640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf740b48b0 0x7fcf740a9460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:58.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.489+0000 7fcf7a2de640 10 monclient(hunting): picked mon.noname-b con 0x7fcf740b48b0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:34:58.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.489+0000 7fcf7a2de640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fcf740b4c90 addr v1:172.21.15.103:6789/0 2024-02-09T08:34:58.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.489+0000 7fcf7a2de640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fcf74142550 0x7fcf740b0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:58.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.489+0000 7fcf7a2de640 10 monclient(hunting): picked mon.noname-a con 0x7fcf74142550 addr v2:172.21.15.62:3300/0 2024-02-09T08:34:58.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.489+0000 7fcf7a2de640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf740aab50 con 0x7fcf740b4c90 2024-02-09T08:34:58.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.489+0000 7fcf7a2de640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:58.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.489+0000 7fcf7a2de640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf740b2380 con 0x7fcf74142550 2024-02-09T08:34:58.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.489+0000 7fcf7a2de640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:58.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.489+0000 7fcf7a2de640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf740a9b30 con 0x7fcf740b48b0 2024-02-09T08:34:58.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.489+0000 7fcf7a2de640 10 monclient(hunting): _renew_subs 2024-02-09T08:34:58.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.489+0000 7fcf7a2de640 10 monclient(hunting): authenticate will time out at 3341.849574s 2024-02-09T08:34:58.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.489+0000 7fcf73fff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf740b48b0 0x7fcf740a9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:58.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.489+0000 7fcf737fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fcf740b4c90 0x7fcf740b1c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.62:46484/0 (socket says 172.21.15.62:46484) 2024-02-09T08:34:58.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.490+0000 7fcf737fe640 1 -- 172.21.15.62:0/219590035 learned_addr learned my addr 172.21.15.62:0/219590035 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-09T08:34:58.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.490+0000 7fcf7887b640 1 --2- 172.21.15.62:0/219590035 >> v2:172.21.15.62:3300/0 conn(0x7fcf74142550 0x7fcf740b0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:58.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.490+0000 7fcf73fff640 10 monclient(hunting): get_auth_request con 0x7fcf740b48b0 auth_method 0 2024-02-09T08:34:58.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.490+0000 7fcf73fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:58.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.490+0000 7fcf73fff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:58.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.490+0000 7fcf73fff640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:58.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.490+0000 7fcf7887b640 10 monclient(hunting): get_auth_request con 0x7fcf74142550 auth_method 0 2024-02-09T08:34:58.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.490+0000 7fcf7887b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:58.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.490+0000 7fcf7887b640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:58.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.490+0000 7fcf7887b640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:58.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.490+0000 7fcf73fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:58.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.490+0000 7fcf73fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:58.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.490+0000 7fcf73fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:58.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.490+0000 7fcf7887b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:58.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.490+0000 7fcf7887b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:58.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.490+0000 7fcf7887b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:58.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.492+0000 7fcf72ffd640 1 -- 172.21.15.62:0/219590035 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2468313532 0 0) 0x7fcf740aab50 con 0x7fcf740b4c90 2024-02-09T08:34:58.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.492+0000 7fcf72ffd640 10 monclient(hunting): _negotiate 2024-02-09T08:34:58.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.492+0000 7fcf72ffd640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:58.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.492+0000 7fcf72ffd640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:58.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.492+0000 7fcf72ffd640 10 monclient(hunting): my global_id is 22333 2024-02-09T08:34:58.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.492+0000 7fcf72ffd640 1 -- 172.21.15.62:0/219590035 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf5c003520 con 0x7fcf740b4c90 2024-02-09T08:34:58.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.492+0000 7fcf7887b640 10 monclient(hunting): handle_auth_done global_id 16194 payload 274 2024-02-09T08:34:58.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.492+0000 7fcf7887b640 1 -- 172.21.15.62:0/219590035 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf740b48b0 msgr2=0x7fcf740a9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:34:58.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.492+0000 7fcf7887b640 1 --2- 172.21.15.62:0/219590035 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf740b48b0 0x7fcf740a9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:58.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.492+0000 7fcf7887b640 1 -- 172.21.15.62:0/219590035 >> v1:172.21.15.103:6789/0 conn(0x7fcf740b4c90 legacy=0x7fcf740b1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:58.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.492+0000 7fcf7887b640 10 monclient: _finish_hunting 0 2024-02-09T08:34:58.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.492+0000 7fcf7887b640 1 monclient: found mon.noname-a 2024-02-09T08:34:58.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.492+0000 7fcf7887b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:34:58.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.492+0000 7fcf7887b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-02-09T08:34:58.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.492+0000 7fcf7887b640 1 -- 172.21.15.62:0/219590035 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf74142990 con 0x7fcf74142550 2024-02-09T08:34:58.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.494+0000 7fcf7887b640 1 --2- 172.21.15.62:0/219590035 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf74142550 0x7fcf740b0eb0 secure :-1 s=READY pgs=3212 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c009d90 tx=0x7fcf6c02be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45f622442cb00204 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:34:58.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.498+0000 7fcf72ffd640 1 -- 172.21.15.62:0/219590035 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c02cbc0 con 0x7fcf74142550 2024-02-09T08:34:58.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.498+0000 7fcf72ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:58.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.498+0000 7fcf72ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-09T08:34:58.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.498+0000 7fcf72ffd640 10 monclient: dump: 2024-02-09T08:34:58.501 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:58.501 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:58.501 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:58.501 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:58.502 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:58.502 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:58.502 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:58.502 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:58.502 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:58.502 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:58.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.498+0000 7fcf72ffd640 10 monclient: _finish_auth 0 2024-02-09T08:34:58.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.498+0000 7fcf72ffd640 10 monclient: _check_auth_tickets 2024-02-09T08:34:58.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.498+0000 7fcf72ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:34:58.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.498+0000 7fcf72ffd640 1 -- 172.21.15.62:0/219590035 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf6c02cd20 con 0x7fcf74142550 2024-02-09T08:34:58.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.498+0000 7fcf72ffd640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:34:58.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.498+0000 7fcf72ffd640 1 -- 172.21.15.62:0/219590035 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c034660 con 0x7fcf74142550 2024-02-09T08:34:58.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.498+0000 7fcf7a2de640 5 monclient: authenticate success, global_id 16194 2024-02-09T08:34:58.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.498+0000 7fcf7a2de640 10 monclient: get_monmap_and_config success 2024-02-09T08:34:58.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.498+0000 7fcf7a2de640 4 set_mon_vals no callback set 2024-02-09T08:34:58.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.498+0000 7fcf72ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:58.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.498+0000 7fcf72ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-09T08:34:58.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.498+0000 7fcf72ffd640 10 monclient: dump: 2024-02-09T08:34:58.503 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:58.503 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:58.503 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:58.503 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:58.503 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:58.503 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:58.503 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:58.503 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:58.504 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:58.504 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:58.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.499+0000 7fcf7a2de640 10 monclient: shutdown 2024-02-09T08:34:58.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.499+0000 7fcf7a2de640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:34:58.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.499+0000 7fcf7a2de640 1 -- 172.21.15.62:0/219590035 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf74142550 msgr2=0x7fcf740b0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:58.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.499+0000 7fcf7a2de640 1 --2- 172.21.15.62:0/219590035 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf74142550 0x7fcf740b0eb0 secure :-1 s=READY pgs=3212 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c009d90 tx=0x7fcf6c02be10 comp rx=0 tx=0).stop 2024-02-09T08:34:58.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.499+0000 7fcf7a2de640 1 -- 172.21.15.62:0/219590035 shutdown_connections 2024-02-09T08:34:58.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.499+0000 7fcf7a2de640 1 --2- 172.21.15.62:0/219590035 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf74142550 0x7fcf740b0eb0 unknown :-1 s=CLOSED pgs=3212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:58.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.499+0000 7fcf7a2de640 1 --2- 172.21.15.62:0/219590035 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf740b48b0 0x7fcf740a9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:58.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.499+0000 7fcf7a2de640 1 -- 172.21.15.62:0/219590035 >> 172.21.15.62:0/219590035 conn(0x7fcf7406bbc0 msgr2=0x7fcf7406bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:34:58.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.499+0000 7fcf7a2de640 1 -- 172.21.15.62:0/219590035 shutdown_connections 2024-02-09T08:34:58.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.499+0000 7fcf7a2de640 1 -- 172.21.15.62:0/219590035 wait complete. 2024-02-09T08:34:58.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.500+0000 7fcf7a2de640 10 monclient: build_initial_monmap 2024-02-09T08:34:58.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.500+0000 7fcf7a2de640 10 monclient: monmap: 2024-02-09T08:34:58.508 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:34:58.508 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:34:58.508 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:34:58.508 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:34:58.508 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:34:58.508 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:58.508 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:34:58.508 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:34:58.508 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:34:58.508 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:58.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.500+0000 7fcf7a2de640 1 librados: starting msgr at 2024-02-09T08:34:58.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.500+0000 7fcf7a2de640 1 librados: starting objecter 2024-02-09T08:34:58.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.500+0000 7fcf7a2de640 1 Processor -- start 2024-02-09T08:34:58.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.501+0000 7fcf7a2de640 1 -- start start 2024-02-09T08:34:58.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.501+0000 7fcf7a2de640 1 librados: setting wanted keys 2024-02-09T08:34:58.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.501+0000 7fcf7a2de640 1 librados: calling monclient init 2024-02-09T08:34:58.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.501+0000 7fcf7a2de640 10 monclient: init 2024-02-09T08:34:58.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.501+0000 7fcf7a2de640 10 monclient: _reopen_session rank -1 2024-02-09T08:34:58.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.501+0000 7fcf7a2de640 10 monclient: _add_conns ranks=[0,1,2] 2024-02-09T08:34:58.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.501+0000 7fcf7a2de640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf740b48b0 0x7fcf741c93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:58.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.501+0000 7fcf7a2de640 10 monclient(hunting): picked mon.noname-a con 0x7fcf740b48b0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:34:58.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.501+0000 7fcf7a2de640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf74142550 0x7fcf741da7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:58.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.501+0000 7fcf7a2de640 10 monclient(hunting): picked mon.noname-b con 0x7fcf74142550 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:34:58.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.501+0000 7fcf7a2de640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf7413c060 0x7fcf741dad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:58.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.501+0000 7fcf7a2de640 10 monclient(hunting): picked mon.noname-c con 0x7fcf7413c060 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:34:58.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.501+0000 7fcf7a2de640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:58.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.501+0000 7fcf7a2de640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf741cc140 con 0x7fcf740b48b0 2024-02-09T08:34:58.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.501+0000 7fcf7a2de640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:58.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.501+0000 7fcf7a2de640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf741cac30 con 0x7fcf74142550 2024-02-09T08:34:58.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.501+0000 7fcf7a2de640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:58.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.501+0000 7fcf7a2de640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7413c520 con 0x7fcf7413c060 2024-02-09T08:34:58.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.501+0000 7fcf7a2de640 10 monclient(hunting): _renew_subs 2024-02-09T08:34:58.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.501+0000 7fcf7a2de640 10 monclient(hunting): authenticate will time out at 3341.861960s 2024-02-09T08:34:58.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.502+0000 7fcf73fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf740b48b0 0x7fcf741c93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:58.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.502+0000 7fcf7887b640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf7413c060 0x7fcf741dad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:58.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.502+0000 7fcf737fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf74142550 0x7fcf741da7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:58.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.502+0000 7fcf737fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf74142550 0x7fcf741da7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.62:52046/0 (socket says 172.21.15.62:52046) 2024-02-09T08:34:58.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.502+0000 7fcf737fe640 1 -- 172.21.15.62:0/4257427519 learned_addr learned my addr 172.21.15.62:0/4257427519 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:34:58.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.502+0000 7fcf737fe640 10 monclient(hunting): get_auth_request con 0x7fcf74142550 auth_method 0 2024-02-09T08:34:58.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.502+0000 7fcf737fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:58.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.502+0000 7fcf737fe640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:58.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.502+0000 7fcf737fe640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:58.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.502+0000 7fcf7887b640 10 monclient(hunting): get_auth_request con 0x7fcf7413c060 auth_method 0 2024-02-09T08:34:58.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.502+0000 7fcf7887b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:58.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.502+0000 7fcf7887b640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:58.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.502+0000 7fcf7887b640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:58.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.502+0000 7fcf73fff640 10 monclient(hunting): get_auth_request con 0x7fcf740b48b0 auth_method 0 2024-02-09T08:34:58.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.502+0000 7fcf73fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:58.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.502+0000 7fcf73fff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:58.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.502+0000 7fcf73fff640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:58.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.503+0000 7fcf737fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:58.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.503+0000 7fcf737fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:58.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.503+0000 7fcf737fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:58.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.503+0000 7fcf7887b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:58.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.503+0000 7fcf7887b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:58.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.503+0000 7fcf7887b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:58.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.503+0000 7fcf73fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:58.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.503+0000 7fcf73fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:58.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.503+0000 7fcf73fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:58.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.505+0000 7fcf737fe640 10 monclient(hunting): handle_auth_done global_id 22336 payload 824 2024-02-09T08:34:58.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.505+0000 7fcf737fe640 1 -- 172.21.15.62:0/4257427519 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf7413c060 msgr2=0x7fcf741dad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:58.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.505+0000 7fcf737fe640 1 --2- 172.21.15.62:0/4257427519 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf7413c060 0x7fcf741dad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:58.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.505+0000 7fcf737fe640 1 -- 172.21.15.62:0/4257427519 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf740b48b0 msgr2=0x7fcf741c93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:58.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.505+0000 7fcf737fe640 1 --2- 172.21.15.62:0/4257427519 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf740b48b0 0x7fcf741c93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:58.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.505+0000 7fcf737fe640 10 monclient: _finish_hunting 0 2024-02-09T08:34:58.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.505+0000 7fcf737fe640 1 monclient: found mon.noname-b 2024-02-09T08:34:58.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.505+0000 7fcf737fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:34:58.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.505+0000 7fcf737fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.103:3300/0 2024-02-09T08:34:58.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.505+0000 7fcf737fe640 1 -- 172.21.15.62:0/4257427519 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf6c009a70 con 0x7fcf74142550 2024-02-09T08:34:58.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.508+0000 7fcf737fe640 1 --2- 172.21.15.62:0/4257427519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf74142550 0x7fcf741da7f0 secure :-1 s=READY pgs=5668 cs=0 l=1 rev1=1 crypto rx=0x7fcf6400c460 tx=0x7fcf6400c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:34:58.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.508+0000 7fcf70ff9640 10 client.?.objecter ms_handle_connect 0x7fcf74142550 2024-02-09T08:34:58.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.508+0000 7fcf70ff9640 10 client.?.objecter resend_mon_ops 2024-02-09T08:34:58.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.510+0000 7fcf70ff9640 1 -- 172.21.15.62:0/4257427519 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf64005ce0 con 0x7fcf74142550 2024-02-09T08:34:58.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.510+0000 7fcf70ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:58.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.510+0000 7fcf70ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:34:58.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.510+0000 7fcf70ff9640 10 monclient: dump: 2024-02-09T08:34:58.514 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:58.514 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:58.515 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:58.515 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:58.515 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:58.515 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:58.515 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:58.515 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:58.515 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:58.515 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:58.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.510+0000 7fcf70ff9640 10 monclient: _finish_auth 0 2024-02-09T08:34:58.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.510+0000 7fcf70ff9640 10 monclient: _check_auth_tickets 2024-02-09T08:34:58.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.510+0000 7fcf70ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:34:58.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.510+0000 7fcf7a2de640 5 monclient: authenticate success, global_id 22336 2024-02-09T08:34:58.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.510+0000 7fcf7a2de640 10 monclient: _renew_subs 2024-02-09T08:34:58.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.510+0000 7fcf7a2de640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:34:58.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.510+0000 7fcf7a2de640 1 -- 172.21.15.62:0/4257427519 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf741cb080 con 0x7fcf74142550 2024-02-09T08:34:58.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.510+0000 7fcf7a2de640 10 client.22336.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:34:58.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.510+0000 7fcf7a2de640 10 monclient: _renew_subs 2024-02-09T08:34:58.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.510+0000 7fcf7a2de640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:34:58.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.510+0000 7fcf7a2de640 1 -- 172.21.15.62:0/4257427519 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf741cc940 con 0x7fcf74142550 2024-02-09T08:34:58.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.510+0000 7fcf7a2de640 1 librados: init done 2024-02-09T08:34:58.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.511+0000 7fcf7a2de640 10 client.22336.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:34:58.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.511+0000 7fcf7a2de640 15 client.22336.objecter _session_command_op_assign -1 1 2024-02-09T08:34:58.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.511+0000 7fcf7a2de640 20 client.22336.objecter _get_session osd=-1 returning homeless 2024-02-09T08:34:58.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.511+0000 7fcf7a2de640 10 client.22336.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:34:58.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.511+0000 7fcf7a2de640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:34:58.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.511+0000 7fcf7a2de640 1 -- 172.21.15.62:0/4257427519 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcf740ab080 con 0x7fcf74142550 2024-02-09T08:34:58.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.511+0000 7fcf70ff9640 1 -- 172.21.15.62:0/4257427519 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf64005e40 con 0x7fcf74142550 2024-02-09T08:34:58.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.511+0000 7fcf70ff9640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:34:58.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.511+0000 7fcf70ff9640 1 -- 172.21.15.62:0/4257427519 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf64007ea0 con 0x7fcf74142550 2024-02-09T08:34:58.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.511+0000 7fcf70ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:58.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.511+0000 7fcf70ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:34:58.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.511+0000 7fcf70ff9640 10 monclient: dump: 2024-02-09T08:34:58.517 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:58.517 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:58.517 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:58.517 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:58.518 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:58.518 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:58.518 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:58.518 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:58.518 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:58.518 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:58.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.511+0000 7fcf727fc640 4 set_mon_vals no callback set 2024-02-09T08:34:58.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.532+0000 7fcf70ff9640 1 -- 172.21.15.62:0/4257427519 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fcf64007270 con 0x7fcf74142550 2024-02-09T08:34:58.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.532+0000 7fcf70ff9640 1 --2- 172.21.15.62:0/4257427519 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fcf6006d1d0 0x7fcf6006f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:58.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.533+0000 7fcf73fff640 1 --2- 172.21.15.62:0/4257427519 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fcf6006d1d0 0x7fcf6006f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:58.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.533+0000 7fcf73fff640 10 monclient: get_auth_request con 0x7fcf6006d1d0 auth_method 0 2024-02-09T08:34:58.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.533+0000 7fcf73fff640 1 --2- 172.21.15.62:0/4257427519 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fcf6006d1d0 0x7fcf6006f690 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fcf68009b40 tx=0x7fcf68009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:34:58.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.533+0000 7fcf70ff9640 10 client.22336.objecter ms_handle_connect 0x7fcf6006d1d0 2024-02-09T08:34:58.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.535+0000 7fcf70ff9640 1 -- 172.21.15.62:0/4257427519 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(1270..1270 src has 1104..1270) v4 ==== 6381+0+0 (secure 0 0 0) 0x7fcf64058970 con 0x7fcf74142550 2024-02-09T08:34:58.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.535+0000 7fcf70ff9640 10 client.22336.objecter ms_dispatch 0x7fcf74000b90 osd_map(1270..1270 src has 1104..1270) v4 2024-02-09T08:34:58.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.535+0000 7fcf70ff9640 3 client.22336.objecter handle_osd_map got epochs [1270,1270] > 0 2024-02-09T08:34:58.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.535+0000 7fcf70ff9640 3 client.22336.objecter handle_osd_map decoding full epoch 1270 2024-02-09T08:34:58.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.535+0000 7fcf70ff9640 10 client.22336.objecter checking command 1 2024-02-09T08:34:58.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.535+0000 7fcf70ff9640 1 --2- 172.21.15.62:0/4257427519 >> [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] conn(0x7fcf60074f60 0x7fcf60077400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:58.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.535+0000 7fcf70ff9640 20 client.22336.objecter _get_session s=0x7fcf60074890 osd=3 3 2024-02-09T08:34:58.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.535+0000 7fcf70ff9640 20 client.22336.objecter put_session s=0x7fcf60074890 osd=3 3 2024-02-09T08:34:58.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.535+0000 7fcf70ff9640 15 client.22336.objecter _session_command_op_remove -1 1 2024-02-09T08:34:58.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.535+0000 7fcf70ff9640 20 client.22336.objecter _get_session s=0x7fcf60074890 osd=3 3 2024-02-09T08:34:58.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.535+0000 7fcf70ff9640 20 client.22336.objecter get_session s=0x7fcf60074890 osd=3 3 2024-02-09T08:34:58.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.535+0000 7fcf70ff9640 15 client.22336.objecter _session_command_op_assign 3 1 2024-02-09T08:34:58.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.535+0000 7fcf70ff9640 20 client.22336.objecter put_session s=0x7fcf60074890 osd=3 4 2024-02-09T08:34:58.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.535+0000 7fcf70ff9640 10 client.22336.objecter _send_command 1 2024-02-09T08:34:58.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.535+0000 7fcf70ff9640 1 -- 172.21.15.62:0/4257427519 --> [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcf60077ad0 con 0x7fcf60074f60 2024-02-09T08:34:58.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.535+0000 7fcf70ff9640 20 client.22336.objecter dump_active .. 0 homeless 2024-02-09T08:34:58.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.535+0000 7fcf70ff9640 1 -- 172.21.15.62:0/4257427519 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=1270) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf64058740 con 0x7fcf74142550 2024-02-09T08:34:58.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.535+0000 7fcf70ff9640 10 monclient: handle_get_version_reply finishing 1 version 1270 2024-02-09T08:34:58.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.536+0000 7fcf7887b640 1 --2- 172.21.15.62:0/4257427519 >> [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] conn(0x7fcf60074f60 0x7fcf60077400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:58.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.536+0000 7fcf7887b640 10 monclient: get_auth_request con 0x7fcf60074f60 auth_method 0 2024-02-09T08:34:58.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.540+0000 7fcf70ff9640 10 client.22336.objecter ms_handle_connect 0x7fcf60074f60 2024-02-09T08:34:58.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.540+0000 7fcf7887b640 1 --2- 172.21.15.62:0/4257427519 >> [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] conn(0x7fcf60074f60 0x7fcf60077400 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:34:58.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.566+0000 7fcf70ff9640 1 -- 172.21.15.62:0/4257427519 <== osd.3 v2:172.21.15.62:6824/556356316 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fcf60077ad0 con 0x7fcf60074f60 2024-02-09T08:34:58.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.566+0000 7fcf70ff9640 10 client.22336.objecter ms_dispatch 0x7fcf74000b90 command_reply(tid 1: 0 ) v1 2024-02-09T08:34:58.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.566+0000 7fcf70ff9640 10 client.22336.objecter _finish_command 1 = system:0 2024-02-09T08:34:58.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.566+0000 7fcf70ff9640 20 client.22336.objecter put_session s=0x7fcf60074890 osd=3 4 2024-02-09T08:34:58.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.566+0000 7fcf70ff9640 15 client.22336.objecter _session_command_op_remove 3 1 2024-02-09T08:34:58.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.579+0000 7fcf7a2de640 10 client.22336.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2024-02-09T08:34:58.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.579+0000 7fcf7a2de640 15 client.22336.objecter _session_command_op_assign -1 2 2024-02-09T08:34:58.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.579+0000 7fcf7a2de640 20 client.22336.objecter _get_session s=0x7fcf60074890 osd=3 3 2024-02-09T08:34:58.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.579+0000 7fcf7a2de640 20 client.22336.objecter put_session s=0x7fcf60074890 osd=3 3 2024-02-09T08:34:58.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.579+0000 7fcf7a2de640 20 client.22336.objecter _get_session s=0x7fcf60074890 osd=3 3 2024-02-09T08:34:58.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.579+0000 7fcf7a2de640 15 client.22336.objecter _session_command_op_remove -1 2 2024-02-09T08:34:58.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.579+0000 7fcf7a2de640 20 client.22336.objecter get_session s=0x7fcf60074890 osd=3 3 2024-02-09T08:34:58.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.579+0000 7fcf7a2de640 15 client.22336.objecter _session_command_op_assign 3 2 2024-02-09T08:34:58.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.579+0000 7fcf7a2de640 20 client.22336.objecter put_session s=0x7fcf60074890 osd=3 4 2024-02-09T08:34:58.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.579+0000 7fcf7a2de640 10 client.22336.objecter _send_command 2 2024-02-09T08:34:58.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.579+0000 7fcf7a2de640 1 -- 172.21.15.62:0/4257427519 --> [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcf741caa00 con 0x7fcf60074f60 2024-02-09T08:34:58.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.593+0000 7fcf70ff9640 1 -- 172.21.15.62:0/4257427519 <== osd.3 v2:172.21.15.62:6824/556356316 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fcf741caa00 con 0x7fcf60074f60 2024-02-09T08:34:58.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.593+0000 7fcf70ff9640 10 client.22336.objecter ms_dispatch 0x7fcf74000b90 command_reply(tid 2: 0 ) v1 2024-02-09T08:34:58.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.593+0000 7fcf70ff9640 10 client.22336.objecter _finish_command 2 = system:0 2024-02-09T08:34:58.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.593+0000 7fcf70ff9640 20 client.22336.objecter put_session s=0x7fcf60074890 osd=3 4 2024-02-09T08:34:58.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.593+0000 7fcf70ff9640 15 client.22336.objecter _session_command_op_remove 3 2 2024-02-09T08:34:58.596 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-02-09T08:34:58.596 INFO:teuthology.orchestra.run.smithi062.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-09T08:34:58.596 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-02-09T08:34:58.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.593+0000 7fcf7a2de640 10 librados: watch_flush enter 2024-02-09T08:34:58.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.593+0000 7fcf7a2de640 10 librados: watch_flush exit 2024-02-09T08:34:58.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.593+0000 7fcf7a2de640 10 client.22336.objecter close_session for osd.3 2024-02-09T08:34:58.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.593+0000 7fcf7a2de640 1 -- 172.21.15.62:0/4257427519 >> [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] conn(0x7fcf60074f60 msgr2=0x7fcf60077400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:58.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.593+0000 7fcf7a2de640 1 --2- 172.21.15.62:0/4257427519 >> [v2:172.21.15.62:6824/556356316,v1:172.21.15.62:6825/556356316] conn(0x7fcf60074f60 0x7fcf60077400 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:58.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.593+0000 7fcf7a2de640 20 client.22336.objecter put_session s=0x7fcf60074890 osd=3 1 2024-02-09T08:34:58.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.593+0000 7fcf7a2de640 20 client.22336.objecter shutdown clearing up homeless session... 2024-02-09T08:34:58.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.593+0000 7fcf7a2de640 10 client.22336.objecter successfully canceled tick 2024-02-09T08:34:58.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.593+0000 7fcf7a2de640 1 -- 172.21.15.62:0/4257427519 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fcf6006d1d0 msgr2=0x7fcf6006f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:58.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.593+0000 7fcf7a2de640 1 --2- 172.21.15.62:0/4257427519 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fcf6006d1d0 0x7fcf6006f690 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fcf68009b40 tx=0x7fcf68009190 comp rx=0 tx=0).stop 2024-02-09T08:34:58.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.593+0000 7fcf7a2de640 10 monclient: shutdown 2024-02-09T08:34:58.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.593+0000 7fcf7a2de640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:34:58.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.593+0000 7fcf7a2de640 1 -- 172.21.15.62:0/4257427519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf74142550 msgr2=0x7fcf741da7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:58.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.593+0000 7fcf7a2de640 1 --2- 172.21.15.62:0/4257427519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf74142550 0x7fcf741da7f0 secure :-1 s=READY pgs=5668 cs=0 l=1 rev1=1 crypto rx=0x7fcf6400c460 tx=0x7fcf6400c920 comp rx=0 tx=0).stop 2024-02-09T08:34:58.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.593+0000 7fcf7887b640 1 -- 172.21.15.62:0/4257427519 reap_dead start 2024-02-09T08:34:58.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.593+0000 7fcf7a2de640 1 -- 172.21.15.62:0/4257427519 shutdown_connections 2024-02-09T08:34:58.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.593+0000 7fcf7a2de640 1 -- 172.21.15.62:0/4257427519 >> 172.21.15.62:0/4257427519 conn(0x7fcf7406bbc0 msgr2=0x7fcf741cd390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:34:58.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.593+0000 7fcf7a2de640 1 -- 172.21.15.62:0/4257427519 shutdown_connections 2024-02-09T08:34:58.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.593+0000 7fcf7a2de640 1 -- 172.21.15.62:0/4257427519 wait complete. 2024-02-09T08:34:58.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.593+0000 7fcf7a2de640 1 librados: shutdown 2024-02-09T08:34:58.606 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-02-09T08:34:58.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.717+0000 7f7707352640 10 monclient: get_monmap_and_config 2024-02-09T08:34:58.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.717+0000 7f7707352640 10 monclient: build_initial_monmap 2024-02-09T08:34:58.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.717+0000 7f7707352640 10 monclient: monmap: 2024-02-09T08:34:58.720 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:34:58.720 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:58.720 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:34:58.718347+0000 2024-02-09T08:34:58.720 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:34:58.718347+0000 2024-02-09T08:34:58.720 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:34:58.720 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:58.720 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:34:58.720 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:34:58.720 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:34:58.720 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:34:58.720 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:34:58.720 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:58.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.717+0000 7f7707352640 1 Processor -- start 2024-02-09T08:34:58.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.718+0000 7f7707352640 1 -- start start 2024-02-09T08:34:58.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.718+0000 7f7707352640 10 monclient: init 2024-02-09T08:34:58.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.718+0000 7f7707352640 10 monclient: _reopen_session rank -1 2024-02-09T08:34:58.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.718+0000 7f7707352640 10 monclient: _add_conns ranks=[0,4,3,2,1] 2024-02-09T08:34:58.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.718+0000 7f7707352640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f77000b52a0 addr v1:172.21.15.62:6789/0 2024-02-09T08:34:58.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.718+0000 7f7707352640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f77000b22d0 0x7f770013f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:58.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.718+0000 7f7707352640 10 monclient(hunting): picked mon.noname-c con 0x7f77000b22d0 addr v2:172.21.15.103:3300/0 2024-02-09T08:34:58.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.718+0000 7f7707352640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f770013fdc0 0x7f77001427e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:58.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.718+0000 7f7707352640 10 monclient(hunting): picked mon.noname-a con 0x7f770013fdc0 addr v2:172.21.15.62:3300/0 2024-02-09T08:34:58.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.718+0000 7f7707352640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77000b3620 con 0x7f77000b52a0 2024-02-09T08:34:58.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.718+0000 7f7707352640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:58.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.718+0000 7f7707352640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77000b5680 con 0x7f770013fdc0 2024-02-09T08:34:58.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.718+0000 7f7707352640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:58.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.718+0000 7f7707352640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7700140250 con 0x7f77000b22d0 2024-02-09T08:34:58.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.718+0000 7f7707352640 10 monclient(hunting): _renew_subs 2024-02-09T08:34:58.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.718+0000 7f7707352640 10 monclient(hunting): authenticate will time out at 3342.079091s 2024-02-09T08:34:58.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.719+0000 7f77058ef640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f770013fdc0 0x7f77001427e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:58.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.719+0000 7f77048ed640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f77000b22d0 0x7f770013f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:58.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.719+0000 7f77048ed640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f77000b22d0 0x7f770013f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.62:52058/0 (socket says 172.21.15.62:52058) 2024-02-09T08:34:58.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.719+0000 7f77048ed640 1 -- 172.21.15.62:0/3530761000 learned_addr learned my addr 172.21.15.62:0/3530761000 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:34:58.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.719+0000 7f77048ed640 10 monclient(hunting): get_auth_request con 0x7f77000b22d0 auth_method 0 2024-02-09T08:34:58.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.719+0000 7f77048ed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:58.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.719+0000 7f77048ed640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:58.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.719+0000 7f77048ed640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:58.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.720+0000 7f77058ef640 10 monclient(hunting): get_auth_request con 0x7f770013fdc0 auth_method 0 2024-02-09T08:34:58.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.720+0000 7f77058ef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:58.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.720+0000 7f77058ef640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:58.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.720+0000 7f77058ef640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:58.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.720+0000 7f77048ed640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:58.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.720+0000 7f77048ed640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:58.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.720+0000 7f77048ed640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:58.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.720+0000 7f77058ef640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:58.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.720+0000 7f77058ef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:58.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.720+0000 7f77058ef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:58.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.722+0000 7f77048ed640 10 monclient(hunting): handle_auth_done global_id 22339 payload 274 2024-02-09T08:34:58.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.722+0000 7f77048ed640 1 -- 172.21.15.62:0/3530761000 >> v2:172.21.15.62:3300/0 conn(0x7f770013fdc0 msgr2=0x7f77001427e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:34:58.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.722+0000 7f77048ed640 1 --2- 172.21.15.62:0/3530761000 >> v2:172.21.15.62:3300/0 conn(0x7f770013fdc0 0x7f77001427e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:58.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.722+0000 7f77048ed640 1 -- 172.21.15.62:0/3530761000 >> v1:172.21.15.62:6789/0 conn(0x7f77000b52a0 legacy=0x7f77000b2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:58.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.722+0000 7f77048ed640 10 monclient: _finish_hunting 0 2024-02-09T08:34:58.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.722+0000 7f77048ed640 1 monclient: found mon.noname-c 2024-02-09T08:34:58.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.722+0000 7f77048ed640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:34:58.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.722+0000 7f77048ed640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.103:3300/0 2024-02-09T08:34:58.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.722+0000 7f77048ed640 1 -- 172.21.15.62:0/3530761000 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7700142d20 con 0x7f77000b22d0 2024-02-09T08:34:58.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.724+0000 7f77048ed640 1 --2- 172.21.15.62:0/3530761000 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77000b22d0 0x7f770013f880 secure :-1 s=READY pgs=5669 cs=0 l=1 rev1=1 crypto rx=0x7f77000679d0 tx=0x7f76f002b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a17c6b3358ead66 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:34:58.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.728+0000 7f76f7fff640 1 -- 172.21.15.62:0/3530761000 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f0031870 con 0x7f77000b22d0 2024-02-09T08:34:58.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.728+0000 7f76f7fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:58.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.728+0000 7f76f7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-09T08:34:58.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.728+0000 7f76f7fff640 10 monclient: dump: 2024-02-09T08:34:58.730 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:58.730 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:58.730 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:58.731 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:58.731 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:58.731 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:58.731 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:58.731 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:58.731 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:58.731 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:58.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.728+0000 7f76f7fff640 10 monclient: _finish_auth 0 2024-02-09T08:34:58.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.728+0000 7f76f7fff640 10 monclient: _check_auth_tickets 2024-02-09T08:34:58.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.728+0000 7f76f7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:34:58.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.728+0000 7f76f7fff640 1 -- 172.21.15.62:0/3530761000 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f00319d0 con 0x7f77000b22d0 2024-02-09T08:34:58.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.728+0000 7f76f7fff640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:34:58.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.728+0000 7f76f7fff640 1 -- 172.21.15.62:0/3530761000 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f0031d60 con 0x7f77000b22d0 2024-02-09T08:34:58.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.728+0000 7f7707352640 5 monclient: authenticate success, global_id 22339 2024-02-09T08:34:58.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.728+0000 7f7707352640 10 monclient: get_monmap_and_config success 2024-02-09T08:34:58.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.728+0000 7f7707352640 4 set_mon_vals no callback set 2024-02-09T08:34:58.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.728+0000 7f76f7fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:58.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.728+0000 7f76f7fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:34:58.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.728+0000 7f76f7fff640 10 monclient: dump: 2024-02-09T08:34:58.732 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:58.732 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:58.732 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:58.732 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:58.732 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:58.732 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:58.732 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:58.732 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:58.732 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:58.732 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:58.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.728+0000 7f7707352640 10 monclient: shutdown 2024-02-09T08:34:58.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.728+0000 7f7707352640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:34:58.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.728+0000 7f7707352640 1 -- 172.21.15.62:0/3530761000 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77000b22d0 msgr2=0x7f770013f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:58.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.728+0000 7f7707352640 1 --2- 172.21.15.62:0/3530761000 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77000b22d0 0x7f770013f880 secure :-1 s=READY pgs=5669 cs=0 l=1 rev1=1 crypto rx=0x7f77000679d0 tx=0x7f76f002b910 comp rx=0 tx=0).stop 2024-02-09T08:34:58.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.728+0000 7f7707352640 1 -- 172.21.15.62:0/3530761000 shutdown_connections 2024-02-09T08:34:58.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.728+0000 7f7707352640 1 --2- 172.21.15.62:0/3530761000 >> v2:172.21.15.62:3300/0 conn(0x7f770013fdc0 0x7f77001427e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:58.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.728+0000 7f7707352640 1 --2- 172.21.15.62:0/3530761000 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77000b22d0 0x7f770013f880 unknown :-1 s=CLOSED pgs=5669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:58.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.728+0000 7f7707352640 1 -- 172.21.15.62:0/3530761000 >> 172.21.15.62:0/3530761000 conn(0x7f77000b84d0 msgr2=0x7f77000b4920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:34:58.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.729+0000 7f7707352640 1 -- 172.21.15.62:0/3530761000 shutdown_connections 2024-02-09T08:34:58.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.729+0000 7f7707352640 1 -- 172.21.15.62:0/3530761000 wait complete. 2024-02-09T08:34:58.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.729+0000 7f7707352640 10 monclient: build_initial_monmap 2024-02-09T08:34:58.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.729+0000 7f7707352640 10 monclient: monmap: 2024-02-09T08:34:58.737 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:34:58.737 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:34:58.737 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:34:58.738 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:34:58.738 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:34:58.738 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:58.738 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:34:58.738 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:34:58.738 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:34:58.738 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:58.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.729+0000 7f7707352640 1 librados: starting msgr at 2024-02-09T08:34:58.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.729+0000 7f7707352640 1 librados: starting objecter 2024-02-09T08:34:58.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.730+0000 7f7707352640 1 Processor -- start 2024-02-09T08:34:58.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.730+0000 7f7707352640 1 -- start start 2024-02-09T08:34:58.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.730+0000 7f7707352640 1 librados: setting wanted keys 2024-02-09T08:34:58.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.730+0000 7f7707352640 1 librados: calling monclient init 2024-02-09T08:34:58.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.730+0000 7f7707352640 10 monclient: init 2024-02-09T08:34:58.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.730+0000 7f7707352640 10 monclient: _reopen_session rank -1 2024-02-09T08:34:58.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.730+0000 7f7707352640 10 monclient: _add_conns ranks=[1,0,2] 2024-02-09T08:34:58.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.730+0000 7f7707352640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77000b22d0 0x7f77001397e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:58.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.730+0000 7f7707352640 10 monclient(hunting): picked mon.noname-b con 0x7f77000b22d0 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:34:58.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.730+0000 7f7707352640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77000b52a0 0x7f77001db050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:58.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.730+0000 7f7707352640 10 monclient(hunting): picked mon.noname-a con 0x7f77000b52a0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:34:58.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.730+0000 7f7707352640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f770013fdc0 0x7f77001db590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:58.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.730+0000 7f7707352640 10 monclient(hunting): picked mon.noname-c con 0x7f770013fdc0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:34:58.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.730+0000 7f7707352640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:58.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.730+0000 7f7707352640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77001dbad0 con 0x7f77000b52a0 2024-02-09T08:34:58.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.730+0000 7f7707352640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:58.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.730+0000 7f7707352640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77001dabc0 con 0x7f77000b22d0 2024-02-09T08:34:58.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.730+0000 7f7707352640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:58.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.730+0000 7f7707352640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7700136140 con 0x7f770013fdc0 2024-02-09T08:34:58.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.730+0000 7f7707352640 10 monclient(hunting): _renew_subs 2024-02-09T08:34:58.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.730+0000 7f7707352640 10 monclient(hunting): authenticate will time out at 3342.090978s 2024-02-09T08:34:58.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.731+0000 7f77048ed640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77000b52a0 0x7f77001db050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:58.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.731+0000 7f77050ee640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77000b22d0 0x7f77001397e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:58.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.731+0000 7f77058ef640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f770013fdc0 0x7f77001db590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:58.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.731+0000 7f77050ee640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77000b22d0 0x7f77001397e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.62:52066/0 (socket says 172.21.15.62:52066) 2024-02-09T08:34:58.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.731+0000 7f77050ee640 1 -- 172.21.15.62:0/1439866558 learned_addr learned my addr 172.21.15.62:0/1439866558 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:34:58.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.731+0000 7f77058ef640 10 monclient(hunting): get_auth_request con 0x7f770013fdc0 auth_method 0 2024-02-09T08:34:58.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.731+0000 7f77058ef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:58.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.731+0000 7f77058ef640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:58.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.731+0000 7f77058ef640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:58.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.731+0000 7f77048ed640 10 monclient(hunting): get_auth_request con 0x7f77000b52a0 auth_method 0 2024-02-09T08:34:58.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.731+0000 7f77048ed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:58.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.731+0000 7f77048ed640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:58.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.731+0000 7f77048ed640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:58.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.731+0000 7f77050ee640 10 monclient(hunting): get_auth_request con 0x7f77000b22d0 auth_method 0 2024-02-09T08:34:58.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.731+0000 7f77050ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:58.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.731+0000 7f77050ee640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:58.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.731+0000 7f77050ee640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:58.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.732+0000 7f77050ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:58.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.732+0000 7f77050ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:58.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.732+0000 7f77050ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:58.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.732+0000 7f77058ef640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:58.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.732+0000 7f77058ef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:58.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.732+0000 7f77058ef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:58.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.732+0000 7f77048ed640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:58.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.732+0000 7f77048ed640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:58.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.732+0000 7f77048ed640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:58.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.734+0000 7f77050ee640 10 monclient(hunting): handle_auth_done global_id 22342 payload 824 2024-02-09T08:34:58.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.735+0000 7f77050ee640 1 -- 172.21.15.62:0/1439866558 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f770013fdc0 msgr2=0x7f77001db590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:58.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.735+0000 7f77050ee640 1 --2- 172.21.15.62:0/1439866558 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f770013fdc0 0x7f77001db590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:58.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.735+0000 7f77050ee640 1 -- 172.21.15.62:0/1439866558 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77000b52a0 msgr2=0x7f77001db050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:58.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.735+0000 7f77050ee640 1 --2- 172.21.15.62:0/1439866558 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77000b52a0 0x7f77001db050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:58.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.735+0000 7f77050ee640 10 monclient: _finish_hunting 0 2024-02-09T08:34:58.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.735+0000 7f77050ee640 1 monclient: found mon.noname-b 2024-02-09T08:34:58.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.735+0000 7f77050ee640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:34:58.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.735+0000 7f77050ee640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.103:3300/0 2024-02-09T08:34:58.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.735+0000 7f77050ee640 1 -- 172.21.15.62:0/1439866558 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f00094d0 con 0x7f77000b22d0 2024-02-09T08:34:58.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.737+0000 7f77050ee640 1 --2- 172.21.15.62:0/1439866558 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77000b22d0 0x7f77001397e0 secure :-1 s=READY pgs=5670 cs=0 l=1 rev1=1 crypto rx=0x7f76fc00c400 tx=0x7f76fc00c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:34:58.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.737+0000 7f76f5ffb640 10 client.?.objecter ms_handle_connect 0x7f77000b22d0 2024-02-09T08:34:58.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.737+0000 7f76f5ffb640 10 client.?.objecter resend_mon_ops 2024-02-09T08:34:58.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.740+0000 7f76f5ffb640 1 -- 172.21.15.62:0/1439866558 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76fc0052d0 con 0x7f77000b22d0 2024-02-09T08:34:58.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.740+0000 7f76f5ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:58.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.740+0000 7f76f5ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:34:58.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.740+0000 7f76f5ffb640 10 monclient: dump: 2024-02-09T08:34:58.746 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:58.746 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:58.746 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:58.746 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:58.747 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:58.747 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:58.747 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:58.747 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:58.747 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:58.747 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:58.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.740+0000 7f76f5ffb640 10 monclient: _finish_auth 0 2024-02-09T08:34:58.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.740+0000 7f76f5ffb640 10 monclient: _check_auth_tickets 2024-02-09T08:34:58.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.740+0000 7f76f5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:34:58.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.740+0000 7f76f5ffb640 1 -- 172.21.15.62:0/1439866558 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76fc005450 con 0x7f77000b22d0 2024-02-09T08:34:58.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.740+0000 7f7707352640 5 monclient: authenticate success, global_id 22342 2024-02-09T08:34:58.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.740+0000 7f7707352640 10 monclient: _renew_subs 2024-02-09T08:34:58.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.740+0000 7f7707352640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:34:58.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.740+0000 7f7707352640 1 -- 172.21.15.62:0/1439866558 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f770013aee0 con 0x7f77000b22d0 2024-02-09T08:34:58.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.740+0000 7f76f5ffb640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:34:58.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.740+0000 7f76f5ffb640 1 -- 172.21.15.62:0/1439866558 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76fc007260 con 0x7f77000b22d0 2024-02-09T08:34:58.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.740+0000 7f76f5ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:58.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.740+0000 7f76f5ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:34:58.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.740+0000 7f76f5ffb640 10 monclient: dump: 2024-02-09T08:34:58.748 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:58.748 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:58.748 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:58.748 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:58.748 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:58.748 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:58.748 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:58.748 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:58.749 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:58.749 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:58.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.740+0000 7f76f77fe640 4 set_mon_vals no callback set 2024-02-09T08:34:58.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.741+0000 7f7707352640 10 client.22342.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:34:58.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.741+0000 7f7707352640 10 monclient: _renew_subs 2024-02-09T08:34:58.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.741+0000 7f7707352640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:34:58.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.741+0000 7f7707352640 1 -- 172.21.15.62:0/1439866558 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7700139200 con 0x7f77000b22d0 2024-02-09T08:34:58.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.741+0000 7f7707352640 1 librados: init done 2024-02-09T08:34:58.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.742+0000 7f7707352640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:34:58.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.742+0000 7f7707352640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:34:58.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.742+0000 7f7707352640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:34:58.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.742+0000 7f7707352640 1 -- 172.21.15.62:0/1439866558 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f770004ef90 con 0x7f77000b22d0 2024-02-09T08:34:58.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.992+0000 7f76f5ffb640 1 -- 172.21.15.62:0/1439866558 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f76fc0073c0 con 0x7f77000b22d0 2024-02-09T08:34:58.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.992+0000 7f76f5ffb640 1 --2- 172.21.15.62:0/1439866558 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f76e406d1a0 0x7f76e406f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:58.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.992+0000 7f77048ed640 1 --2- 172.21.15.62:0/1439866558 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f76e406d1a0 0x7f76e406f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:58.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.992+0000 7f77048ed640 10 monclient: get_auth_request con 0x7f76e406d1a0 auth_method 0 2024-02-09T08:34:58.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.993+0000 7f76f5ffb640 10 client.22342.objecter ms_handle_connect 0x7f76e406d1a0 2024-02-09T08:34:58.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.993+0000 7f77048ed640 1 --2- 172.21.15.62:0/1439866558 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f76e406d1a0 0x7f76e406f660 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f76f0036000 tx=0x7f76f003c040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:34:58.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.994+0000 7f76f5ffb640 1 -- 172.21.15.62:0/1439866558 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(1270..1270 src has 1104..1270) v4 ==== 6381+0+0 (secure 0 0 0) 0x7f76fc007670 con 0x7f77000b22d0 2024-02-09T08:34:58.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.994+0000 7f76f5ffb640 10 client.22342.objecter ms_dispatch 0x7f7700000b90 osd_map(1270..1270 src has 1104..1270) v4 2024-02-09T08:34:58.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.994+0000 7f76f5ffb640 3 client.22342.objecter handle_osd_map got epochs [1270,1270] > 0 2024-02-09T08:34:58.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.994+0000 7f76f5ffb640 3 client.22342.objecter handle_osd_map decoding full epoch 1270 2024-02-09T08:34:58.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:58.995+0000 7f76f5ffb640 20 client.22342.objecter dump_active .. 0 homeless 2024-02-09T08:34:59.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.005+0000 7f76f5ffb640 1 -- 172.21.15.62:0/1439866558 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f76fc054560 con 0x7f77000b22d0 2024-02-09T08:34:59.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.005+0000 7f76f5ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:34:59.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.005+0000 7f76f5ffb640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:34:59.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.189+0000 7f7707352640 1 -- 172.21.15.62:0/1439866558 --> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f770014cf00 con 0x7f76e406d1a0 2024-02-09T08:34:59.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.190+0000 7f76f5ffb640 1 -- 172.21.15.62:0/1439866558 <== mgr.4109 v2:172.21.15.103:6800/2270392189 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f76f0031670 con 0x7f76e406d1a0 2024-02-09T08:34:59.192 INFO:teuthology.orchestra.run.smithi062.stderr:instructed osd(s) 3 to deep-scrub 2024-02-09T08:34:59.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.192+0000 7f7707352640 10 librados: watch_flush enter 2024-02-09T08:34:59.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.192+0000 7f7707352640 10 librados: watch_flush exit 2024-02-09T08:34:59.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.192+0000 7f7707352640 20 client.22342.objecter shutdown clearing up homeless session... 2024-02-09T08:34:59.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.192+0000 7f7707352640 10 client.22342.objecter successfully canceled tick 2024-02-09T08:34:59.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.192+0000 7f7707352640 1 -- 172.21.15.62:0/1439866558 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f76e406d1a0 msgr2=0x7f76e406f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:59.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.192+0000 7f7707352640 1 --2- 172.21.15.62:0/1439866558 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f76e406d1a0 0x7f76e406f660 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f76f0036000 tx=0x7f76f003c040 comp rx=0 tx=0).stop 2024-02-09T08:34:59.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.192+0000 7f7707352640 10 monclient: shutdown 2024-02-09T08:34:59.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.192+0000 7f7707352640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:34:59.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.192+0000 7f7707352640 1 -- 172.21.15.62:0/1439866558 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77000b22d0 msgr2=0x7f77001397e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:59.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.192+0000 7f7707352640 1 --2- 172.21.15.62:0/1439866558 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77000b22d0 0x7f77001397e0 secure :-1 s=READY pgs=5670 cs=0 l=1 rev1=1 crypto rx=0x7f76fc00c400 tx=0x7f76fc00c8c0 comp rx=0 tx=0).stop 2024-02-09T08:34:59.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.192+0000 7f7707352640 1 -- 172.21.15.62:0/1439866558 shutdown_connections 2024-02-09T08:34:59.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.192+0000 7f7707352640 1 --2- 172.21.15.62:0/1439866558 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f76e406d1a0 0x7f76e406f660 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:59.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.192+0000 7f7707352640 1 --2- 172.21.15.62:0/1439866558 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f770013fdc0 0x7f77001db590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:59.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.192+0000 7f7707352640 1 --2- 172.21.15.62:0/1439866558 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77000b52a0 0x7f77001db050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:59.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.192+0000 7f7707352640 1 --2- 172.21.15.62:0/1439866558 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77000b22d0 0x7f77001397e0 unknown :-1 s=CLOSED pgs=5670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:59.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.192+0000 7f7707352640 1 -- 172.21.15.62:0/1439866558 >> 172.21.15.62:0/1439866558 conn(0x7f77000b84d0 msgr2=0x7f77000b2720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:34:59.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.192+0000 7f7707352640 1 -- 172.21.15.62:0/1439866558 shutdown_connections 2024-02-09T08:34:59.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.192+0000 7f7707352640 1 -- 172.21.15.62:0/1439866558 wait complete. 2024-02-09T08:34:59.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.192+0000 7f7707352640 1 librados: shutdown 2024-02-09T08:34:59.206 INFO:tasks.ceph:Scrubbing osd.4 2024-02-09T08:34:59.206 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-02-09T08:34:59.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.310+0000 7fb263d8d640 10 monclient: get_monmap_and_config 2024-02-09T08:34:59.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.310+0000 7fb263d8d640 10 monclient: build_initial_monmap 2024-02-09T08:34:59.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.310+0000 7fb263d8d640 10 monclient: monmap: 2024-02-09T08:34:59.312 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:34:59.312 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:59.312 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:34:59.311146+0000 2024-02-09T08:34:59.313 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:34:59.311146+0000 2024-02-09T08:34:59.313 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:34:59.313 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:59.313 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:34:59.313 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:34:59.313 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:34:59.313 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:34:59.313 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:34:59.313 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:59.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.310+0000 7fb263d8d640 1 Processor -- start 2024-02-09T08:34:59.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.310+0000 7fb263d8d640 1 -- start start 2024-02-09T08:34:59.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.310+0000 7fb263d8d640 10 monclient: init 2024-02-09T08:34:59.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.311+0000 7fb263d8d640 10 monclient: _reopen_session rank -1 2024-02-09T08:34:59.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.311+0000 7fb263d8d640 10 monclient: _add_conns ranks=[0,3,4,1,2] 2024-02-09T08:34:59.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.311+0000 7fb263d8d640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb25c06c320 addr v1:172.21.15.62:6789/0 2024-02-09T08:34:59.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.311+0000 7fb263d8d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb25c0a9be0 0x7fb25c145ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:59.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.311+0000 7fb263d8d640 10 monclient(hunting): picked mon.noname-a con 0x7fb25c0a9be0 addr v2:172.21.15.62:3300/0 2024-02-09T08:34:59.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.311+0000 7fb263d8d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb25c0b2280 0x7fb25c146000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:59.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.311+0000 7fb263d8d640 10 monclient(hunting): picked mon.noname-c con 0x7fb25c0b2280 addr v2:172.21.15.103:3300/0 2024-02-09T08:34:59.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.311+0000 7fb263d8d640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb25c0aa130 con 0x7fb25c06c320 2024-02-09T08:34:59.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.311+0000 7fb263d8d640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:59.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.311+0000 7fb263d8d640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb25c06c700 con 0x7fb25c0a9be0 2024-02-09T08:34:59.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.311+0000 7fb263d8d640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:59.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.311+0000 7fb263d8d640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb25c0aa5c0 con 0x7fb25c0b2280 2024-02-09T08:34:59.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.311+0000 7fb263d8d640 10 monclient(hunting): _renew_subs 2024-02-09T08:34:59.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.311+0000 7fb263d8d640 10 monclient(hunting): authenticate will time out at 3342.671887s 2024-02-09T08:34:59.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.314+0000 7fb26232a640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb25c0b2280 0x7fb25c146000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:59.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.314+0000 7fb26232a640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb25c0b2280 0x7fb25c146000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.62:52068/0 (socket says 172.21.15.62:52068) 2024-02-09T08:34:59.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.314+0000 7fb26232a640 1 -- 172.21.15.62:0/1986227220 learned_addr learned my addr 172.21.15.62:0/1986227220 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:34:59.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.314+0000 7fb26232a640 10 monclient(hunting): get_auth_request con 0x7fb25c0b2280 auth_method 0 2024-02-09T08:34:59.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.314+0000 7fb26232a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:59.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.314+0000 7fb26232a640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:59.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.314+0000 7fb26232a640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:59.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.315+0000 7fb26232a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:59.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.315+0000 7fb26232a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:59.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.315+0000 7fb26232a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:59.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.317+0000 7fb26232a640 10 monclient(hunting): handle_auth_done global_id 22345 payload 274 2024-02-09T08:34:59.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.317+0000 7fb26232a640 1 -- 172.21.15.62:0/1986227220 >> v2:172.21.15.62:3300/0 conn(0x7fb25c0a9be0 msgr2=0x7fb25c145ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:34:59.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.317+0000 7fb26232a640 1 --2- 172.21.15.62:0/1986227220 >> v2:172.21.15.62:3300/0 conn(0x7fb25c0a9be0 0x7fb25c145ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:59.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.317+0000 7fb26232a640 1 -- 172.21.15.62:0/1986227220 >> v1:172.21.15.62:6789/0 conn(0x7fb25c06c320 legacy=0x7fb25c13f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:34:59.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.317+0000 7fb26232a640 10 monclient: _finish_hunting 0 2024-02-09T08:34:59.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.317+0000 7fb26232a640 1 monclient: found mon.noname-c 2024-02-09T08:34:59.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.317+0000 7fb26232a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:34:59.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.317+0000 7fb26232a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.103:3300/0 2024-02-09T08:34:59.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.317+0000 7fb26232a640 1 -- 172.21.15.62:0/1986227220 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb25c0ab5f0 con 0x7fb25c0b2280 2024-02-09T08:34:59.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.321+0000 7fb26232a640 1 --2- 172.21.15.62:0/1986227220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb25c0b2280 0x7fb25c146000 secure :-1 s=READY pgs=5671 cs=0 l=1 rev1=1 crypto rx=0x7fb254009e50 tx=0x7fb25402bdc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbe8a6be5e994eb server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:34:59.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.325+0000 7fb260b27640 1 -- 172.21.15.62:0/1986227220 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25402c960 con 0x7fb25c0b2280 2024-02-09T08:34:59.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.325+0000 7fb260b27640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:59.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.325+0000 7fb260b27640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-09T08:34:59.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.325+0000 7fb260b27640 10 monclient: dump: 2024-02-09T08:34:59.329 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:59.329 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:59.329 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:59.329 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:59.329 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:59.329 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:59.329 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:59.329 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:59.329 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:59.329 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:59.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.325+0000 7fb260b27640 10 monclient: _finish_auth 0 2024-02-09T08:34:59.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.325+0000 7fb260b27640 10 monclient: _check_auth_tickets 2024-02-09T08:34:59.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.325+0000 7fb260b27640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:34:59.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.325+0000 7fb260b27640 1 -- 172.21.15.62:0/1986227220 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb25402cac0 con 0x7fb25c0b2280 2024-02-09T08:34:59.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.325+0000 7fb260b27640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:34:59.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.325+0000 7fb260b27640 1 -- 172.21.15.62:0/1986227220 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25402ce50 con 0x7fb25c0b2280 2024-02-09T08:34:59.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.325+0000 7fb260b27640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:59.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.325+0000 7fb260b27640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:34:59.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.325+0000 7fb260b27640 10 monclient: dump: 2024-02-09T08:34:59.330 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:59.330 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:59.330 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:59.330 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:59.330 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:59.330 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:59.331 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:59.331 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:59.331 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:59.331 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:59.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.325+0000 7fb263d8d640 5 monclient: authenticate success, global_id 22345 2024-02-09T08:34:59.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.325+0000 7fb263d8d640 10 monclient: get_monmap_and_config success 2024-02-09T08:34:59.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.325+0000 7fb263d8d640 4 set_mon_vals no callback set 2024-02-09T08:34:59.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.326+0000 7fb263d8d640 10 monclient: shutdown 2024-02-09T08:34:59.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.326+0000 7fb263d8d640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:34:59.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.326+0000 7fb263d8d640 1 -- 172.21.15.62:0/1986227220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb25c0b2280 msgr2=0x7fb25c146000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:59.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.326+0000 7fb263d8d640 1 --2- 172.21.15.62:0/1986227220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb25c0b2280 0x7fb25c146000 secure :-1 s=READY pgs=5671 cs=0 l=1 rev1=1 crypto rx=0x7fb254009e50 tx=0x7fb25402bdc0 comp rx=0 tx=0).stop 2024-02-09T08:34:59.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.326+0000 7fb263d8d640 1 -- 172.21.15.62:0/1986227220 shutdown_connections 2024-02-09T08:34:59.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.326+0000 7fb263d8d640 1 --2- 172.21.15.62:0/1986227220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb25c0b2280 0x7fb25c146000 unknown :-1 s=CLOSED pgs=5671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:59.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.326+0000 7fb263d8d640 1 --2- 172.21.15.62:0/1986227220 >> v2:172.21.15.62:3300/0 conn(0x7fb25c0a9be0 0x7fb25c145ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:59.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.326+0000 7fb263d8d640 1 -- 172.21.15.62:0/1986227220 >> 172.21.15.62:0/1986227220 conn(0x7fb25c0b4db0 msgr2=0x7fb25c0b51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:34:59.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.326+0000 7fb263d8d640 1 -- 172.21.15.62:0/1986227220 shutdown_connections 2024-02-09T08:34:59.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.326+0000 7fb263d8d640 1 -- 172.21.15.62:0/1986227220 wait complete. 2024-02-09T08:34:59.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.327+0000 7fb263d8d640 10 monclient: build_initial_monmap 2024-02-09T08:34:59.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.327+0000 7fb263d8d640 10 monclient: monmap: 2024-02-09T08:34:59.335 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:34:59.335 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:34:59.335 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:34:59.336 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:34:59.336 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:34:59.336 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:59.336 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:34:59.336 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:34:59.336 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:34:59.336 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:59.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.327+0000 7fb263d8d640 1 librados: starting msgr at 2024-02-09T08:34:59.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.327+0000 7fb263d8d640 1 librados: starting objecter 2024-02-09T08:34:59.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.327+0000 7fb263d8d640 1 Processor -- start 2024-02-09T08:34:59.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.327+0000 7fb263d8d640 1 -- start start 2024-02-09T08:34:59.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.327+0000 7fb263d8d640 1 librados: setting wanted keys 2024-02-09T08:34:59.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.327+0000 7fb263d8d640 1 librados: calling monclient init 2024-02-09T08:34:59.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.327+0000 7fb263d8d640 10 monclient: init 2024-02-09T08:34:59.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.328+0000 7fb263d8d640 10 monclient: _reopen_session rank -1 2024-02-09T08:34:59.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.328+0000 7fb263d8d640 10 monclient: _add_conns ranks=[0,1,2] 2024-02-09T08:34:59.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.328+0000 7fb263d8d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb25c06c320 0x7fb25c142b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:59.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.328+0000 7fb263d8d640 10 monclient(hunting): picked mon.noname-a con 0x7fb25c06c320 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:34:59.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.328+0000 7fb263d8d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb25c0a9be0 0x7fb25c1430d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:59.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.328+0000 7fb263d8d640 10 monclient(hunting): picked mon.noname-b con 0x7fb25c0a9be0 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:34:59.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.328+0000 7fb263d8d640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb25c0b2280 0x7fb25c132f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:59.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.328+0000 7fb263d8d640 10 monclient(hunting): picked mon.noname-c con 0x7fb25c0b2280 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:34:59.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.328+0000 7fb263d8d640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:59.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.328+0000 7fb263d8d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb25c141e40 con 0x7fb25c06c320 2024-02-09T08:34:59.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.328+0000 7fb263d8d640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:59.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.328+0000 7fb263d8d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb25c142120 con 0x7fb25c0a9be0 2024-02-09T08:34:59.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.328+0000 7fb263d8d640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:59.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.328+0000 7fb263d8d640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb25c142400 con 0x7fb25c0b2280 2024-02-09T08:34:59.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.328+0000 7fb263d8d640 10 monclient(hunting): _renew_subs 2024-02-09T08:34:59.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.328+0000 7fb263d8d640 10 monclient(hunting): authenticate will time out at 3342.688476s 2024-02-09T08:34:59.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.328+0000 7fb261b29640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb25c06c320 0x7fb25c142b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:59.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.328+0000 7fb26232a640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb25c0b2280 0x7fb25c132f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:59.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.328+0000 7fb261328640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb25c0a9be0 0x7fb25c1430d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:59.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.329+0000 7fb261b29640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb25c06c320 0x7fb25c142b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46568/0 (socket says 172.21.15.62:46568) 2024-02-09T08:34:59.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.329+0000 7fb261b29640 1 -- 172.21.15.62:0/1169477705 learned_addr learned my addr 172.21.15.62:0/1169477705 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:34:59.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.329+0000 7fb261b29640 10 monclient(hunting): get_auth_request con 0x7fb25c06c320 auth_method 0 2024-02-09T08:34:59.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.329+0000 7fb261b29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:59.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.329+0000 7fb261b29640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:59.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.329+0000 7fb261b29640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:59.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.329+0000 7fb261328640 10 monclient(hunting): get_auth_request con 0x7fb25c0a9be0 auth_method 0 2024-02-09T08:34:59.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.329+0000 7fb261328640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:59.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.329+0000 7fb261328640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:59.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.329+0000 7fb261328640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:59.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.329+0000 7fb26232a640 10 monclient(hunting): get_auth_request con 0x7fb25c0b2280 auth_method 0 2024-02-09T08:34:59.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.329+0000 7fb26232a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:59.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.329+0000 7fb26232a640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:59.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.329+0000 7fb26232a640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:59.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.329+0000 7fb261b29640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:59.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.329+0000 7fb261b29640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:59.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.329+0000 7fb261b29640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:59.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.329+0000 7fb261328640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:59.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.329+0000 7fb261328640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:59.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.329+0000 7fb261328640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:59.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.329+0000 7fb26232a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:59.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.329+0000 7fb26232a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:59.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.329+0000 7fb26232a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:59.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.332+0000 7fb261328640 10 monclient(hunting): handle_auth_done global_id 22348 payload 824 2024-02-09T08:34:59.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.332+0000 7fb261328640 1 -- 172.21.15.62:0/1169477705 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb25c0b2280 msgr2=0x7fb25c132f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:59.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.332+0000 7fb261328640 1 --2- 172.21.15.62:0/1169477705 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb25c0b2280 0x7fb25c132f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:59.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.332+0000 7fb261328640 1 -- 172.21.15.62:0/1169477705 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb25c06c320 msgr2=0x7fb25c142b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:59.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.332+0000 7fb261328640 1 --2- 172.21.15.62:0/1169477705 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb25c06c320 0x7fb25c142b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:59.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.332+0000 7fb261328640 10 monclient: _finish_hunting 0 2024-02-09T08:34:59.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.332+0000 7fb261328640 1 monclient: found mon.noname-b 2024-02-09T08:34:59.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.332+0000 7fb261328640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:34:59.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.332+0000 7fb261328640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.103:3300/0 2024-02-09T08:34:59.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.332+0000 7fb261328640 1 -- 172.21.15.62:0/1169477705 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb254009b30 con 0x7fb25c0a9be0 2024-02-09T08:34:59.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.334+0000 7fb261328640 1 --2- 172.21.15.62:0/1169477705 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb25c0a9be0 0x7fb25c1430d0 secure :-1 s=READY pgs=5672 cs=0 l=1 rev1=1 crypto rx=0x7fb24c00b3c0 tx=0x7fb24c00b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:34:59.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.334+0000 7fb2527fc640 10 client.?.objecter ms_handle_connect 0x7fb25c0a9be0 2024-02-09T08:34:59.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.334+0000 7fb2527fc640 10 client.?.objecter resend_mon_ops 2024-02-09T08:34:59.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.338+0000 7fb2527fc640 1 -- 172.21.15.62:0/1169477705 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24c011830 con 0x7fb25c0a9be0 2024-02-09T08:34:59.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.338+0000 7fb2527fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:59.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.338+0000 7fb2527fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:34:59.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.338+0000 7fb2527fc640 10 monclient: dump: 2024-02-09T08:34:59.342 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:59.342 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:59.342 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:59.342 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:59.342 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:59.342 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:59.342 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:59.342 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:59.342 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:59.342 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:59.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.338+0000 7fb2527fc640 10 monclient: _finish_auth 0 2024-02-09T08:34:59.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.338+0000 7fb2527fc640 10 monclient: _check_auth_tickets 2024-02-09T08:34:59.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.338+0000 7fb2527fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:34:59.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.338+0000 7fb2527fc640 1 -- 172.21.15.62:0/1169477705 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb24c011990 con 0x7fb25c0a9be0 2024-02-09T08:34:59.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.338+0000 7fb2527fc640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:34:59.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.338+0000 7fb2527fc640 1 -- 172.21.15.62:0/1169477705 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24c011d40 con 0x7fb25c0a9be0 2024-02-09T08:34:59.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.338+0000 7fb263d8d640 5 monclient: authenticate success, global_id 22348 2024-02-09T08:34:59.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.338+0000 7fb263d8d640 10 monclient: _renew_subs 2024-02-09T08:34:59.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.338+0000 7fb263d8d640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:34:59.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.338+0000 7fb263d8d640 1 -- 172.21.15.62:0/1169477705 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb25c13ccb0 con 0x7fb25c0a9be0 2024-02-09T08:34:59.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.338+0000 7fb253fff640 4 set_mon_vals no callback set 2024-02-09T08:34:59.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.338+0000 7fb2527fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:59.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.338+0000 7fb2527fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:34:59.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.338+0000 7fb2527fc640 10 monclient: dump: 2024-02-09T08:34:59.343 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:59.343 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:59.343 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:59.344 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:59.344 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:59.344 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:59.344 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:59.344 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:59.344 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:59.344 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:59.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.338+0000 7fb263d8d640 10 client.22348.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:34:59.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.338+0000 7fb263d8d640 10 monclient: _renew_subs 2024-02-09T08:34:59.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.338+0000 7fb263d8d640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:34:59.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.338+0000 7fb263d8d640 1 -- 172.21.15.62:0/1169477705 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb25c1415a0 con 0x7fb25c0a9be0 2024-02-09T08:34:59.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.339+0000 7fb263d8d640 1 librados: init done 2024-02-09T08:34:59.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.339+0000 7fb263d8d640 10 client.22348.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:34:59.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.339+0000 7fb263d8d640 15 client.22348.objecter _session_command_op_assign -1 1 2024-02-09T08:34:59.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.339+0000 7fb263d8d640 20 client.22348.objecter _get_session osd=-1 returning homeless 2024-02-09T08:34:59.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.339+0000 7fb263d8d640 10 client.22348.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:34:59.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.339+0000 7fb263d8d640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:34:59.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.339+0000 7fb263d8d640 1 -- 172.21.15.62:0/1169477705 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb25c04ef90 con 0x7fb25c0a9be0 2024-02-09T08:34:59.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.358+0000 7fb2527fc640 1 -- 172.21.15.62:0/1169477705 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fb24c01b460 con 0x7fb25c0a9be0 2024-02-09T08:34:59.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.359+0000 7fb2527fc640 1 --2- 172.21.15.62:0/1169477705 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fb24006d1f0 0x7fb24006f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:59.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.359+0000 7fb261b29640 1 --2- 172.21.15.62:0/1169477705 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fb24006d1f0 0x7fb24006f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:59.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.359+0000 7fb261b29640 10 monclient: get_auth_request con 0x7fb24006d1f0 auth_method 0 2024-02-09T08:34:59.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.359+0000 7fb261b29640 1 --2- 172.21.15.62:0/1169477705 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fb24006d1f0 0x7fb24006f6b0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fb2580018b0 tx=0x7fb258009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:34:59.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.359+0000 7fb2527fc640 10 client.22348.objecter ms_handle_connect 0x7fb24006d1f0 2024-02-09T08:34:59.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.362+0000 7fb2527fc640 1 -- 172.21.15.62:0/1169477705 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(1270..1270 src has 1104..1270) v4 ==== 6381+0+0 (secure 0 0 0) 0x7fb24c059020 con 0x7fb25c0a9be0 2024-02-09T08:34:59.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.362+0000 7fb2527fc640 10 client.22348.objecter ms_dispatch 0x7fb25c000b90 osd_map(1270..1270 src has 1104..1270) v4 2024-02-09T08:34:59.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.362+0000 7fb2527fc640 3 client.22348.objecter handle_osd_map got epochs [1270,1270] > 0 2024-02-09T08:34:59.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.362+0000 7fb2527fc640 3 client.22348.objecter handle_osd_map decoding full epoch 1270 2024-02-09T08:34:59.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.362+0000 7fb2527fc640 10 client.22348.objecter checking command 1 2024-02-09T08:34:59.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.362+0000 7fb2527fc640 1 --2- 172.21.15.62:0/1169477705 >> [v2:172.21.15.103:6810/2442009417,v1:172.21.15.103:6811/2442009417] conn(0x7fb240074f80 0x7fb240077420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:59.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.362+0000 7fb2527fc640 20 client.22348.objecter _get_session s=0x7fb2400748b0 osd=4 3 2024-02-09T08:34:59.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.362+0000 7fb2527fc640 20 client.22348.objecter put_session s=0x7fb2400748b0 osd=4 3 2024-02-09T08:34:59.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.362+0000 7fb2527fc640 15 client.22348.objecter _session_command_op_remove -1 1 2024-02-09T08:34:59.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.362+0000 7fb2527fc640 20 client.22348.objecter _get_session s=0x7fb2400748b0 osd=4 3 2024-02-09T08:34:59.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.362+0000 7fb2527fc640 20 client.22348.objecter get_session s=0x7fb2400748b0 osd=4 3 2024-02-09T08:34:59.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.362+0000 7fb2527fc640 15 client.22348.objecter _session_command_op_assign 4 1 2024-02-09T08:34:59.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.362+0000 7fb2527fc640 20 client.22348.objecter put_session s=0x7fb2400748b0 osd=4 4 2024-02-09T08:34:59.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.362+0000 7fb2527fc640 10 client.22348.objecter _send_command 1 2024-02-09T08:34:59.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.362+0000 7fb2527fc640 1 -- 172.21.15.62:0/1169477705 --> [v2:172.21.15.103:6810/2442009417,v1:172.21.15.103:6811/2442009417] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb240077af0 con 0x7fb240074f80 2024-02-09T08:34:59.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.362+0000 7fb2527fc640 20 client.22348.objecter dump_active .. 0 homeless 2024-02-09T08:34:59.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.363+0000 7fb26232a640 1 --2- 172.21.15.62:0/1169477705 >> [v2:172.21.15.103:6810/2442009417,v1:172.21.15.103:6811/2442009417] conn(0x7fb240074f80 0x7fb240077420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:59.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.363+0000 7fb2527fc640 1 -- 172.21.15.62:0/1169477705 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=1270) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb24c0552c0 con 0x7fb25c0a9be0 2024-02-09T08:34:59.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.363+0000 7fb2527fc640 10 monclient: handle_get_version_reply finishing 1 version 1270 2024-02-09T08:34:59.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.363+0000 7fb26232a640 10 monclient: get_auth_request con 0x7fb240074f80 auth_method 0 2024-02-09T08:34:59.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.366+0000 7fb26232a640 1 --2- 172.21.15.62:0/1169477705 >> [v2:172.21.15.103:6810/2442009417,v1:172.21.15.103:6811/2442009417] conn(0x7fb240074f80 0x7fb240077420 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:34:59.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.366+0000 7fb2527fc640 10 client.22348.objecter ms_handle_connect 0x7fb240074f80 2024-02-09T08:34:59.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.391+0000 7fb2527fc640 1 -- 172.21.15.62:0/1169477705 <== osd.4 v2:172.21.15.103:6810/2442009417 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fb240077af0 con 0x7fb240074f80 2024-02-09T08:34:59.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.391+0000 7fb2527fc640 10 client.22348.objecter ms_dispatch 0x7fb25c000b90 command_reply(tid 1: 0 ) v1 2024-02-09T08:34:59.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.391+0000 7fb2527fc640 10 client.22348.objecter _finish_command 1 = system:0 2024-02-09T08:34:59.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.391+0000 7fb2527fc640 20 client.22348.objecter put_session s=0x7fb2400748b0 osd=4 4 2024-02-09T08:34:59.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.391+0000 7fb2527fc640 15 client.22348.objecter _session_command_op_remove 4 1 2024-02-09T08:34:59.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.407+0000 7fb263d8d640 10 client.22348.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2024-02-09T08:34:59.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.407+0000 7fb263d8d640 15 client.22348.objecter _session_command_op_assign -1 2 2024-02-09T08:34:59.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.407+0000 7fb263d8d640 20 client.22348.objecter _get_session s=0x7fb2400748b0 osd=4 3 2024-02-09T08:34:59.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.407+0000 7fb263d8d640 20 client.22348.objecter put_session s=0x7fb2400748b0 osd=4 3 2024-02-09T08:34:59.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.407+0000 7fb263d8d640 20 client.22348.objecter _get_session s=0x7fb2400748b0 osd=4 3 2024-02-09T08:34:59.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.407+0000 7fb263d8d640 15 client.22348.objecter _session_command_op_remove -1 2 2024-02-09T08:34:59.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.407+0000 7fb263d8d640 20 client.22348.objecter get_session s=0x7fb2400748b0 osd=4 3 2024-02-09T08:34:59.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.407+0000 7fb263d8d640 15 client.22348.objecter _session_command_op_assign 4 2 2024-02-09T08:34:59.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.407+0000 7fb263d8d640 20 client.22348.objecter put_session s=0x7fb2400748b0 osd=4 4 2024-02-09T08:34:59.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.407+0000 7fb263d8d640 10 client.22348.objecter _send_command 2 2024-02-09T08:34:59.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.407+0000 7fb263d8d640 1 -- 172.21.15.62:0/1169477705 --> [v2:172.21.15.103:6810/2442009417,v1:172.21.15.103:6811/2442009417] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb25c140ec0 con 0x7fb240074f80 2024-02-09T08:34:59.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.427+0000 7fb2527fc640 1 -- 172.21.15.62:0/1169477705 <== osd.4 v2:172.21.15.103:6810/2442009417 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fb25c140ec0 con 0x7fb240074f80 2024-02-09T08:34:59.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.427+0000 7fb2527fc640 10 client.22348.objecter ms_dispatch 0x7fb25c000b90 command_reply(tid 2: 0 ) v1 2024-02-09T08:34:59.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.427+0000 7fb2527fc640 10 client.22348.objecter _finish_command 2 = system:0 2024-02-09T08:34:59.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.427+0000 7fb2527fc640 20 client.22348.objecter put_session s=0x7fb2400748b0 osd=4 4 2024-02-09T08:34:59.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.427+0000 7fb2527fc640 15 client.22348.objecter _session_command_op_remove 4 2 2024-02-09T08:34:59.430 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-02-09T08:34:59.430 INFO:teuthology.orchestra.run.smithi062.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-09T08:34:59.430 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-02-09T08:34:59.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.427+0000 7fb263d8d640 10 librados: watch_flush enter 2024-02-09T08:34:59.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.428+0000 7fb263d8d640 10 librados: watch_flush exit 2024-02-09T08:34:59.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.428+0000 7fb263d8d640 10 client.22348.objecter close_session for osd.4 2024-02-09T08:34:59.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.428+0000 7fb263d8d640 1 -- 172.21.15.62:0/1169477705 >> [v2:172.21.15.103:6810/2442009417,v1:172.21.15.103:6811/2442009417] conn(0x7fb240074f80 msgr2=0x7fb240077420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:59.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.428+0000 7fb263d8d640 1 --2- 172.21.15.62:0/1169477705 >> [v2:172.21.15.103:6810/2442009417,v1:172.21.15.103:6811/2442009417] conn(0x7fb240074f80 0x7fb240077420 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:59.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.428+0000 7fb263d8d640 20 client.22348.objecter put_session s=0x7fb2400748b0 osd=4 1 2024-02-09T08:34:59.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.428+0000 7fb263d8d640 20 client.22348.objecter shutdown clearing up homeless session... 2024-02-09T08:34:59.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.428+0000 7fb263d8d640 10 client.22348.objecter successfully canceled tick 2024-02-09T08:34:59.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.428+0000 7fb263d8d640 1 -- 172.21.15.62:0/1169477705 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fb24006d1f0 msgr2=0x7fb24006f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:59.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.428+0000 7fb263d8d640 1 --2- 172.21.15.62:0/1169477705 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fb24006d1f0 0x7fb24006f6b0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fb2580018b0 tx=0x7fb258009040 comp rx=0 tx=0).stop 2024-02-09T08:34:59.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.428+0000 7fb263d8d640 10 monclient: shutdown 2024-02-09T08:34:59.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.428+0000 7fb263d8d640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:34:59.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.428+0000 7fb263d8d640 1 -- 172.21.15.62:0/1169477705 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb25c0a9be0 msgr2=0x7fb25c1430d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:59.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.428+0000 7fb263d8d640 1 --2- 172.21.15.62:0/1169477705 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb25c0a9be0 0x7fb25c1430d0 secure :-1 s=READY pgs=5672 cs=0 l=1 rev1=1 crypto rx=0x7fb24c00b3c0 tx=0x7fb24c00b880 comp rx=0 tx=0).stop 2024-02-09T08:34:59.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.428+0000 7fb26232a640 1 -- 172.21.15.62:0/1169477705 reap_dead start 2024-02-09T08:34:59.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.428+0000 7fb263d8d640 1 -- 172.21.15.62:0/1169477705 shutdown_connections 2024-02-09T08:34:59.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.428+0000 7fb263d8d640 1 -- 172.21.15.62:0/1169477705 >> 172.21.15.62:0/1169477705 conn(0x7fb25c0b4db0 msgr2=0x7fb25c0b8570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:34:59.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.428+0000 7fb263d8d640 1 -- 172.21.15.62:0/1169477705 shutdown_connections 2024-02-09T08:34:59.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.428+0000 7fb263d8d640 1 -- 172.21.15.62:0/1169477705 wait complete. 2024-02-09T08:34:59.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.428+0000 7fb263d8d640 1 librados: shutdown 2024-02-09T08:34:59.441 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-02-09T08:34:59.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.546+0000 7fd31b498640 10 monclient: get_monmap_and_config 2024-02-09T08:34:59.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.546+0000 7fd31b498640 10 monclient: build_initial_monmap 2024-02-09T08:34:59.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.546+0000 7fd31b498640 10 monclient: monmap: 2024-02-09T08:34:59.549 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:34:59.549 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:59.549 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:34:59.547619+0000 2024-02-09T08:34:59.549 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:34:59.547619+0000 2024-02-09T08:34:59.549 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:34:59.549 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:59.549 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:34:59.549 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:34:59.549 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:34:59.549 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:34:59.550 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:34:59.550 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:59.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.547+0000 7fd31b498640 1 Processor -- start 2024-02-09T08:34:59.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.547+0000 7fd31b498640 1 -- start start 2024-02-09T08:34:59.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.547+0000 7fd31b498640 10 monclient: init 2024-02-09T08:34:59.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.547+0000 7fd31b498640 10 monclient: _reopen_session rank -1 2024-02-09T08:34:59.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.547+0000 7fd31b498640 10 monclient: _add_conns ranks=[4,1,0,3,2] 2024-02-09T08:34:59.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.547+0000 7fd31b498640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd314067110 0x7fd3140a9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:59.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.547+0000 7fd31b498640 10 monclient(hunting): picked mon.noname-c con 0x7fd314067110 addr v2:172.21.15.103:3300/0 2024-02-09T08:34:59.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.547+0000 7fd31b498640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fd31413f830 addr v1:172.21.15.103:6789/0 2024-02-09T08:34:59.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.547+0000 7fd31b498640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd314142bd0 addr v1:172.21.15.62:6789/0 2024-02-09T08:34:59.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.547+0000 7fd31b498640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3140aa090 con 0x7fd314142bd0 2024-02-09T08:34:59.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.547+0000 7fd31b498640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd314143020 con 0x7fd31413f830 2024-02-09T08:34:59.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.547+0000 7fd31b498640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:59.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.547+0000 7fd31b498640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3140674f0 con 0x7fd314067110 2024-02-09T08:34:59.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.547+0000 7fd31b498640 10 monclient(hunting): _renew_subs 2024-02-09T08:34:59.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.547+0000 7fd31b498640 10 monclient(hunting): authenticate will time out at 3342.908209s 2024-02-09T08:34:59.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.548+0000 7fd319234640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd314067110 0x7fd3140a9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:59.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.548+0000 7fd319a35640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fd314142bd0 0x7fd31414cdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:59552/0 (socket says 172.21.15.62:59552) 2024-02-09T08:34:59.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.548+0000 7fd319a35640 1 -- 172.21.15.62:0/2948620219 learned_addr learned my addr 172.21.15.62:0/2948620219 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-09T08:34:59.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.548+0000 7fd319234640 10 monclient(hunting): get_auth_request con 0x7fd314067110 auth_method 0 2024-02-09T08:34:59.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.548+0000 7fd319234640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:59.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.548+0000 7fd319234640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:59.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.548+0000 7fd319234640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:59.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.549+0000 7fd319234640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:59.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.549+0000 7fd319234640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:59.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.549+0000 7fd319234640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:59.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.551+0000 7fd319234640 10 monclient(hunting): handle_auth_done global_id 22351 payload 274 2024-02-09T08:34:59.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.551+0000 7fd319234640 1 -- 172.21.15.62:0/2948620219 >> v1:172.21.15.103:6789/0 conn(0x7fd31413f830 legacy=0x7fd3141424c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:34:59.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.551+0000 7fd319234640 1 -- 172.21.15.62:0/2948620219 >> v1:172.21.15.62:6789/0 conn(0x7fd314142bd0 legacy=0x7fd31414cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:59.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.551+0000 7fd319234640 10 monclient: _finish_hunting 0 2024-02-09T08:34:59.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.551+0000 7fd319234640 1 monclient: found mon.noname-c 2024-02-09T08:34:59.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.551+0000 7fd319234640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:34:59.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.551+0000 7fd319234640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.103:3300/0 2024-02-09T08:34:59.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.551+0000 7fd319234640 1 -- 172.21.15.62:0/2948620219 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3140ab5b0 con 0x7fd314067110 2024-02-09T08:34:59.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.553+0000 7fd319234640 1 --2- 172.21.15.62:0/2948620219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd314067110 0x7fd3140a9930 secure :-1 s=READY pgs=5673 cs=0 l=1 rev1=1 crypto rx=0x7fd3100097a0 tx=0x7fd31002b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=687c519951b294a5 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:34:59.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.557+0000 7fd30bfff640 1 -- 172.21.15.62:0/2948620219 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31002e070 con 0x7fd314067110 2024-02-09T08:34:59.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.557+0000 7fd30bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:59.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.557+0000 7fd30bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-09T08:34:59.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.557+0000 7fd30bfff640 10 monclient: dump: 2024-02-09T08:34:59.560 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:59.560 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:59.560 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:59.560 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:59.560 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:59.560 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:59.560 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:59.560 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:59.560 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:59.560 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:59.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.557+0000 7fd30bfff640 10 monclient: _finish_auth 0 2024-02-09T08:34:59.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.557+0000 7fd30bfff640 10 monclient: _check_auth_tickets 2024-02-09T08:34:59.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.557+0000 7fd30bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:34:59.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.557+0000 7fd30bfff640 1 -- 172.21.15.62:0/2948620219 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3100315a0 con 0x7fd314067110 2024-02-09T08:34:59.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.557+0000 7fd31b498640 5 monclient: authenticate success, global_id 22351 2024-02-09T08:34:59.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.557+0000 7fd30bfff640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:34:59.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.557+0000 7fd31b498640 10 monclient: get_monmap_and_config success 2024-02-09T08:34:59.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.557+0000 7fd31b498640 4 set_mon_vals no callback set 2024-02-09T08:34:59.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.557+0000 7fd30bfff640 1 -- 172.21.15.62:0/2948620219 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd310031930 con 0x7fd314067110 2024-02-09T08:34:59.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.557+0000 7fd30bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:59.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.557+0000 7fd30bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:34:59.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.557+0000 7fd30bfff640 10 monclient: dump: 2024-02-09T08:34:59.561 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:59.561 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:59.561 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:59.562 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:59.562 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:59.562 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:59.562 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:59.562 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:59.562 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:59.562 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:59.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.558+0000 7fd31b498640 10 monclient: shutdown 2024-02-09T08:34:59.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.558+0000 7fd31b498640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:34:59.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.558+0000 7fd31b498640 1 -- 172.21.15.62:0/2948620219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd314067110 msgr2=0x7fd3140a9930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:59.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.558+0000 7fd31b498640 1 --2- 172.21.15.62:0/2948620219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd314067110 0x7fd3140a9930 secure :-1 s=READY pgs=5673 cs=0 l=1 rev1=1 crypto rx=0x7fd3100097a0 tx=0x7fd31002b840 comp rx=0 tx=0).stop 2024-02-09T08:34:59.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.558+0000 7fd31b498640 1 -- 172.21.15.62:0/2948620219 shutdown_connections 2024-02-09T08:34:59.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.558+0000 7fd31b498640 1 --2- 172.21.15.62:0/2948620219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd314067110 0x7fd3140a9930 unknown :-1 s=CLOSED pgs=5673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:59.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.558+0000 7fd31b498640 1 -- 172.21.15.62:0/2948620219 >> 172.21.15.62:0/2948620219 conn(0x7fd3140b4e20 msgr2=0x7fd3140b5230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:34:59.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.558+0000 7fd31b498640 1 -- 172.21.15.62:0/2948620219 shutdown_connections 2024-02-09T08:34:59.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.558+0000 7fd31b498640 1 -- 172.21.15.62:0/2948620219 wait complete. 2024-02-09T08:34:59.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.559+0000 7fd31b498640 10 monclient: build_initial_monmap 2024-02-09T08:34:59.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.559+0000 7fd31b498640 10 monclient: monmap: 2024-02-09T08:34:59.566 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:34:59.566 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:34:59.566 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:34:59.566 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:34:59.566 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:34:59.566 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:59.566 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:34:59.566 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:34:59.566 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:34:59.566 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:59.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.559+0000 7fd31b498640 1 librados: starting msgr at 2024-02-09T08:34:59.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.559+0000 7fd31b498640 1 librados: starting objecter 2024-02-09T08:34:59.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.559+0000 7fd31b498640 1 Processor -- start 2024-02-09T08:34:59.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.559+0000 7fd31b498640 1 -- start start 2024-02-09T08:34:59.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.559+0000 7fd31b498640 1 librados: setting wanted keys 2024-02-09T08:34:59.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.559+0000 7fd31b498640 1 librados: calling monclient init 2024-02-09T08:34:59.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.559+0000 7fd31b498640 10 monclient: init 2024-02-09T08:34:59.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.559+0000 7fd31b498640 10 monclient: _reopen_session rank -1 2024-02-09T08:34:59.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.559+0000 7fd31b498640 10 monclient: _add_conns ranks=[0,2,1] 2024-02-09T08:34:59.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.559+0000 7fd31b498640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd314067110 0x7fd3140b1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:59.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.559+0000 7fd31b498640 10 monclient(hunting): picked mon.noname-a con 0x7fd314067110 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:34:59.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.559+0000 7fd31b498640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd31413f830 0x7fd3140ae930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:59.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.559+0000 7fd31b498640 10 monclient(hunting): picked mon.noname-c con 0x7fd31413f830 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:34:59.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.559+0000 7fd31b498640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd314142bd0 0x7fd3140aee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:59.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.560+0000 7fd31b498640 10 monclient(hunting): picked mon.noname-b con 0x7fd314142bd0 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:34:59.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.560+0000 7fd31b498640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:59.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.560+0000 7fd31b498640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3140af3b0 con 0x7fd314067110 2024-02-09T08:34:59.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.560+0000 7fd31b498640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:59.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.560+0000 7fd31b498640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3141c9a20 con 0x7fd314142bd0 2024-02-09T08:34:59.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.560+0000 7fd31b498640 10 monclient(hunting): start opening mon connection 2024-02-09T08:34:59.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.560+0000 7fd31b498640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3141c9d00 con 0x7fd31413f830 2024-02-09T08:34:59.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.560+0000 7fd31b498640 10 monclient(hunting): _renew_subs 2024-02-09T08:34:59.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.560+0000 7fd31b498640 10 monclient(hunting): authenticate will time out at 3342.920254s 2024-02-09T08:34:59.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.560+0000 7fd319a35640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd314142bd0 0x7fd3140aee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:59.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.560+0000 7fd319234640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd314067110 0x7fd3140b1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:59.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.560+0000 7fd319a35640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd314142bd0 0x7fd3140aee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.62:41298/0 (socket says 172.21.15.62:41298) 2024-02-09T08:34:59.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.560+0000 7fd319a35640 1 -- 172.21.15.62:0/2880781602 learned_addr learned my addr 172.21.15.62:0/2880781602 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:34:59.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.560+0000 7fd319a35640 10 monclient(hunting): get_auth_request con 0x7fd314142bd0 auth_method 0 2024-02-09T08:34:59.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.560+0000 7fd319a35640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:59.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.560+0000 7fd319a35640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:59.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.560+0000 7fd319a35640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:59.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.561+0000 7fd319234640 10 monclient(hunting): get_auth_request con 0x7fd314067110 auth_method 0 2024-02-09T08:34:59.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.561+0000 7fd319234640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:34:59.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.561+0000 7fd319234640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:34:59.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.561+0000 7fd319234640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:34:59.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.561+0000 7fd319a35640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:59.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.561+0000 7fd319a35640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:59.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.561+0000 7fd319a35640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:59.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.562+0000 7fd319234640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:34:59.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.562+0000 7fd319234640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:34:59.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.562+0000 7fd319234640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:34:59.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.563+0000 7fd319a35640 10 monclient(hunting): handle_auth_done global_id 22354 payload 824 2024-02-09T08:34:59.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.564+0000 7fd319a35640 1 -- 172.21.15.62:0/2880781602 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd31413f830 msgr2=0x7fd3140ae930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:59.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.564+0000 7fd319a35640 1 --2- 172.21.15.62:0/2880781602 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd31413f830 0x7fd3140ae930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:59.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.564+0000 7fd319a35640 1 -- 172.21.15.62:0/2880781602 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd314067110 msgr2=0x7fd3140b1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:34:59.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.564+0000 7fd319a35640 1 --2- 172.21.15.62:0/2880781602 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd314067110 0x7fd3140b1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:34:59.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.564+0000 7fd319a35640 10 monclient: _finish_hunting 0 2024-02-09T08:34:59.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.564+0000 7fd319a35640 1 monclient: found mon.noname-b 2024-02-09T08:34:59.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.564+0000 7fd319a35640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:34:59.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.564+0000 7fd319a35640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.103:3300/0 2024-02-09T08:34:59.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.564+0000 7fd319a35640 1 -- 172.21.15.62:0/2880781602 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd310009400 con 0x7fd314142bd0 2024-02-09T08:34:59.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.566+0000 7fd319a35640 1 --2- 172.21.15.62:0/2880781602 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd314142bd0 0x7fd3140aee70 secure :-1 s=READY pgs=5674 cs=0 l=1 rev1=1 crypto rx=0x7fd30c00ca80 tx=0x7fd30c00cf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:34:59.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.566+0000 7fd309ffb640 10 client.?.objecter ms_handle_connect 0x7fd314142bd0 2024-02-09T08:34:59.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.566+0000 7fd309ffb640 10 client.?.objecter resend_mon_ops 2024-02-09T08:34:59.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.569+0000 7fd309ffb640 1 -- 172.21.15.62:0/2880781602 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30c00ac30 con 0x7fd314142bd0 2024-02-09T08:34:59.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.569+0000 7fd309ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:59.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.569+0000 7fd309ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:34:59.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.569+0000 7fd309ffb640 10 monclient: dump: 2024-02-09T08:34:59.572 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:59.573 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:59.573 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:59.573 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:59.573 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:59.573 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:59.573 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:59.573 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:59.573 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:59.573 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:59.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.569+0000 7fd309ffb640 10 monclient: _finish_auth 0 2024-02-09T08:34:59.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.569+0000 7fd309ffb640 10 monclient: _check_auth_tickets 2024-02-09T08:34:59.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.569+0000 7fd309ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:34:59.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.569+0000 7fd309ffb640 1 -- 172.21.15.62:0/2880781602 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd30c00ad90 con 0x7fd314142bd0 2024-02-09T08:34:59.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.569+0000 7fd31b498640 5 monclient: authenticate success, global_id 22354 2024-02-09T08:34:59.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.569+0000 7fd309ffb640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:34:59.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.569+0000 7fd309ffb640 1 -- 172.21.15.62:0/2880781602 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30c012600 con 0x7fd314142bd0 2024-02-09T08:34:59.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.569+0000 7fd31b498640 10 monclient: _renew_subs 2024-02-09T08:34:59.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.569+0000 7fd31b498640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:34:59.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.569+0000 7fd31b498640 1 -- 172.21.15.62:0/2880781602 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3141c9fe0 con 0x7fd314142bd0 2024-02-09T08:34:59.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.569+0000 7fd309ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:34:59.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.569+0000 7fd309ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:34:59.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.569+0000 7fd30b7fe640 4 set_mon_vals no callback set 2024-02-09T08:34:59.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.569+0000 7fd309ffb640 10 monclient: dump: 2024-02-09T08:34:59.574 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:34:59.574 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:34:59.574 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:59.574 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:34:59.574 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:34:59.574 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:34:59.575 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:34:59.575 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:34:59.575 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:34:59.575 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:34:59.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.570+0000 7fd31b498640 10 client.22354.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:34:59.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.570+0000 7fd31b498640 10 monclient: _renew_subs 2024-02-09T08:34:59.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.570+0000 7fd31b498640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:34:59.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.570+0000 7fd31b498640 1 -- 172.21.15.62:0/2880781602 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3141c8910 con 0x7fd314142bd0 2024-02-09T08:34:59.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.570+0000 7fd31b498640 1 librados: init done 2024-02-09T08:34:59.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.571+0000 7fd31b498640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:34:59.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.571+0000 7fd31b498640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:34:59.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.571+0000 7fd31b498640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:34:59.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.571+0000 7fd31b498640 1 -- 172.21.15.62:0/2880781602 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd31404ef90 con 0x7fd314142bd0 2024-02-09T08:34:59.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.588+0000 7fd309ffb640 1 -- 172.21.15.62:0/2880781602 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fd30c007070 con 0x7fd314142bd0 2024-02-09T08:34:59.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.588+0000 7fd309ffb640 1 --2- 172.21.15.62:0/2880781602 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fd2f806d1a0 0x7fd2f806f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:34:59.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.589+0000 7fd319234640 1 --2- 172.21.15.62:0/2880781602 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fd2f806d1a0 0x7fd2f806f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:34:59.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.589+0000 7fd319234640 10 monclient: get_auth_request con 0x7fd2f806d1a0 auth_method 0 2024-02-09T08:34:59.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.589+0000 7fd319234640 1 --2- 172.21.15.62:0/2880781602 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fd2f806d1a0 0x7fd2f806f660 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd310036000 tx=0x7fd31003d040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:34:59.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.589+0000 7fd309ffb640 10 client.22354.objecter ms_handle_connect 0x7fd2f806d1a0 2024-02-09T08:34:59.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.591+0000 7fd309ffb640 1 -- 172.21.15.62:0/2880781602 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(1270..1270 src has 1104..1270) v4 ==== 6381+0+0 (secure 0 0 0) 0x7fd30c058d00 con 0x7fd314142bd0 2024-02-09T08:34:59.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.591+0000 7fd309ffb640 10 client.22354.objecter ms_dispatch 0x7fd314000b90 osd_map(1270..1270 src has 1104..1270) v4 2024-02-09T08:34:59.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.591+0000 7fd309ffb640 3 client.22354.objecter handle_osd_map got epochs [1270,1270] > 0 2024-02-09T08:34:59.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.591+0000 7fd309ffb640 3 client.22354.objecter handle_osd_map decoding full epoch 1270 2024-02-09T08:34:59.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.591+0000 7fd309ffb640 20 client.22354.objecter dump_active .. 0 homeless 2024-02-09T08:34:59.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.826+0000 7fd309ffb640 1 -- 172.21.15.62:0/2880781602 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd30c054fa0 con 0x7fd314142bd0 2024-02-09T08:34:59.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.826+0000 7fd309ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:34:59.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:34:59.826+0000 7fd309ffb640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:35:00.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.010+0000 7fd31b498640 1 -- 172.21.15.62:0/2880781602 --> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3141c8aa0 con 0x7fd2f806d1a0 2024-02-09T08:35:00.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.011+0000 7fd309ffb640 1 -- 172.21.15.62:0/2880781602 <== mgr.4109 v2:172.21.15.103:6800/2270392189 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd3141c8aa0 con 0x7fd2f806d1a0 2024-02-09T08:35:00.013 INFO:teuthology.orchestra.run.smithi062.stderr:instructed osd(s) 4 to deep-scrub 2024-02-09T08:35:00.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.013+0000 7fd31b498640 10 librados: watch_flush enter 2024-02-09T08:35:00.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.013+0000 7fd31b498640 10 librados: watch_flush exit 2024-02-09T08:35:00.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.013+0000 7fd31b498640 20 client.22354.objecter shutdown clearing up homeless session... 2024-02-09T08:35:00.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.013+0000 7fd31b498640 10 client.22354.objecter successfully canceled tick 2024-02-09T08:35:00.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.013+0000 7fd31b498640 1 -- 172.21.15.62:0/2880781602 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fd2f806d1a0 msgr2=0x7fd2f806f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:00.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.013+0000 7fd31b498640 1 --2- 172.21.15.62:0/2880781602 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fd2f806d1a0 0x7fd2f806f660 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd310036000 tx=0x7fd31003d040 comp rx=0 tx=0).stop 2024-02-09T08:35:00.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.013+0000 7fd31b498640 10 monclient: shutdown 2024-02-09T08:35:00.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.013+0000 7fd31b498640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:35:00.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.013+0000 7fd31b498640 1 -- 172.21.15.62:0/2880781602 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd314142bd0 msgr2=0x7fd3140aee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:00.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.013+0000 7fd31b498640 1 --2- 172.21.15.62:0/2880781602 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd314142bd0 0x7fd3140aee70 secure :-1 s=READY pgs=5674 cs=0 l=1 rev1=1 crypto rx=0x7fd30c00ca80 tx=0x7fd30c00cf40 comp rx=0 tx=0).stop 2024-02-09T08:35:00.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.013+0000 7fd31b498640 1 -- 172.21.15.62:0/2880781602 shutdown_connections 2024-02-09T08:35:00.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.013+0000 7fd31b498640 1 --2- 172.21.15.62:0/2880781602 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fd2f806d1a0 0x7fd2f806f660 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:00.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.013+0000 7fd31b498640 1 --2- 172.21.15.62:0/2880781602 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd314142bd0 0x7fd3140aee70 unknown :-1 s=CLOSED pgs=5674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:00.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.013+0000 7fd31b498640 1 --2- 172.21.15.62:0/2880781602 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd31413f830 0x7fd3140ae930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:00.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.013+0000 7fd31b498640 1 --2- 172.21.15.62:0/2880781602 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd314067110 0x7fd3140b1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:00.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.013+0000 7fd31b498640 1 -- 172.21.15.62:0/2880781602 >> 172.21.15.62:0/2880781602 conn(0x7fd3140b4e20 msgr2=0x7fd3140b7490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:35:00.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.013+0000 7fd31b498640 1 -- 172.21.15.62:0/2880781602 shutdown_connections 2024-02-09T08:35:00.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.013+0000 7fd31b498640 1 -- 172.21.15.62:0/2880781602 wait complete. 2024-02-09T08:35:00.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.013+0000 7fd31b498640 1 librados: shutdown 2024-02-09T08:35:00.027 INFO:tasks.ceph:Scrubbing osd.5 2024-02-09T08:35:00.027 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-02-09T08:35:00.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.130+0000 7f73d79cf640 10 monclient: get_monmap_and_config 2024-02-09T08:35:00.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.130+0000 7f73d79cf640 10 monclient: build_initial_monmap 2024-02-09T08:35:00.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.130+0000 7f73d79cf640 10 monclient: monmap: 2024-02-09T08:35:00.132 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:35:00.132 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:35:00.133 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:35:00.131249+0000 2024-02-09T08:35:00.133 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:35:00.131249+0000 2024-02-09T08:35:00.133 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:35:00.133 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:00.133 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:35:00.133 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:35:00.133 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:35:00.133 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:35:00.133 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:35:00.133 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:00.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.130+0000 7f73d79cf640 1 Processor -- start 2024-02-09T08:35:00.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.130+0000 7f73d79cf640 1 -- start start 2024-02-09T08:35:00.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.130+0000 7f73d79cf640 10 monclient: init 2024-02-09T08:35:00.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.131+0000 7f73d79cf640 10 monclient: _reopen_session rank -1 2024-02-09T08:35:00.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.131+0000 7f73d79cf640 10 monclient: _add_conns ranks=[3,1,2,0,4] 2024-02-09T08:35:00.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.131+0000 7f73d79cf640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f73d00b48b0 0x7f73d00a9460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:00.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.131+0000 7f73d79cf640 10 monclient(hunting): picked mon.noname-a con 0x7f73d00b48b0 addr v2:172.21.15.62:3300/0 2024-02-09T08:35:00.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.131+0000 7f73d79cf640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f73d00b4c90 addr v1:172.21.15.103:6789/0 2024-02-09T08:35:00.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.131+0000 7f73d79cf640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f73d0142550 0x7f73d00b0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:00.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.131+0000 7f73d79cf640 10 monclient(hunting): picked mon.noname-b con 0x7f73d0142550 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:35:00.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.131+0000 7f73d79cf640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73d00aab50 con 0x7f73d00b4c90 2024-02-09T08:35:00.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.131+0000 7f73d79cf640 10 monclient(hunting): start opening mon connection 2024-02-09T08:35:00.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.131+0000 7f73d79cf640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73d00b2380 con 0x7f73d00b48b0 2024-02-09T08:35:00.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.131+0000 7f73d79cf640 10 monclient(hunting): start opening mon connection 2024-02-09T08:35:00.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.131+0000 7f73d79cf640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73d0142a00 con 0x7f73d0142550 2024-02-09T08:35:00.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.131+0000 7f73d79cf640 10 monclient(hunting): _renew_subs 2024-02-09T08:35:00.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.131+0000 7f73d79cf640 10 monclient(hunting): authenticate will time out at 3343.491811s 2024-02-09T08:35:00.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.132+0000 7f73d576b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f73d00b48b0 0x7f73d00a9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:35:00.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.132+0000 7f73d5f6c640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f73d0142550 0x7f73d00b0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:35:00.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.132+0000 7f73d4f6a640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f73d00b4c90 0x7f73d00b1c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.62:53026/0 (socket says 172.21.15.62:53026) 2024-02-09T08:35:00.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.132+0000 7f73d4f6a640 1 -- 172.21.15.62:0/1854635742 learned_addr learned my addr 172.21.15.62:0/1854635742 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-09T08:35:00.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.132+0000 7f73d576b640 10 monclient(hunting): get_auth_request con 0x7f73d00b48b0 auth_method 0 2024-02-09T08:35:00.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.132+0000 7f73d576b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:35:00.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.132+0000 7f73d576b640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:35:00.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.132+0000 7f73d576b640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:35:00.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.132+0000 7f73d5f6c640 10 monclient(hunting): get_auth_request con 0x7f73d0142550 auth_method 0 2024-02-09T08:35:00.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.132+0000 7f73d5f6c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:35:00.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.132+0000 7f73d5f6c640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:35:00.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.132+0000 7f73d5f6c640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:35:00.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.133+0000 7f73d5f6c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:35:00.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.133+0000 7f73d5f6c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:35:00.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.133+0000 7f73d5f6c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:35:00.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.133+0000 7f73d576b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:35:00.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.133+0000 7f73d576b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:35:00.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.133+0000 7f73d576b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:35:00.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.134+0000 7f73cffff640 1 -- 172.21.15.62:0/1854635742 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1359961598 0 0) 0x7f73d00aab50 con 0x7f73d00b4c90 2024-02-09T08:35:00.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.134+0000 7f73cffff640 10 monclient(hunting): _negotiate 2024-02-09T08:35:00.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.134+0000 7f73cffff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:35:00.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.134+0000 7f73cffff640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:35:00.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.134+0000 7f73cffff640 10 monclient(hunting): my global_id is 22357 2024-02-09T08:35:00.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.134+0000 7f73cffff640 1 -- 172.21.15.62:0/1854635742 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73b8003520 con 0x7f73d00b4c90 2024-02-09T08:35:00.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.134+0000 7f73d576b640 10 monclient(hunting): handle_auth_done global_id 16218 payload 274 2024-02-09T08:35:00.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.134+0000 7f73d576b640 1 -- 172.21.15.62:0/1854635742 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f73d0142550 msgr2=0x7f73d00b0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:35:00.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.134+0000 7f73d576b640 1 --2- 172.21.15.62:0/1854635742 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f73d0142550 0x7f73d00b0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:00.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.134+0000 7f73d576b640 1 -- 172.21.15.62:0/1854635742 >> v1:172.21.15.103:6789/0 conn(0x7f73d00b4c90 legacy=0x7f73d00b1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:00.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.134+0000 7f73d576b640 10 monclient: _finish_hunting 0 2024-02-09T08:35:00.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.134+0000 7f73d576b640 1 monclient: found mon.noname-a 2024-02-09T08:35:00.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.134+0000 7f73d576b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:35:00.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.134+0000 7f73d576b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-02-09T08:35:00.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.134+0000 7f73d576b640 1 -- 172.21.15.62:0/1854635742 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d00a9b30 con 0x7f73d00b48b0 2024-02-09T08:35:00.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.134+0000 7f73d5f6c640 1 --2- 172.21.15.62:0/1854635742 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f73d0142550 0x7f73d00b0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-09T08:35:00.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.137+0000 7f73d576b640 1 --2- 172.21.15.62:0/1854635742 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73d00b48b0 0x7f73d00a9460 secure :-1 s=READY pgs=3215 cs=0 l=1 rev1=1 crypto rx=0x7f73c80097a0 tx=0x7f73c802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfc45cc9ea410249 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:35:00.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.141+0000 7f73cffff640 1 -- 172.21.15.62:0/1854635742 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c802e070 con 0x7f73d00b48b0 2024-02-09T08:35:00.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.141+0000 7f73cffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:35:00.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.141+0000 7f73cffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-09T08:35:00.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.141+0000 7f73cffff640 10 monclient: dump: 2024-02-09T08:35:00.143 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:35:00.143 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:35:00.144 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:00.144 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:00.144 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:35:00.144 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:00.144 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:35:00.144 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:35:00.144 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:35:00.144 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:00.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.141+0000 7f73cffff640 10 monclient: _finish_auth 0 2024-02-09T08:35:00.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.141+0000 7f73cffff640 10 monclient: _check_auth_tickets 2024-02-09T08:35:00.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.141+0000 7f73cffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:35:00.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.141+0000 7f73cffff640 1 -- 172.21.15.62:0/1854635742 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73c80315a0 con 0x7f73d00b48b0 2024-02-09T08:35:00.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.141+0000 7f73d79cf640 5 monclient: authenticate success, global_id 16218 2024-02-09T08:35:00.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.141+0000 7f73d79cf640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-02-09T08:35:00.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.141+0000 7f73cffff640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:35:00.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.141+0000 7f73d79cf640 10 monclient: get_monmap_and_config success 2024-02-09T08:35:00.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.141+0000 7f73d79cf640 4 set_mon_vals no callback set 2024-02-09T08:35:00.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.141+0000 7f73cffff640 1 -- 172.21.15.62:0/1854635742 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c8031930 con 0x7f73d00b48b0 2024-02-09T08:35:00.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.141+0000 7f73cffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:35:00.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.141+0000 7f73cffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-09T08:35:00.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.141+0000 7f73cffff640 10 monclient: dump: 2024-02-09T08:35:00.145 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:35:00.145 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:35:00.145 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:00.145 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:00.145 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:35:00.145 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:00.145 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:35:00.146 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:35:00.146 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:35:00.146 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:00.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.141+0000 7f73d79cf640 10 monclient: shutdown 2024-02-09T08:35:00.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.141+0000 7f73d79cf640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:35:00.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.141+0000 7f73d79cf640 1 -- 172.21.15.62:0/1854635742 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73d00b48b0 msgr2=0x7f73d00a9460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:00.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.141+0000 7f73d79cf640 1 --2- 172.21.15.62:0/1854635742 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73d00b48b0 0x7f73d00a9460 secure :-1 s=READY pgs=3215 cs=0 l=1 rev1=1 crypto rx=0x7f73c80097a0 tx=0x7f73c802b840 comp rx=0 tx=0).stop 2024-02-09T08:35:00.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.141+0000 7f73d79cf640 1 -- 172.21.15.62:0/1854635742 shutdown_connections 2024-02-09T08:35:00.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.141+0000 7f73d79cf640 1 --2- 172.21.15.62:0/1854635742 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f73d0142550 0x7f73d00b0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:00.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.141+0000 7f73d79cf640 1 --2- 172.21.15.62:0/1854635742 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73d00b48b0 0x7f73d00a9460 unknown :-1 s=CLOSED pgs=3215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:00.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.141+0000 7f73d79cf640 1 -- 172.21.15.62:0/1854635742 >> 172.21.15.62:0/1854635742 conn(0x7f73d006bbc0 msgr2=0x7f73d006bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:35:00.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.142+0000 7f73d79cf640 1 -- 172.21.15.62:0/1854635742 shutdown_connections 2024-02-09T08:35:00.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.142+0000 7f73d79cf640 1 -- 172.21.15.62:0/1854635742 wait complete. 2024-02-09T08:35:00.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.142+0000 7f73d79cf640 10 monclient: build_initial_monmap 2024-02-09T08:35:00.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.142+0000 7f73d79cf640 10 monclient: monmap: 2024-02-09T08:35:00.150 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:35:00.150 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:35:00.150 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:35:00.150 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:35:00.150 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:35:00.150 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:00.150 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:35:00.150 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:35:00.150 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:35:00.151 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:00.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.143+0000 7f73d79cf640 1 librados: starting msgr at 2024-02-09T08:35:00.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.143+0000 7f73d79cf640 1 librados: starting objecter 2024-02-09T08:35:00.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.143+0000 7f73d79cf640 1 Processor -- start 2024-02-09T08:35:00.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.143+0000 7f73d79cf640 1 -- start start 2024-02-09T08:35:00.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.143+0000 7f73d79cf640 1 librados: setting wanted keys 2024-02-09T08:35:00.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.143+0000 7f73d79cf640 1 librados: calling monclient init 2024-02-09T08:35:00.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.143+0000 7f73d79cf640 10 monclient: init 2024-02-09T08:35:00.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.143+0000 7f73d79cf640 10 monclient: _reopen_session rank -1 2024-02-09T08:35:00.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.143+0000 7f73d79cf640 10 monclient: _add_conns ranks=[0,2,1] 2024-02-09T08:35:00.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.143+0000 7f73d79cf640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73d00b48b0 0x7f73d00afc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:00.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.143+0000 7f73d79cf640 10 monclient(hunting): picked mon.noname-a con 0x7f73d00b48b0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:35:00.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.143+0000 7f73d79cf640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f73d0142550 0x7f73d0121640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:00.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.143+0000 7f73d79cf640 10 monclient(hunting): picked mon.noname-c con 0x7f73d0142550 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:35:00.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.143+0000 7f73d79cf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73d0121cb0 0x7f73d011fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:00.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.143+0000 7f73d79cf640 10 monclient(hunting): picked mon.noname-b con 0x7f73d0121cb0 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:35:00.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.143+0000 7f73d79cf640 10 monclient(hunting): start opening mon connection 2024-02-09T08:35:00.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.143+0000 7f73d79cf640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d0123850 con 0x7f73d00b48b0 2024-02-09T08:35:00.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.143+0000 7f73d79cf640 10 monclient(hunting): start opening mon connection 2024-02-09T08:35:00.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.143+0000 7f73d79cf640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d0122140 con 0x7f73d0121cb0 2024-02-09T08:35:00.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.143+0000 7f73d79cf640 10 monclient(hunting): start opening mon connection 2024-02-09T08:35:00.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.143+0000 7f73d79cf640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73d0122660 con 0x7f73d0142550 2024-02-09T08:35:00.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.143+0000 7f73d79cf640 10 monclient(hunting): _renew_subs 2024-02-09T08:35:00.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.143+0000 7f73d79cf640 10 monclient(hunting): authenticate will time out at 3343.504093s 2024-02-09T08:35:00.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.144+0000 7f73d576b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73d00b48b0 0x7f73d00afc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:35:00.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.144+0000 7f73d4f6a640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f73d0142550 0x7f73d0121640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:35:00.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.144+0000 7f73d5f6c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73d0121cb0 0x7f73d011fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:35:00.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.144+0000 7f73d576b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73d00b48b0 0x7f73d00afc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44064/0 (socket says 172.21.15.62:44064) 2024-02-09T08:35:00.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.144+0000 7f73d576b640 1 -- 172.21.15.62:0/3886644772 learned_addr learned my addr 172.21.15.62:0/3886644772 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:35:00.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.144+0000 7f73d576b640 10 monclient(hunting): get_auth_request con 0x7f73d00b48b0 auth_method 0 2024-02-09T08:35:00.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.144+0000 7f73d576b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:35:00.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.144+0000 7f73d576b640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:35:00.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.144+0000 7f73d576b640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:35:00.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.144+0000 7f73d4f6a640 10 monclient(hunting): get_auth_request con 0x7f73d0142550 auth_method 0 2024-02-09T08:35:00.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.144+0000 7f73d4f6a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:35:00.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.144+0000 7f73d4f6a640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:35:00.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.144+0000 7f73d4f6a640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:35:00.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.144+0000 7f73d5f6c640 10 monclient(hunting): get_auth_request con 0x7f73d0121cb0 auth_method 0 2024-02-09T08:35:00.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.144+0000 7f73d5f6c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:35:00.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.144+0000 7f73d5f6c640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:35:00.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.144+0000 7f73d5f6c640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:35:00.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.145+0000 7f73d576b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:35:00.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.145+0000 7f73d576b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:35:00.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.145+0000 7f73d576b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:35:00.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.145+0000 7f73d4f6a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:35:00.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.145+0000 7f73d4f6a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:35:00.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.145+0000 7f73d4f6a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:35:00.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.145+0000 7f73d5f6c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:35:00.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.145+0000 7f73d5f6c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:35:00.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.145+0000 7f73d5f6c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:35:00.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.148+0000 7f73d576b640 10 monclient(hunting): handle_auth_done global_id 16221 payload 824 2024-02-09T08:35:00.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.148+0000 7f73d576b640 1 -- 172.21.15.62:0/3886644772 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f73d0142550 msgr2=0x7f73d0121640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:00.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.148+0000 7f73d576b640 1 --2- 172.21.15.62:0/3886644772 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f73d0142550 0x7f73d0121640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:00.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.148+0000 7f73d576b640 1 -- 172.21.15.62:0/3886644772 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73d0121cb0 msgr2=0x7f73d011fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:00.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.148+0000 7f73d576b640 1 --2- 172.21.15.62:0/3886644772 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73d0121cb0 0x7f73d011fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:00.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.148+0000 7f73d576b640 10 monclient: _finish_hunting 0 2024-02-09T08:35:00.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.148+0000 7f73d576b640 1 monclient: found mon.noname-a 2024-02-09T08:35:00.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.148+0000 7f73d576b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:35:00.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.148+0000 7f73d576b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-02-09T08:35:00.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.148+0000 7f73d576b640 1 -- 172.21.15.62:0/3886644772 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c0009a70 con 0x7f73d00b48b0 2024-02-09T08:35:00.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.148+0000 7f73d5f6c640 1 --2- 172.21.15.62:0/3886644772 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73d0121cb0 0x7f73d011fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-09T08:35:00.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.150+0000 7f73d576b640 1 --2- 172.21.15.62:0/3886644772 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73d00b48b0 0x7f73d00afc70 secure :-1 s=READY pgs=3216 cs=0 l=1 rev1=1 crypto rx=0x7f73c8034040 tx=0x7f73c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:35:00.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.150+0000 7f73cdffb640 10 client.?.objecter ms_handle_connect 0x7f73d00b48b0 2024-02-09T08:35:00.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.150+0000 7f73cdffb640 10 client.?.objecter resend_mon_ops 2024-02-09T08:35:00.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.154+0000 7f73cdffb640 1 -- 172.21.15.62:0/3886644772 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c8032630 con 0x7f73d00b48b0 2024-02-09T08:35:00.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.154+0000 7f73cdffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:35:00.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.154+0000 7f73cdffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-09T08:35:00.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.154+0000 7f73cdffb640 10 monclient: dump: 2024-02-09T08:35:00.158 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:35:00.158 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:35:00.158 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:00.158 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:00.158 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:35:00.158 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:00.158 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:35:00.158 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:35:00.158 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:35:00.158 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:00.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.154+0000 7f73cdffb640 10 monclient: _finish_auth 0 2024-02-09T08:35:00.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.154+0000 7f73cdffb640 10 monclient: _check_auth_tickets 2024-02-09T08:35:00.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.154+0000 7f73cdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:35:00.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.154+0000 7f73cdffb640 1 -- 172.21.15.62:0/3886644772 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73c8032790 con 0x7f73d00b48b0 2024-02-09T08:35:00.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.154+0000 7f73d79cf640 5 monclient: authenticate success, global_id 16221 2024-02-09T08:35:00.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.154+0000 7f73d79cf640 10 monclient: _renew_subs 2024-02-09T08:35:00.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.154+0000 7f73d79cf640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:35:00.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.154+0000 7f73d79cf640 1 -- 172.21.15.62:0/3886644772 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73c8009400 con 0x7f73d00b48b0 2024-02-09T08:35:00.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.154+0000 7f73cdffb640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:35:00.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.154+0000 7f73cdffb640 1 -- 172.21.15.62:0/3886644772 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c8032b40 con 0x7f73d00b48b0 2024-02-09T08:35:00.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.154+0000 7f73cdffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:35:00.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.154+0000 7f73cdffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-09T08:35:00.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.154+0000 7f73cdffb640 10 monclient: dump: 2024-02-09T08:35:00.159 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:35:00.159 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:35:00.159 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:00.159 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:00.160 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:35:00.160 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:00.160 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:35:00.160 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:35:00.160 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:35:00.160 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:00.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.154+0000 7f73d79cf640 10 client.16221.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:35:00.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.154+0000 7f73cf7fe640 4 set_mon_vals no callback set 2024-02-09T08:35:00.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.154+0000 7f73d79cf640 10 monclient: _renew_subs 2024-02-09T08:35:00.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.154+0000 7f73d79cf640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:35:00.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.154+0000 7f73d79cf640 1 -- 172.21.15.62:0/3886644772 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73d0120120 con 0x7f73d00b48b0 2024-02-09T08:35:00.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.154+0000 7f73d79cf640 1 librados: init done 2024-02-09T08:35:00.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.155+0000 7f73d79cf640 10 client.16221.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:35:00.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.155+0000 7f73d79cf640 15 client.16221.objecter _session_command_op_assign -1 1 2024-02-09T08:35:00.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.155+0000 7f73d79cf640 20 client.16221.objecter _get_session osd=-1 returning homeless 2024-02-09T08:35:00.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.155+0000 7f73d79cf640 10 client.16221.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:35:00.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.155+0000 7f73d79cf640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:35:00.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.155+0000 7f73d79cf640 1 -- 172.21.15.62:0/3886644772 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f73d00ab080 con 0x7f73d00b48b0 2024-02-09T08:35:00.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.175+0000 7f73cdffb640 1 -- 172.21.15.62:0/3886644772 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f73c8032ca0 con 0x7f73d00b48b0 2024-02-09T08:35:00.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.175+0000 7f73cdffb640 1 --2- 172.21.15.62:0/3886644772 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f73bc06d1f0 0x7f73bc06f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:00.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.175+0000 7f73d4f6a640 1 --2- 172.21.15.62:0/3886644772 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f73bc06d1f0 0x7f73bc06f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:35:00.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.175+0000 7f73d4f6a640 10 monclient: get_auth_request con 0x7f73bc06d1f0 auth_method 0 2024-02-09T08:35:00.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.176+0000 7f73d4f6a640 1 --2- 172.21.15.62:0/3886644772 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f73bc06d1f0 0x7f73bc06f6b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f73d00b0350 tx=0x7f73c4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:35:00.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.176+0000 7f73cdffb640 10 client.16221.objecter ms_handle_connect 0x7f73bc06d1f0 2024-02-09T08:35:00.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.179+0000 7f73cdffb640 1 -- 172.21.15.62:0/3886644772 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(1270..1270 src has 1104..1270) v4 ==== 6381+0+0 (secure 0 0 0) 0x7f73c807b000 con 0x7f73d00b48b0 2024-02-09T08:35:00.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.179+0000 7f73cdffb640 10 client.16221.objecter ms_dispatch 0x7f73d0000b90 osd_map(1270..1270 src has 1104..1270) v4 2024-02-09T08:35:00.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.179+0000 7f73cdffb640 3 client.16221.objecter handle_osd_map got epochs [1270,1270] > 0 2024-02-09T08:35:00.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.179+0000 7f73cdffb640 3 client.16221.objecter handle_osd_map decoding full epoch 1270 2024-02-09T08:35:00.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.179+0000 7f73cdffb640 10 client.16221.objecter checking command 1 2024-02-09T08:35:00.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.179+0000 7f73cdffb640 1 --2- 172.21.15.62:0/3886644772 >> [v2:172.21.15.103:6802/262591034,v1:172.21.15.103:6803/262591034] conn(0x7f73bc074f80 0x7f73bc077420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:00.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.179+0000 7f73cdffb640 20 client.16221.objecter _get_session s=0x7f73bc0748b0 osd=5 3 2024-02-09T08:35:00.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.179+0000 7f73cdffb640 20 client.16221.objecter put_session s=0x7f73bc0748b0 osd=5 3 2024-02-09T08:35:00.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.179+0000 7f73cdffb640 15 client.16221.objecter _session_command_op_remove -1 1 2024-02-09T08:35:00.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.179+0000 7f73cdffb640 20 client.16221.objecter _get_session s=0x7f73bc0748b0 osd=5 3 2024-02-09T08:35:00.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.179+0000 7f73cdffb640 20 client.16221.objecter get_session s=0x7f73bc0748b0 osd=5 3 2024-02-09T08:35:00.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.179+0000 7f73cdffb640 15 client.16221.objecter _session_command_op_assign 5 1 2024-02-09T08:35:00.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.179+0000 7f73cdffb640 20 client.16221.objecter put_session s=0x7f73bc0748b0 osd=5 4 2024-02-09T08:35:00.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.179+0000 7f73cdffb640 10 client.16221.objecter _send_command 1 2024-02-09T08:35:00.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.179+0000 7f73cdffb640 1 -- 172.21.15.62:0/3886644772 --> [v2:172.21.15.103:6802/262591034,v1:172.21.15.103:6803/262591034] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f73bc077af0 con 0x7f73bc074f80 2024-02-09T08:35:00.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.179+0000 7f73cdffb640 20 client.16221.objecter dump_active .. 0 homeless 2024-02-09T08:35:00.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.179+0000 7f73cdffb640 1 -- 172.21.15.62:0/3886644772 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=1270) v2 ==== 24+0+0 (secure 0 0 0) 0x7f73c8076ba0 con 0x7f73d00b48b0 2024-02-09T08:35:00.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.179+0000 7f73cdffb640 10 monclient: handle_get_version_reply finishing 1 version 1270 2024-02-09T08:35:00.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.180+0000 7f73d5f6c640 1 --2- 172.21.15.62:0/3886644772 >> [v2:172.21.15.103:6802/262591034,v1:172.21.15.103:6803/262591034] conn(0x7f73bc074f80 0x7f73bc077420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:35:00.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.181+0000 7f73d5f6c640 10 monclient: get_auth_request con 0x7f73bc074f80 auth_method 0 2024-02-09T08:35:00.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.183+0000 7f73d5f6c640 1 --2- 172.21.15.62:0/3886644772 >> [v2:172.21.15.103:6802/262591034,v1:172.21.15.103:6803/262591034] conn(0x7f73bc074f80 0x7f73bc077420 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:35:00.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.183+0000 7f73cdffb640 10 client.16221.objecter ms_handle_connect 0x7f73bc074f80 2024-02-09T08:35:00.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.207+0000 7f73cdffb640 1 -- 172.21.15.62:0/3886644772 <== osd.5 v2:172.21.15.103:6802/262591034 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f73bc077af0 con 0x7f73bc074f80 2024-02-09T08:35:00.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.207+0000 7f73cdffb640 10 client.16221.objecter ms_dispatch 0x7f73d0000b90 command_reply(tid 1: 0 ) v1 2024-02-09T08:35:00.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.207+0000 7f73cdffb640 10 client.16221.objecter _finish_command 1 = system:0 2024-02-09T08:35:00.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.207+0000 7f73cdffb640 20 client.16221.objecter put_session s=0x7f73bc0748b0 osd=5 4 2024-02-09T08:35:00.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.207+0000 7f73cdffb640 15 client.16221.objecter _session_command_op_remove 5 1 2024-02-09T08:35:00.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.222+0000 7f73d79cf640 10 client.16221.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2024-02-09T08:35:00.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.222+0000 7f73d79cf640 15 client.16221.objecter _session_command_op_assign -1 2 2024-02-09T08:35:00.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.222+0000 7f73d79cf640 20 client.16221.objecter _get_session s=0x7f73bc0748b0 osd=5 3 2024-02-09T08:35:00.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.222+0000 7f73d79cf640 20 client.16221.objecter put_session s=0x7f73bc0748b0 osd=5 3 2024-02-09T08:35:00.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.222+0000 7f73d79cf640 20 client.16221.objecter _get_session s=0x7f73bc0748b0 osd=5 3 2024-02-09T08:35:00.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.222+0000 7f73d79cf640 15 client.16221.objecter _session_command_op_remove -1 2 2024-02-09T08:35:00.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.222+0000 7f73d79cf640 20 client.16221.objecter get_session s=0x7f73bc0748b0 osd=5 3 2024-02-09T08:35:00.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.222+0000 7f73d79cf640 15 client.16221.objecter _session_command_op_assign 5 2 2024-02-09T08:35:00.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.222+0000 7f73d79cf640 20 client.16221.objecter put_session s=0x7f73bc0748b0 osd=5 4 2024-02-09T08:35:00.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.222+0000 7f73d79cf640 10 client.16221.objecter _send_command 2 2024-02-09T08:35:00.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.222+0000 7f73d79cf640 1 -- 172.21.15.62:0/3886644772 --> [v2:172.21.15.103:6802/262591034,v1:172.21.15.103:6803/262591034] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f73d004ef90 con 0x7f73bc074f80 2024-02-09T08:35:00.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.237+0000 7f73cdffb640 1 -- 172.21.15.62:0/3886644772 <== osd.5 v2:172.21.15.103:6802/262591034 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f73d004ef90 con 0x7f73bc074f80 2024-02-09T08:35:00.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.237+0000 7f73cdffb640 10 client.16221.objecter ms_dispatch 0x7f73d0000b90 command_reply(tid 2: 0 ) v1 2024-02-09T08:35:00.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.237+0000 7f73cdffb640 10 client.16221.objecter _finish_command 2 = system:0 2024-02-09T08:35:00.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.237+0000 7f73cdffb640 20 client.16221.objecter put_session s=0x7f73bc0748b0 osd=5 4 2024-02-09T08:35:00.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.237+0000 7f73cdffb640 15 client.16221.objecter _session_command_op_remove 5 2 2024-02-09T08:35:00.240 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-02-09T08:35:00.240 INFO:teuthology.orchestra.run.smithi062.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-09T08:35:00.241 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-02-09T08:35:00.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.238+0000 7f73d79cf640 10 librados: watch_flush enter 2024-02-09T08:35:00.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.238+0000 7f73d79cf640 10 librados: watch_flush exit 2024-02-09T08:35:00.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.238+0000 7f73d79cf640 10 client.16221.objecter close_session for osd.5 2024-02-09T08:35:00.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.238+0000 7f73d79cf640 1 -- 172.21.15.62:0/3886644772 >> [v2:172.21.15.103:6802/262591034,v1:172.21.15.103:6803/262591034] conn(0x7f73bc074f80 msgr2=0x7f73bc077420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:00.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.238+0000 7f73d79cf640 1 --2- 172.21.15.62:0/3886644772 >> [v2:172.21.15.103:6802/262591034,v1:172.21.15.103:6803/262591034] conn(0x7f73bc074f80 0x7f73bc077420 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:00.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.238+0000 7f73d79cf640 20 client.16221.objecter put_session s=0x7f73bc0748b0 osd=5 1 2024-02-09T08:35:00.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.238+0000 7f73d79cf640 20 client.16221.objecter shutdown clearing up homeless session... 2024-02-09T08:35:00.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.238+0000 7f73d79cf640 10 client.16221.objecter successfully canceled tick 2024-02-09T08:35:00.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.238+0000 7f73d79cf640 1 -- 172.21.15.62:0/3886644772 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f73bc06d1f0 msgr2=0x7f73bc06f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:00.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.238+0000 7f73d79cf640 1 --2- 172.21.15.62:0/3886644772 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f73bc06d1f0 0x7f73bc06f6b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f73d00b0350 tx=0x7f73c4009040 comp rx=0 tx=0).stop 2024-02-09T08:35:00.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.238+0000 7f73d79cf640 10 monclient: shutdown 2024-02-09T08:35:00.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.238+0000 7f73d79cf640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:35:00.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.238+0000 7f73d79cf640 1 -- 172.21.15.62:0/3886644772 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73d00b48b0 msgr2=0x7f73d00afc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:00.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.238+0000 7f73d79cf640 1 --2- 172.21.15.62:0/3886644772 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73d00b48b0 0x7f73d00afc70 secure :-1 s=READY pgs=3216 cs=0 l=1 rev1=1 crypto rx=0x7f73c8034040 tx=0x7f73c80046c0 comp rx=0 tx=0).stop 2024-02-09T08:35:00.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.238+0000 7f73d5f6c640 1 -- 172.21.15.62:0/3886644772 reap_dead start 2024-02-09T08:35:00.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.238+0000 7f73d79cf640 1 -- 172.21.15.62:0/3886644772 shutdown_connections 2024-02-09T08:35:00.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.238+0000 7f73d79cf640 1 -- 172.21.15.62:0/3886644772 >> 172.21.15.62:0/3886644772 conn(0x7f73d006bbc0 msgr2=0x7f73d0069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:35:00.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.238+0000 7f73d79cf640 1 -- 172.21.15.62:0/3886644772 shutdown_connections 2024-02-09T08:35:00.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.238+0000 7f73d79cf640 1 -- 172.21.15.62:0/3886644772 wait complete. 2024-02-09T08:35:00.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.238+0000 7f73d79cf640 1 librados: shutdown 2024-02-09T08:35:00.251 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-02-09T08:35:00.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.355+0000 7fb6a272e640 10 monclient: get_monmap_and_config 2024-02-09T08:35:00.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.355+0000 7fb6a272e640 10 monclient: build_initial_monmap 2024-02-09T08:35:00.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.355+0000 7fb6a272e640 10 monclient: monmap: 2024-02-09T08:35:00.358 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:35:00.358 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:35:00.358 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:35:00.356407+0000 2024-02-09T08:35:00.358 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:35:00.356407+0000 2024-02-09T08:35:00.358 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:35:00.358 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:00.358 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:35:00.358 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:35:00.358 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:35:00.358 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:35:00.358 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:35:00.358 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:00.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.356+0000 7fb6a272e640 1 Processor -- start 2024-02-09T08:35:00.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.356+0000 7fb6a272e640 1 -- start start 2024-02-09T08:35:00.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.356+0000 7fb6a272e640 10 monclient: init 2024-02-09T08:35:00.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.356+0000 7fb6a272e640 10 monclient: _reopen_session rank -1 2024-02-09T08:35:00.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.356+0000 7fb6a272e640 10 monclient: _add_conns ranks=[3,0,1,4,2] 2024-02-09T08:35:00.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.356+0000 7fb6a272e640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb69c145d30 0x7fb69c0b0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:00.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.356+0000 7fb6a272e640 10 monclient(hunting): picked mon.noname-a con 0x7fb69c145d30 addr v2:172.21.15.62:3300/0 2024-02-09T08:35:00.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.356+0000 7fb6a272e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb69c06bc60 addr v1:172.21.15.62:6789/0 2024-02-09T08:35:00.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.356+0000 7fb6a272e640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb69c13f6c0 addr v1:172.21.15.103:6789/0 2024-02-09T08:35:00.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.356+0000 7fb6a272e640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb69c06b9a0 con 0x7fb69c06bc60 2024-02-09T08:35:00.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.356+0000 7fb6a272e640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb69c0b0c80 con 0x7fb69c13f6c0 2024-02-09T08:35:00.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.356+0000 7fb6a272e640 10 monclient(hunting): start opening mon connection 2024-02-09T08:35:00.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.356+0000 7fb6a272e640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb69c146110 con 0x7fb69c145d30 2024-02-09T08:35:00.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.356+0000 7fb6a272e640 10 monclient(hunting): _renew_subs 2024-02-09T08:35:00.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.356+0000 7fb6a272e640 10 monclient(hunting): authenticate will time out at 3343.717016s 2024-02-09T08:35:00.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.357+0000 7fb69bfff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb69c145d30 0x7fb69c0b0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:35:00.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.357+0000 7fb6a0ccb640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fb69c13f6c0 0x7fb69c14ce50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.62:53034/0 (socket says 172.21.15.62:53034) 2024-02-09T08:35:00.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.357+0000 7fb6a0ccb640 1 -- 172.21.15.62:0/2085746451 learned_addr learned my addr 172.21.15.62:0/2085746451 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-09T08:35:00.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.357+0000 7fb69bfff640 10 monclient(hunting): get_auth_request con 0x7fb69c145d30 auth_method 0 2024-02-09T08:35:00.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.357+0000 7fb69bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:35:00.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.357+0000 7fb69bfff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:35:00.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.357+0000 7fb69bfff640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:35:00.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.358+0000 7fb69bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:35:00.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.358+0000 7fb69bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:35:00.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.358+0000 7fb69bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:35:00.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.359+0000 7fb69affd640 1 -- 172.21.15.62:0/2085746451 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 59523452 0 0) 0x7fb69c0b0c80 con 0x7fb69c13f6c0 2024-02-09T08:35:00.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.359+0000 7fb69affd640 10 monclient(hunting): _negotiate 2024-02-09T08:35:00.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.359+0000 7fb69affd640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:35:00.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.359+0000 7fb69affd640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:35:00.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.359+0000 7fb69affd640 10 monclient(hunting): my global_id is 22363 2024-02-09T08:35:00.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.359+0000 7fb69affd640 1 -- 172.21.15.62:0/2085746451 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb684003520 con 0x7fb69c13f6c0 2024-02-09T08:35:00.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.360+0000 7fb69bfff640 10 monclient(hunting): handle_auth_done global_id 16224 payload 274 2024-02-09T08:35:00.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.360+0000 7fb69bfff640 1 -- 172.21.15.62:0/2085746451 >> v1:172.21.15.103:6789/0 conn(0x7fb69c13f6c0 legacy=0x7fb69c14ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:00.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.360+0000 7fb69bfff640 1 -- 172.21.15.62:0/2085746451 >> v1:172.21.15.62:6789/0 conn(0x7fb69c06bc60 legacy=0x7fb69c146400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:00.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.360+0000 7fb69bfff640 10 monclient: _finish_hunting 0 2024-02-09T08:35:00.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.360+0000 7fb69bfff640 1 monclient: found mon.noname-a 2024-02-09T08:35:00.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.360+0000 7fb69bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:35:00.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.360+0000 7fb69bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-02-09T08:35:00.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.360+0000 7fb69bfff640 1 -- 172.21.15.62:0/2085746451 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb69c0ae420 con 0x7fb69c145d30 2024-02-09T08:35:00.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.362+0000 7fb69bfff640 1 --2- 172.21.15.62:0/2085746451 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb69c145d30 0x7fb69c0b0740 secure :-1 s=READY pgs=3218 cs=0 l=1 rev1=1 crypto rx=0x7fb68c0097a0 tx=0x7fb68c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26ebbff2635efd2c server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:35:00.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.368+0000 7fb69affd640 1 -- 172.21.15.62:0/2085746451 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68c030610 con 0x7fb69c145d30 2024-02-09T08:35:00.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.368+0000 7fb69affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:35:00.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.368+0000 7fb69affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-09T08:35:00.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.368+0000 7fb69affd640 10 monclient: dump: 2024-02-09T08:35:00.371 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:35:00.371 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:35:00.371 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:00.371 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:00.371 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:35:00.371 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:00.371 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:35:00.371 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:35:00.371 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:35:00.371 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:00.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.368+0000 7fb69affd640 10 monclient: _finish_auth 0 2024-02-09T08:35:00.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.368+0000 7fb69affd640 10 monclient: _check_auth_tickets 2024-02-09T08:35:00.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.368+0000 7fb69affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:35:00.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.368+0000 7fb69affd640 1 -- 172.21.15.62:0/2085746451 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb68c030770 con 0x7fb69c145d30 2024-02-09T08:35:00.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.368+0000 7fb69affd640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:35:00.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.368+0000 7fb69affd640 1 -- 172.21.15.62:0/2085746451 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68c030b00 con 0x7fb69c145d30 2024-02-09T08:35:00.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.368+0000 7fb6a272e640 5 monclient: authenticate success, global_id 16224 2024-02-09T08:35:00.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.368+0000 7fb6a272e640 10 monclient: get_monmap_and_config success 2024-02-09T08:35:00.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.368+0000 7fb6a272e640 4 set_mon_vals no callback set 2024-02-09T08:35:00.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.368+0000 7fb69affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:35:00.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.368+0000 7fb69affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-09T08:35:00.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.368+0000 7fb69affd640 10 monclient: dump: 2024-02-09T08:35:00.373 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:35:00.373 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:35:00.373 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:00.373 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:00.373 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:35:00.373 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:00.374 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:35:00.374 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:35:00.374 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:35:00.374 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:00.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.369+0000 7fb6a272e640 10 monclient: shutdown 2024-02-09T08:35:00.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.369+0000 7fb6a272e640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:35:00.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.369+0000 7fb6a272e640 1 -- 172.21.15.62:0/2085746451 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb69c145d30 msgr2=0x7fb69c0b0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:00.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.369+0000 7fb6a272e640 1 --2- 172.21.15.62:0/2085746451 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb69c145d30 0x7fb69c0b0740 secure :-1 s=READY pgs=3218 cs=0 l=1 rev1=1 crypto rx=0x7fb68c0097a0 tx=0x7fb68c02b960 comp rx=0 tx=0).stop 2024-02-09T08:35:00.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.369+0000 7fb6a272e640 1 -- 172.21.15.62:0/2085746451 shutdown_connections 2024-02-09T08:35:00.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.369+0000 7fb6a272e640 1 --2- 172.21.15.62:0/2085746451 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb69c145d30 0x7fb69c0b0740 unknown :-1 s=CLOSED pgs=3218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:00.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.369+0000 7fb6a272e640 1 -- 172.21.15.62:0/2085746451 >> 172.21.15.62:0/2085746451 conn(0x7fb69c0b5e70 msgr2=0x7fb69c0b6280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:35:00.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.369+0000 7fb6a272e640 1 -- 172.21.15.62:0/2085746451 shutdown_connections 2024-02-09T08:35:00.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.369+0000 7fb6a272e640 1 -- 172.21.15.62:0/2085746451 wait complete. 2024-02-09T08:35:00.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.369+0000 7fb6a272e640 10 monclient: build_initial_monmap 2024-02-09T08:35:00.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.369+0000 7fb6a272e640 10 monclient: monmap: 2024-02-09T08:35:00.379 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:35:00.379 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:35:00.379 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:35:00.380 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:35:00.380 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:35:00.380 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:00.380 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:35:00.380 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:35:00.380 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:35:00.380 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:00.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.370+0000 7fb6a272e640 1 librados: starting msgr at 2024-02-09T08:35:00.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.370+0000 7fb6a272e640 1 librados: starting objecter 2024-02-09T08:35:00.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.370+0000 7fb6a272e640 1 Processor -- start 2024-02-09T08:35:00.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.370+0000 7fb6a272e640 1 -- start start 2024-02-09T08:35:00.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.370+0000 7fb6a272e640 1 librados: setting wanted keys 2024-02-09T08:35:00.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.370+0000 7fb6a272e640 1 librados: calling monclient init 2024-02-09T08:35:00.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.370+0000 7fb6a272e640 10 monclient: init 2024-02-09T08:35:00.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.371+0000 7fb6a272e640 10 monclient: _reopen_session rank -1 2024-02-09T08:35:00.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.371+0000 7fb6a272e640 10 monclient: _add_conns ranks=[2,1,0] 2024-02-09T08:35:00.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.371+0000 7fb6a272e640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb69c06bc60 0x7fb69c13a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:00.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.371+0000 7fb6a272e640 10 monclient(hunting): picked mon.noname-c con 0x7fb69c06bc60 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:35:00.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.371+0000 7fb6a272e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb69c13f6c0 0x7fb69c13af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:00.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.371+0000 7fb6a272e640 10 monclient(hunting): picked mon.noname-b con 0x7fb69c13f6c0 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:35:00.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.371+0000 7fb6a272e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb69c145d30 0x7fb69c143a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:00.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.371+0000 7fb6a272e640 10 monclient(hunting): picked mon.noname-a con 0x7fb69c145d30 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:35:00.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.371+0000 7fb6a272e640 10 monclient(hunting): start opening mon connection 2024-02-09T08:35:00.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.371+0000 7fb6a272e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb69c13c3c0 con 0x7fb69c145d30 2024-02-09T08:35:00.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.371+0000 7fb6a272e640 10 monclient(hunting): start opening mon connection 2024-02-09T08:35:00.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.371+0000 7fb6a272e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb69c13c630 con 0x7fb69c13f6c0 2024-02-09T08:35:00.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.371+0000 7fb6a272e640 10 monclient(hunting): start opening mon connection 2024-02-09T08:35:00.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.371+0000 7fb6a272e640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb69c13c910 con 0x7fb69c06bc60 2024-02-09T08:35:00.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.371+0000 7fb6a272e640 10 monclient(hunting): _renew_subs 2024-02-09T08:35:00.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.371+0000 7fb6a272e640 10 monclient(hunting): authenticate will time out at 3343.731481s 2024-02-09T08:35:00.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.371+0000 7fb6a0ccb640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb69c145d30 0x7fb69c143a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:35:00.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.371+0000 7fb69b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb69c13f6c0 0x7fb69c13af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:35:00.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.372+0000 7fb69bfff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb69c06bc60 0x7fb69c13a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:35:00.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.372+0000 7fb6a0ccb640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb69c145d30 0x7fb69c143a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44080/0 (socket says 172.21.15.62:44080) 2024-02-09T08:35:00.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.372+0000 7fb6a0ccb640 1 -- 172.21.15.62:0/3942274963 learned_addr learned my addr 172.21.15.62:0/3942274963 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:35:00.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.372+0000 7fb6a0ccb640 10 monclient(hunting): get_auth_request con 0x7fb69c145d30 auth_method 0 2024-02-09T08:35:00.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.372+0000 7fb6a0ccb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:35:00.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.372+0000 7fb6a0ccb640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:35:00.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.372+0000 7fb6a0ccb640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:35:00.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.372+0000 7fb69b7fe640 10 monclient(hunting): get_auth_request con 0x7fb69c13f6c0 auth_method 0 2024-02-09T08:35:00.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.372+0000 7fb69b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:35:00.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.372+0000 7fb69b7fe640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:35:00.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.372+0000 7fb69b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:35:00.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.372+0000 7fb69bfff640 10 monclient(hunting): get_auth_request con 0x7fb69c06bc60 auth_method 0 2024-02-09T08:35:00.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.372+0000 7fb69bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:35:00.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.372+0000 7fb69bfff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:35:00.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.372+0000 7fb69bfff640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:35:00.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.372+0000 7fb6a0ccb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:35:00.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.372+0000 7fb6a0ccb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:35:00.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.372+0000 7fb6a0ccb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:35:00.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.372+0000 7fb69b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:35:00.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.372+0000 7fb69b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:35:00.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.372+0000 7fb69b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:35:00.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.372+0000 7fb69bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:35:00.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.372+0000 7fb69bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:35:00.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.372+0000 7fb69bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:35:00.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.375+0000 7fb69b7fe640 10 monclient(hunting): handle_auth_done global_id 22366 payload 824 2024-02-09T08:35:00.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.375+0000 7fb69b7fe640 1 -- 172.21.15.62:0/3942274963 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb69c06bc60 msgr2=0x7fb69c13a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:00.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.375+0000 7fb69b7fe640 1 --2- 172.21.15.62:0/3942274963 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb69c06bc60 0x7fb69c13a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:00.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.375+0000 7fb69b7fe640 1 -- 172.21.15.62:0/3942274963 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb69c145d30 msgr2=0x7fb69c143a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:00.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.375+0000 7fb69b7fe640 1 --2- 172.21.15.62:0/3942274963 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb69c145d30 0x7fb69c143a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:00.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.375+0000 7fb69b7fe640 10 monclient: _finish_hunting 0 2024-02-09T08:35:00.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.375+0000 7fb69b7fe640 1 monclient: found mon.noname-b 2024-02-09T08:35:00.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.375+0000 7fb69b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:35:00.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.375+0000 7fb69b7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.103:3300/0 2024-02-09T08:35:00.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.375+0000 7fb69b7fe640 1 -- 172.21.15.62:0/3942274963 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb68c009400 con 0x7fb69c13f6c0 2024-02-09T08:35:00.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.377+0000 7fb69b7fe640 1 --2- 172.21.15.62:0/3942274963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb69c13f6c0 0x7fb69c13af10 secure :-1 s=READY pgs=5677 cs=0 l=1 rev1=1 crypto rx=0x7fb69000c340 tx=0x7fb69000c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:35:00.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.377+0000 7fb698ff9640 10 client.?.objecter ms_handle_connect 0x7fb69c13f6c0 2024-02-09T08:35:00.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.377+0000 7fb698ff9640 10 client.?.objecter resend_mon_ops 2024-02-09T08:35:00.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.381+0000 7fb698ff9640 1 -- 172.21.15.62:0/3942274963 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6900052d0 con 0x7fb69c13f6c0 2024-02-09T08:35:00.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.381+0000 7fb698ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:35:00.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.381+0000 7fb698ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:35:00.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.381+0000 7fb698ff9640 10 monclient: dump: 2024-02-09T08:35:00.387 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:35:00.387 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:35:00.387 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:00.387 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:00.387 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:35:00.387 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:00.387 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:35:00.387 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:35:00.388 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:35:00.388 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:00.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.381+0000 7fb698ff9640 10 monclient: _finish_auth 0 2024-02-09T08:35:00.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.381+0000 7fb698ff9640 10 monclient: _check_auth_tickets 2024-02-09T08:35:00.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.381+0000 7fb698ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:35:00.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.381+0000 7fb698ff9640 1 -- 172.21.15.62:0/3942274963 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb690005450 con 0x7fb69c13f6c0 2024-02-09T08:35:00.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.381+0000 7fb698ff9640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:35:00.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.381+0000 7fb698ff9640 1 -- 172.21.15.62:0/3942274963 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb690007260 con 0x7fb69c13f6c0 2024-02-09T08:35:00.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.381+0000 7fb6a272e640 5 monclient: authenticate success, global_id 22366 2024-02-09T08:35:00.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.381+0000 7fb698ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:35:00.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.381+0000 7fb698ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:35:00.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.381+0000 7fb698ff9640 10 monclient: dump: 2024-02-09T08:35:00.389 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:35:00.389 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:35:00.389 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:00.389 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:00.389 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:35:00.389 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:00.389 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:35:00.389 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:35:00.389 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:35:00.389 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:00.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.381+0000 7fb6a272e640 10 monclient: _renew_subs 2024-02-09T08:35:00.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.381+0000 7fb6a272e640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:35:00.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.381+0000 7fb6a272e640 1 -- 172.21.15.62:0/3942274963 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb69c13b530 con 0x7fb69c13f6c0 2024-02-09T08:35:00.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.381+0000 7fb69a7fc640 4 set_mon_vals no callback set 2024-02-09T08:35:00.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.381+0000 7fb6a272e640 10 client.22366.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:35:00.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.381+0000 7fb6a272e640 10 monclient: _renew_subs 2024-02-09T08:35:00.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.381+0000 7fb6a272e640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:35:00.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.381+0000 7fb6a272e640 1 -- 172.21.15.62:0/3942274963 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb69c143f50 con 0x7fb69c13f6c0 2024-02-09T08:35:00.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.381+0000 7fb6a272e640 1 librados: init done 2024-02-09T08:35:00.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.382+0000 7fb6a272e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:35:00.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.382+0000 7fb6a272e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:35:00.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.382+0000 7fb6a272e640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:35:00.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.382+0000 7fb6a272e640 1 -- 172.21.15.62:0/3942274963 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb69c13b750 con 0x7fb69c13f6c0 2024-02-09T08:35:00.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.399+0000 7fb698ff9640 1 -- 172.21.15.62:0/3942274963 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fb6900073c0 con 0x7fb69c13f6c0 2024-02-09T08:35:00.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.400+0000 7fb698ff9640 1 --2- 172.21.15.62:0/3942274963 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fb68806d1f0 0x7fb68806f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:00.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.400+0000 7fb69bfff640 1 --2- 172.21.15.62:0/3942274963 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fb68806d1f0 0x7fb68806f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:35:00.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.400+0000 7fb69bfff640 10 monclient: get_auth_request con 0x7fb68806d1f0 auth_method 0 2024-02-09T08:35:00.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.400+0000 7fb69bfff640 1 --2- 172.21.15.62:0/3942274963 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fb68806d1f0 0x7fb68806f6b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fb68c036000 tx=0x7fb68c03b040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:35:00.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.400+0000 7fb698ff9640 10 client.22366.objecter ms_handle_connect 0x7fb68806d1f0 2024-02-09T08:35:00.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.403+0000 7fb698ff9640 1 -- 172.21.15.62:0/3942274963 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(1270..1270 src has 1104..1270) v4 ==== 6381+0+0 (secure 0 0 0) 0x7fb690058220 con 0x7fb69c13f6c0 2024-02-09T08:35:00.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.403+0000 7fb698ff9640 10 client.22366.objecter ms_dispatch 0x7fb69c000b90 osd_map(1270..1270 src has 1104..1270) v4 2024-02-09T08:35:00.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.403+0000 7fb698ff9640 3 client.22366.objecter handle_osd_map got epochs [1270,1270] > 0 2024-02-09T08:35:00.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.403+0000 7fb698ff9640 3 client.22366.objecter handle_osd_map decoding full epoch 1270 2024-02-09T08:35:00.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.403+0000 7fb698ff9640 20 client.22366.objecter dump_active .. 0 homeless 2024-02-09T08:35:00.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.648+0000 7fb698ff9640 1 -- 172.21.15.62:0/3942274963 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb6900544c0 con 0x7fb69c13f6c0 2024-02-09T08:35:00.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.649+0000 7fb698ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:35:00.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.649+0000 7fb698ff9640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:35:00.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.868+0000 7fb6a272e640 1 -- 172.21.15.62:0/3942274963 --> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fb69c13faf0 con 0x7fb68806d1f0 2024-02-09T08:35:00.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.868+0000 7fb698ff9640 1 -- 172.21.15.62:0/3942274963 <== mgr.4109 v2:172.21.15.103:6800/2270392189 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb68c03f040 con 0x7fb68806d1f0 2024-02-09T08:35:00.871 INFO:teuthology.orchestra.run.smithi062.stderr:instructed osd(s) 5 to deep-scrub 2024-02-09T08:35:00.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.871+0000 7fb6a272e640 10 librados: watch_flush enter 2024-02-09T08:35:00.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.871+0000 7fb6a272e640 10 librados: watch_flush exit 2024-02-09T08:35:00.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.871+0000 7fb6a272e640 20 client.22366.objecter shutdown clearing up homeless session... 2024-02-09T08:35:00.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.871+0000 7fb6a272e640 10 client.22366.objecter successfully canceled tick 2024-02-09T08:35:00.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.871+0000 7fb6a272e640 1 -- 172.21.15.62:0/3942274963 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fb68806d1f0 msgr2=0x7fb68806f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:00.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.871+0000 7fb6a272e640 1 --2- 172.21.15.62:0/3942274963 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fb68806d1f0 0x7fb68806f6b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fb68c036000 tx=0x7fb68c03b040 comp rx=0 tx=0).stop 2024-02-09T08:35:00.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.871+0000 7fb6a272e640 10 monclient: shutdown 2024-02-09T08:35:00.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.871+0000 7fb6a272e640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:35:00.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.871+0000 7fb6a272e640 1 -- 172.21.15.62:0/3942274963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb69c13f6c0 msgr2=0x7fb69c13af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:00.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.871+0000 7fb6a272e640 1 --2- 172.21.15.62:0/3942274963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb69c13f6c0 0x7fb69c13af10 secure :-1 s=READY pgs=5677 cs=0 l=1 rev1=1 crypto rx=0x7fb69000c340 tx=0x7fb69000c800 comp rx=0 tx=0).stop 2024-02-09T08:35:00.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.871+0000 7fb6a272e640 1 -- 172.21.15.62:0/3942274963 shutdown_connections 2024-02-09T08:35:00.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.871+0000 7fb6a272e640 1 --2- 172.21.15.62:0/3942274963 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fb68806d1f0 0x7fb68806f6b0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:00.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.871+0000 7fb6a272e640 1 --2- 172.21.15.62:0/3942274963 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb69c145d30 0x7fb69c143a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:00.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.871+0000 7fb6a272e640 1 --2- 172.21.15.62:0/3942274963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb69c13f6c0 0x7fb69c13af10 unknown :-1 s=CLOSED pgs=5677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:00.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.871+0000 7fb6a272e640 1 --2- 172.21.15.62:0/3942274963 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb69c06bc60 0x7fb69c13a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:00.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.871+0000 7fb6a272e640 1 -- 172.21.15.62:0/3942274963 >> 172.21.15.62:0/3942274963 conn(0x7fb69c0b5e70 msgr2=0x7fb69c137cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:35:00.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.871+0000 7fb6a272e640 1 -- 172.21.15.62:0/3942274963 shutdown_connections 2024-02-09T08:35:00.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.871+0000 7fb6a272e640 1 -- 172.21.15.62:0/3942274963 wait complete. 2024-02-09T08:35:00.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.872+0000 7fb6a272e640 1 librados: shutdown 2024-02-09T08:35:00.886 INFO:tasks.ceph:Scrubbing osd.6 2024-02-09T08:35:00.886 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-02-09T08:35:00.888 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:33:10.295 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:00.893 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:33:10.300 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:00.920 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:33:10.327 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:00.943 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:33:10.340 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:00.945 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:33:10.342 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:00.961 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:33:10.368 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:00.962 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:33:10.359 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:00.963 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:33:10.370 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:00.991 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:33:10.397 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:00.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.995+0000 7f271dc98640 10 monclient: get_monmap_and_config 2024-02-09T08:35:00.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.996+0000 7f271dc98640 10 monclient: build_initial_monmap 2024-02-09T08:35:00.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.996+0000 7f271dc98640 10 monclient: monmap: 2024-02-09T08:35:00.998 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:35:00.998 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:35:00.998 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:35:00.997091+0000 2024-02-09T08:35:00.999 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:35:00.997091+0000 2024-02-09T08:35:00.999 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:35:00.999 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:00.999 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:35:00.999 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:35:00.999 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:35:00.999 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:35:00.999 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:35:00.999 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:01.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.996+0000 7f271dc98640 1 Processor -- start 2024-02-09T08:35:01.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.996+0000 7f271dc98640 1 -- start start 2024-02-09T08:35:01.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.996+0000 7f271dc98640 10 monclient: init 2024-02-09T08:35:01.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.997+0000 7f271dc98640 10 monclient: _reopen_session rank -1 2024-02-09T08:35:01.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.997+0000 7f271dc98640 10 monclient: _add_conns ranks=[3,2,0,4,1] 2024-02-09T08:35:01.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.997+0000 7f271dc98640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f271806c320 0x7f271813f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:01.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.997+0000 7f271dc98640 10 monclient(hunting): picked mon.noname-a con 0x7f271806c320 addr v2:172.21.15.62:3300/0 2024-02-09T08:35:01.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.997+0000 7f271dc98640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f27180a9be0 0x7f271813fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:01.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.997+0000 7f271dc98640 10 monclient(hunting): picked mon.noname-b con 0x7f27180a9be0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:35:01.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.997+0000 7f271dc98640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f27180b2280 addr v1:172.21.15.62:6789/0 2024-02-09T08:35:01.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.997+0000 7f271dc98640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27180aa130 con 0x7f27180b2280 2024-02-09T08:35:01.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.997+0000 7f271dc98640 10 monclient(hunting): start opening mon connection 2024-02-09T08:35:01.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.997+0000 7f271dc98640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f271806c700 con 0x7f271806c320 2024-02-09T08:35:01.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.997+0000 7f271dc98640 10 monclient(hunting): start opening mon connection 2024-02-09T08:35:01.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.997+0000 7f271dc98640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2718140240 con 0x7f27180a9be0 2024-02-09T08:35:01.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.997+0000 7f271dc98640 10 monclient(hunting): _renew_subs 2024-02-09T08:35:01.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:00.997+0000 7f271dc98640 10 monclient(hunting): authenticate will time out at 3344.357731s 2024-02-09T08:35:01.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.002+0000 7f2716ffd640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f27180a9be0 0x7f271813fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:35:01.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.002+0000 7f27177fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f271806c320 0x7f271813f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:35:01.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.004+0000 7f2716ffd640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f27180a9be0 0x7f271813fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:52458/0 (socket says 172.21.15.62:52458) 2024-02-09T08:35:01.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.004+0000 7f2716ffd640 1 -- 172.21.15.62:0/1228740371 learned_addr learned my addr 172.21.15.62:0/1228740371 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:35:01.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.004+0000 7f2716ffd640 10 monclient(hunting): get_auth_request con 0x7f27180a9be0 auth_method 0 2024-02-09T08:35:01.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.004+0000 7f2716ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:35:01.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.004+0000 7f2716ffd640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:35:01.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.004+0000 7f2716ffd640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:35:01.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.005+0000 7f27177fe640 10 monclient(hunting): get_auth_request con 0x7f271806c320 auth_method 0 2024-02-09T08:35:01.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.005+0000 7f27177fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:35:01.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.005+0000 7f27177fe640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:35:01.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.005+0000 7f27177fe640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:35:01.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.006+0000 7f2716ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:35:01.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.006+0000 7f2716ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:35:01.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.006+0000 7f2716ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:35:01.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.009+0000 7f27177fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:35:01.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.009+0000 7f27177fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:35:01.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.009+0000 7f27177fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:35:01.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.010+0000 7f2716ffd640 10 monclient(hunting): handle_auth_done global_id 18641 payload 274 2024-02-09T08:35:01.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.010+0000 7f2716ffd640 1 -- 172.21.15.62:0/1228740371 >> v2:172.21.15.62:3300/0 conn(0x7f271806c320 msgr2=0x7f271813f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:35:01.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.010+0000 7f2716ffd640 1 --2- 172.21.15.62:0/1228740371 >> v2:172.21.15.62:3300/0 conn(0x7f271806c320 0x7f271813f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:01.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.010+0000 7f2716ffd640 1 -- 172.21.15.62:0/1228740371 >> v1:172.21.15.62:6789/0 conn(0x7f27180b2280 legacy=0x7f2718145ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:01.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.010+0000 7f2716ffd640 10 monclient: _finish_hunting 0 2024-02-09T08:35:01.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.010+0000 7f2716ffd640 1 monclient: found mon.noname-b 2024-02-09T08:35:01.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.010+0000 7f2716ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:35:01.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.010+0000 7f2716ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.62:3301/0 2024-02-09T08:35:01.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.010+0000 7f2716ffd640 1 -- 172.21.15.62:0/1228740371 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27180aa5c0 con 0x7f27180a9be0 2024-02-09T08:35:01.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.014+0000 7f2716ffd640 1 --2- 172.21.15.62:0/1228740371 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f27180a9be0 0x7f271813fd00 secure :-1 s=READY pgs=3197 cs=0 l=1 rev1=1 crypto rx=0x7f270c009870 tx=0x7f270c02b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51e5358276a499d3 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:35:01.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.024+0000 7f27167fc640 1 -- 172.21.15.62:0/1228740371 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270c0317c0 con 0x7f27180a9be0 2024-02-09T08:35:01.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.024+0000 7f27167fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:35:01.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.024+0000 7f27167fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:35:01.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.024+0000 7f27167fc640 10 monclient: dump: 2024-02-09T08:35:01.027 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:35:01.027 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:35:01.027 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:01.027 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:01.027 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:35:01.027 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:01.027 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:35:01.027 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:35:01.027 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:35:01.027 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:01.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.024+0000 7f27167fc640 10 monclient: _finish_auth 0 2024-02-09T08:35:01.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.024+0000 7f27167fc640 10 monclient: _check_auth_tickets 2024-02-09T08:35:01.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.024+0000 7f27167fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:35:01.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.024+0000 7f27167fc640 1 -- 172.21.15.62:0/1228740371 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270c031920 con 0x7f27180a9be0 2024-02-09T08:35:01.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.024+0000 7f27167fc640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:35:01.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.024+0000 7f27167fc640 1 -- 172.21.15.62:0/1228740371 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270c031cb0 con 0x7f27180a9be0 2024-02-09T08:35:01.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.024+0000 7f271dc98640 5 monclient: authenticate success, global_id 18641 2024-02-09T08:35:01.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.024+0000 7f271dc98640 10 monclient: get_monmap_and_config success 2024-02-09T08:35:01.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.024+0000 7f271dc98640 4 set_mon_vals no callback set 2024-02-09T08:35:01.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.024+0000 7f27167fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:35:01.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.024+0000 7f27167fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-09T08:35:01.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.024+0000 7f27167fc640 10 monclient: dump: 2024-02-09T08:35:01.028 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:35:01.028 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:35:01.028 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:01.028 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:01.028 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:35:01.028 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:01.028 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:35:01.029 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:35:01.029 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:35:01.029 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:01.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.025+0000 7f271dc98640 10 monclient: shutdown 2024-02-09T08:35:01.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.025+0000 7f271dc98640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:35:01.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.025+0000 7f271dc98640 1 -- 172.21.15.62:0/1228740371 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f27180a9be0 msgr2=0x7f271813fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:01.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.025+0000 7f271dc98640 1 --2- 172.21.15.62:0/1228740371 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f27180a9be0 0x7f271813fd00 secure :-1 s=READY pgs=3197 cs=0 l=1 rev1=1 crypto rx=0x7f270c009870 tx=0x7f270c02b860 comp rx=0 tx=0).stop 2024-02-09T08:35:01.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.025+0000 7f271dc98640 1 -- 172.21.15.62:0/1228740371 shutdown_connections 2024-02-09T08:35:01.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.025+0000 7f271dc98640 1 --2- 172.21.15.62:0/1228740371 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f27180a9be0 0x7f271813fd00 unknown :-1 s=CLOSED pgs=3197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:01.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.025+0000 7f271dc98640 1 --2- 172.21.15.62:0/1228740371 >> v2:172.21.15.62:3300/0 conn(0x7f271806c320 0x7f271813f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:01.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.025+0000 7f271dc98640 1 -- 172.21.15.62:0/1228740371 >> 172.21.15.62:0/1228740371 conn(0x7f27180b4db0 msgr2=0x7f27180b51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:35:01.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.025+0000 7f271dc98640 1 -- 172.21.15.62:0/1228740371 shutdown_connections 2024-02-09T08:35:01.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.025+0000 7f271dc98640 1 -- 172.21.15.62:0/1228740371 wait complete. 2024-02-09T08:35:01.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.026+0000 7f271dc98640 10 monclient: build_initial_monmap 2024-02-09T08:35:01.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.026+0000 7f271dc98640 10 monclient: monmap: 2024-02-09T08:35:01.032 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:35:01.032 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:35:01.032 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:35:01.032 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:35:01.032 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:35:01.032 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:01.032 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:35:01.032 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:35:01.032 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:35:01.032 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:01.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.026+0000 7f271dc98640 1 librados: starting msgr at 2024-02-09T08:35:01.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.026+0000 7f271dc98640 1 librados: starting objecter 2024-02-09T08:35:01.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.027+0000 7f271dc98640 1 Processor -- start 2024-02-09T08:35:01.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.027+0000 7f271dc98640 1 -- start start 2024-02-09T08:35:01.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.027+0000 7f271dc98640 1 librados: setting wanted keys 2024-02-09T08:35:01.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.027+0000 7f271dc98640 1 librados: calling monclient init 2024-02-09T08:35:01.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.027+0000 7f271dc98640 10 monclient: init 2024-02-09T08:35:01.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.028+0000 7f271dc98640 10 monclient: _reopen_session rank -1 2024-02-09T08:35:01.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.028+0000 7f271dc98640 10 monclient: _add_conns ranks=[1,2,0] 2024-02-09T08:35:01.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.028+0000 7f271dc98640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f271806c320 0x7f2718138950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:01.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.028+0000 7f271dc98640 10 monclient(hunting): picked mon.noname-b con 0x7f271806c320 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:35:01.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.028+0000 7f271dc98640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f27180a9be0 0x7f2718134070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:01.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.028+0000 7f271dc98640 10 monclient(hunting): picked mon.noname-c con 0x7f27180a9be0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:35:01.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.028+0000 7f271dc98640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27180b2280 0x7f27181345b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:01.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.028+0000 7f271dc98640 10 monclient(hunting): picked mon.noname-a con 0x7f27180b2280 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:35:01.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.028+0000 7f271dc98640 10 monclient(hunting): start opening mon connection 2024-02-09T08:35:01.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.028+0000 7f271dc98640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2718139860 con 0x7f27180b2280 2024-02-09T08:35:01.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.028+0000 7f271dc98640 10 monclient(hunting): start opening mon connection 2024-02-09T08:35:01.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.028+0000 7f271dc98640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2718139a40 con 0x7f271806c320 2024-02-09T08:35:01.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.028+0000 7f271dc98640 10 monclient(hunting): start opening mon connection 2024-02-09T08:35:01.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.028+0000 7f271dc98640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27180b8be0 con 0x7f27180a9be0 2024-02-09T08:35:01.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.028+0000 7f271dc98640 10 monclient(hunting): _renew_subs 2024-02-09T08:35:01.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.028+0000 7f271dc98640 10 monclient(hunting): authenticate will time out at 3344.388417s 2024-02-09T08:35:01.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.031+0000 7f2717fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27180b2280 0x7f27181345b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:35:01.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.031+0000 7f2716ffd640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f27180a9be0 0x7f2718134070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:35:01.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.032+0000 7f2716ffd640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f27180a9be0 0x7f2718134070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:52474/0 (socket says 172.21.15.62:52474) 2024-02-09T08:35:01.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.032+0000 7f2716ffd640 1 -- 172.21.15.62:0/2984718226 learned_addr learned my addr 172.21.15.62:0/2984718226 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:35:01.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.032+0000 7f2716ffd640 10 monclient(hunting): get_auth_request con 0x7f27180a9be0 auth_method 0 2024-02-09T08:35:01.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.032+0000 7f2716ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:35:01.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.032+0000 7f2716ffd640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:35:01.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.032+0000 7f2716ffd640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:35:01.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.032+0000 7f2717fff640 10 monclient(hunting): get_auth_request con 0x7f27180b2280 auth_method 0 2024-02-09T08:35:01.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.032+0000 7f2717fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:35:01.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.032+0000 7f2717fff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:35:01.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.032+0000 7f2717fff640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:35:01.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.033+0000 7f2717fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:35:01.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.033+0000 7f2717fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:35:01.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.033+0000 7f2717fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:35:01.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.034+0000 7f2716ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:35:01.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.034+0000 7f2716ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:35:01.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.034+0000 7f2716ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:35:01.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.037+0000 7f2717fff640 10 monclient(hunting): handle_auth_done global_id 16233 payload 824 2024-02-09T08:35:01.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.038+0000 7f2717fff640 1 -- 172.21.15.62:0/2984718226 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f27180a9be0 msgr2=0x7f2718134070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:01.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.038+0000 7f2717fff640 1 --2- 172.21.15.62:0/2984718226 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f27180a9be0 0x7f2718134070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:01.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.038+0000 7f2717fff640 1 -- 172.21.15.62:0/2984718226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f271806c320 msgr2=0x7f2718138950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:01.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.038+0000 7f2717fff640 1 --2- 172.21.15.62:0/2984718226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f271806c320 0x7f2718138950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:01.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.038+0000 7f2717fff640 10 monclient: _finish_hunting 0 2024-02-09T08:35:01.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.038+0000 7f2717fff640 1 monclient: found mon.noname-a 2024-02-09T08:35:01.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.038+0000 7f2717fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:35:01.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.038+0000 7f2717fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-02-09T08:35:01.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.038+0000 7f2717fff640 1 -- 172.21.15.62:0/2984718226 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f270c0094d0 con 0x7f27180b2280 2024-02-09T08:35:01.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.077+0000 7f2717fff640 1 --2- 172.21.15.62:0/2984718226 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27180b2280 0x7f27181345b0 secure :-1 s=READY pgs=3220 cs=0 l=1 rev1=1 crypto rx=0x7f271000c700 tx=0x7f271000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:35:01.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.077+0000 7f26fffff640 10 client.?.objecter ms_handle_connect 0x7f27180b2280 2024-02-09T08:35:01.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.077+0000 7f26fffff640 10 client.?.objecter resend_mon_ops 2024-02-09T08:35:01.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.100+0000 7f26fffff640 1 -- 172.21.15.62:0/2984718226 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2710003b70 con 0x7f27180b2280 2024-02-09T08:35:01.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.100+0000 7f26fffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:35:01.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.100+0000 7f26fffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-09T08:35:01.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.100+0000 7f26fffff640 10 monclient: dump: 2024-02-09T08:35:01.103 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:35:01.103 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:35:01.103 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:01.103 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:01.103 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:35:01.103 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:01.103 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:35:01.104 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:35:01.104 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:35:01.104 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:01.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.100+0000 7f26fffff640 10 monclient: _finish_auth 0 2024-02-09T08:35:01.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.100+0000 7f26fffff640 10 monclient: _check_auth_tickets 2024-02-09T08:35:01.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.100+0000 7f26fffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:35:01.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.100+0000 7f26fffff640 1 -- 172.21.15.62:0/2984718226 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2710003cd0 con 0x7f27180b2280 2024-02-09T08:35:01.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.100+0000 7f26fffff640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:35:01.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.100+0000 7f26fffff640 1 -- 172.21.15.62:0/2984718226 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2710005310 con 0x7f27180b2280 2024-02-09T08:35:01.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.100+0000 7f271dc98640 5 monclient: authenticate success, global_id 16233 2024-02-09T08:35:01.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.100+0000 7f271dc98640 10 monclient: _renew_subs 2024-02-09T08:35:01.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.100+0000 7f271dc98640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:35:01.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.100+0000 7f271dc98640 1 -- 172.21.15.62:0/2984718226 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27180b5a80 con 0x7f27180b2280 2024-02-09T08:35:01.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.100+0000 7f26fffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:35:01.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.100+0000 7f26fffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-09T08:35:01.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.100+0000 7f26fffff640 10 monclient: dump: 2024-02-09T08:35:01.105 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:35:01.105 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:35:01.105 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:01.105 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:01.105 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:35:01.105 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:01.105 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:35:01.105 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:35:01.105 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:35:01.105 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:01.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.100+0000 7f2715ffb640 4 set_mon_vals no callback set 2024-02-09T08:35:01.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.100+0000 7f271dc98640 10 client.16233.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:35:01.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.100+0000 7f271dc98640 10 monclient: _renew_subs 2024-02-09T08:35:01.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.100+0000 7f271dc98640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:35:01.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.100+0000 7f271dc98640 1 -- 172.21.15.62:0/2984718226 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2718138550 con 0x7f27180b2280 2024-02-09T08:35:01.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.100+0000 7f271dc98640 1 librados: init done 2024-02-09T08:35:01.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.101+0000 7f271dc98640 10 client.16233.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:35:01.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.101+0000 7f271dc98640 15 client.16233.objecter _session_command_op_assign -1 1 2024-02-09T08:35:01.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.101+0000 7f271dc98640 20 client.16233.objecter _get_session osd=-1 returning homeless 2024-02-09T08:35:01.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.101+0000 7f271dc98640 10 client.16233.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:35:01.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.101+0000 7f271dc98640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:35:01.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.101+0000 7f271dc98640 1 -- 172.21.15.62:0/2984718226 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f271804ef90 con 0x7f27180b2280 2024-02-09T08:35:01.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.158+0000 7f26fffff640 1 -- 172.21.15.62:0/2984718226 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f2710005470 con 0x7f27180b2280 2024-02-09T08:35:01.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.158+0000 7f26fffff640 1 --2- 172.21.15.62:0/2984718226 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f270406d1d0 0x7f270406f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:01.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.159+0000 7f27177fe640 1 --2- 172.21.15.62:0/2984718226 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f270406d1d0 0x7f270406f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:35:01.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.159+0000 7f27177fe640 10 monclient: get_auth_request con 0x7f270406d1d0 auth_method 0 2024-02-09T08:35:01.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.159+0000 7f27177fe640 1 --2- 172.21.15.62:0/2984718226 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f270406d1d0 0x7f270406f690 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f2708006a90 tx=0x7f2708006a20 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:35:01.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.159+0000 7f26fffff640 10 client.16233.objecter ms_handle_connect 0x7f270406d1d0 2024-02-09T08:35:01.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.164+0000 7f26fffff640 1 -- 172.21.15.62:0/2984718226 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(1270..1270 src has 1199..1270) v4 ==== 6381+0+0 (secure 0 0 0) 0x7f2710059690 con 0x7f27180b2280 2024-02-09T08:35:01.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.164+0000 7f26fffff640 10 client.16233.objecter ms_dispatch 0x7f2718000b90 osd_map(1270..1270 src has 1199..1270) v4 2024-02-09T08:35:01.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.164+0000 7f26fffff640 3 client.16233.objecter handle_osd_map got epochs [1270,1270] > 0 2024-02-09T08:35:01.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.164+0000 7f26fffff640 3 client.16233.objecter handle_osd_map decoding full epoch 1270 2024-02-09T08:35:01.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.164+0000 7f26fffff640 10 client.16233.objecter checking command 1 2024-02-09T08:35:01.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.164+0000 7f26fffff640 1 --2- 172.21.15.62:0/2984718226 >> [v2:172.21.15.103:6826/3983655111,v1:172.21.15.103:6827/3983655111] conn(0x7f2704074f60 0x7f2704077400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:01.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.164+0000 7f26fffff640 20 client.16233.objecter _get_session s=0x7f2704074890 osd=6 3 2024-02-09T08:35:01.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.164+0000 7f26fffff640 20 client.16233.objecter put_session s=0x7f2704074890 osd=6 3 2024-02-09T08:35:01.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.164+0000 7f26fffff640 15 client.16233.objecter _session_command_op_remove -1 1 2024-02-09T08:35:01.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.164+0000 7f26fffff640 20 client.16233.objecter _get_session s=0x7f2704074890 osd=6 3 2024-02-09T08:35:01.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.164+0000 7f26fffff640 20 client.16233.objecter get_session s=0x7f2704074890 osd=6 3 2024-02-09T08:35:01.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.164+0000 7f26fffff640 15 client.16233.objecter _session_command_op_assign 6 1 2024-02-09T08:35:01.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.164+0000 7f26fffff640 20 client.16233.objecter put_session s=0x7f2704074890 osd=6 4 2024-02-09T08:35:01.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.164+0000 7f26fffff640 10 client.16233.objecter _send_command 1 2024-02-09T08:35:01.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.164+0000 7f26fffff640 1 -- 172.21.15.62:0/2984718226 --> [v2:172.21.15.103:6826/3983655111,v1:172.21.15.103:6827/3983655111] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2704077ad0 con 0x7f2704074f60 2024-02-09T08:35:01.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.164+0000 7f26fffff640 20 client.16233.objecter dump_active .. 0 homeless 2024-02-09T08:35:01.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.164+0000 7f26fffff640 1 -- 172.21.15.62:0/2984718226 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=1270) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2710001700 con 0x7f27180b2280 2024-02-09T08:35:01.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.164+0000 7f26fffff640 10 monclient: handle_get_version_reply finishing 1 version 1270 2024-02-09T08:35:01.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.165+0000 7f2716ffd640 1 --2- 172.21.15.62:0/2984718226 >> [v2:172.21.15.103:6826/3983655111,v1:172.21.15.103:6827/3983655111] conn(0x7f2704074f60 0x7f2704077400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:35:01.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.165+0000 7f2716ffd640 10 monclient: get_auth_request con 0x7f2704074f60 auth_method 0 2024-02-09T08:35:01.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.168+0000 7f26fffff640 10 client.16233.objecter ms_handle_connect 0x7f2704074f60 2024-02-09T08:35:01.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.168+0000 7f2716ffd640 1 --2- 172.21.15.62:0/2984718226 >> [v2:172.21.15.103:6826/3983655111,v1:172.21.15.103:6827/3983655111] conn(0x7f2704074f60 0x7f2704077400 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:35:01.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.194+0000 7f26fffff640 1 -- 172.21.15.62:0/2984718226 <== osd.6 v2:172.21.15.103:6826/3983655111 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f2704077ad0 con 0x7f2704074f60 2024-02-09T08:35:01.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.194+0000 7f26fffff640 10 client.16233.objecter ms_dispatch 0x7f2718000b90 command_reply(tid 1: 0 ) v1 2024-02-09T08:35:01.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.194+0000 7f26fffff640 10 client.16233.objecter _finish_command 1 = system:0 2024-02-09T08:35:01.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.194+0000 7f26fffff640 20 client.16233.objecter put_session s=0x7f2704074890 osd=6 4 2024-02-09T08:35:01.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.194+0000 7f26fffff640 15 client.16233.objecter _session_command_op_remove 6 1 2024-02-09T08:35:01.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.207+0000 7f271dc98640 10 client.16233.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2024-02-09T08:35:01.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.207+0000 7f271dc98640 15 client.16233.objecter _session_command_op_assign -1 2 2024-02-09T08:35:01.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.207+0000 7f271dc98640 20 client.16233.objecter _get_session s=0x7f2704074890 osd=6 3 2024-02-09T08:35:01.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.207+0000 7f271dc98640 20 client.16233.objecter put_session s=0x7f2704074890 osd=6 3 2024-02-09T08:35:01.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.207+0000 7f271dc98640 20 client.16233.objecter _get_session s=0x7f2704074890 osd=6 3 2024-02-09T08:35:01.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.207+0000 7f271dc98640 15 client.16233.objecter _session_command_op_remove -1 2 2024-02-09T08:35:01.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.207+0000 7f271dc98640 20 client.16233.objecter get_session s=0x7f2704074890 osd=6 3 2024-02-09T08:35:01.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.207+0000 7f271dc98640 15 client.16233.objecter _session_command_op_assign 6 2 2024-02-09T08:35:01.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.207+0000 7f271dc98640 20 client.16233.objecter put_session s=0x7f2704074890 osd=6 4 2024-02-09T08:35:01.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.207+0000 7f271dc98640 10 client.16233.objecter _send_command 2 2024-02-09T08:35:01.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.207+0000 7f271dc98640 1 -- 172.21.15.62:0/2984718226 --> [v2:172.21.15.103:6826/3983655111,v1:172.21.15.103:6827/3983655111] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f271813e960 con 0x7f2704074f60 2024-02-09T08:35:01.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.223+0000 7f26fffff640 1 -- 172.21.15.62:0/2984718226 <== osd.6 v2:172.21.15.103:6826/3983655111 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f271813e960 con 0x7f2704074f60 2024-02-09T08:35:01.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.223+0000 7f26fffff640 10 client.16233.objecter ms_dispatch 0x7f2718000b90 command_reply(tid 2: 0 ) v1 2024-02-09T08:35:01.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.223+0000 7f26fffff640 10 client.16233.objecter _finish_command 2 = system:0 2024-02-09T08:35:01.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.223+0000 7f26fffff640 20 client.16233.objecter put_session s=0x7f2704074890 osd=6 4 2024-02-09T08:35:01.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.223+0000 7f26fffff640 15 client.16233.objecter _session_command_op_remove 6 2 2024-02-09T08:35:01.228 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-02-09T08:35:01.228 INFO:teuthology.orchestra.run.smithi062.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-09T08:35:01.228 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-02-09T08:35:01.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.224+0000 7f271dc98640 10 librados: watch_flush enter 2024-02-09T08:35:01.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.224+0000 7f271dc98640 10 librados: watch_flush exit 2024-02-09T08:35:01.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.224+0000 7f271dc98640 10 client.16233.objecter close_session for osd.6 2024-02-09T08:35:01.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.224+0000 7f271dc98640 1 -- 172.21.15.62:0/2984718226 >> [v2:172.21.15.103:6826/3983655111,v1:172.21.15.103:6827/3983655111] conn(0x7f2704074f60 msgr2=0x7f2704077400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:01.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.224+0000 7f271dc98640 1 --2- 172.21.15.62:0/2984718226 >> [v2:172.21.15.103:6826/3983655111,v1:172.21.15.103:6827/3983655111] conn(0x7f2704074f60 0x7f2704077400 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:01.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.224+0000 7f271dc98640 20 client.16233.objecter put_session s=0x7f2704074890 osd=6 1 2024-02-09T08:35:01.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.224+0000 7f271dc98640 20 client.16233.objecter shutdown clearing up homeless session... 2024-02-09T08:35:01.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.224+0000 7f271dc98640 10 client.16233.objecter successfully canceled tick 2024-02-09T08:35:01.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.224+0000 7f271dc98640 1 -- 172.21.15.62:0/2984718226 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f270406d1d0 msgr2=0x7f270406f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:01.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.224+0000 7f271dc98640 1 --2- 172.21.15.62:0/2984718226 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f270406d1d0 0x7f270406f690 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f2708006a90 tx=0x7f2708006a20 comp rx=0 tx=0).stop 2024-02-09T08:35:01.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.224+0000 7f271dc98640 10 monclient: shutdown 2024-02-09T08:35:01.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.224+0000 7f271dc98640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:35:01.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.224+0000 7f271dc98640 1 -- 172.21.15.62:0/2984718226 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27180b2280 msgr2=0x7f27181345b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:01.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.224+0000 7f271dc98640 1 --2- 172.21.15.62:0/2984718226 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27180b2280 0x7f27181345b0 secure :-1 s=READY pgs=3220 cs=0 l=1 rev1=1 crypto rx=0x7f271000c700 tx=0x7f271000cbc0 comp rx=0 tx=0).stop 2024-02-09T08:35:01.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.224+0000 7f2717fff640 1 -- 172.21.15.62:0/2984718226 reap_dead start 2024-02-09T08:35:01.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.224+0000 7f271dc98640 1 -- 172.21.15.62:0/2984718226 shutdown_connections 2024-02-09T08:35:01.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.224+0000 7f271dc98640 1 -- 172.21.15.62:0/2984718226 >> 172.21.15.62:0/2984718226 conn(0x7f27180b4db0 msgr2=0x7f27181378c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:35:01.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.224+0000 7f271dc98640 1 -- 172.21.15.62:0/2984718226 shutdown_connections 2024-02-09T08:35:01.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.224+0000 7f271dc98640 1 -- 172.21.15.62:0/2984718226 wait complete. 2024-02-09T08:35:01.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.224+0000 7f271dc98640 1 librados: shutdown 2024-02-09T08:35:01.237 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-02-09T08:35:01.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.382+0000 7f4676b52640 10 monclient: get_monmap_and_config 2024-02-09T08:35:01.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.382+0000 7f4676b52640 10 monclient: build_initial_monmap 2024-02-09T08:35:01.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.382+0000 7f4676b52640 10 monclient: monmap: 2024-02-09T08:35:01.385 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:35:01.385 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:35:01.385 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:35:01.383840+0000 2024-02-09T08:35:01.385 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:35:01.383840+0000 2024-02-09T08:35:01.385 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:35:01.385 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:01.386 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:35:01.386 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:35:01.386 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:35:01.386 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:35:01.386 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:35:01.386 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:01.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.383+0000 7f4676b52640 1 Processor -- start 2024-02-09T08:35:01.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.383+0000 7f4676b52640 1 -- start start 2024-02-09T08:35:01.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.383+0000 7f4676b52640 10 monclient: init 2024-02-09T08:35:01.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.384+0000 7f4676b52640 10 monclient: _reopen_session rank -1 2024-02-09T08:35:01.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.384+0000 7f4676b52640 10 monclient: _add_conns ranks=[2,1,3,0,4] 2024-02-09T08:35:01.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.384+0000 7f4676b52640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4670067110 0x7f46700a9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:01.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.384+0000 7f4676b52640 10 monclient(hunting): picked mon.noname-b con 0x7f4670067110 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:35:01.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.384+0000 7f4676b52640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f467013f830 addr v1:172.21.15.103:6789/0 2024-02-09T08:35:01.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.384+0000 7f4676b52640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4670142bd0 0x7f467013fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:01.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.384+0000 7f4676b52640 10 monclient(hunting): picked mon.noname-a con 0x7f4670142bd0 addr v2:172.21.15.62:3300/0 2024-02-09T08:35:01.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.384+0000 7f4676b52640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46700aa090 con 0x7f467013f830 2024-02-09T08:35:01.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.384+0000 7f4676b52640 10 monclient(hunting): start opening mon connection 2024-02-09T08:35:01.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.384+0000 7f4676b52640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46700674f0 con 0x7f4670142bd0 2024-02-09T08:35:01.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.384+0000 7f4676b52640 10 monclient(hunting): start opening mon connection 2024-02-09T08:35:01.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.384+0000 7f4676b52640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4670143040 con 0x7f4670067110 2024-02-09T08:35:01.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.384+0000 7f4676b52640 10 monclient(hunting): _renew_subs 2024-02-09T08:35:01.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.384+0000 7f4676b52640 10 monclient(hunting): authenticate will time out at 3344.744505s 2024-02-09T08:35:01.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.390+0000 7f46750ef640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4670142bd0 0x7f467013fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:35:01.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.393+0000 7f466ffff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f467013f830 0x7f46701424c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.62:53036/0 (socket says 172.21.15.62:53036) 2024-02-09T08:35:01.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.393+0000 7f466ffff640 1 -- 172.21.15.62:0/2213888557 learned_addr learned my addr 172.21.15.62:0/2213888557 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-09T08:35:01.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.395+0000 7f46748ee640 1 --2- 172.21.15.62:0/2213888557 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4670067110 0x7f46700a9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:35:01.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.396+0000 7f46750ef640 10 monclient(hunting): get_auth_request con 0x7f4670142bd0 auth_method 0 2024-02-09T08:35:01.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.396+0000 7f46750ef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:35:01.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.396+0000 7f46750ef640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:35:01.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.396+0000 7f46750ef640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:35:01.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.397+0000 7f46748ee640 10 monclient(hunting): get_auth_request con 0x7f4670067110 auth_method 0 2024-02-09T08:35:01.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.397+0000 7f46748ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:35:01.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.397+0000 7f46748ee640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:35:01.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.397+0000 7f46748ee640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:35:01.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.402+0000 7f46748ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:35:01.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.402+0000 7f46748ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:35:01.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.402+0000 7f46748ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:35:01.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.402+0000 7f46750ef640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:35:01.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.402+0000 7f46750ef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:35:01.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.402+0000 7f46750ef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:35:01.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.406+0000 7f46748ee640 10 monclient(hunting): handle_auth_done global_id 18647 payload 274 2024-02-09T08:35:01.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.406+0000 7f46748ee640 1 -- 172.21.15.62:0/2213888557 >> v2:172.21.15.62:3300/0 conn(0x7f4670142bd0 msgr2=0x7f467013fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:35:01.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.406+0000 7f46748ee640 1 --2- 172.21.15.62:0/2213888557 >> v2:172.21.15.62:3300/0 conn(0x7f4670142bd0 0x7f467013fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:01.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.406+0000 7f46748ee640 1 -- 172.21.15.62:0/2213888557 >> v1:172.21.15.103:6789/0 conn(0x7f467013f830 legacy=0x7f46701424c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:01.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.406+0000 7f46748ee640 10 monclient: _finish_hunting 0 2024-02-09T08:35:01.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.406+0000 7f46748ee640 1 monclient: found mon.noname-b 2024-02-09T08:35:01.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.406+0000 7f46748ee640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:35:01.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.406+0000 7f46748ee640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.62:3301/0 2024-02-09T08:35:01.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.406+0000 7f46748ee640 1 -- 172.21.15.62:0/2213888557 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46700ab5b0 con 0x7f4670067110 2024-02-09T08:35:01.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.411+0000 7f46748ee640 1 --2- 172.21.15.62:0/2213888557 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4670067110 0x7f46700a9930 secure :-1 s=READY pgs=3198 cs=0 l=1 rev1=1 crypto rx=0x7f46640097a0 tx=0x7f466402b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56181ec2bab80c47 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:35:01.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.420+0000 7f466f7fe640 1 -- 172.21.15.62:0/2213888557 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466402e070 con 0x7f4670067110 2024-02-09T08:35:01.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.420+0000 7f466f7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:35:01.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.420+0000 7f466f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:35:01.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.420+0000 7f466f7fe640 10 monclient: dump: 2024-02-09T08:35:01.423 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:35:01.423 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:35:01.423 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:01.423 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:01.423 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:35:01.423 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:01.423 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:35:01.423 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:35:01.423 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:35:01.423 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:01.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.420+0000 7f466f7fe640 10 monclient: _finish_auth 0 2024-02-09T08:35:01.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.420+0000 7f466f7fe640 10 monclient: _check_auth_tickets 2024-02-09T08:35:01.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.420+0000 7f466f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:35:01.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.420+0000 7f466f7fe640 1 -- 172.21.15.62:0/2213888557 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46640315a0 con 0x7f4670067110 2024-02-09T08:35:01.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.420+0000 7f4676b52640 5 monclient: authenticate success, global_id 18647 2024-02-09T08:35:01.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.420+0000 7f4676b52640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-02-09T08:35:01.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.420+0000 7f466f7fe640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:35:01.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.420+0000 7f4676b52640 10 monclient: get_monmap_and_config success 2024-02-09T08:35:01.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.420+0000 7f466f7fe640 1 -- 172.21.15.62:0/2213888557 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4664031930 con 0x7f4670067110 2024-02-09T08:35:01.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.420+0000 7f4676b52640 4 set_mon_vals no callback set 2024-02-09T08:35:01.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.420+0000 7f466f7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:35:01.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.420+0000 7f466f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-09T08:35:01.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.420+0000 7f466f7fe640 10 monclient: dump: 2024-02-09T08:35:01.425 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:35:01.425 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:35:01.425 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:01.425 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:01.425 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:35:01.425 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:01.425 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:35:01.425 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:35:01.425 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:35:01.426 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:01.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.421+0000 7f4676b52640 10 monclient: shutdown 2024-02-09T08:35:01.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.421+0000 7f4676b52640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:35:01.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.421+0000 7f4676b52640 1 -- 172.21.15.62:0/2213888557 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4670067110 msgr2=0x7f46700a9930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:01.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.421+0000 7f4676b52640 1 --2- 172.21.15.62:0/2213888557 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4670067110 0x7f46700a9930 secure :-1 s=READY pgs=3198 cs=0 l=1 rev1=1 crypto rx=0x7f46640097a0 tx=0x7f466402b840 comp rx=0 tx=0).stop 2024-02-09T08:35:01.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.421+0000 7f4676b52640 1 -- 172.21.15.62:0/2213888557 shutdown_connections 2024-02-09T08:35:01.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.421+0000 7f4676b52640 1 --2- 172.21.15.62:0/2213888557 >> v2:172.21.15.62:3300/0 conn(0x7f4670142bd0 0x7f467013fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:01.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.421+0000 7f4676b52640 1 --2- 172.21.15.62:0/2213888557 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4670067110 0x7f46700a9930 unknown :-1 s=CLOSED pgs=3198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:01.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.421+0000 7f4676b52640 1 -- 172.21.15.62:0/2213888557 >> 172.21.15.62:0/2213888557 conn(0x7f46700b4e20 msgr2=0x7f46700b5230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:35:01.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.421+0000 7f4676b52640 1 -- 172.21.15.62:0/2213888557 shutdown_connections 2024-02-09T08:35:01.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.421+0000 7f4676b52640 1 -- 172.21.15.62:0/2213888557 wait complete. 2024-02-09T08:35:01.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.422+0000 7f4676b52640 10 monclient: build_initial_monmap 2024-02-09T08:35:01.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.422+0000 7f4676b52640 10 monclient: monmap: 2024-02-09T08:35:01.432 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:35:01.433 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:35:01.433 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:35:01.433 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:35:01.433 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:35:01.433 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:01.433 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:35:01.433 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:35:01.433 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:35:01.433 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:01.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.422+0000 7f4676b52640 1 librados: starting msgr at 2024-02-09T08:35:01.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.422+0000 7f4676b52640 1 librados: starting objecter 2024-02-09T08:35:01.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.422+0000 7f4676b52640 1 Processor -- start 2024-02-09T08:35:01.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.422+0000 7f4676b52640 1 -- start start 2024-02-09T08:35:01.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.422+0000 7f4676b52640 1 librados: setting wanted keys 2024-02-09T08:35:01.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.422+0000 7f4676b52640 1 librados: calling monclient init 2024-02-09T08:35:01.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.422+0000 7f4676b52640 10 monclient: init 2024-02-09T08:35:01.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.423+0000 7f4676b52640 10 monclient: _reopen_session rank -1 2024-02-09T08:35:01.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.423+0000 7f4676b52640 10 monclient: _add_conns ranks=[1,2,0] 2024-02-09T08:35:01.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.423+0000 7f4676b52640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4670067110 0x7f467013a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:01.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.423+0000 7f4676b52640 10 monclient(hunting): picked mon.noname-b con 0x7f4670067110 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:35:01.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.423+0000 7f4676b52640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f467013f830 0x7f46700b7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:01.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.423+0000 7f4676b52640 10 monclient(hunting): picked mon.noname-c con 0x7f467013f830 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:35:01.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.423+0000 7f4676b52640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4670142bd0 0x7f46700b8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:01.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.423+0000 7f4676b52640 10 monclient(hunting): picked mon.noname-a con 0x7f4670142bd0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:35:01.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.423+0000 7f4676b52640 10 monclient(hunting): start opening mon connection 2024-02-09T08:35:01.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.423+0000 7f4676b52640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46700b89c0 con 0x7f4670142bd0 2024-02-09T08:35:01.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.423+0000 7f4676b52640 10 monclient(hunting): start opening mon connection 2024-02-09T08:35:01.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.423+0000 7f4676b52640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467014c280 con 0x7f4670067110 2024-02-09T08:35:01.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.423+0000 7f4676b52640 10 monclient(hunting): start opening mon connection 2024-02-09T08:35:01.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.423+0000 7f4676b52640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46700ac270 con 0x7f467013f830 2024-02-09T08:35:01.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.423+0000 7f4676b52640 10 monclient(hunting): _renew_subs 2024-02-09T08:35:01.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.423+0000 7f4676b52640 10 monclient(hunting): authenticate will time out at 3344.784153s 2024-02-09T08:35:01.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.425+0000 7f466ffff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f467013f830 0x7f46700b7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:35:01.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.425+0000 7f46750ef640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4670142bd0 0x7f46700b8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:35:01.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.426+0000 7f466ffff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f467013f830 0x7f46700b7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:52492/0 (socket says 172.21.15.62:52492) 2024-02-09T08:35:01.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.426+0000 7f466ffff640 1 -- 172.21.15.62:0/3993952297 learned_addr learned my addr 172.21.15.62:0/3993952297 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:35:01.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.426+0000 7f466ffff640 10 monclient(hunting): get_auth_request con 0x7f467013f830 auth_method 0 2024-02-09T08:35:01.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.426+0000 7f466ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:35:01.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.426+0000 7f466ffff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:35:01.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.426+0000 7f466ffff640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:35:01.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.427+0000 7f46750ef640 10 monclient(hunting): get_auth_request con 0x7f4670142bd0 auth_method 0 2024-02-09T08:35:01.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.427+0000 7f46750ef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:35:01.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.427+0000 7f46750ef640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:35:01.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.427+0000 7f46750ef640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:35:01.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.427+0000 7f466ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:35:01.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.427+0000 7f466ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:35:01.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.427+0000 7f466ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:35:01.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.428+0000 7f46750ef640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:35:01.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.428+0000 7f46750ef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:35:01.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.428+0000 7f46750ef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:35:01.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.428+0000 7f46748ee640 1 --2- 172.21.15.62:0/3993952297 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4670067110 0x7f467013a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:35:01.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.429+0000 7f46748ee640 10 monclient(hunting): get_auth_request con 0x7f4670067110 auth_method 0 2024-02-09T08:35:01.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.429+0000 7f46748ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:35:01.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.429+0000 7f46748ee640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:35:01.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.429+0000 7f46748ee640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:35:01.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.431+0000 7f466ffff640 10 monclient(hunting): handle_auth_done global_id 18650 payload 824 2024-02-09T08:35:01.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.431+0000 7f466ffff640 1 -- 172.21.15.62:0/3993952297 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4670067110 msgr2=0x7f467013a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:01.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.431+0000 7f466ffff640 1 --2- 172.21.15.62:0/3993952297 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4670067110 0x7f467013a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:01.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.431+0000 7f466ffff640 1 -- 172.21.15.62:0/3993952297 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4670142bd0 msgr2=0x7f46700b8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:01.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.431+0000 7f466ffff640 1 --2- 172.21.15.62:0/3993952297 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4670142bd0 0x7f46700b8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:01.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.431+0000 7f466ffff640 10 monclient: _finish_hunting 0 2024-02-09T08:35:01.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.431+0000 7f466ffff640 1 monclient: found mon.noname-c 2024-02-09T08:35:01.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.431+0000 7f466ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:35:01.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.431+0000 7f466ffff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-02-09T08:35:01.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.431+0000 7f466ffff640 1 -- 172.21.15.62:0/3993952297 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4664009400 con 0x7f467013f830 2024-02-09T08:35:01.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.436+0000 7f466ffff640 1 --2- 172.21.15.62:0/3993952297 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f467013f830 0x7f46700b7f40 secure :-1 s=READY pgs=3199 cs=0 l=1 rev1=1 crypto rx=0x7f465c00c400 tx=0x7f465c00c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:35:01.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.436+0000 7f466d7fa640 10 client.?.objecter ms_handle_connect 0x7f467013f830 2024-02-09T08:35:01.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.436+0000 7f466d7fa640 10 client.?.objecter resend_mon_ops 2024-02-09T08:35:01.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.443+0000 7f466d7fa640 1 -- 172.21.15.62:0/3993952297 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465c005ce0 con 0x7f467013f830 2024-02-09T08:35:01.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.443+0000 7f466d7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:35:01.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.443+0000 7f466d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-09T08:35:01.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.443+0000 7f466d7fa640 10 monclient: dump: 2024-02-09T08:35:01.446 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:35:01.446 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:35:01.446 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:01.446 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:01.447 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:35:01.448 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:01.448 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:35:01.448 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:35:01.448 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:35:01.448 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:01.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.443+0000 7f466d7fa640 10 monclient: _finish_auth 0 2024-02-09T08:35:01.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.443+0000 7f466d7fa640 10 monclient: _check_auth_tickets 2024-02-09T08:35:01.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.443+0000 7f466d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:35:01.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.443+0000 7f466d7fa640 1 -- 172.21.15.62:0/3993952297 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f465c005e40 con 0x7f467013f830 2024-02-09T08:35:01.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.443+0000 7f466d7fa640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:35:01.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.443+0000 7f466d7fa640 1 -- 172.21.15.62:0/3993952297 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465c0072d0 con 0x7f467013f830 2024-02-09T08:35:01.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.443+0000 7f4676b52640 5 monclient: authenticate success, global_id 18650 2024-02-09T08:35:01.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.443+0000 7f4676b52640 10 monclient: _renew_subs 2024-02-09T08:35:01.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.443+0000 7f4676b52640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:35:01.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.443+0000 7f4676b52640 1 -- 172.21.15.62:0/3993952297 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46700ac550 con 0x7f467013f830 2024-02-09T08:35:01.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.443+0000 7f466effd640 4 set_mon_vals no callback set 2024-02-09T08:35:01.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.443+0000 7f466d7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:35:01.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.443+0000 7f466d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-09T08:35:01.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.443+0000 7f466d7fa640 10 monclient: dump: 2024-02-09T08:35:01.449 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:35:01.449 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:35:01.449 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:01.449 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:01.449 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:35:01.449 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:01.449 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:35:01.449 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:35:01.449 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:35:01.449 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:01.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.443+0000 7f4676b52640 10 client.18650.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:35:01.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.443+0000 7f4676b52640 10 monclient: _renew_subs 2024-02-09T08:35:01.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.443+0000 7f4676b52640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:35:01.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.443+0000 7f4676b52640 1 -- 172.21.15.62:0/3993952297 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f467014ca60 con 0x7f467013f830 2024-02-09T08:35:01.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.443+0000 7f4676b52640 1 librados: init done 2024-02-09T08:35:01.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.444+0000 7f4676b52640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:35:01.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.444+0000 7f4676b52640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:35:01.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.444+0000 7f4676b52640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:35:01.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.444+0000 7f4676b52640 1 -- 172.21.15.62:0/3993952297 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f467004ef90 con 0x7f467013f830 2024-02-09T08:35:01.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.732+0000 7f466d7fa640 1 -- 172.21.15.62:0/3993952297 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f465c0074f0 con 0x7f467013f830 2024-02-09T08:35:01.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.732+0000 7f466d7fa640 1 --2- 172.21.15.62:0/3993952297 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f465406d1f0 0x7f465406f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:01.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.732+0000 7f46748ee640 1 --2- 172.21.15.62:0/3993952297 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f465406d1f0 0x7f465406f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:35:01.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.733+0000 7f46748ee640 10 monclient: get_auth_request con 0x7f465406d1f0 auth_method 0 2024-02-09T08:35:01.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.733+0000 7f46748ee640 1 --2- 172.21.15.62:0/3993952297 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f465406d1f0 0x7f465406f6b0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f4664036000 tx=0x7f466403d040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:35:01.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.733+0000 7f466d7fa640 10 client.18650.objecter ms_handle_connect 0x7f465406d1f0 2024-02-09T08:35:01.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.747+0000 7f466d7fa640 1 -- 172.21.15.62:0/3993952297 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(1270..1270 src has 1199..1270) v4 ==== 6381+0+0 (secure 0 0 0) 0x7f465c058460 con 0x7f467013f830 2024-02-09T08:35:01.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.747+0000 7f466d7fa640 10 client.18650.objecter ms_dispatch 0x7f4670000b90 osd_map(1270..1270 src has 1199..1270) v4 2024-02-09T08:35:01.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.747+0000 7f466d7fa640 3 client.18650.objecter handle_osd_map got epochs [1270,1270] > 0 2024-02-09T08:35:01.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.747+0000 7f466d7fa640 3 client.18650.objecter handle_osd_map decoding full epoch 1270 2024-02-09T08:35:01.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.747+0000 7f466d7fa640 20 client.18650.objecter dump_active .. 0 homeless 2024-02-09T08:35:01.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.747+0000 7f466d7fa640 1 -- 172.21.15.62:0/3993952297 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f465c054700 con 0x7f467013f830 2024-02-09T08:35:01.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.747+0000 7f466d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:35:01.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.747+0000 7f466d7fa640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:35:01.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.990+0000 7f4676b52640 1 -- 172.21.15.62:0/3993952297 --> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f467014c690 con 0x7f465406d1f0 2024-02-09T08:35:01.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.990+0000 7f466d7fa640 1 -- 172.21.15.62:0/3993952297 <== mgr.4109 v2:172.21.15.103:6800/2270392189 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f467014c690 con 0x7f465406d1f0 2024-02-09T08:35:01.993 INFO:teuthology.orchestra.run.smithi062.stderr:instructed osd(s) 6 to deep-scrub 2024-02-09T08:35:01.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.992+0000 7f4676b52640 10 librados: watch_flush enter 2024-02-09T08:35:01.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.992+0000 7f4676b52640 10 librados: watch_flush exit 2024-02-09T08:35:01.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.992+0000 7f4676b52640 20 client.18650.objecter shutdown clearing up homeless session... 2024-02-09T08:35:01.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.992+0000 7f4676b52640 10 client.18650.objecter successfully canceled tick 2024-02-09T08:35:01.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.992+0000 7f4676b52640 1 -- 172.21.15.62:0/3993952297 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f465406d1f0 msgr2=0x7f465406f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:01.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.992+0000 7f4676b52640 1 --2- 172.21.15.62:0/3993952297 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f465406d1f0 0x7f465406f6b0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f4664036000 tx=0x7f466403d040 comp rx=0 tx=0).stop 2024-02-09T08:35:01.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.992+0000 7f4676b52640 10 monclient: shutdown 2024-02-09T08:35:01.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.992+0000 7f4676b52640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:35:01.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.992+0000 7f4676b52640 1 -- 172.21.15.62:0/3993952297 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f467013f830 msgr2=0x7f46700b7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:01.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.992+0000 7f4676b52640 1 --2- 172.21.15.62:0/3993952297 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f467013f830 0x7f46700b7f40 secure :-1 s=READY pgs=3199 cs=0 l=1 rev1=1 crypto rx=0x7f465c00c400 tx=0x7f465c00c8c0 comp rx=0 tx=0).stop 2024-02-09T08:35:01.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.992+0000 7f4676b52640 1 -- 172.21.15.62:0/3993952297 shutdown_connections 2024-02-09T08:35:01.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.992+0000 7f4676b52640 1 --2- 172.21.15.62:0/3993952297 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f465406d1f0 0x7f465406f6b0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:01.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.992+0000 7f4676b52640 1 --2- 172.21.15.62:0/3993952297 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4670142bd0 0x7f46700b8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:01.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.992+0000 7f4676b52640 1 --2- 172.21.15.62:0/3993952297 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f467013f830 0x7f46700b7f40 unknown :-1 s=CLOSED pgs=3199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:01.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.992+0000 7f4676b52640 1 --2- 172.21.15.62:0/3993952297 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4670067110 0x7f467013a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:01.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.992+0000 7f4676b52640 1 -- 172.21.15.62:0/3993952297 >> 172.21.15.62:0/3993952297 conn(0x7f46700b4e20 msgr2=0x7f467013c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:35:01.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.992+0000 7f4676b52640 1 -- 172.21.15.62:0/3993952297 shutdown_connections 2024-02-09T08:35:01.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.992+0000 7f4676b52640 1 -- 172.21.15.62:0/3993952297 wait complete. 2024-02-09T08:35:01.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:01.992+0000 7f4676b52640 1 librados: shutdown 2024-02-09T08:35:02.007 INFO:tasks.ceph:Scrubbing osd.7 2024-02-09T08:35:02.007 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-02-09T08:35:02.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.117+0000 7f01708de640 10 monclient: get_monmap_and_config 2024-02-09T08:35:02.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.117+0000 7f01708de640 10 monclient: build_initial_monmap 2024-02-09T08:35:02.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.117+0000 7f01708de640 10 monclient: monmap: 2024-02-09T08:35:02.120 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:35:02.120 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:35:02.120 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:35:02.118941+0000 2024-02-09T08:35:02.120 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:35:02.118941+0000 2024-02-09T08:35:02.120 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:35:02.121 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:02.121 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:35:02.121 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:35:02.121 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:35:02.121 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:35:02.121 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:35:02.121 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:02.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.118+0000 7f01708de640 1 Processor -- start 2024-02-09T08:35:02.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.118+0000 7f01708de640 1 -- start start 2024-02-09T08:35:02.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.118+0000 7f01708de640 10 monclient: init 2024-02-09T08:35:02.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.119+0000 7f01708de640 10 monclient: _reopen_session rank -1 2024-02-09T08:35:02.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.119+0000 7f01708de640 10 monclient: _add_conns ranks=[1,4,3,2,0] 2024-02-09T08:35:02.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.119+0000 7f01708de640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f016c06c320 addr v1:172.21.15.103:6789/0 2024-02-09T08:35:02.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.119+0000 7f01708de640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f016c0a9be0 0x7f016c145ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:02.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.119+0000 7f01708de640 10 monclient(hunting): picked mon.noname-c con 0x7f016c0a9be0 addr v2:172.21.15.103:3300/0 2024-02-09T08:35:02.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.119+0000 7f01708de640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f016c0b2280 0x7f016c146000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:02.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.119+0000 7f01708de640 10 monclient(hunting): picked mon.noname-a con 0x7f016c0b2280 addr v2:172.21.15.62:3300/0 2024-02-09T08:35:02.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.119+0000 7f01708de640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f016c0aa130 con 0x7f016c06c320 2024-02-09T08:35:02.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.119+0000 7f01708de640 10 monclient(hunting): start opening mon connection 2024-02-09T08:35:02.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.119+0000 7f01708de640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f016c06c700 con 0x7f016c0b2280 2024-02-09T08:35:02.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.119+0000 7f01708de640 10 monclient(hunting): start opening mon connection 2024-02-09T08:35:02.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.119+0000 7f01708de640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f016c0aa5c0 con 0x7f016c0a9be0 2024-02-09T08:35:02.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.119+0000 7f01708de640 10 monclient(hunting): _renew_subs 2024-02-09T08:35:02.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.119+0000 7f01708de640 10 monclient(hunting): authenticate will time out at 3345.479484s 2024-02-09T08:35:02.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.119+0000 7f0169d9b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f016c0a9be0 0x7f016c145ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:35:02.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.119+0000 7f016ad9d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f016c0b2280 0x7f016c146000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:35:02.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.120+0000 7f0169d9b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f016c0a9be0 0x7f016c145ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.62:41326/0 (socket says 172.21.15.62:41326) 2024-02-09T08:35:02.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.120+0000 7f0169d9b640 1 -- 172.21.15.62:0/2268432377 learned_addr learned my addr 172.21.15.62:0/2268432377 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:35:02.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.120+0000 7f0169d9b640 10 monclient(hunting): get_auth_request con 0x7f016c0a9be0 auth_method 0 2024-02-09T08:35:02.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.120+0000 7f0169d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:35:02.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.120+0000 7f0169d9b640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:35:02.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.120+0000 7f0169d9b640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:35:02.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.120+0000 7f016ad9d640 10 monclient(hunting): get_auth_request con 0x7f016c0b2280 auth_method 0 2024-02-09T08:35:02.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.120+0000 7f016ad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:35:02.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.120+0000 7f016ad9d640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:35:02.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.120+0000 7f016ad9d640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:35:02.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.120+0000 7f0169d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:35:02.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.120+0000 7f0169d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:35:02.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.120+0000 7f0169d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:35:02.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.120+0000 7f016ad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:35:02.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.120+0000 7f016ad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:35:02.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.121+0000 7f016ad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:35:02.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.122+0000 7f016ad9d640 10 monclient(hunting): handle_auth_done global_id 16242 payload 274 2024-02-09T08:35:02.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.122+0000 7f016ad9d640 1 -- 172.21.15.62:0/2268432377 >> v2:172.21.15.103:3300/0 conn(0x7f016c0a9be0 msgr2=0x7f016c145ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:35:02.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.122+0000 7f016ad9d640 1 --2- 172.21.15.62:0/2268432377 >> v2:172.21.15.103:3300/0 conn(0x7f016c0a9be0 0x7f016c145ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:02.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.122+0000 7f016ad9d640 1 -- 172.21.15.62:0/2268432377 >> v1:172.21.15.103:6789/0 conn(0x7f016c06c320 legacy=0x7f016c13f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:35:02.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.122+0000 7f016ad9d640 10 monclient: _finish_hunting 0 2024-02-09T08:35:02.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.122+0000 7f016ad9d640 1 monclient: found mon.noname-a 2024-02-09T08:35:02.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.122+0000 7f016ad9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:35:02.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.122+0000 7f016ad9d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-02-09T08:35:02.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.122+0000 7f016ad9d640 1 -- 172.21.15.62:0/2268432377 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f016c0ab5f0 con 0x7f016c0b2280 2024-02-09T08:35:02.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.122+0000 7f0169d9b640 1 --2- 172.21.15.62:0/2268432377 >> v2:172.21.15.103:3300/0 conn(0x7f016c0a9be0 0x7f016c145ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-09T08:35:02.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.124+0000 7f016ad9d640 1 --2- 172.21.15.62:0/2268432377 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f016c0b2280 0x7f016c146000 secure :-1 s=READY pgs=3221 cs=0 l=1 rev1=1 crypto rx=0x7f0164009d90 tx=0x7f016402bd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fe67502e680274e server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:35:02.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.126+0000 7f016959a640 1 -- 172.21.15.62:0/2268432377 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016402cab0 con 0x7f016c0b2280 2024-02-09T08:35:02.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.126+0000 7f016959a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:35:02.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.126+0000 7f016959a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-09T08:35:02.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.126+0000 7f016959a640 10 monclient: dump: 2024-02-09T08:35:02.129 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:35:02.129 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:35:02.129 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:02.130 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:02.130 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:35:02.130 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:02.130 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:35:02.130 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:35:02.130 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:35:02.130 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:02.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.126+0000 7f016959a640 10 monclient: _finish_auth 0 2024-02-09T08:35:02.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.126+0000 7f016959a640 10 monclient: _check_auth_tickets 2024-02-09T08:35:02.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.126+0000 7f016959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:35:02.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.127+0000 7f01708de640 5 monclient: authenticate success, global_id 16242 2024-02-09T08:35:02.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.127+0000 7f01708de640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-02-09T08:35:02.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.128+0000 7f016959a640 1 -- 172.21.15.62:0/2268432377 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f016402cc10 con 0x7f016c0b2280 2024-02-09T08:35:02.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.128+0000 7f016959a640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:35:02.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.128+0000 7f016959a640 1 -- 172.21.15.62:0/2268432377 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0164034440 con 0x7f016c0b2280 2024-02-09T08:35:02.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.128+0000 7f016959a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:35:02.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.128+0000 7f016959a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-09T08:35:02.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.128+0000 7f016959a640 10 monclient: dump: 2024-02-09T08:35:02.131 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:35:02.131 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:35:02.131 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:02.132 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:02.132 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:35:02.132 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:02.132 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:35:02.132 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:35:02.132 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:35:02.132 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:02.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.129+0000 7f01708de640 10 monclient: get_monmap_and_config success 2024-02-09T08:35:02.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.129+0000 7f01708de640 4 set_mon_vals no callback set 2024-02-09T08:35:02.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.129+0000 7f01708de640 10 monclient: shutdown 2024-02-09T08:35:02.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.129+0000 7f01708de640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:35:02.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.129+0000 7f01708de640 1 -- 172.21.15.62:0/2268432377 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f016c0b2280 msgr2=0x7f016c146000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:02.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.129+0000 7f01708de640 1 --2- 172.21.15.62:0/2268432377 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f016c0b2280 0x7f016c146000 secure :-1 s=READY pgs=3221 cs=0 l=1 rev1=1 crypto rx=0x7f0164009d90 tx=0x7f016402bd00 comp rx=0 tx=0).stop 2024-02-09T08:35:02.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.129+0000 7f01708de640 1 -- 172.21.15.62:0/2268432377 shutdown_connections 2024-02-09T08:35:02.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.129+0000 7f01708de640 1 --2- 172.21.15.62:0/2268432377 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f016c0b2280 0x7f016c146000 unknown :-1 s=CLOSED pgs=3221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:02.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.129+0000 7f01708de640 1 --2- 172.21.15.62:0/2268432377 >> v2:172.21.15.103:3300/0 conn(0x7f016c0a9be0 0x7f016c145ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:02.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.129+0000 7f01708de640 1 -- 172.21.15.62:0/2268432377 >> 172.21.15.62:0/2268432377 conn(0x7f016c0b4db0 msgr2=0x7f016c0b51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:35:02.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.129+0000 7f01708de640 1 -- 172.21.15.62:0/2268432377 shutdown_connections 2024-02-09T08:35:02.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.129+0000 7f01708de640 1 -- 172.21.15.62:0/2268432377 wait complete. 2024-02-09T08:35:02.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.130+0000 7f01708de640 10 monclient: build_initial_monmap 2024-02-09T08:35:02.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.130+0000 7f01708de640 10 monclient: monmap: 2024-02-09T08:35:02.135 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:35:02.135 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:35:02.135 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:35:02.135 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:35:02.135 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:35:02.135 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:02.135 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:35:02.135 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:35:02.135 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:35:02.136 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:02.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.131+0000 7f01708de640 1 librados: starting msgr at 2024-02-09T08:35:02.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.131+0000 7f01708de640 1 librados: starting objecter 2024-02-09T08:35:02.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.131+0000 7f01708de640 1 Processor -- start 2024-02-09T08:35:02.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.131+0000 7f01708de640 1 -- start start 2024-02-09T08:35:02.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.131+0000 7f01708de640 1 librados: setting wanted keys 2024-02-09T08:35:02.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.131+0000 7f01708de640 1 librados: calling monclient init 2024-02-09T08:35:02.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.131+0000 7f01708de640 10 monclient: init 2024-02-09T08:35:02.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.131+0000 7f01708de640 10 monclient: _reopen_session rank -1 2024-02-09T08:35:02.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.131+0000 7f01708de640 10 monclient: _add_conns ranks=[1,2,0] 2024-02-09T08:35:02.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.131+0000 7f01708de640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f016c06c320 0x7f016c140ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:02.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.131+0000 7f01708de640 10 monclient(hunting): picked mon.noname-b con 0x7f016c06c320 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:35:02.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.131+0000 7f01708de640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f016c0a9be0 0x7f016c13b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:02.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.131+0000 7f01708de640 10 monclient(hunting): picked mon.noname-c con 0x7f016c0a9be0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:35:02.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.131+0000 7f01708de640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f016c0b2280 0x7f016c132ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:02.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.131+0000 7f01708de640 10 monclient(hunting): picked mon.noname-a con 0x7f016c0b2280 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:35:02.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.131+0000 7f01708de640 10 monclient(hunting): start opening mon connection 2024-02-09T08:35:02.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.131+0000 7f01708de640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f016c13cb90 con 0x7f016c0b2280 2024-02-09T08:35:02.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.131+0000 7f01708de640 10 monclient(hunting): start opening mon connection 2024-02-09T08:35:02.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.131+0000 7f01708de640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f016c1406a0 con 0x7f016c06c320 2024-02-09T08:35:02.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.131+0000 7f01708de640 10 monclient(hunting): start opening mon connection 2024-02-09T08:35:02.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.131+0000 7f01708de640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f016c1403c0 con 0x7f016c0a9be0 2024-02-09T08:35:02.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.131+0000 7f01708de640 10 monclient(hunting): _renew_subs 2024-02-09T08:35:02.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.131+0000 7f01708de640 10 monclient(hunting): authenticate will time out at 3345.491960s 2024-02-09T08:35:02.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.132+0000 7f016ad9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f016c0b2280 0x7f016c132ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:35:02.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.132+0000 7f016a59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f016c06c320 0x7f016c140ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:35:02.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.132+0000 7f016ad9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f016c0b2280 0x7f016c132ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44150/0 (socket says 172.21.15.62:44150) 2024-02-09T08:35:02.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.132+0000 7f016ad9d640 1 -- 172.21.15.62:0/1265983352 learned_addr learned my addr 172.21.15.62:0/1265983352 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:35:02.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.132+0000 7f016ad9d640 10 monclient(hunting): get_auth_request con 0x7f016c0b2280 auth_method 0 2024-02-09T08:35:02.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.132+0000 7f016ad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:35:02.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.132+0000 7f016ad9d640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:35:02.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.132+0000 7f016ad9d640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:35:02.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.132+0000 7f016a59c640 10 monclient(hunting): get_auth_request con 0x7f016c06c320 auth_method 0 2024-02-09T08:35:02.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.132+0000 7f016a59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:35:02.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.132+0000 7f016a59c640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:35:02.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.132+0000 7f016a59c640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:35:02.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.133+0000 7f016a59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:35:02.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.133+0000 7f016a59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:35:02.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.133+0000 7f016a59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:35:02.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.133+0000 7f016ad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:35:02.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.133+0000 7f016ad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:35:02.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.133+0000 7f016ad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:35:02.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.134+0000 7f0169d9b640 1 --2- 172.21.15.62:0/1265983352 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f016c0a9be0 0x7f016c13b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:35:02.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.135+0000 7f016a59c640 10 monclient(hunting): handle_auth_done global_id 22378 payload 824 2024-02-09T08:35:02.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.135+0000 7f016a59c640 1 -- 172.21.15.62:0/1265983352 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f016c0a9be0 msgr2=0x7f016c13b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:02.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.135+0000 7f016a59c640 1 --2- 172.21.15.62:0/1265983352 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f016c0a9be0 0x7f016c13b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:02.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.135+0000 7f016a59c640 1 -- 172.21.15.62:0/1265983352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f016c0b2280 msgr2=0x7f016c132ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:02.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.135+0000 7f016a59c640 1 --2- 172.21.15.62:0/1265983352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f016c0b2280 0x7f016c132ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:02.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.135+0000 7f016a59c640 10 monclient: _finish_hunting 0 2024-02-09T08:35:02.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.135+0000 7f016a59c640 1 monclient: found mon.noname-b 2024-02-09T08:35:02.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.135+0000 7f016a59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:35:02.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.135+0000 7f016a59c640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.103:3300/0 2024-02-09T08:35:02.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.135+0000 7f016a59c640 1 -- 172.21.15.62:0/1265983352 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01600094d0 con 0x7f016c06c320 2024-02-09T08:35:02.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.137+0000 7f016a59c640 1 --2- 172.21.15.62:0/1265983352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f016c06c320 0x7f016c140ac0 secure :-1 s=READY pgs=5679 cs=0 l=1 rev1=1 crypto rx=0x7f015c00c410 tx=0x7f015c00c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:35:02.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.137+0000 7f015affd640 10 client.?.objecter ms_handle_connect 0x7f016c06c320 2024-02-09T08:35:02.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.137+0000 7f015affd640 10 client.?.objecter resend_mon_ops 2024-02-09T08:35:02.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.139+0000 7f015affd640 1 -- 172.21.15.62:0/1265983352 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f015c0035f0 con 0x7f016c06c320 2024-02-09T08:35:02.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.139+0000 7f015affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:35:02.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.139+0000 7f015affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:35:02.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.139+0000 7f015affd640 10 monclient: dump: 2024-02-09T08:35:02.143 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:35:02.143 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:35:02.143 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:02.143 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:02.143 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:35:02.143 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:02.143 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:35:02.143 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:35:02.143 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:35:02.143 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:02.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.139+0000 7f015affd640 10 monclient: _finish_auth 0 2024-02-09T08:35:02.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.139+0000 7f015affd640 10 monclient: _check_auth_tickets 2024-02-09T08:35:02.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.139+0000 7f015affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:35:02.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.139+0000 7f01708de640 5 monclient: authenticate success, global_id 22378 2024-02-09T08:35:02.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.139+0000 7f01708de640 10 monclient: _renew_subs 2024-02-09T08:35:02.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.139+0000 7f01708de640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:35:02.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.139+0000 7f01708de640 1 -- 172.21.15.62:0/1265983352 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0164009a70 con 0x7f016c06c320 2024-02-09T08:35:02.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.139+0000 7f01708de640 10 client.22378.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:35:02.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.139+0000 7f01708de640 10 monclient: _renew_subs 2024-02-09T08:35:02.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.139+0000 7f01708de640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:35:02.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.139+0000 7f01708de640 1 -- 172.21.15.62:0/1265983352 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f016c13bd10 con 0x7f016c06c320 2024-02-09T08:35:02.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.139+0000 7f01708de640 1 librados: init done 2024-02-09T08:35:02.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.140+0000 7f01708de640 10 client.22378.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:35:02.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.140+0000 7f01708de640 15 client.22378.objecter _session_command_op_assign -1 1 2024-02-09T08:35:02.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.140+0000 7f01708de640 20 client.22378.objecter _get_session osd=-1 returning homeless 2024-02-09T08:35:02.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.140+0000 7f01708de640 10 client.22378.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:35:02.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.140+0000 7f01708de640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:35:02.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.140+0000 7f01708de640 1 -- 172.21.15.62:0/1265983352 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f016c13ad10 con 0x7f016c06c320 2024-02-09T08:35:02.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.141+0000 7f015affd640 1 -- 172.21.15.62:0/1265983352 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f016c13ad10 con 0x7f016c06c320 2024-02-09T08:35:02.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.141+0000 7f015affd640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:35:02.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.141+0000 7f015affd640 1 -- 172.21.15.62:0/1265983352 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f015c007220 con 0x7f016c06c320 2024-02-09T08:35:02.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.141+0000 7f015affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:35:02.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.141+0000 7f015affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:35:02.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.141+0000 7f015affd640 10 monclient: dump: 2024-02-09T08:35:02.146 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:35:02.146 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:35:02.146 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:02.146 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:02.146 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:35:02.146 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:02.146 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:35:02.146 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:35:02.146 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:35:02.146 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:02.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.141+0000 7f0168d99640 4 set_mon_vals no callback set 2024-02-09T08:35:02.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.161+0000 7f015affd640 1 -- 172.21.15.62:0/1265983352 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f015c007380 con 0x7f016c06c320 2024-02-09T08:35:02.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.161+0000 7f015affd640 1 --2- 172.21.15.62:0/1265983352 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f014c06d1d0 0x7f014c06f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:02.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.162+0000 7f0169d9b640 1 --2- 172.21.15.62:0/1265983352 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f014c06d1d0 0x7f014c06f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:35:02.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.162+0000 7f0169d9b640 10 monclient: get_auth_request con 0x7f014c06d1d0 auth_method 0 2024-02-09T08:35:02.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.162+0000 7f015affd640 10 client.22378.objecter ms_handle_connect 0x7f014c06d1d0 2024-02-09T08:35:02.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.162+0000 7f0169d9b640 1 --2- 172.21.15.62:0/1265983352 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f014c06d1d0 0x7f014c06f690 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f016c142ea0 tx=0x7f0160008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:35:02.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.163+0000 7f015affd640 1 -- 172.21.15.62:0/1265983352 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(1270..1270 src has 1199..1270) v4 ==== 6381+0+0 (secure 0 0 0) 0x7f015c007630 con 0x7f016c06c320 2024-02-09T08:35:02.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.163+0000 7f015affd640 10 client.22378.objecter ms_dispatch 0x7f016c000b90 osd_map(1270..1270 src has 1199..1270) v4 2024-02-09T08:35:02.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.163+0000 7f015affd640 3 client.22378.objecter handle_osd_map got epochs [1270,1270] > 0 2024-02-09T08:35:02.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.163+0000 7f015affd640 3 client.22378.objecter handle_osd_map decoding full epoch 1270 2024-02-09T08:35:02.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.163+0000 7f015affd640 10 client.22378.objecter checking command 1 2024-02-09T08:35:02.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.163+0000 7f015affd640 1 --2- 172.21.15.62:0/1265983352 >> [v2:172.21.15.103:6812/1369132028,v1:172.21.15.103:6813/1369132028] conn(0x7f014c074f60 0x7f014c077400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:02.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.163+0000 7f015affd640 20 client.22378.objecter _get_session s=0x7f014c074890 osd=7 3 2024-02-09T08:35:02.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.163+0000 7f015affd640 20 client.22378.objecter put_session s=0x7f014c074890 osd=7 3 2024-02-09T08:35:02.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.163+0000 7f015affd640 15 client.22378.objecter _session_command_op_remove -1 1 2024-02-09T08:35:02.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.163+0000 7f015affd640 20 client.22378.objecter _get_session s=0x7f014c074890 osd=7 3 2024-02-09T08:35:02.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.163+0000 7f015affd640 20 client.22378.objecter get_session s=0x7f014c074890 osd=7 3 2024-02-09T08:35:02.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.163+0000 7f015affd640 15 client.22378.objecter _session_command_op_assign 7 1 2024-02-09T08:35:02.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.163+0000 7f015affd640 20 client.22378.objecter put_session s=0x7f014c074890 osd=7 4 2024-02-09T08:35:02.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.163+0000 7f015affd640 10 client.22378.objecter _send_command 1 2024-02-09T08:35:02.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.163+0000 7f015affd640 1 -- 172.21.15.62:0/1265983352 --> [v2:172.21.15.103:6812/1369132028,v1:172.21.15.103:6813/1369132028] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f014c077ad0 con 0x7f014c074f60 2024-02-09T08:35:02.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.163+0000 7f015affd640 20 client.22378.objecter dump_active .. 0 homeless 2024-02-09T08:35:02.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.163+0000 7f015affd640 1 -- 172.21.15.62:0/1265983352 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=1270) v2 ==== 24+0+0 (secure 0 0 0) 0x7f015c054880 con 0x7f016c06c320 2024-02-09T08:35:02.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.163+0000 7f015affd640 10 monclient: handle_get_version_reply finishing 1 version 1270 2024-02-09T08:35:02.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.164+0000 7f016ad9d640 1 --2- 172.21.15.62:0/1265983352 >> [v2:172.21.15.103:6812/1369132028,v1:172.21.15.103:6813/1369132028] conn(0x7f014c074f60 0x7f014c077400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:35:02.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.164+0000 7f016ad9d640 10 monclient: get_auth_request con 0x7f014c074f60 auth_method 0 2024-02-09T08:35:02.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.167+0000 7f016ad9d640 1 --2- 172.21.15.62:0/1265983352 >> [v2:172.21.15.103:6812/1369132028,v1:172.21.15.103:6813/1369132028] conn(0x7f014c074f60 0x7f014c077400 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:35:02.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.167+0000 7f015affd640 10 client.22378.objecter ms_handle_connect 0x7f014c074f60 2024-02-09T08:35:02.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.190+0000 7f015affd640 1 -- 172.21.15.62:0/1265983352 <== osd.7 v2:172.21.15.103:6812/1369132028 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f014c077ad0 con 0x7f014c074f60 2024-02-09T08:35:02.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.190+0000 7f015affd640 10 client.22378.objecter ms_dispatch 0x7f016c000b90 command_reply(tid 1: 0 ) v1 2024-02-09T08:35:02.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.190+0000 7f015affd640 10 client.22378.objecter _finish_command 1 = system:0 2024-02-09T08:35:02.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.190+0000 7f015affd640 20 client.22378.objecter put_session s=0x7f014c074890 osd=7 4 2024-02-09T08:35:02.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.190+0000 7f015affd640 15 client.22378.objecter _session_command_op_remove 7 1 2024-02-09T08:35:02.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.204+0000 7f01708de640 10 client.22378.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2024-02-09T08:35:02.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.204+0000 7f01708de640 15 client.22378.objecter _session_command_op_assign -1 2 2024-02-09T08:35:02.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.204+0000 7f01708de640 20 client.22378.objecter _get_session s=0x7f014c074890 osd=7 3 2024-02-09T08:35:02.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.204+0000 7f01708de640 20 client.22378.objecter put_session s=0x7f014c074890 osd=7 3 2024-02-09T08:35:02.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.204+0000 7f01708de640 20 client.22378.objecter _get_session s=0x7f014c074890 osd=7 3 2024-02-09T08:35:02.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.204+0000 7f01708de640 15 client.22378.objecter _session_command_op_remove -1 2 2024-02-09T08:35:02.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.204+0000 7f01708de640 20 client.22378.objecter get_session s=0x7f014c074890 osd=7 3 2024-02-09T08:35:02.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.204+0000 7f01708de640 15 client.22378.objecter _session_command_op_assign 7 2 2024-02-09T08:35:02.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.204+0000 7f01708de640 20 client.22378.objecter put_session s=0x7f014c074890 osd=7 4 2024-02-09T08:35:02.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.204+0000 7f01708de640 10 client.22378.objecter _send_command 2 2024-02-09T08:35:02.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.204+0000 7f01708de640 1 -- 172.21.15.62:0/1265983352 --> [v2:172.21.15.103:6812/1369132028,v1:172.21.15.103:6813/1369132028] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f016c04ef90 con 0x7f014c074f60 2024-02-09T08:35:02.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.218+0000 7f015affd640 1 -- 172.21.15.62:0/1265983352 <== osd.7 v2:172.21.15.103:6812/1369132028 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f016c04ef90 con 0x7f014c074f60 2024-02-09T08:35:02.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.218+0000 7f015affd640 10 client.22378.objecter ms_dispatch 0x7f016c000b90 command_reply(tid 2: 0 ) v1 2024-02-09T08:35:02.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.218+0000 7f015affd640 10 client.22378.objecter _finish_command 2 = system:0 2024-02-09T08:35:02.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.218+0000 7f015affd640 20 client.22378.objecter put_session s=0x7f014c074890 osd=7 4 2024-02-09T08:35:02.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.218+0000 7f015affd640 15 client.22378.objecter _session_command_op_remove 7 2 2024-02-09T08:35:02.221 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-02-09T08:35:02.221 INFO:teuthology.orchestra.run.smithi062.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-09T08:35:02.221 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-02-09T08:35:02.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.219+0000 7f01708de640 10 librados: watch_flush enter 2024-02-09T08:35:02.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.219+0000 7f01708de640 10 librados: watch_flush exit 2024-02-09T08:35:02.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.219+0000 7f01708de640 10 client.22378.objecter close_session for osd.7 2024-02-09T08:35:02.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.219+0000 7f01708de640 1 -- 172.21.15.62:0/1265983352 >> [v2:172.21.15.103:6812/1369132028,v1:172.21.15.103:6813/1369132028] conn(0x7f014c074f60 msgr2=0x7f014c077400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:02.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.219+0000 7f01708de640 1 --2- 172.21.15.62:0/1265983352 >> [v2:172.21.15.103:6812/1369132028,v1:172.21.15.103:6813/1369132028] conn(0x7f014c074f60 0x7f014c077400 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:02.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.219+0000 7f01708de640 20 client.22378.objecter put_session s=0x7f014c074890 osd=7 1 2024-02-09T08:35:02.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.219+0000 7f01708de640 20 client.22378.objecter shutdown clearing up homeless session... 2024-02-09T08:35:02.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.219+0000 7f01708de640 10 client.22378.objecter successfully canceled tick 2024-02-09T08:35:02.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.219+0000 7f01708de640 1 -- 172.21.15.62:0/1265983352 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f014c06d1d0 msgr2=0x7f014c06f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:02.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.219+0000 7f01708de640 1 --2- 172.21.15.62:0/1265983352 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f014c06d1d0 0x7f014c06f690 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f016c142ea0 tx=0x7f0160008040 comp rx=0 tx=0).stop 2024-02-09T08:35:02.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.219+0000 7f01708de640 10 monclient: shutdown 2024-02-09T08:35:02.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.219+0000 7f01708de640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:35:02.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.219+0000 7f01708de640 1 -- 172.21.15.62:0/1265983352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f016c06c320 msgr2=0x7f016c140ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:02.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.219+0000 7f01708de640 1 --2- 172.21.15.62:0/1265983352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f016c06c320 0x7f016c140ac0 secure :-1 s=READY pgs=5679 cs=0 l=1 rev1=1 crypto rx=0x7f015c00c410 tx=0x7f015c00c810 comp rx=0 tx=0).stop 2024-02-09T08:35:02.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.219+0000 7f016ad9d640 1 -- 172.21.15.62:0/1265983352 reap_dead start 2024-02-09T08:35:02.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.219+0000 7f01708de640 1 -- 172.21.15.62:0/1265983352 shutdown_connections 2024-02-09T08:35:02.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.219+0000 7f01708de640 1 -- 172.21.15.62:0/1265983352 >> 172.21.15.62:0/1265983352 conn(0x7f016c0b4db0 msgr2=0x7f016c0b8570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:35:02.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.219+0000 7f01708de640 1 -- 172.21.15.62:0/1265983352 shutdown_connections 2024-02-09T08:35:02.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.219+0000 7f01708de640 1 -- 172.21.15.62:0/1265983352 wait complete. 2024-02-09T08:35:02.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.219+0000 7f01708de640 1 librados: shutdown 2024-02-09T08:35:02.232 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-02-09T08:35:02.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.335+0000 7fe201d52640 10 monclient: get_monmap_and_config 2024-02-09T08:35:02.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.335+0000 7fe201d52640 10 monclient: build_initial_monmap 2024-02-09T08:35:02.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.335+0000 7fe201d52640 10 monclient: monmap: 2024-02-09T08:35:02.338 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:35:02.338 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:35:02.338 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:35:02.336329+0000 2024-02-09T08:35:02.338 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:35:02.336329+0000 2024-02-09T08:35:02.338 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:35:02.338 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:02.338 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:35:02.338 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:35:02.338 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:35:02.338 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:35:02.338 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:35:02.338 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:02.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.336+0000 7fe201d52640 1 Processor -- start 2024-02-09T08:35:02.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.336+0000 7fe201d52640 1 -- start start 2024-02-09T08:35:02.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.336+0000 7fe201d52640 10 monclient: init 2024-02-09T08:35:02.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.336+0000 7fe201d52640 10 monclient: _reopen_session rank -1 2024-02-09T08:35:02.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.336+0000 7fe201d52640 10 monclient: _add_conns ranks=[4,3,0,2,1] 2024-02-09T08:35:02.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.336+0000 7fe201d52640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe1fc067110 0x7fe1fc0a9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:02.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.336+0000 7fe201d52640 10 monclient(hunting): picked mon.noname-c con 0x7fe1fc067110 addr v2:172.21.15.103:3300/0 2024-02-09T08:35:02.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.336+0000 7fe201d52640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe1fc13f830 0x7fe1fc13fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:02.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.336+0000 7fe201d52640 10 monclient(hunting): picked mon.noname-a con 0x7fe1fc13f830 addr v2:172.21.15.62:3300/0 2024-02-09T08:35:02.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.336+0000 7fe201d52640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe1fc1424c0 addr v1:172.21.15.62:6789/0 2024-02-09T08:35:02.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.336+0000 7fe201d52640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1fc0aa090 con 0x7fe1fc1424c0 2024-02-09T08:35:02.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.336+0000 7fe201d52640 10 monclient(hunting): start opening mon connection 2024-02-09T08:35:02.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.336+0000 7fe201d52640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1fc0674f0 con 0x7fe1fc13f830 2024-02-09T08:35:02.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.336+0000 7fe201d52640 10 monclient(hunting): start opening mon connection 2024-02-09T08:35:02.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.336+0000 7fe201d52640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1fc143020 con 0x7fe1fc067110 2024-02-09T08:35:02.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.336+0000 7fe201d52640 10 monclient(hunting): _renew_subs 2024-02-09T08:35:02.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.336+0000 7fe201d52640 10 monclient(hunting): authenticate will time out at 3345.696906s 2024-02-09T08:35:02.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.337+0000 7fe1fb7fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe1fc067110 0x7fe1fc0a9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:35:02.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.337+0000 7fe1faffd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe1fc13f830 0x7fe1fc13fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:35:02.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.337+0000 7fe1fb7fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe1fc067110 0x7fe1fc0a9930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.62:41344/0 (socket says 172.21.15.62:41344) 2024-02-09T08:35:02.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.337+0000 7fe1fb7fe640 1 -- 172.21.15.62:0/1636098255 learned_addr learned my addr 172.21.15.62:0/1636098255 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:35:02.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.337+0000 7fe1fb7fe640 10 monclient(hunting): get_auth_request con 0x7fe1fc067110 auth_method 0 2024-02-09T08:35:02.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.337+0000 7fe1fb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:35:02.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.337+0000 7fe1fb7fe640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:35:02.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.337+0000 7fe1fb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:35:02.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.337+0000 7fe1faffd640 10 monclient(hunting): get_auth_request con 0x7fe1fc13f830 auth_method 0 2024-02-09T08:35:02.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.337+0000 7fe1faffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:35:02.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.337+0000 7fe1faffd640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:35:02.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.337+0000 7fe1faffd640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:35:02.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.338+0000 7fe1fb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:35:02.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.338+0000 7fe1fb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:35:02.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.338+0000 7fe1fb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:35:02.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.338+0000 7fe1faffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:35:02.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.338+0000 7fe1faffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:35:02.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.338+0000 7fe1faffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:35:02.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.339+0000 7fe1fb7fe640 10 monclient(hunting): handle_auth_done global_id 22381 payload 274 2024-02-09T08:35:02.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.339+0000 7fe1fb7fe640 1 -- 172.21.15.62:0/1636098255 >> v2:172.21.15.62:3300/0 conn(0x7fe1fc13f830 msgr2=0x7fe1fc13fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:35:02.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.339+0000 7fe1fb7fe640 1 --2- 172.21.15.62:0/1636098255 >> v2:172.21.15.62:3300/0 conn(0x7fe1fc13f830 0x7fe1fc13fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:02.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.339+0000 7fe1fb7fe640 1 -- 172.21.15.62:0/1636098255 >> v1:172.21.15.62:6789/0 conn(0x7fe1fc1424c0 legacy=0x7fe1fc142910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:02.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.339+0000 7fe1fb7fe640 10 monclient: _finish_hunting 0 2024-02-09T08:35:02.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.339+0000 7fe1fb7fe640 1 monclient: found mon.noname-c 2024-02-09T08:35:02.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.339+0000 7fe1fb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:35:02.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.339+0000 7fe1fb7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.103:3300/0 2024-02-09T08:35:02.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.339+0000 7fe1fb7fe640 1 -- 172.21.15.62:0/1636098255 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1fc0ab5b0 con 0x7fe1fc067110 2024-02-09T08:35:02.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.341+0000 7fe1fb7fe640 1 --2- 172.21.15.62:0/1636098255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1fc067110 0x7fe1fc0a9930 secure :-1 s=READY pgs=5680 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc0b8f10 tx=0x7fe1ec02b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7fc3e0522a935f2 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:35:02.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.344+0000 7fe1fa7fc640 1 -- 172.21.15.62:0/1636098255 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec031870 con 0x7fe1fc067110 2024-02-09T08:35:02.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.344+0000 7fe1fa7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:35:02.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.344+0000 7fe1fa7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-09T08:35:02.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.344+0000 7fe1fa7fc640 10 monclient: dump: 2024-02-09T08:35:02.349 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:35:02.349 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:35:02.349 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:02.349 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:02.349 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:35:02.349 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:02.349 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:35:02.349 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:35:02.349 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:35:02.349 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:02.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.344+0000 7fe1fa7fc640 10 monclient: _finish_auth 0 2024-02-09T08:35:02.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.344+0000 7fe1fa7fc640 10 monclient: _check_auth_tickets 2024-02-09T08:35:02.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.344+0000 7fe1fa7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:35:02.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.344+0000 7fe201d52640 5 monclient: authenticate success, global_id 22381 2024-02-09T08:35:02.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.344+0000 7fe1fa7fc640 1 -- 172.21.15.62:0/1636098255 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1ec0319d0 con 0x7fe1fc067110 2024-02-09T08:35:02.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.344+0000 7fe201d52640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-02-09T08:35:02.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.344+0000 7fe1fa7fc640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:35:02.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.344+0000 7fe201d52640 10 monclient: get_monmap_and_config success 2024-02-09T08:35:02.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.344+0000 7fe201d52640 4 set_mon_vals no callback set 2024-02-09T08:35:02.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.344+0000 7fe1fa7fc640 1 -- 172.21.15.62:0/1636098255 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec031d60 con 0x7fe1fc067110 2024-02-09T08:35:02.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.344+0000 7fe1fa7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:35:02.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.344+0000 7fe1fa7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:35:02.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.344+0000 7fe1fa7fc640 10 monclient: dump: 2024-02-09T08:35:02.350 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:35:02.350 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:35:02.350 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:02.350 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:02.350 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:35:02.350 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:02.350 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:35:02.351 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:35:02.351 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:35:02.351 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:02.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.345+0000 7fe201d52640 10 monclient: shutdown 2024-02-09T08:35:02.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.345+0000 7fe201d52640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:35:02.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.345+0000 7fe201d52640 1 -- 172.21.15.62:0/1636098255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1fc067110 msgr2=0x7fe1fc0a9930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:02.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.345+0000 7fe201d52640 1 --2- 172.21.15.62:0/1636098255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1fc067110 0x7fe1fc0a9930 secure :-1 s=READY pgs=5680 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc0b8f10 tx=0x7fe1ec02b910 comp rx=0 tx=0).stop 2024-02-09T08:35:02.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.345+0000 7fe201d52640 1 -- 172.21.15.62:0/1636098255 shutdown_connections 2024-02-09T08:35:02.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.345+0000 7fe201d52640 1 --2- 172.21.15.62:0/1636098255 >> v2:172.21.15.62:3300/0 conn(0x7fe1fc13f830 0x7fe1fc13fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:02.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.345+0000 7fe201d52640 1 --2- 172.21.15.62:0/1636098255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1fc067110 0x7fe1fc0a9930 unknown :-1 s=CLOSED pgs=5680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:02.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.345+0000 7fe201d52640 1 -- 172.21.15.62:0/1636098255 >> 172.21.15.62:0/1636098255 conn(0x7fe1fc0b4e20 msgr2=0x7fe1fc0b5230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:35:02.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.345+0000 7fe201d52640 1 -- 172.21.15.62:0/1636098255 shutdown_connections 2024-02-09T08:35:02.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.345+0000 7fe201d52640 1 -- 172.21.15.62:0/1636098255 wait complete. 2024-02-09T08:35:02.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.346+0000 7fe201d52640 10 monclient: build_initial_monmap 2024-02-09T08:35:02.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.346+0000 7fe201d52640 10 monclient: monmap: 2024-02-09T08:35:02.352 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:35:02.352 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:35:02.352 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:35:02.352 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:35:02.352 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:35:02.352 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:02.352 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:35:02.352 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:35:02.352 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:35:02.352 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:02.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.346+0000 7fe201d52640 1 librados: starting msgr at 2024-02-09T08:35:02.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.346+0000 7fe201d52640 1 librados: starting objecter 2024-02-09T08:35:02.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.346+0000 7fe201d52640 1 Processor -- start 2024-02-09T08:35:02.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.346+0000 7fe201d52640 1 -- start start 2024-02-09T08:35:02.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.346+0000 7fe201d52640 1 librados: setting wanted keys 2024-02-09T08:35:02.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.346+0000 7fe201d52640 1 librados: calling monclient init 2024-02-09T08:35:02.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.346+0000 7fe201d52640 10 monclient: init 2024-02-09T08:35:02.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.347+0000 7fe201d52640 10 monclient: _reopen_session rank -1 2024-02-09T08:35:02.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.347+0000 7fe201d52640 10 monclient: _add_conns ranks=[1,2,0] 2024-02-09T08:35:02.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.347+0000 7fe201d52640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1fc067110 0x7fe1fc13a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:02.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.347+0000 7fe201d52640 10 monclient(hunting): picked mon.noname-b con 0x7fe1fc067110 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:35:02.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.347+0000 7fe201d52640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1fc13f830 0x7fe1fc136b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:02.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.347+0000 7fe201d52640 10 monclient(hunting): picked mon.noname-c con 0x7fe1fc13f830 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:35:02.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.347+0000 7fe201d52640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1fc1424c0 0x7fe1fc1340e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:02.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.347+0000 7fe201d52640 10 monclient(hunting): picked mon.noname-a con 0x7fe1fc1424c0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:35:02.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.347+0000 7fe201d52640 10 monclient(hunting): start opening mon connection 2024-02-09T08:35:02.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.347+0000 7fe201d52640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1fc137250 con 0x7fe1fc1424c0 2024-02-09T08:35:02.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.347+0000 7fe201d52640 10 monclient(hunting): start opening mon connection 2024-02-09T08:35:02.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.347+0000 7fe201d52640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1fc1376e0 con 0x7fe1fc067110 2024-02-09T08:35:02.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.347+0000 7fe201d52640 10 monclient(hunting): start opening mon connection 2024-02-09T08:35:02.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.347+0000 7fe201d52640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1fc0ac4a0 con 0x7fe1fc13f830 2024-02-09T08:35:02.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.347+0000 7fe201d52640 10 monclient(hunting): _renew_subs 2024-02-09T08:35:02.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.347+0000 7fe201d52640 10 monclient(hunting): authenticate will time out at 3345.707613s 2024-02-09T08:35:02.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.347+0000 7fe1fbfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1fc1424c0 0x7fe1fc1340e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:35:02.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.347+0000 7fe1fb7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1fc067110 0x7fe1fc13a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:35:02.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.347+0000 7fe1faffd640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1fc13f830 0x7fe1fc136b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:35:02.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.348+0000 7fe1fb7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1fc067110 0x7fe1fc13a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.62:41352/0 (socket says 172.21.15.62:41352) 2024-02-09T08:35:02.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.348+0000 7fe1fb7fe640 1 -- 172.21.15.62:0/2912849639 learned_addr learned my addr 172.21.15.62:0/2912849639 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:35:02.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.348+0000 7fe1fb7fe640 10 monclient(hunting): get_auth_request con 0x7fe1fc067110 auth_method 0 2024-02-09T08:35:02.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.348+0000 7fe1fb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:35:02.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.348+0000 7fe1fb7fe640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:35:02.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.348+0000 7fe1fb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:35:02.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.348+0000 7fe1fbfff640 10 monclient(hunting): get_auth_request con 0x7fe1fc1424c0 auth_method 0 2024-02-09T08:35:02.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.348+0000 7fe1fbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:35:02.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.348+0000 7fe1fbfff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:35:02.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.348+0000 7fe1fbfff640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:35:02.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.348+0000 7fe1faffd640 10 monclient(hunting): get_auth_request con 0x7fe1fc13f830 auth_method 0 2024-02-09T08:35:02.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.348+0000 7fe1faffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:35:02.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.348+0000 7fe1faffd640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:35:02.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.348+0000 7fe1faffd640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:35:02.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.348+0000 7fe1fb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:35:02.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.348+0000 7fe1fb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:35:02.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.348+0000 7fe1fb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:35:02.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.348+0000 7fe1fbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:35:02.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.348+0000 7fe1fbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:35:02.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.348+0000 7fe1fbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:35:02.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.348+0000 7fe1faffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:35:02.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.348+0000 7fe1faffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:35:02.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.348+0000 7fe1faffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:35:02.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.351+0000 7fe1fb7fe640 10 monclient(hunting): handle_auth_done global_id 22384 payload 824 2024-02-09T08:35:02.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.351+0000 7fe1fb7fe640 1 -- 172.21.15.62:0/2912849639 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1fc13f830 msgr2=0x7fe1fc136b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:02.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.351+0000 7fe1fb7fe640 1 --2- 172.21.15.62:0/2912849639 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1fc13f830 0x7fe1fc136b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:02.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.351+0000 7fe1fb7fe640 1 -- 172.21.15.62:0/2912849639 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1fc1424c0 msgr2=0x7fe1fc1340e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:02.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.351+0000 7fe1fb7fe640 1 --2- 172.21.15.62:0/2912849639 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1fc1424c0 0x7fe1fc1340e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:02.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.351+0000 7fe1fb7fe640 10 monclient: _finish_hunting 0 2024-02-09T08:35:02.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.351+0000 7fe1fb7fe640 1 monclient: found mon.noname-b 2024-02-09T08:35:02.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.351+0000 7fe1fb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:35:02.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.351+0000 7fe1fb7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.103:3300/0 2024-02-09T08:35:02.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.351+0000 7fe1fb7fe640 1 -- 172.21.15.62:0/2912849639 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ec0094d0 con 0x7fe1fc067110 2024-02-09T08:35:02.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.353+0000 7fe1fb7fe640 1 --2- 172.21.15.62:0/2912849639 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1fc067110 0x7fe1fc13a670 secure :-1 s=READY pgs=5681 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec02b950 tx=0x7fe1ec0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:35:02.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.353+0000 7fe1e3fff640 10 client.?.objecter ms_handle_connect 0x7fe1fc067110 2024-02-09T08:35:02.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.353+0000 7fe1e3fff640 10 client.?.objecter resend_mon_ops 2024-02-09T08:35:02.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.355+0000 7fe1e3fff640 1 -- 172.21.15.62:0/2912849639 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec03abe0 con 0x7fe1fc067110 2024-02-09T08:35:02.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.355+0000 7fe1e3fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:35:02.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.355+0000 7fe1e3fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:35:02.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.355+0000 7fe1e3fff640 10 monclient: dump: 2024-02-09T08:35:02.360 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:35:02.360 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:35:02.360 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:02.361 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:02.361 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:35:02.361 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:02.361 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:35:02.361 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:35:02.361 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:35:02.361 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:02.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.355+0000 7fe1e3fff640 10 monclient: _finish_auth 0 2024-02-09T08:35:02.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.355+0000 7fe1e3fff640 10 monclient: _check_auth_tickets 2024-02-09T08:35:02.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.355+0000 7fe1e3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:35:02.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.355+0000 7fe201d52640 5 monclient: authenticate success, global_id 22384 2024-02-09T08:35:02.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.355+0000 7fe201d52640 10 monclient: _renew_subs 2024-02-09T08:35:02.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.355+0000 7fe201d52640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:35:02.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.355+0000 7fe201d52640 1 -- 172.21.15.62:0/2912849639 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1fc136220 con 0x7fe1fc067110 2024-02-09T08:35:02.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.355+0000 7fe201d52640 10 client.22384.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:35:02.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.355+0000 7fe201d52640 10 monclient: _renew_subs 2024-02-09T08:35:02.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.355+0000 7fe201d52640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:35:02.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.355+0000 7fe201d52640 1 -- 172.21.15.62:0/2912849639 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1fc134800 con 0x7fe1fc067110 2024-02-09T08:35:02.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.355+0000 7fe201d52640 1 librados: init done 2024-02-09T08:35:02.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.356+0000 7fe201d52640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:35:02.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.356+0000 7fe201d52640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:35:02.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.356+0000 7fe201d52640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:35:02.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.356+0000 7fe201d52640 1 -- 172.21.15.62:0/2912849639 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1fc134aa0 con 0x7fe1fc067110 2024-02-09T08:35:02.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.620+0000 7fe1e3fff640 1 -- 172.21.15.62:0/2912849639 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1ec03ad40 con 0x7fe1fc067110 2024-02-09T08:35:02.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.620+0000 7fe1e3fff640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:35:02.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.620+0000 7fe1e3fff640 1 -- 172.21.15.62:0/2912849639 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec04d650 con 0x7fe1fc067110 2024-02-09T08:35:02.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.620+0000 7fe1e3fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:35:02.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.620+0000 7fe1e3fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:35:02.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.620+0000 7fe1e3fff640 10 monclient: dump: 2024-02-09T08:35:02.623 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:35:02.623 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:35:02.624 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:02.624 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:02.624 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:35:02.624 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:02.624 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:35:02.624 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:35:02.624 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:35:02.624 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:02.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.620+0000 7fe1f9ffb640 4 set_mon_vals no callback set 2024-02-09T08:35:02.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.621+0000 7fe1e3fff640 1 -- 172.21.15.62:0/2912849639 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fe1ec04d870 con 0x7fe1fc067110 2024-02-09T08:35:02.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.621+0000 7fe1e3fff640 1 --2- 172.21.15.62:0/2912849639 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fe1e806d1d0 0x7fe1e806f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:02.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.622+0000 7fe1faffd640 1 --2- 172.21.15.62:0/2912849639 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fe1e806d1d0 0x7fe1e806f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:35:02.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.622+0000 7fe1faffd640 10 monclient: get_auth_request con 0x7fe1e806d1d0 auth_method 0 2024-02-09T08:35:02.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.622+0000 7fe1faffd640 1 --2- 172.21.15.62:0/2912849639 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fe1e806d1d0 0x7fe1e806f690 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc0b58e0 tx=0x7fe1f0009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:35:02.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.622+0000 7fe1e3fff640 10 client.22384.objecter ms_handle_connect 0x7fe1e806d1d0 2024-02-09T08:35:02.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.623+0000 7fe1e3fff640 1 -- 172.21.15.62:0/2912849639 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(1270..1270 src has 1199..1270) v4 ==== 6381+0+0 (secure 0 0 0) 0x7fe1ec02d040 con 0x7fe1fc067110 2024-02-09T08:35:02.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.623+0000 7fe1e3fff640 10 client.22384.objecter ms_dispatch 0x7fe1fc000b90 osd_map(1270..1270 src has 1199..1270) v4 2024-02-09T08:35:02.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.623+0000 7fe1e3fff640 3 client.22384.objecter handle_osd_map got epochs [1270,1270] > 0 2024-02-09T08:35:02.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.623+0000 7fe1e3fff640 3 client.22384.objecter handle_osd_map decoding full epoch 1270 2024-02-09T08:35:02.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.623+0000 7fe1e3fff640 20 client.22384.objecter dump_active .. 0 homeless 2024-02-09T08:35:02.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.633+0000 7fe1e3fff640 1 -- 172.21.15.62:0/2912849639 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe1ec0774c0 con 0x7fe1fc067110 2024-02-09T08:35:02.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.633+0000 7fe1e3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:35:02.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.633+0000 7fe1e3fff640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:35:02.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.818+0000 7fe201d52640 1 -- 172.21.15.62:0/2912849639 --> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fe1fc1428f0 con 0x7fe1e806d1d0 2024-02-09T08:35:02.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.819+0000 7fe1e3fff640 1 -- 172.21.15.62:0/2912849639 <== mgr.4109 v2:172.21.15.103:6800/2270392189 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe1fc1428f0 con 0x7fe1e806d1d0 2024-02-09T08:35:02.821 INFO:teuthology.orchestra.run.smithi062.stderr:instructed osd(s) 7 to deep-scrub 2024-02-09T08:35:02.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.821+0000 7fe201d52640 10 librados: watch_flush enter 2024-02-09T08:35:02.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.821+0000 7fe201d52640 10 librados: watch_flush exit 2024-02-09T08:35:02.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.821+0000 7fe201d52640 20 client.22384.objecter shutdown clearing up homeless session... 2024-02-09T08:35:02.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.821+0000 7fe201d52640 10 client.22384.objecter successfully canceled tick 2024-02-09T08:35:02.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.821+0000 7fe201d52640 1 -- 172.21.15.62:0/2912849639 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fe1e806d1d0 msgr2=0x7fe1e806f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:02.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.821+0000 7fe201d52640 1 --2- 172.21.15.62:0/2912849639 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fe1e806d1d0 0x7fe1e806f690 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc0b58e0 tx=0x7fe1f0009190 comp rx=0 tx=0).stop 2024-02-09T08:35:02.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.821+0000 7fe201d52640 10 monclient: shutdown 2024-02-09T08:35:02.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.821+0000 7fe201d52640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:35:02.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.821+0000 7fe201d52640 1 -- 172.21.15.62:0/2912849639 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1fc067110 msgr2=0x7fe1fc13a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:02.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.821+0000 7fe201d52640 1 --2- 172.21.15.62:0/2912849639 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1fc067110 0x7fe1fc13a670 secure :-1 s=READY pgs=5681 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec02b950 tx=0x7fe1ec0046c0 comp rx=0 tx=0).stop 2024-02-09T08:35:02.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.821+0000 7fe201d52640 1 -- 172.21.15.62:0/2912849639 shutdown_connections 2024-02-09T08:35:02.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.821+0000 7fe201d52640 1 --2- 172.21.15.62:0/2912849639 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fe1e806d1d0 0x7fe1e806f690 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:02.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.821+0000 7fe201d52640 1 --2- 172.21.15.62:0/2912849639 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1fc1424c0 0x7fe1fc1340e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:02.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.821+0000 7fe201d52640 1 --2- 172.21.15.62:0/2912849639 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1fc13f830 0x7fe1fc136b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:02.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.821+0000 7fe201d52640 1 --2- 172.21.15.62:0/2912849639 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1fc067110 0x7fe1fc13a670 unknown :-1 s=CLOSED pgs=5681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:02.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.821+0000 7fe201d52640 1 -- 172.21.15.62:0/2912849639 >> 172.21.15.62:0/2912849639 conn(0x7fe1fc0b4e20 msgr2=0x7fe1fc0b3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:35:02.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.821+0000 7fe201d52640 1 -- 172.21.15.62:0/2912849639 shutdown_connections 2024-02-09T08:35:02.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.821+0000 7fe201d52640 1 -- 172.21.15.62:0/2912849639 wait complete. 2024-02-09T08:35:02.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.821+0000 7fe201d52640 1 librados: shutdown 2024-02-09T08:35:02.835 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-09T08:35:02.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.950+0000 7fb6004de640 10 monclient: get_monmap_and_config 2024-02-09T08:35:02.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.950+0000 7fb6004de640 10 monclient: build_initial_monmap 2024-02-09T08:35:02.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.950+0000 7fb6004de640 10 monclient: monmap: 2024-02-09T08:35:02.953 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:35:02.953 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:35:02.953 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:35:02.951654+0000 2024-02-09T08:35:02.953 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:35:02.951654+0000 2024-02-09T08:35:02.953 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:35:02.953 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:02.953 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:35:02.953 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:35:02.953 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:35:02.953 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:35:02.954 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:35:02.954 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:02.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.951+0000 7fb6004de640 1 Processor -- start 2024-02-09T08:35:02.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.951+0000 7fb6004de640 1 -- start start 2024-02-09T08:35:02.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.951+0000 7fb6004de640 10 monclient: init 2024-02-09T08:35:02.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.952+0000 7fb6004de640 10 monclient: _reopen_session rank -1 2024-02-09T08:35:02.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.952+0000 7fb6004de640 10 monclient: _add_conns ranks=[0,1,4,2,3] 2024-02-09T08:35:02.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.952+0000 7fb6004de640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb5f8067110 addr v1:172.21.15.62:6789/0 2024-02-09T08:35:02.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.952+0000 7fb6004de640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb5f80a9930 addr v1:172.21.15.103:6789/0 2024-02-09T08:35:02.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.952+0000 7fb6004de640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb5f8142bd0 0x7fb5f814ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:02.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.952+0000 7fb6004de640 10 monclient(hunting): picked mon.noname-c con 0x7fb5f8142bd0 addr v2:172.21.15.103:3300/0 2024-02-09T08:35:02.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.952+0000 7fb6004de640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5f80aa090 con 0x7fb5f8067110 2024-02-09T08:35:02.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.952+0000 7fb6004de640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5f8143020 con 0x7fb5f80a9930 2024-02-09T08:35:02.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.952+0000 7fb6004de640 10 monclient(hunting): start opening mon connection 2024-02-09T08:35:02.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.952+0000 7fb6004de640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5f80674f0 con 0x7fb5f8142bd0 2024-02-09T08:35:02.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.952+0000 7fb6004de640 10 monclient(hunting): _renew_subs 2024-02-09T08:35:02.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.952+0000 7fb6004de640 10 monclient(hunting): authenticate will time out at 3346.312343s 2024-02-09T08:35:02.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.952+0000 7fb5fe27a640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb5f8067110 0x7fb5f813f830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:59596/0 (socket says 172.21.15.62:59596) 2024-02-09T08:35:02.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.952+0000 7fb5fe27a640 1 -- 172.21.15.62:0/2085461014 learned_addr learned my addr 172.21.15.62:0/2085461014 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-09T08:35:02.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.956+0000 7fb5fd278640 1 -- 172.21.15.62:0/2085461014 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1617017492 0 0) 0x7fb5f80aa090 con 0x7fb5f8067110 2024-02-09T08:35:02.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.956+0000 7fb5fd278640 10 monclient(hunting): _negotiate 2024-02-09T08:35:02.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.956+0000 7fb5fd278640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:35:02.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.956+0000 7fb5fd278640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:35:02.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.956+0000 7fb5fd278640 10 monclient(hunting): my global_id is 16257 2024-02-09T08:35:02.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.956+0000 7fb5fd278640 1 -- 172.21.15.62:0/2085461014 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5e4003520 con 0x7fb5f8067110 2024-02-09T08:35:02.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.960+0000 7fb5fd278640 1 -- 172.21.15.62:0/2085461014 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3356941864 0 0) 0x7fb5e4003520 con 0x7fb5f8067110 2024-02-09T08:35:02.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.960+0000 7fb5fd278640 1 -- 172.21.15.62:0/2085461014 >> v2:172.21.15.103:3300/0 conn(0x7fb5f8142bd0 msgr2=0x7fb5f814ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:35:02.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.960+0000 7fb5fd278640 1 --2- 172.21.15.62:0/2085461014 >> v2:172.21.15.103:3300/0 conn(0x7fb5f8142bd0 0x7fb5f814ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:02.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.960+0000 7fb5fd278640 1 -- 172.21.15.62:0/2085461014 >> v1:172.21.15.103:6789/0 conn(0x7fb5f80a9930 legacy=0x7fb5f81424c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:35:02.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.960+0000 7fb5fd278640 10 monclient: _finish_hunting 0 2024-02-09T08:35:02.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.960+0000 7fb5fd278640 1 monclient: found mon.noname-a-legacy 2024-02-09T08:35:02.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.960+0000 7fb5fd278640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:35:02.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.960+0000 7fb5fd278640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:172.21.15.62:6789/0 2024-02-09T08:35:02.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.960+0000 7fb5fd278640 1 -- 172.21.15.62:0/2085461014 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f80a9d70 con 0x7fb5f8067110 2024-02-09T08:35:02.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.960+0000 7fb5fd278640 10 monclient: _finish_auth 0 2024-02-09T08:35:02.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.960+0000 7fb5fd278640 10 monclient: _check_auth_tickets 2024-02-09T08:35:02.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.960+0000 7fb5fd278640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:35:02.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.960+0000 7fb5fd278640 1 -- 172.21.15.62:0/2085461014 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1140318843 0 0) 0x7fb5f4001670 con 0x7fb5f8067110 2024-02-09T08:35:02.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.960+0000 7fb5fd278640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:35:02.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.960+0000 7fb5fd278640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2024-02-09T08:35:02.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.960+0000 7fb5fd278640 10 monclient: dump: 2024-02-09T08:35:02.965 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:35:02.965 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:35:02.965 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:02.965 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:02.965 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:35:02.965 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:02.965 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:35:02.965 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:35:02.965 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:35:02.965 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:02.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.960+0000 7fb5fd278640 1 monclient: mon.a has (v2) addrs [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] but i'm connected to v1:172.21.15.62:6789/0, reconnecting 2024-02-09T08:35:02.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.960+0000 7fb5fd278640 10 monclient: _reopen_session rank -1 2024-02-09T08:35:02.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.960+0000 7fb5fd278640 1 -- 172.21.15.62:0/2085461014 >> v1:172.21.15.62:6789/0 conn(0x7fb5f8067110 legacy=0x7fb5f813f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:02.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.960+0000 7fb5fd278640 10 monclient: _add_conns ranks=[1,0,2] 2024-02-09T08:35:02.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.960+0000 7fb5fd278640 1 --2- 172.21.15.62:0/2085461014 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5e4003a30 0x7fb5e4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:02.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.960+0000 7fb5fd278640 10 monclient(hunting): picked mon.b con 0x7fb5e4003a30 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:35:02.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.960+0000 7fb5fd278640 1 --2- 172.21.15.62:0/2085461014 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5e40047c0 0x7fb5e4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:02.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.960+0000 7fb5fd278640 10 monclient(hunting): picked mon.a con 0x7fb5e40047c0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:35:02.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.960+0000 7fb5fd278640 1 --2- 172.21.15.62:0/2085461014 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5e40053d0 0x7fb5e400ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:02.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.960+0000 7fb5fd278640 10 monclient(hunting): picked mon.c con 0x7fb5e40053d0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:35:02.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.960+0000 7fb5fd278640 10 monclient(hunting): start opening mon connection 2024-02-09T08:35:02.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.960+0000 7fb5fd278640 1 -- 172.21.15.62:0/2085461014 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f80674f0 con 0x7fb5e40047c0 2024-02-09T08:35:02.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.960+0000 7fb5fd278640 10 monclient(hunting): start opening mon connection 2024-02-09T08:35:02.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.960+0000 7fb5fd278640 1 -- 172.21.15.62:0/2085461014 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e400c2e0 con 0x7fb5e4003a30 2024-02-09T08:35:02.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.960+0000 7fb5fd278640 10 monclient(hunting): start opening mon connection 2024-02-09T08:35:02.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.960+0000 7fb5fd278640 1 -- 172.21.15.62:0/2085461014 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e400c4a0 con 0x7fb5e40053d0 2024-02-09T08:35:02.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.960+0000 7fb5fd278640 10 monclient(hunting): _renew_subs 2024-02-09T08:35:02.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.960+0000 7fb5fd278640 10 monclient(hunting): _finish_auth 0 2024-02-09T08:35:02.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.963+0000 7fb5fda79640 1 --2- 172.21.15.62:0/2085461014 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5e40047c0 0x7fb5e4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:35:02.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.964+0000 7fb5fda79640 10 monclient(hunting): get_auth_request con 0x7fb5e40047c0 auth_method 0 2024-02-09T08:35:02.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.964+0000 7fb5fda79640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:35:02.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.964+0000 7fb5fda79640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:35:02.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.964+0000 7fb5fda79640 10 monclient(hunting): _init_auth already have auth, reseting 2024-02-09T08:35:02.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.964+0000 7fb5fda79640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:35:02.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.964+0000 7fb5fda79640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:35:02.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.964+0000 7fb5fda79640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-02-09T08:35:02.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.966+0000 7fb5fda79640 10 monclient(hunting): handle_auth_done global_id 16257 payload 293 2024-02-09T08:35:02.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.966+0000 7fb5fda79640 1 -- 172.21.15.62:0/2085461014 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5e40053d0 msgr2=0x7fb5e400ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:35:02.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.966+0000 7fb5fda79640 1 --2- 172.21.15.62:0/2085461014 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5e40053d0 0x7fb5e400ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:02.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.966+0000 7fb5fda79640 1 -- 172.21.15.62:0/2085461014 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5e4003a30 msgr2=0x7fb5e4003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:35:02.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.966+0000 7fb5fda79640 1 --2- 172.21.15.62:0/2085461014 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5e4003a30 0x7fb5e4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:02.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.966+0000 7fb5fda79640 10 monclient: _finish_hunting 0 2024-02-09T08:35:02.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.966+0000 7fb5fda79640 1 monclient: found mon.a 2024-02-09T08:35:02.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.966+0000 7fb5fda79640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:35:02.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.966+0000 7fb5fda79640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:35:02.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.966+0000 7fb5fda79640 1 -- 172.21.15.62:0/2085461014 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e4003520 con 0x7fb5e40047c0 2024-02-09T08:35:02.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.966+0000 7fb5fda79640 10 monclient: _finish_auth 0 2024-02-09T08:35:02.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.966+0000 7fb5fda79640 10 monclient: _check_auth_tickets 2024-02-09T08:35:02.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.966+0000 7fb5fda79640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:35:02.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.966+0000 7fb5fea7b640 1 -- 172.21.15.62:0/2085461014 reap_dead start 2024-02-09T08:35:02.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.966+0000 7fb6004de640 5 monclient: authenticate success, global_id 16257 2024-02-09T08:35:02.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.966+0000 7fb6004de640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-02-09T08:35:02.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.968+0000 7fb5fda79640 1 --2- 172.21.15.62:0/2085461014 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5e40047c0 0x7fb5e4004c40 secure :-1 s=READY pgs=3224 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8001650 tx=0x7fb5e40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d45dac2dd232b99f server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:35:02.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.972+0000 7fb5fd278640 1 -- 172.21.15.62:0/2085461014 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e8005270 con 0x7fb5e40047c0 2024-02-09T08:35:02.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.972+0000 7fb5fd278640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:35:02.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.972+0000 7fb5fd278640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-09T08:35:02.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.972+0000 7fb5fd278640 10 monclient: dump: 2024-02-09T08:35:02.975 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:35:02.975 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:35:02.975 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:02.975 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:02.975 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:35:02.975 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:02.975 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:35:02.975 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:35:02.975 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:35:02.976 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:02.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.972+0000 7fb5fd278640 1 -- 172.21.15.62:0/2085461014 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e802e070 con 0x7fb5e40047c0 2024-02-09T08:35:02.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.972+0000 7fb5fd278640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:35:02.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.972+0000 7fb5fd278640 1 -- 172.21.15.62:0/2085461014 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e8003610 con 0x7fb5e40047c0 2024-02-09T08:35:02.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.972+0000 7fb6004de640 10 monclient: get_monmap_and_config success 2024-02-09T08:35:02.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.972+0000 7fb6004de640 4 set_mon_vals no callback set 2024-02-09T08:35:02.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.972+0000 7fb5fd278640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:35:02.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.972+0000 7fb5fd278640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-09T08:35:02.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.972+0000 7fb5fd278640 10 monclient: dump: 2024-02-09T08:35:02.976 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:35:02.976 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:35:02.976 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:02.976 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:02.977 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:35:02.977 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:02.977 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:35:02.977 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:35:02.977 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:35:02.977 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:02.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.973+0000 7fb6004de640 10 monclient: shutdown 2024-02-09T08:35:02.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.973+0000 7fb6004de640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:35:02.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.973+0000 7fb6004de640 1 -- 172.21.15.62:0/2085461014 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5e40047c0 msgr2=0x7fb5e4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:02.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.973+0000 7fb6004de640 1 --2- 172.21.15.62:0/2085461014 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5e40047c0 0x7fb5e4004c40 secure :-1 s=READY pgs=3224 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8001650 tx=0x7fb5e40057f0 comp rx=0 tx=0).stop 2024-02-09T08:35:02.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.973+0000 7fb6004de640 1 -- 172.21.15.62:0/2085461014 shutdown_connections 2024-02-09T08:35:02.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.973+0000 7fb6004de640 1 --2- 172.21.15.62:0/2085461014 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5e40047c0 0x7fb5e4004c40 unknown :-1 s=CLOSED pgs=3224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:02.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.973+0000 7fb6004de640 1 -- 172.21.15.62:0/2085461014 >> 172.21.15.62:0/2085461014 conn(0x7fb5f80b4e20 msgr2=0x7fb5f80b5230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:35:02.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.973+0000 7fb6004de640 1 -- 172.21.15.62:0/2085461014 shutdown_connections 2024-02-09T08:35:02.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.973+0000 7fb6004de640 1 -- 172.21.15.62:0/2085461014 wait complete. 2024-02-09T08:35:02.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.974+0000 7fb6004de640 10 monclient: build_initial_monmap 2024-02-09T08:35:02.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.974+0000 7fb6004de640 10 monclient: monmap: 2024-02-09T08:35:02.980 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:35:02.980 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:35:02.980 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:35:02.981 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:35:02.981 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:35:02.981 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:02.981 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:35:02.981 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:35:02.981 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:35:02.981 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:02.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.974+0000 7fb6004de640 1 librados: starting msgr at 2024-02-09T08:35:02.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.974+0000 7fb6004de640 1 librados: starting objecter 2024-02-09T08:35:02.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.974+0000 7fb6004de640 1 Processor -- start 2024-02-09T08:35:02.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.974+0000 7fb6004de640 1 -- start start 2024-02-09T08:35:02.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.974+0000 7fb6004de640 1 librados: setting wanted keys 2024-02-09T08:35:02.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.974+0000 7fb6004de640 1 librados: calling monclient init 2024-02-09T08:35:02.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.974+0000 7fb6004de640 10 monclient: init 2024-02-09T08:35:02.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.975+0000 7fb6004de640 10 monclient: _reopen_session rank -1 2024-02-09T08:35:02.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.975+0000 7fb6004de640 10 monclient: _add_conns ranks=[0,2,1] 2024-02-09T08:35:02.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.975+0000 7fb6004de640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5e40047c0 0x7fb5f81dadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:02.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.975+0000 7fb6004de640 10 monclient(hunting): picked mon.noname-a con 0x7fb5e40047c0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:35:02.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.975+0000 7fb6004de640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5f81db810 0x7fb5f80b0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:02.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.975+0000 7fb6004de640 10 monclient(hunting): picked mon.noname-c con 0x7fb5f81db810 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:35:02.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.975+0000 7fb6004de640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5f80b1200 0x7fb5f813a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:02.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.975+0000 7fb6004de640 10 monclient(hunting): picked mon.noname-b con 0x7fb5f80b1200 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:35:02.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.975+0000 7fb6004de640 10 monclient(hunting): start opening mon connection 2024-02-09T08:35:02.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.975+0000 7fb6004de640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f80ada50 con 0x7fb5e40047c0 2024-02-09T08:35:02.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.975+0000 7fb6004de640 10 monclient(hunting): start opening mon connection 2024-02-09T08:35:02.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.975+0000 7fb6004de640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f81208b0 con 0x7fb5f80b1200 2024-02-09T08:35:02.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.975+0000 7fb6004de640 10 monclient(hunting): start opening mon connection 2024-02-09T08:35:02.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.975+0000 7fb6004de640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f8120b90 con 0x7fb5f81db810 2024-02-09T08:35:02.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.975+0000 7fb6004de640 10 monclient(hunting): _renew_subs 2024-02-09T08:35:02.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.975+0000 7fb6004de640 10 monclient(hunting): authenticate will time out at 3346.335691s 2024-02-09T08:35:02.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.975+0000 7fb5fe27a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5e40047c0 0x7fb5f81dadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:35:02.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.976+0000 7fb5fe27a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5e40047c0 0x7fb5f81dadf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44196/0 (socket says 172.21.15.62:44196) 2024-02-09T08:35:02.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.976+0000 7fb5fe27a640 1 -- 172.21.15.62:0/2789842280 learned_addr learned my addr 172.21.15.62:0/2789842280 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:35:02.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.976+0000 7fb5fe27a640 10 monclient(hunting): get_auth_request con 0x7fb5e40047c0 auth_method 0 2024-02-09T08:35:02.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.976+0000 7fb5fe27a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:35:02.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.976+0000 7fb5fe27a640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:35:02.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.976+0000 7fb5fe27a640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:35:02.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.976+0000 7fb5fe27a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:35:02.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.976+0000 7fb5fe27a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:35:02.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.976+0000 7fb5fe27a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:35:02.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.979+0000 7fb5fe27a640 10 monclient(hunting): handle_auth_done global_id 16260 payload 824 2024-02-09T08:35:02.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.979+0000 7fb5fe27a640 1 -- 172.21.15.62:0/2789842280 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5f81db810 msgr2=0x7fb5f80b0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:02.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.979+0000 7fb5fe27a640 1 --2- 172.21.15.62:0/2789842280 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5f81db810 0x7fb5f80b0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:02.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.979+0000 7fb5fe27a640 1 -- 172.21.15.62:0/2789842280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5f80b1200 msgr2=0x7fb5f813a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:02.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.979+0000 7fb5fe27a640 1 --2- 172.21.15.62:0/2789842280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5f80b1200 0x7fb5f813a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:02.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.979+0000 7fb5fe27a640 10 monclient: _finish_hunting 0 2024-02-09T08:35:02.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.979+0000 7fb5fe27a640 1 monclient: found mon.noname-a 2024-02-09T08:35:02.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.979+0000 7fb5fe27a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:35:02.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.979+0000 7fb5fe27a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-02-09T08:35:02.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.979+0000 7fb5fe27a640 1 -- 172.21.15.62:0/2789842280 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f80b07a0 con 0x7fb5e40047c0 2024-02-09T08:35:02.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.981+0000 7fb5fe27a640 1 --2- 172.21.15.62:0/2789842280 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5e40047c0 0x7fb5f81dadf0 secure :-1 s=READY pgs=3225 cs=0 l=1 rev1=1 crypto rx=0x7fb5f400c730 tx=0x7fb5f400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:35:02.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.981+0000 7fb5eeffd640 10 client.?.objecter ms_handle_connect 0x7fb5e40047c0 2024-02-09T08:35:02.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.981+0000 7fb5eeffd640 10 client.?.objecter resend_mon_ops 2024-02-09T08:35:02.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.986+0000 7fb5eeffd640 1 -- 172.21.15.62:0/2789842280 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f40072d0 con 0x7fb5e40047c0 2024-02-09T08:35:02.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.986+0000 7fb5eeffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:35:02.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.986+0000 7fb5eeffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-09T08:35:02.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.986+0000 7fb5eeffd640 10 monclient: dump: 2024-02-09T08:35:02.989 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:35:02.989 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:35:02.989 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:02.989 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:02.990 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:35:02.990 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:02.990 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:35:02.990 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:35:02.990 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:35:02.990 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:02.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.986+0000 7fb5eeffd640 10 monclient: _finish_auth 0 2024-02-09T08:35:02.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.986+0000 7fb5eeffd640 10 monclient: _check_auth_tickets 2024-02-09T08:35:02.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.986+0000 7fb5eeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:35:02.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.986+0000 7fb5eeffd640 1 -- 172.21.15.62:0/2789842280 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f4007430 con 0x7fb5e40047c0 2024-02-09T08:35:02.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.986+0000 7fb6004de640 5 monclient: authenticate success, global_id 16260 2024-02-09T08:35:02.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.986+0000 7fb6004de640 10 monclient: _renew_subs 2024-02-09T08:35:02.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.986+0000 7fb6004de640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:35:02.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.986+0000 7fb6004de640 1 -- 172.21.15.62:0/2789842280 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5f80b0430 con 0x7fb5e40047c0 2024-02-09T08:35:02.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.986+0000 7fb5eeffd640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:35:02.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.986+0000 7fb5eeffd640 1 -- 172.21.15.62:0/2789842280 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f40047e0 con 0x7fb5e40047c0 2024-02-09T08:35:02.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.986+0000 7fb5eeffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:35:02.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.986+0000 7fb5eeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-09T08:35:02.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.986+0000 7fb5eeffd640 10 monclient: dump: 2024-02-09T08:35:02.991 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:35:02.991 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:35:02.991 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:02.991 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:02.991 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:35:02.991 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:02.991 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:35:02.991 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:35:02.991 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:35:02.991 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:02.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.986+0000 7fb5fca77640 4 set_mon_vals no callback set 2024-02-09T08:35:02.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.986+0000 7fb6004de640 10 client.16260.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:35:02.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.986+0000 7fb6004de640 10 monclient: _renew_subs 2024-02-09T08:35:02.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.986+0000 7fb6004de640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:35:02.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.986+0000 7fb6004de640 1 -- 172.21.15.62:0/2789842280 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5f80b1820 con 0x7fb5e40047c0 2024-02-09T08:35:02.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.986+0000 7fb6004de640 1 librados: init done 2024-02-09T08:35:02.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.987+0000 7fb6004de640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:35:02.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.987+0000 7fb6004de640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:35:02.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.987+0000 7fb6004de640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-02-09T08:35:02.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:02.987+0000 7fb6004de640 1 -- 172.21.15.62:0/2789842280 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5f80b05c0 con 0x7fb5e40047c0 2024-02-09T08:35:03.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:03.250+0000 7fb5eeffd640 1 -- 172.21.15.62:0/2789842280 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fb5f400a5e0 con 0x7fb5e40047c0 2024-02-09T08:35:03.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:03.251+0000 7fb5eeffd640 1 --2- 172.21.15.62:0/2789842280 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fb5dc06d1f0 0x7fb5dc06f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:03.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:03.251+0000 7fb5fda79640 1 --2- 172.21.15.62:0/2789842280 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fb5dc06d1f0 0x7fb5dc06f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:35:03.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:03.251+0000 7fb5fda79640 10 monclient: get_auth_request con 0x7fb5dc06d1f0 auth_method 0 2024-02-09T08:35:03.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:03.252+0000 7fb5fda79640 1 --2- 172.21.15.62:0/2789842280 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fb5dc06d1f0 0x7fb5dc06f6b0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8033000 tx=0x7fb5e8005000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:35:03.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:03.252+0000 7fb5eeffd640 10 client.16260.objecter ms_handle_connect 0x7fb5dc06d1f0 2024-02-09T08:35:03.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:03.264+0000 7fb5eeffd640 1 -- 172.21.15.62:0/2789842280 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(1270..1270 src has 1199..1270) v4 ==== 6381+0+0 (secure 0 0 0) 0x7fb5f40588a0 con 0x7fb5e40047c0 2024-02-09T08:35:03.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:03.264+0000 7fb5eeffd640 10 client.16260.objecter ms_dispatch 0x7fb5f8000b90 osd_map(1270..1270 src has 1199..1270) v4 2024-02-09T08:35:03.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:03.264+0000 7fb5eeffd640 3 client.16260.objecter handle_osd_map got epochs [1270,1270] > 0 2024-02-09T08:35:03.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:03.264+0000 7fb5eeffd640 3 client.16260.objecter handle_osd_map decoding full epoch 1270 2024-02-09T08:35:03.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:03.264+0000 7fb5eeffd640 20 client.16260.objecter dump_active .. 0 homeless 2024-02-09T08:35:03.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:03.264+0000 7fb5eeffd640 1 -- 172.21.15.62:0/2789842280 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb5f4054440 con 0x7fb5e40047c0 2024-02-09T08:35:03.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:03.264+0000 7fb5eeffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:35:03.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:03.264+0000 7fb5eeffd640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:35:03.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:03.459+0000 7fb6004de640 1 -- 172.21.15.62:0/2789842280 --> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb5f8075100 con 0x7fb5dc06d1f0 2024-02-09T08:35:03.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:03.464+0000 7fb5eeffd640 1 -- 172.21.15.62:0/2789842280 <== mgr.4109 v2:172.21.15.103:6800/2270392189 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+151627 (secure 0 0 0) 0x7fb5f8075100 con 0x7fb5dc06d1f0 2024-02-09T08:35:03.467 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T08:35:03.468 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-02-09T08:35:03.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:03.466+0000 7fb6004de640 10 librados: watch_flush enter 2024-02-09T08:35:03.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:03.466+0000 7fb6004de640 10 librados: watch_flush exit 2024-02-09T08:35:03.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:03.466+0000 7fb6004de640 20 client.16260.objecter shutdown clearing up homeless session... 2024-02-09T08:35:03.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:03.466+0000 7fb6004de640 10 client.16260.objecter successfully canceled tick 2024-02-09T08:35:03.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:03.466+0000 7fb6004de640 1 -- 172.21.15.62:0/2789842280 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fb5dc06d1f0 msgr2=0x7fb5dc06f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:03.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:03.466+0000 7fb6004de640 1 --2- 172.21.15.62:0/2789842280 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fb5dc06d1f0 0x7fb5dc06f6b0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8033000 tx=0x7fb5e8005000 comp rx=0 tx=0).stop 2024-02-09T08:35:03.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:03.466+0000 7fb6004de640 10 monclient: shutdown 2024-02-09T08:35:03.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:03.466+0000 7fb6004de640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:35:03.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:03.466+0000 7fb6004de640 1 -- 172.21.15.62:0/2789842280 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5e40047c0 msgr2=0x7fb5f81dadf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:03.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:03.466+0000 7fb6004de640 1 --2- 172.21.15.62:0/2789842280 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5e40047c0 0x7fb5f81dadf0 secure :-1 s=READY pgs=3225 cs=0 l=1 rev1=1 crypto rx=0x7fb5f400c730 tx=0x7fb5f400cbf0 comp rx=0 tx=0).stop 2024-02-09T08:35:03.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:03.467+0000 7fb6004de640 1 -- 172.21.15.62:0/2789842280 shutdown_connections 2024-02-09T08:35:03.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:03.467+0000 7fb6004de640 1 --2- 172.21.15.62:0/2789842280 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7fb5dc06d1f0 0x7fb5dc06f6b0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:03.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:03.467+0000 7fb6004de640 1 --2- 172.21.15.62:0/2789842280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5f80b1200 0x7fb5f813a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:03.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:03.467+0000 7fb6004de640 1 --2- 172.21.15.62:0/2789842280 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5f81db810 0x7fb5f80b0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:03.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:03.467+0000 7fb6004de640 1 --2- 172.21.15.62:0/2789842280 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5e40047c0 0x7fb5f81dadf0 unknown :-1 s=CLOSED pgs=3225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:03.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:03.467+0000 7fb6004de640 1 -- 172.21.15.62:0/2789842280 >> 172.21.15.62:0/2789842280 conn(0x7fb5f80b4e20 msgr2=0x7fb5f813d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:35:03.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:03.467+0000 7fb6004de640 1 -- 172.21.15.62:0/2789842280 shutdown_connections 2024-02-09T08:35:03.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:03.467+0000 7fb6004de640 1 -- 172.21.15.62:0/2789842280 wait complete. 2024-02-09T08:35:03.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:03.467+0000 7fb6004de640 1 librados: shutdown 2024-02-09T08:35:03.482 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":2238,"stamp":"2024-02-09T08:35:02.521176+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459285,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":88,"num_write":120,"num_write_kb":1379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":86,"ondisk_log_size":86,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":565872,"kb_used_data":31832,"kb_used_omap":12,"kb_used_meta":533939,"kb_avail":754408848,"statfs":{"total":773094113280,"available":772514660352,"internally_reserved":0,"allocated":32595968,"data_stored":13732130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":546754096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":90,"apply_latency_ms":90,"commit_latency_ns":90000000,"apply_latency_ns":90000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001970"},"pg_stats":[{"pgid":"11.1b","version":"0'0","reported_seq":2426,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:34:59.623762+0000","last_change":"2024-02-09T08:34:59.624583+0000","last_active":"2024-02-09T08:34:59.623762+0000","last_peered":"2024-02-09T08:34:59.623762+0000","last_clean":"2024-02-09T08:34:59.623762+0000","last_became_active":"2024-02-09T08:04:33.521240+0000","last_became_peered":"2024-02-09T08:04:33.521240+0000","last_unstale":"2024-02-09T08:34:59.623762+0000","last_undegraded":"2024-02-09T08:34:59.623762+0000","last_fullsized":"2024-02-09T08:34:59.623762+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:34:59.622292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:34:59.622292+0000","last_clean_scrub_stamp":"2024-02-09T08:34:59.622292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T14:37:48.847958+0000","scrub_duration":91,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":2433,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:34:55.726503+0000","last_change":"2024-02-09T08:04:40.805290+0000","last_active":"2024-02-09T08:34:55.726503+0000","last_peered":"2024-02-09T08:34:55.726503+0000","last_clean":"2024-02-09T08:34:55.726503+0000","last_became_active":"2024-02-09T08:04:40.657553+0000","last_became_peered":"2024-02-09T08:04:40.657553+0000","last_unstale":"2024-02-09T08:34:55.726503+0000","last_undegraded":"2024-02-09T08:34:55.726503+0000","last_fullsized":"2024-02-09T08:34:55.726503+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T10:06:50.567240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":2430,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:34:55.823004+0000","last_change":"2024-02-09T08:04:36.602734+0000","last_active":"2024-02-09T08:34:55.823004+0000","last_peered":"2024-02-09T08:34:55.823004+0000","last_clean":"2024-02-09T08:34:55.823004+0000","last_became_active":"2024-02-09T08:04:36.596835+0000","last_became_peered":"2024-02-09T08:04:36.596835+0000","last_unstale":"2024-02-09T08:34:55.823004+0000","last_undegraded":"2024-02-09T08:34:55.823004+0000","last_fullsized":"2024-02-09T08:34:55.823004+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T16:22:37.194403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":2437,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:34:55.801959+0000","last_change":"2024-02-09T08:05:00.789599+0000","last_active":"2024-02-09T08:34:55.801959+0000","last_peered":"2024-02-09T08:34:55.801959+0000","last_clean":"2024-02-09T08:34:55.801959+0000","last_became_active":"2024-02-09T08:05:00.783372+0000","last_became_peered":"2024-02-09T08:05:00.783372+0000","last_unstale":"2024-02-09T08:34:55.801959+0000","last_undegraded":"2024-02-09T08:34:55.801959+0000","last_fullsized":"2024-02-09T08:34:55.801959+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":2412,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:34:55.920186+0000","last_change":"2024-02-09T08:04:29.148658+0000","last_active":"2024-02-09T08:34:55.920186+0000","last_peered":"2024-02-09T08:34:55.920186+0000","last_clean":"2024-02-09T08:34:55.920186+0000","last_became_active":"2024-02-09T08:04:29.124225+0000","last_became_peered":"2024-02-09T08:04:29.124225+0000","last_unstale":"2024-02-09T08:34:55.920186+0000","last_undegraded":"2024-02-09T08:34:55.920186+0000","last_fullsized":"2024-02-09T08:34:55.920186+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":2443,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:34:55.785937+0000","last_change":"2024-02-09T08:04:39.748237+0000","last_active":"2024-02-09T08:34:55.785937+0000","last_peered":"2024-02-09T08:34:55.785937+0000","last_clean":"2024-02-09T08:34:55.785937+0000","last_became_active":"2024-02-09T08:04:39.743089+0000","last_became_peered":"2024-02-09T08:04:39.743089+0000","last_unstale":"2024-02-09T08:34:55.785937+0000","last_undegraded":"2024-02-09T08:34:55.785937+0000","last_fullsized":"2024-02-09T08:34:55.785937+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T12:00:51.961215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":2409,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:34:55.909576+0000","last_change":"2024-02-09T08:05:03.172587+0000","last_active":"2024-02-09T08:34:55.909576+0000","last_peered":"2024-02-09T08:34:55.909576+0000","last_clean":"2024-02-09T08:34:55.909576+0000","last_became_active":"2024-02-09T08:05:03.159711+0000","last_became_peered":"2024-02-09T08:05:03.159711+0000","last_unstale":"2024-02-09T08:34:55.909576+0000","last_undegraded":"2024-02-09T08:34:55.909576+0000","last_fullsized":"2024-02-09T08:34:55.909576+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":2420,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:35:00.723757+0000","last_change":"2024-02-09T08:35:00.724608+0000","last_active":"2024-02-09T08:35:00.723757+0000","last_peered":"2024-02-09T08:35:00.723757+0000","last_clean":"2024-02-09T08:35:00.723757+0000","last_became_active":"2024-02-09T08:04:30.066772+0000","last_became_peered":"2024-02-09T08:04:30.066772+0000","last_unstale":"2024-02-09T08:35:00.723757+0000","last_undegraded":"2024-02-09T08:35:00.723757+0000","last_fullsized":"2024-02-09T08:35:00.723757+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:35:00.721467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:35:00.721467+0000","last_clean_scrub_stamp":"2024-02-09T08:35:00.721467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T16:59:42.583966+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":2435,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:34:55.737181+0000","last_change":"2024-02-09T08:04:53.183149+0000","last_active":"2024-02-09T08:34:55.737181+0000","last_peered":"2024-02-09T08:34:55.737181+0000","last_clean":"2024-02-09T08:34:55.737181+0000","last_became_active":"2024-02-09T08:04:53.127636+0000","last_became_peered":"2024-02-09T08:04:53.127636+0000","last_unstale":"2024-02-09T08:34:55.737181+0000","last_undegraded":"2024-02-09T08:34:55.737181+0000","last_fullsized":"2024-02-09T08:34:55.737181+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T15:08:17.048446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":2440,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:34:55.778624+0000","last_change":"2024-02-09T08:04:56.560292+0000","last_active":"2024-02-09T08:34:55.778624+0000","last_peered":"2024-02-09T08:34:55.778624+0000","last_clean":"2024-02-09T08:34:55.778624+0000","last_became_active":"2024-02-09T08:04:56.548820+0000","last_became_peered":"2024-02-09T08:04:56.548820+0000","last_unstale":"2024-02-09T08:34:55.778624+0000","last_undegraded":"2024-02-09T08:34:55.778624+0000","last_fullsized":"2024-02-09T08:34:55.778624+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T10:03:15.435898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1","version":"1270'8","reported_seq":2434,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:34:58.728370+0000","last_change":"2024-02-09T08:34:58.729416+0000","last_active":"2024-02-09T08:34:58.728370+0000","last_peered":"2024-02-09T08:34:58.728370+0000","last_clean":"2024-02-09T08:34:58.728370+0000","last_became_active":"2024-02-09T08:04:23.166119+0000","last_became_peered":"2024-02-09T08:04:23.166119+0000","last_unstale":"2024-02-09T08:34:58.728370+0000","last_undegraded":"2024-02-09T08:34:58.728370+0000","last_fullsized":"2024-02-09T08:34:58.728370+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"1270'8","last_scrub_stamp":"2024-02-09T08:34:58.726806+0000","last_deep_scrub":"1270'8","last_deep_scrub_stamp":"2024-02-09T08:34:58.726806+0000","last_clean_scrub_stamp":"2024-02-09T08:34:58.726806+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T19:42:15.856674+0000","scrub_duration":83,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":2440,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:34:55.803683+0000","last_change":"2024-02-09T08:05:03.863540+0000","last_active":"2024-02-09T08:34:55.803683+0000","last_peered":"2024-02-09T08:34:55.803683+0000","last_clean":"2024-02-09T08:34:55.803683+0000","last_became_active":"2024-02-09T08:05:03.857816+0000","last_became_peered":"2024-02-09T08:05:03.857816+0000","last_unstale":"2024-02-09T08:34:55.803683+0000","last_undegraded":"2024-02-09T08:34:55.803683+0000","last_fullsized":"2024-02-09T08:34:55.803683+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":2443,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:34:55.776397+0000","last_change":"2024-02-09T08:04:23.020050+0000","last_active":"2024-02-09T08:34:55.776397+0000","last_peered":"2024-02-09T08:34:55.776397+0000","last_clean":"2024-02-09T08:34:55.776397+0000","last_became_active":"2024-02-09T08:04:23.007209+0000","last_became_peered":"2024-02-09T08:04:23.007209+0000","last_unstale":"2024-02-09T08:34:55.776397+0000","last_undegraded":"2024-02-09T08:34:55.776397+0000","last_fullsized":"2024-02-09T08:34:55.776397+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T14:15:50.318219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"1270'78","reported_seq":2556,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:34:57.941980+0000","last_change":"2024-02-09T08:34:57.943144+0000","last_active":"2024-02-09T08:34:57.941980+0000","last_peered":"2024-02-09T08:34:57.941980+0000","last_clean":"2024-02-09T08:34:57.941980+0000","last_became_active":"2024-02-09T08:02:58.754736+0000","last_became_peered":"2024-02-09T08:02:58.754736+0000","last_unstale":"2024-02-09T08:34:57.941980+0000","last_undegraded":"2024-02-09T08:34:57.941980+0000","last_fullsized":"2024-02-09T08:34:57.941980+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"1270'78","last_scrub_stamp":"2024-02-09T08:34:57.940443+0000","last_deep_scrub":"1270'78","last_deep_scrub_stamp":"2024-02-09T08:34:57.940443+0000","last_clean_scrub_stamp":"2024-02-09T08:34:57.940443+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T10:18:06.983561+0000","scrub_duration":110,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":2448,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:34:55.738972+0000","last_change":"2024-02-09T08:03:12.939816+0000","last_active":"2024-02-09T08:34:55.738972+0000","last_peered":"2024-02-09T08:34:55.738972+0000","last_clean":"2024-02-09T08:34:55.738972+0000","last_became_active":"2024-02-09T08:03:12.934488+0000","last_became_peered":"2024-02-09T08:03:12.934488+0000","last_unstale":"2024-02-09T08:34:55.738972+0000","last_undegraded":"2024-02-09T08:34:55.738972+0000","last_fullsized":"2024-02-09T08:34:55.738972+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_clean_scrub_stamp":"2024-02-09T08:03:10.689497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T08:15:00.733484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":2432,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:34:55.825115+0000","last_change":"2024-02-09T08:04:34.779296+0000","last_active":"2024-02-09T08:34:55.825115+0000","last_peered":"2024-02-09T08:34:55.825115+0000","last_clean":"2024-02-09T08:34:55.825115+0000","last_became_active":"2024-02-09T08:04:34.763206+0000","last_became_peered":"2024-02-09T08:04:34.763206+0000","last_unstale":"2024-02-09T08:34:55.825115+0000","last_undegraded":"2024-02-09T08:34:55.825115+0000","last_fullsized":"2024-02-09T08:34:55.825115+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T14:34:34.410613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2448,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:34:55.730818+0000","last_change":"2024-02-09T08:03:12.238763+0000","last_active":"2024-02-09T08:34:55.730818+0000","last_peered":"2024-02-09T08:34:55.730818+0000","last_clean":"2024-02-09T08:34:55.730818+0000","last_became_active":"2024-02-09T08:03:12.210217+0000","last_became_peered":"2024-02-09T08:03:12.210217+0000","last_unstale":"2024-02-09T08:34:55.730818+0000","last_undegraded":"2024-02-09T08:34:55.730818+0000","last_fullsized":"2024-02-09T08:34:55.730818+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_clean_scrub_stamp":"2024-02-09T08:03:10.689497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T11:36:35.345417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":2439,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:34:55.805364+0000","last_change":"2024-02-09T08:04:28.955676+0000","last_active":"2024-02-09T08:34:55.805364+0000","last_peered":"2024-02-09T08:34:55.805364+0000","last_clean":"2024-02-09T08:34:55.805364+0000","last_became_active":"2024-02-09T08:04:28.937638+0000","last_became_peered":"2024-02-09T08:04:28.937638+0000","last_unstale":"2024-02-09T08:34:55.805364+0000","last_undegraded":"2024-02-09T08:34:55.805364+0000","last_fullsized":"2024-02-09T08:34:55.805364+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2461,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:34:55.882367+0000","last_change":"2024-02-09T08:03:12.225325+0000","last_active":"2024-02-09T08:34:55.882367+0000","last_peered":"2024-02-09T08:34:55.882367+0000","last_clean":"2024-02-09T08:34:55.882367+0000","last_became_active":"2024-02-09T08:03:12.197237+0000","last_became_peered":"2024-02-09T08:03:12.197237+0000","last_unstale":"2024-02-09T08:34:55.882367+0000","last_undegraded":"2024-02-09T08:34:55.882367+0000","last_fullsized":"2024-02-09T08:34:55.882367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_clean_scrub_stamp":"2024-02-09T08:03:10.689497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T09:53:22.604814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":2438,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:34:55.818003+0000","last_change":"2024-02-09T08:04:32.150155+0000","last_active":"2024-02-09T08:34:55.818003+0000","last_peered":"2024-02-09T08:34:55.818003+0000","last_clean":"2024-02-09T08:34:55.818003+0000","last_became_active":"2024-02-09T08:04:32.135773+0000","last_became_peered":"2024-02-09T08:04:32.135773+0000","last_unstale":"2024-02-09T08:34:55.818003+0000","last_undegraded":"2024-02-09T08:34:55.818003+0000","last_fullsized":"2024-02-09T08:34:55.818003+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":2448,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:34:55.724633+0000","last_change":"2024-02-09T08:03:12.541068+0000","last_active":"2024-02-09T08:34:55.724633+0000","last_peered":"2024-02-09T08:34:55.724633+0000","last_clean":"2024-02-09T08:34:55.724633+0000","last_became_active":"2024-02-09T08:03:12.535306+0000","last_became_peered":"2024-02-09T08:03:12.535306+0000","last_unstale":"2024-02-09T08:34:55.724633+0000","last_undegraded":"2024-02-09T08:34:55.724633+0000","last_fullsized":"2024-02-09T08:34:55.724633+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_clean_scrub_stamp":"2024-02-09T08:03:10.689497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T16:45:31.048468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":2447,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:34:55.895951+0000","last_change":"2024-02-09T08:04:35.123806+0000","last_active":"2024-02-09T08:34:55.895951+0000","last_peered":"2024-02-09T08:34:55.895951+0000","last_clean":"2024-02-09T08:34:55.895951+0000","last_became_active":"2024-02-09T08:04:35.117349+0000","last_became_peered":"2024-02-09T08:04:35.117349+0000","last_unstale":"2024-02-09T08:34:55.895951+0000","last_undegraded":"2024-02-09T08:34:55.895951+0000","last_fullsized":"2024-02-09T08:34:55.895951+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T15:28:05.326270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2456,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:34:55.773512+0000","last_change":"2024-02-09T08:03:12.601407+0000","last_active":"2024-02-09T08:34:55.773512+0000","last_peered":"2024-02-09T08:34:55.773512+0000","last_clean":"2024-02-09T08:34:55.773512+0000","last_became_active":"2024-02-09T08:03:12.568245+0000","last_became_peered":"2024-02-09T08:03:12.568245+0000","last_unstale":"2024-02-09T08:34:55.773512+0000","last_undegraded":"2024-02-09T08:34:55.773512+0000","last_fullsized":"2024-02-09T08:34:55.773512+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_clean_scrub_stamp":"2024-02-09T08:03:10.689497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T13:19:50.521695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":2447,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:34:55.891283+0000","last_change":"2024-02-09T08:04:21.999119+0000","last_active":"2024-02-09T08:34:55.891283+0000","last_peered":"2024-02-09T08:34:55.891283+0000","last_clean":"2024-02-09T08:34:55.891283+0000","last_became_active":"2024-02-09T08:04:21.984625+0000","last_became_peered":"2024-02-09T08:04:21.984625+0000","last_unstale":"2024-02-09T08:34:55.891283+0000","last_undegraded":"2024-02-09T08:34:55.891283+0000","last_fullsized":"2024-02-09T08:34:55.891283+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T17:50:19.443534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2448,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:34:55.743736+0000","last_change":"2024-02-09T08:03:12.390430+0000","last_active":"2024-02-09T08:34:55.743736+0000","last_peered":"2024-02-09T08:34:55.743736+0000","last_clean":"2024-02-09T08:34:55.743736+0000","last_became_active":"2024-02-09T08:03:12.385148+0000","last_became_peered":"2024-02-09T08:03:12.385148+0000","last_unstale":"2024-02-09T08:34:55.743736+0000","last_undegraded":"2024-02-09T08:34:55.743736+0000","last_fullsized":"2024-02-09T08:34:55.743736+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_clean_scrub_stamp":"2024-02-09T08:03:10.689497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T10:48:39.909252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":2419,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:34:57.729346+0000","last_change":"2024-02-09T08:34:57.730200+0000","last_active":"2024-02-09T08:34:57.729346+0000","last_peered":"2024-02-09T08:34:57.729346+0000","last_clean":"2024-02-09T08:34:57.729346+0000","last_became_active":"2024-02-09T08:04:22.589664+0000","last_became_peered":"2024-02-09T08:04:22.589664+0000","last_unstale":"2024-02-09T08:34:57.729346+0000","last_undegraded":"2024-02-09T08:34:57.729346+0000","last_fullsized":"2024-02-09T08:34:57.729346+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:34:57.727751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:34:57.727751+0000","last_clean_scrub_stamp":"2024-02-09T08:34:57.727751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T11:27:15.363778+0000","scrub_duration":92,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2452,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:34:55.840552+0000","last_change":"2024-02-09T08:03:12.975632+0000","last_active":"2024-02-09T08:34:55.840552+0000","last_peered":"2024-02-09T08:34:55.840552+0000","last_clean":"2024-02-09T08:34:55.840552+0000","last_became_active":"2024-02-09T08:03:12.943786+0000","last_became_peered":"2024-02-09T08:03:12.943786+0000","last_unstale":"2024-02-09T08:34:55.840552+0000","last_undegraded":"2024-02-09T08:34:55.840552+0000","last_fullsized":"2024-02-09T08:34:55.840552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_clean_scrub_stamp":"2024-02-09T08:03:10.689497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T14:17:25.431442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":2402,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:34:55.891822+0000","last_change":"2024-02-09T08:04:47.726395+0000","last_active":"2024-02-09T08:34:55.891822+0000","last_peered":"2024-02-09T08:34:55.891822+0000","last_clean":"2024-02-09T08:34:55.891822+0000","last_became_active":"2024-02-09T08:04:47.720072+0000","last_became_peered":"2024-02-09T08:04:47.720072+0000","last_unstale":"2024-02-09T08:34:55.891822+0000","last_undegraded":"2024-02-09T08:34:55.891822+0000","last_fullsized":"2024-02-09T08:34:55.891822+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2445,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:34:55.760102+0000","last_change":"2024-02-09T08:03:12.925399+0000","last_active":"2024-02-09T08:34:55.760102+0000","last_peered":"2024-02-09T08:34:55.760102+0000","last_clean":"2024-02-09T08:34:55.760102+0000","last_became_active":"2024-02-09T08:03:12.920012+0000","last_became_peered":"2024-02-09T08:03:12.920012+0000","last_unstale":"2024-02-09T08:34:55.760102+0000","last_undegraded":"2024-02-09T08:34:55.760102+0000","last_fullsized":"2024-02-09T08:34:55.760102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:03:10.689497+0000","last_clean_scrub_stamp":"2024-02-09T08:03:10.689497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T10:28:21.672589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":2427,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:35:00.563867+0000","last_change":"2024-02-09T08:35:00.564680+0000","last_active":"2024-02-09T08:35:00.563867+0000","last_peered":"2024-02-09T08:35:00.563867+0000","last_clean":"2024-02-09T08:35:00.563867+0000","last_became_active":"2024-02-09T08:04:33.638587+0000","last_became_peered":"2024-02-09T08:04:33.638587+0000","last_unstale":"2024-02-09T08:35:00.563867+0000","last_undegraded":"2024-02-09T08:35:00.563867+0000","last_fullsized":"2024-02-09T08:35:00.563867+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:35:00.562428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:35:00.562428+0000","last_clean_scrub_stamp":"2024-02-09T08:35:00.562428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T18:19:25.096855+0000","scrub_duration":37,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":2406,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:34:55.907711+0000","last_change":"2024-02-09T08:04:31.512983+0000","last_active":"2024-02-09T08:34:55.907711+0000","last_peered":"2024-02-09T08:34:55.907711+0000","last_clean":"2024-02-09T08:34:55.907711+0000","last_became_active":"2024-02-09T08:04:31.384824+0000","last_became_peered":"2024-02-09T08:04:31.384824+0000","last_unstale":"2024-02-09T08:34:55.907711+0000","last_undegraded":"2024-02-09T08:34:55.907711+0000","last_fullsized":"2024-02-09T08:34:55.907711+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":2436,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:34:55.754345+0000","last_change":"2024-02-09T08:04:53.877017+0000","last_active":"2024-02-09T08:34:55.754345+0000","last_peered":"2024-02-09T08:34:55.754345+0000","last_clean":"2024-02-09T08:34:55.754345+0000","last_became_active":"2024-02-09T08:04:53.837629+0000","last_became_peered":"2024-02-09T08:04:53.837629+0000","last_unstale":"2024-02-09T08:34:55.754345+0000","last_undegraded":"2024-02-09T08:34:55.754345+0000","last_fullsized":"2024-02-09T08:34:55.754345+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T18:40:04.247361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":2448,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:34:55.898885+0000","last_change":"2024-02-09T08:04:21.302362+0000","last_active":"2024-02-09T08:34:55.898885+0000","last_peered":"2024-02-09T08:34:55.898885+0000","last_clean":"2024-02-09T08:34:55.898885+0000","last_became_active":"2024-02-09T08:04:21.282606+0000","last_became_peered":"2024-02-09T08:04:21.282606+0000","last_unstale":"2024-02-09T08:34:55.898885+0000","last_undegraded":"2024-02-09T08:34:55.898885+0000","last_fullsized":"2024-02-09T08:34:55.898885+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T19:16:17.460982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":2443,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:34:55.765367+0000","last_change":"2024-02-09T08:04:21.475042+0000","last_active":"2024-02-09T08:34:55.765367+0000","last_peered":"2024-02-09T08:34:55.765367+0000","last_clean":"2024-02-09T08:34:55.765367+0000","last_became_active":"2024-02-09T08:04:21.467958+0000","last_became_peered":"2024-02-09T08:04:21.467958+0000","last_unstale":"2024-02-09T08:34:55.765367+0000","last_undegraded":"2024-02-09T08:34:55.765367+0000","last_fullsized":"2024-02-09T08:34:55.765367+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T19:20:44.543943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":2447,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:34:55.880691+0000","last_change":"2024-02-09T08:04:20.693952+0000","last_active":"2024-02-09T08:34:55.880691+0000","last_peered":"2024-02-09T08:34:55.880691+0000","last_clean":"2024-02-09T08:34:55.880691+0000","last_became_active":"2024-02-09T08:04:20.679487+0000","last_became_peered":"2024-02-09T08:04:20.679487+0000","last_unstale":"2024-02-09T08:34:55.880691+0000","last_undegraded":"2024-02-09T08:34:55.880691+0000","last_fullsized":"2024-02-09T08:34:55.880691+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T19:30:24.161882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":2426,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:34:58.791569+0000","last_change":"2024-02-09T08:34:58.796393+0000","last_active":"2024-02-09T08:34:58.791569+0000","last_peered":"2024-02-09T08:34:58.791569+0000","last_clean":"2024-02-09T08:34:58.791569+0000","last_became_active":"2024-02-09T08:04:31.595670+0000","last_became_peered":"2024-02-09T08:04:31.595670+0000","last_unstale":"2024-02-09T08:34:58.791569+0000","last_undegraded":"2024-02-09T08:34:58.791569+0000","last_fullsized":"2024-02-09T08:34:58.791569+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:34:58.787397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:34:58.787397+0000","last_clean_scrub_stamp":"2024-02-09T08:34:58.787397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T18:36:55.987207+0000","scrub_duration":234,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":2417,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:34:55.903774+0000","last_change":"2024-02-09T08:04:41.266591+0000","last_active":"2024-02-09T08:34:55.903774+0000","last_peered":"2024-02-09T08:34:55.903774+0000","last_clean":"2024-02-09T08:34:55.903774+0000","last_became_active":"2024-02-09T08:04:41.259580+0000","last_became_peered":"2024-02-09T08:04:41.259580+0000","last_unstale":"2024-02-09T08:34:55.903774+0000","last_undegraded":"2024-02-09T08:34:55.903774+0000","last_fullsized":"2024-02-09T08:34:55.903774+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":2434,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:34:55.750526+0000","last_change":"2024-02-09T08:04:53.258518+0000","last_active":"2024-02-09T08:34:55.750526+0000","last_peered":"2024-02-09T08:34:55.750526+0000","last_clean":"2024-02-09T08:34:55.750526+0000","last_became_active":"2024-02-09T08:04:53.248695+0000","last_became_peered":"2024-02-09T08:04:53.248695+0000","last_unstale":"2024-02-09T08:34:55.750526+0000","last_undegraded":"2024-02-09T08:34:55.750526+0000","last_fullsized":"2024-02-09T08:34:55.750526+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T19:57:41.278249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":2441,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:34:55.782794+0000","last_change":"2024-02-09T08:04:39.731324+0000","last_active":"2024-02-09T08:34:55.782794+0000","last_peered":"2024-02-09T08:34:55.782794+0000","last_clean":"2024-02-09T08:34:55.782794+0000","last_became_active":"2024-02-09T08:04:39.726089+0000","last_became_peered":"2024-02-09T08:04:39.726089+0000","last_unstale":"2024-02-09T08:34:55.782794+0000","last_undegraded":"2024-02-09T08:34:55.782794+0000","last_fullsized":"2024-02-09T08:34:55.782794+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T17:50:58.258753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":2411,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:34:55.915464+0000","last_change":"2024-02-09T08:04:18.181620+0000","last_active":"2024-02-09T08:34:55.915464+0000","last_peered":"2024-02-09T08:34:55.915464+0000","last_clean":"2024-02-09T08:34:55.915464+0000","last_became_active":"2024-02-09T08:04:18.174506+0000","last_became_peered":"2024-02-09T08:04:18.174506+0000","last_unstale":"2024-02-09T08:34:55.915464+0000","last_undegraded":"2024-02-09T08:34:55.915464+0000","last_fullsized":"2024-02-09T08:34:55.915464+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:04:11.529462+0000","last_clean_scrub_stamp":"2024-02-09T08:04:11.529462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":2420,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:34:59.766402+0000","last_change":"2024-02-09T08:34:59.767234+0000","last_active":"2024-02-09T08:34:59.766402+0000","last_peered":"2024-02-09T08:34:59.766402+0000","last_clean":"2024-02-09T08:34:59.766402+0000","last_became_active":"2024-02-09T08:04:23.899068+0000","last_became_peered":"2024-02-09T08:04:23.899068+0000","last_unstale":"2024-02-09T08:34:59.766402+0000","last_undegraded":"2024-02-09T08:34:59.766402+0000","last_fullsized":"2024-02-09T08:34:59.766402+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:34:59.764882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:34:59.764882+0000","last_clean_scrub_stamp":"2024-02-09T08:34:59.764882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T09:20:40.588138+0000","scrub_duration":92,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":21,"seq":90194313596,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71156,"kb_used_data":3880,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94300684,"statfs":{"total":96636764160,"available":96563900416,"internally_reserved":0,"allocated":3973120,"data_stored":1617055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68876743},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 9 08:34:53 2024","interfaces":[{"interface":"back","average":{"1min":24.666,"5min":21.817,"15min":34.436999999999998},"min":{"1min":5.2300000000000004,"5min":4.3630000000000004,"15min":4.3630000000000004},"max":{"1min":143.453,"5min":177.68199999999999,"15min":435.74099999999999},"last":5.6189999999999998},{"interface":"front","average":{"1min":18.814,"5min":18.297000000000001,"15min":31.661999999999999},"min":{"1min":4.9489999999999998,"5min":4.5599999999999996,"15min":4.5140000000000002},"max":{"1min":137.261,"5min":157.96600000000001,"15min":530.76499999999999},"last":7.9939999999999998}]},{"osd":1,"last update":"Fri Feb 9 08:34:40 2024","interfaces":[{"interface":"back","average":{"1min":23.754000000000001,"5min":27.858000000000001,"15min":41.049999999999997},"min":{"1min":10.205,"5min":8.8209999999999997,"15min":6.3339999999999996},"max":{"1min":133.12,"5min":220.53999999999999,"15min":367.85500000000002},"last":13.846},{"interface":"front","average":{"1min":16.032,"5min":22.309999999999999,"15min":33.643000000000001},"min":{"1min":7.2750000000000004,"5min":4.9809999999999999,"15min":4.9809999999999999},"max":{"1min":88.522000000000006,"5min":190.19399999999999,"15min":328.70400000000001},"last":9.2919999999999998}]},{"osd":2,"last update":"Fri Feb 9 08:34:36 2024","interfaces":[{"interface":"back","average":{"1min":20.32,"5min":21.036999999999999,"15min":30.809999999999999},"min":{"1min":7.79,"5min":7.5300000000000002,"15min":6.8380000000000001},"max":{"1min":109.685,"5min":154.72399999999999,"15min":296.97199999999998},"last":11.420999999999999},{"interface":"front","average":{"1min":28.870000000000001,"5min":27.794,"15min":39.774999999999999},"min":{"1min":11.637,"5min":8.6769999999999996,"15min":8.6769999999999996},"max":{"1min":197.815,"5min":197.815,"15min":307.27800000000002},"last":15.951000000000001}]},{"osd":4,"last update":"Fri Feb 9 08:34:49 2024","interfaces":[{"interface":"back","average":{"1min":26.966000000000001,"5min":27.829000000000001,"15min":41.098999999999997},"min":{"1min":11.055999999999999,"5min":9.0449999999999999,"15min":7.1340000000000003},"max":{"1min":170.048,"5min":206.846,"15min":590.62699999999995},"last":14.481999999999999},{"interface":"front","average":{"1min":22.779,"5min":25.157,"15min":36.898000000000003},"min":{"1min":8.5090000000000003,"5min":8.3049999999999997,"15min":8.3049999999999997},"max":{"1min":135.785,"5min":199.39099999999999,"15min":360.63799999999998},"last":12.087}]},{"osd":5,"last update":"Fri Feb 9 08:34:19 2024","interfaces":[{"interface":"back","average":{"1min":9.4120000000000008,"5min":27.838999999999999,"15min":38.497999999999998},"min":{"1min":6.3940000000000001,"5min":6.3940000000000001,"15min":6.3179999999999996},"max":{"1min":14.587999999999999,"5min":287.38499999999999,"15min":593.90599999999995},"last":10.353},{"interface":"front","average":{"1min":15.715,"5min":37.125,"15min":46.695},"min":{"1min":10.574999999999999,"5min":10.532999999999999,"15min":7.7590000000000003},"max":{"1min":21.821000000000002,"5min":296.96100000000001,"15min":595.14099999999996},"last":17.638999999999999}]},{"osd":6,"last update":"Fri Feb 9 08:34:49 2024","interfaces":[{"interface":"back","average":{"1min":21.231000000000002,"5min":24.145,"15min":38.218000000000004},"min":{"1min":7.9770000000000003,"5min":6.585,"15min":6.585},"max":{"1min":141.916,"5min":161.392,"15min":466.93099999999998},"last":13.244999999999999},{"interface":"front","average":{"1min":26.686,"5min":27.655999999999999,"15min":40.771999999999998},"min":{"1min":13.359,"5min":9.4870000000000001,"15min":7.5599999999999996},"max":{"1min":156.434,"5min":168.48500000000001,"15min":713.92999999999995},"last":15.121}]},{"osd":7,"last update":"Fri Feb 9 08:34:53 2024","interfaces":[{"interface":"back","average":{"1min":30.736999999999998,"5min":33.331000000000003,"15min":46.25},"min":{"1min":12.933999999999999,"5min":9.6359999999999992,"15min":8.3849999999999998},"max":{"1min":191.77199999999999,"5min":209.655,"15min":591.36599999999999},"last":18.486999999999998},{"interface":"front","average":{"1min":32.095999999999997,"5min":35.481999999999999,"15min":49.152000000000001},"min":{"1min":13.523999999999999,"5min":13.031000000000001,"15min":11.82},"max":{"1min":192.63300000000001,"5min":245.21600000000001,"15min":815.34000000000003},"last":19.358000000000001}]}]},{"osd":4,"up_from":20,"seq":85899346299,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66996,"kb_used_data":3880,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94304844,"statfs":{"total":96636764160,"available":96568160256,"internally_reserved":0,"allocated":3973120,"data_stored":1617055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 9 08:34:44 2024","interfaces":[{"interface":"back","average":{"1min":10.693,"5min":17.425000000000001,"15min":22.245000000000001},"min":{"1min":4.7210000000000001,"5min":4.7210000000000001,"15min":4.1289999999999996},"max":{"1min":26.428999999999998,"5min":230.53100000000001,"15min":436.31999999999999},"last":13.974},{"interface":"front","average":{"1min":11.77,"5min":14.401999999999999,"15min":20.047999999999998},"min":{"1min":5.7830000000000004,"5min":5.4669999999999996,"15min":4.6539999999999999},"max":{"1min":72.087000000000003,"5min":122.212,"15min":313.82600000000002},"last":8.4380000000000006}]},{"osd":1,"last update":"Fri Feb 9 08:34:44 2024","interfaces":[{"interface":"back","average":{"1min":13.816000000000001,"5min":16.184999999999999,"15min":22.974},"min":{"1min":7.6779999999999999,"5min":7.1020000000000003,"15min":5.2560000000000002},"max":{"1min":42.305,"5min":181.512,"15min":267.11399999999998},"last":18.556000000000001},{"interface":"front","average":{"1min":17.181999999999999,"5min":24.428999999999998,"15min":27.335000000000001},"min":{"1min":9.5890000000000004,"5min":7.0650000000000004,"15min":5.282},"max":{"1min":41.612000000000002,"5min":450.27100000000002,"15min":450.27100000000002},"last":19.565000000000001}]},{"osd":2,"last update":"Fri Feb 9 08:34:44 2024","interfaces":[{"interface":"back","average":{"1min":14.859999999999999,"5min":18.300000000000001,"15min":24.43},"min":{"1min":6.4489999999999998,"5min":6.3209999999999997,"15min":6.1159999999999997},"max":{"1min":62.048000000000002,"5min":133.65600000000001,"15min":380.56599999999997},"last":7.7599999999999998},{"interface":"front","average":{"1min":18.081,"5min":21.329000000000001,"15min":28.344999999999999},"min":{"1min":7.6710000000000003,"5min":6.7039999999999997,"15min":6.7039999999999997},"max":{"1min":149.84800000000001,"5min":150.18100000000001,"15min":328.28100000000001},"last":10.609999999999999}]},{"osd":3,"last update":"Fri Feb 9 08:34:45 2024","interfaces":[{"interface":"back","average":{"1min":16.779,"5min":20.786000000000001,"15min":33.490000000000002},"min":{"1min":7.3289999999999997,"5min":6.8360000000000003,"15min":6.8360000000000003},"max":{"1min":115.795,"5min":147.76900000000001,"15min":957.68299999999999},"last":12.377000000000001},{"interface":"front","average":{"1min":20.568999999999999,"5min":23.959,"15min":35.015000000000001},"min":{"1min":9.9320000000000004,"5min":8.4870000000000001,"15min":6.7359999999999998},"max":{"1min":151.346,"5min":203.74700000000001,"15min":1190.1980000000001},"last":9.7249999999999996}]},{"osd":5,"last update":"Fri Feb 9 08:34:44 2024","interfaces":[{"interface":"back","average":{"1min":24.512,"5min":17.521000000000001,"15min":25.984999999999999},"min":{"1min":6.2759999999999998,"5min":6.2759999999999998,"15min":6.2759999999999998},"max":{"1min":305.34100000000001,"5min":305.34100000000001,"15min":375.72000000000003},"last":15.753},{"interface":"front","average":{"1min":21.675999999999998,"5min":22.166,"15min":26.899000000000001},"min":{"1min":10.917999999999999,"5min":10.558,"15min":6.585},"max":{"1min":128.261,"5min":141.596,"15min":429.53500000000003},"last":11.611000000000001}]},{"osd":6,"last update":"Fri Feb 9 08:34:44 2024","interfaces":[{"interface":"back","average":{"1min":24.588000000000001,"5min":25.984999999999999,"15min":30.030999999999999},"min":{"1min":12.113,"5min":11.869999999999999,"15min":8.4760000000000009},"max":{"1min":100.815,"5min":205.577,"15min":300.27100000000002},"last":14.558999999999999},{"interface":"front","average":{"1min":35.454999999999998,"5min":24.370000000000001,"15min":29.376999999999999},"min":{"1min":8.0079999999999991,"5min":7.0389999999999997,"15min":7.0389999999999997},"max":{"1min":378.00099999999998,"5min":378.00099999999998,"15min":378.00099999999998},"last":13.212}]},{"osd":7,"last update":"Fri Feb 9 08:34:44 2024","interfaces":[{"interface":"back","average":{"1min":18.373999999999999,"5min":18.158999999999999,"15min":27.742000000000001},"min":{"1min":8.9670000000000005,"5min":6.2039999999999997,"15min":6.2039999999999997},"max":{"1min":93.730000000000004,"5min":93.730000000000004,"15min":349.47500000000002},"last":17.553000000000001},{"interface":"front","average":{"1min":21.815000000000001,"5min":19.652999999999999,"15min":28.613},"min":{"1min":9.1069999999999993,"5min":9.0739999999999998,"15min":9.0739999999999998},"max":{"1min":130.899,"5min":130.899,"15min":381.80399999999997},"last":15.201000000000001}]}]},{"osd":1,"up_from":16,"seq":68719477114,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71552,"kb_used_data":4276,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94300288,"statfs":{"total":96636764160,"available":96563494912,"internally_reserved":0,"allocated":4378624,"data_stored":2014900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 9 08:34:05 2024","interfaces":[{"interface":"back","average":{"1min":9.9629999999999992,"5min":23.974,"15min":21.896999999999998},"min":{"1min":6.3019999999999996,"5min":5.532,"15min":4.431},"max":{"1min":17.344999999999999,"5min":206.726,"15min":212.11199999999999},"last":7.2530000000000001},{"interface":"front","average":{"1min":13.121,"5min":29.670000000000002,"15min":27.291},"min":{"1min":8.6069999999999993,"5min":7.867,"15min":4.8849999999999998},"max":{"1min":21.439,"5min":246.137,"15min":468.82799999999997},"last":11.957000000000001}]},{"osd":2,"last update":"Fri Feb 9 08:34:31 2024","interfaces":[{"interface":"back","average":{"1min":33.371000000000002,"5min":24.713999999999999,"15min":24.129000000000001},"min":{"1min":9.1159999999999997,"5min":6.2510000000000003,"15min":5.2809999999999997},"max":{"1min":202.48500000000001,"5min":202.48500000000001,"15min":264.06400000000002},"last":12.749000000000001},{"interface":"front","average":{"1min":32.582999999999998,"5min":27.651,"15min":30.681000000000001},"min":{"1min":9.7490000000000006,"5min":7.8879999999999999,"15min":7.5179999999999998},"max":{"1min":164.06299999999999,"5min":181.94900000000001,"15min":417.31599999999997},"last":13.371}]},{"osd":3,"last update":"Fri Feb 9 08:34:31 2024","interfaces":[{"interface":"back","average":{"1min":21.018000000000001,"5min":25.486000000000001,"15min":30.059000000000001},"min":{"1min":8.2370000000000001,"5min":6.2460000000000004,"15min":6.2460000000000004},"max":{"1min":146.39099999999999,"5min":237.40799999999999,"15min":421.22300000000001},"last":14.054},{"interface":"front","average":{"1min":23.954000000000001,"5min":29.001999999999999,"15min":32.527000000000001},"min":{"1min":9.7919999999999998,"5min":9.6479999999999997,"15min":8.5730000000000004},"max":{"1min":150.655,"5min":251.86199999999999,"15min":434.92500000000001},"last":17.809000000000001}]},{"osd":4,"last update":"Fri Feb 9 08:34:52 2024","interfaces":[{"interface":"back","average":{"1min":36.454999999999998,"5min":24.324999999999999,"15min":23.346},"min":{"1min":6.468,"5min":6.468,"15min":6.468},"max":{"1min":171.54400000000001,"5min":171.54400000000001,"15min":171.54400000000001},"last":15.348000000000001},{"interface":"front","average":{"1min":28.584,"5min":19.079000000000001,"15min":21.050999999999998},"min":{"1min":6.5110000000000001,"5min":5.6890000000000001,"15min":5.6890000000000001},"max":{"1min":168.749,"5min":168.749,"15min":179.363},"last":10.137}]},{"osd":5,"last update":"Fri Feb 9 08:34:05 2024","interfaces":[{"interface":"back","average":{"1min":10.693,"5min":23.084,"15min":28.024999999999999},"min":{"1min":6.8529999999999998,"5min":6.3220000000000001,"15min":6.3220000000000001},"max":{"1min":16.337,"5min":195.422,"15min":455.44299999999998},"last":8.4529999999999994},{"interface":"front","average":{"1min":13.891999999999999,"5min":25.102,"15min":31.346},"min":{"1min":9.3130000000000006,"5min":8.0899999999999999,"15min":8.0899999999999999},"max":{"1min":19.707999999999998,"5min":197.43199999999999,"15min":469.512},"last":10.750999999999999}]},{"osd":6,"last update":"Fri Feb 9 08:34:31 2024","interfaces":[{"interface":"back","average":{"1min":26.119,"5min":25.067,"15min":28.399000000000001},"min":{"1min":10.398999999999999,"5min":9.6460000000000008,"15min":8.1270000000000007},"max":{"1min":175.44,"5min":175.44,"15min":345.596},"last":14.736000000000001},{"interface":"front","average":{"1min":28.597000000000001,"5min":28.733000000000001,"15min":30.506},"min":{"1min":12.433,"5min":11.949,"15min":7.7160000000000002},"max":{"1min":176.929,"5min":176.929,"15min":423.88400000000001},"last":19.818000000000001}]},{"osd":7,"last update":"Fri Feb 9 08:34:31 2024","interfaces":[{"interface":"back","average":{"1min":27.841999999999999,"5min":27.408999999999999,"15min":30.664000000000001},"min":{"1min":11.976000000000001,"5min":11.976000000000001,"15min":9.1010000000000009},"max":{"1min":128.32599999999999,"5min":159.02600000000001,"15min":418.42500000000001},"last":17.079000000000001},{"interface":"front","average":{"1min":27.018999999999998,"5min":28.265000000000001,"15min":30.824000000000002},"min":{"1min":13.486000000000001,"5min":12.634,"15min":8.8149999999999995},"max":{"1min":130.70599999999999,"5min":161.59999999999999,"15min":377.685},"last":18.547000000000001}]}]},{"osd":7,"up_from":15,"seq":64424509825,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71156,"kb_used_data":3880,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94300684,"statfs":{"total":96636764160,"available":96563900416,"internally_reserved":0,"allocated":3973120,"data_stored":1617055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":68876746},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 9 08:35:01 2024","interfaces":[{"interface":"back","average":{"1min":20.501999999999999,"5min":19.914000000000001,"15min":19.274000000000001},"min":{"1min":4.7439999999999998,"5min":4.3600000000000003,"15min":4.3600000000000003},"max":{"1min":145.61799999999999,"5min":312.15699999999998,"15min":312.15699999999998},"last":12.957000000000001},{"interface":"front","average":{"1min":18.420000000000002,"5min":20.728999999999999,"15min":20.725000000000001},"min":{"1min":6.0270000000000001,"5min":4.5410000000000004,"15min":4.0830000000000002},"max":{"1min":127.39700000000001,"5min":315.53399999999999,"15min":315.53399999999999},"last":9.3390000000000004}]},{"osd":1,"last update":"Fri Feb 9 08:34:48 2024","interfaces":[{"interface":"back","average":{"1min":16.395,"5min":21.608000000000001,"15min":33.338999999999999},"min":{"1min":6.5149999999999997,"5min":5.859,"15min":4.5279999999999996},"max":{"1min":76.780000000000001,"5min":277.971,"15min":1551.0129999999999},"last":18.425000000000001},{"interface":"front","average":{"1min":19.09,"5min":23.619,"15min":31.817},"min":{"1min":9.5350000000000001,"5min":5.5709999999999997,"15min":5.5709999999999997},"max":{"1min":75.843999999999994,"5min":318.48500000000001,"15min":1189.5050000000001},"last":10.776999999999999}]},{"osd":2,"last update":"Fri Feb 9 08:35:01 2024","interfaces":[{"interface":"back","average":{"1min":33.542000000000002,"5min":26.085999999999999,"15min":23.984999999999999},"min":{"1min":6.7080000000000002,"5min":5.7249999999999996,"15min":5.7249999999999996},"max":{"1min":196.00200000000001,"5min":309.161,"15min":309.161},"last":8.3970000000000002},{"interface":"front","average":{"1min":36.555999999999997,"5min":28.542000000000002,"15min":26.382999999999999},"min":{"1min":8.0670000000000002,"5min":6.9539999999999997,"15min":6.9050000000000002},"max":{"1min":186.31100000000001,"5min":333.91399999999999,"15min":333.91399999999999},"last":11.603999999999999}]},{"osd":3,"last update":"Fri Feb 9 08:34:11 2024","interfaces":[{"interface":"back","average":{"1min":13.24,"5min":28.524000000000001,"15min":32.805},"min":{"1min":6.516,"5min":6.516,"15min":6.516},"max":{"1min":18.763000000000002,"5min":310.67399999999998,"15min":429.62799999999999},"last":14.371},{"interface":"front","average":{"1min":12.640000000000001,"5min":28.494,"15min":36.866},"min":{"1min":7.9139999999999997,"5min":6.3680000000000003,"15min":6.3680000000000003},"max":{"1min":17.683,"5min":317.71699999999998,"15min":485.76100000000002},"last":13.781000000000001}]},{"osd":4,"last update":"Fri Feb 9 08:34:48 2024","interfaces":[{"interface":"back","average":{"1min":17.018999999999998,"5min":30.007000000000001,"15min":29.927},"min":{"1min":7.8369999999999997,"5min":7.7869999999999999,"15min":7.7869999999999999},"max":{"1min":47.853999999999999,"5min":324.089,"15min":345.54300000000001},"last":16.645},{"interface":"front","average":{"1min":19.475999999999999,"5min":32.319000000000003,"15min":31.989999999999998},"min":{"1min":10.106,"5min":10.106,"15min":10.106},"max":{"1min":49.270000000000003,"5min":316.80399999999997,"15min":316.80399999999997},"last":17.670000000000002}]},{"osd":5,"last update":"Fri Feb 9 08:35:01 2024","interfaces":[{"interface":"back","average":{"1min":40.719000000000001,"5min":30.523,"15min":27.393999999999998},"min":{"1min":8.0790000000000006,"5min":6.6689999999999996,"15min":6.1459999999999999},"max":{"1min":238.01400000000001,"5min":333.00700000000001,"15min":333.00700000000001},"last":8.0790000000000006},{"interface":"front","average":{"1min":32.722000000000001,"5min":32.274000000000001,"15min":27.937000000000001},"min":{"1min":9.2680000000000007,"5min":7.508,"15min":6.3499999999999996},"max":{"1min":135.202,"5min":352.358,"15min":352.358},"last":19.562000000000001}]},{"osd":6,"last update":"Fri Feb 9 08:35:01 2024","interfaces":[{"interface":"back","average":{"1min":43.994,"5min":31.199000000000002,"15min":29.141999999999999},"min":{"1min":10.817,"5min":7.2240000000000002,"15min":6.8879999999999999},"max":{"1min":306.78500000000003,"5min":338.29000000000002,"15min":338.29000000000002},"last":12.228},{"interface":"front","average":{"1min":46.667000000000002,"5min":33.759999999999998,"15min":33.655999999999999},"min":{"1min":13.721,"5min":12.204000000000001,"15min":9.3729999999999993},"max":{"1min":309,"5min":349.34500000000003,"15min":349.34500000000003},"last":15.872999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509824,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71156,"kb_used_data":3880,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94300684,"statfs":{"total":96636764160,"available":96563900416,"internally_reserved":0,"allocated":3973120,"data_stored":1617055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 9 08:34:02 2024","interfaces":[{"interface":"back","average":{"1min":8.6820000000000004,"5min":18.645,"15min":24.832000000000001},"min":{"1min":4.2380000000000004,"5min":4.2380000000000004,"15min":4.1589999999999998},"max":{"1min":18.015000000000001,"5min":167.62899999999999,"15min":318.44400000000002},"last":6.6470000000000002},{"interface":"front","average":{"1min":10.906000000000001,"5min":22.431999999999999,"15min":27.635999999999999},"min":{"1min":5.8159999999999998,"5min":4.6589999999999998,"15min":4.6589999999999998},"max":{"1min":17.667999999999999,"5min":216.55000000000001,"15min":340.25599999999997},"last":9.3859999999999992}]},{"osd":1,"last update":"Fri Feb 9 08:34:08 2024","interfaces":[{"interface":"back","average":{"1min":8.4719999999999995,"5min":28.818999999999999,"15min":28.925999999999998},"min":{"1min":6.0149999999999997,"5min":5.9960000000000004,"15min":5.093},"max":{"1min":15.109,"5min":368.74200000000002,"15min":664.64300000000003},"last":7.9420000000000002},{"interface":"front","average":{"1min":11.473000000000001,"5min":30.515999999999998,"15min":29.097000000000001},"min":{"1min":8.0129999999999999,"5min":7.1449999999999996,"15min":6.5780000000000003},"max":{"1min":18.710000000000001,"5min":258.34500000000003,"15min":369.96899999999999},"last":11.263}]},{"osd":2,"last update":"Fri Feb 9 08:34:02 2024","interfaces":[{"interface":"back","average":{"1min":12.372,"5min":27.215,"15min":29.059999999999999},"min":{"1min":7.3799999999999999,"5min":6.7300000000000004,"15min":6.7300000000000004},"max":{"1min":19.559999999999999,"5min":290.71600000000001,"15min":290.71600000000001},"last":10.198},{"interface":"front","average":{"1min":13.106999999999999,"5min":26.222999999999999,"15min":28.597000000000001},"min":{"1min":8.1549999999999994,"5min":7.2320000000000002,"15min":6.6719999999999997},"max":{"1min":18.646000000000001,"5min":286.08699999999999,"15min":286.08699999999999},"last":19.631}]},{"osd":3,"last update":"Fri Feb 9 08:34:08 2024","interfaces":[{"interface":"back","average":{"1min":14.584,"5min":33.146000000000001,"15min":34.277000000000001},"min":{"1min":9.1270000000000007,"5min":8.827,"15min":7.5209999999999999},"max":{"1min":19.896000000000001,"5min":247.40700000000001,"15min":400.87099999999998},"last":12.324999999999999},{"interface":"front","average":{"1min":12.955,"5min":31.477,"15min":38.030999999999999},"min":{"1min":9.0350000000000001,"5min":6.4420000000000002,"15min":6.4420000000000002},"max":{"1min":17.111999999999998,"5min":273.38499999999999,"15min":401.97300000000001},"last":13.154999999999999}]},{"osd":4,"last update":"Fri Feb 9 08:34:42 2024","interfaces":[{"interface":"back","average":{"1min":27.59,"5min":28.632999999999999,"15min":29.07},"min":{"1min":11.359,"5min":8.8100000000000005,"15min":6.9800000000000004},"max":{"1min":193.97499999999999,"5min":243.23599999999999,"15min":339.286},"last":14.036},{"interface":"front","average":{"1min":30.446000000000002,"5min":34.627000000000002,"15min":35.954000000000001},"min":{"1min":14.337999999999999,"5min":11.573,"15min":10.298999999999999},"max":{"1min":198.60400000000001,"5min":243.86600000000001,"15min":402.19099999999997},"last":17.486000000000001}]},{"osd":5,"last update":"Fri Feb 9 08:34:02 2024","interfaces":[{"interface":"back","average":{"1min":13.428000000000001,"5min":26.620999999999999,"15min":25.609000000000002},"min":{"1min":7.5650000000000004,"5min":6.8390000000000004,"15min":6.0170000000000003},"max":{"1min":19.347999999999999,"5min":395.89999999999998,"15min":395.89999999999998},"last":15.372999999999999},{"interface":"front","average":{"1min":18.483000000000001,"5min":39.442999999999998,"15min":34.320999999999998},"min":{"1min":14.18,"5min":8.1449999999999996,"15min":8.1449999999999996},"max":{"1min":22.501999999999999,"5min":665.33799999999997,"15min":665.33799999999997},"last":18.640000000000001}]},{"osd":7,"last update":"Fri Feb 9 08:34:55 2024","interfaces":[{"interface":"back","average":{"1min":20.887,"5min":23.414999999999999,"15min":27.416},"min":{"1min":8.8010000000000002,"5min":7.9889999999999999,"15min":7.9429999999999996},"max":{"1min":80.307000000000002,"5min":264.161,"15min":326.23200000000003},"last":14.752000000000001},{"interface":"front","average":{"1min":23.617000000000001,"5min":27.332999999999998,"15min":30.577000000000002},"min":{"1min":12.741,"5min":10.56,"15min":8.7810000000000006},"max":{"1min":83.254000000000005,"5min":242.25299999999999,"15min":315.09199999999998},"last":16.731999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509820,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71152,"kb_used_data":3880,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94300688,"statfs":{"total":96636764160,"available":96563904512,"internally_reserved":0,"allocated":3973120,"data_stored":1617055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 9 08:34:56 2024","interfaces":[{"interface":"back","average":{"1min":16.405000000000001,"5min":16.681000000000001,"15min":22.327000000000002},"min":{"1min":8.9139999999999997,"5min":5.6719999999999997,"15min":4.1859999999999999},"max":{"1min":57.972999999999999,"5min":236.542,"15min":236.542},"last":18.452999999999999},{"interface":"front","average":{"1min":19.302,"5min":19.050000000000001,"15min":26.498999999999999},"min":{"1min":6.952,"5min":6.8529999999999998,"15min":5.0830000000000002},"max":{"1min":66.572000000000003,"5min":237.27000000000001,"15min":258.41800000000001},"last":19.268000000000001}]},{"osd":1,"last update":"Fri Feb 9 08:34:34 2024","interfaces":[{"interface":"back","average":{"1min":19.222999999999999,"5min":13.205,"15min":27.302},"min":{"1min":5.681,"5min":5.2800000000000002,"15min":5.2080000000000002},"max":{"1min":170.83000000000001,"5min":170.83000000000001,"15min":752.81500000000005},"last":6.9749999999999996},{"interface":"front","average":{"1min":26.896999999999998,"5min":23.623999999999999,"15min":36.237000000000002},"min":{"1min":9.7539999999999996,"5min":9.5890000000000004,"15min":6.8819999999999997},"max":{"1min":169.58099999999999,"5min":202.91,"15min":752.245},"last":20.175999999999998}]},{"osd":3,"last update":"Fri Feb 9 08:34:56 2024","interfaces":[{"interface":"back","average":{"1min":28.867000000000001,"5min":29.812999999999999,"15min":37.604999999999997},"min":{"1min":11.935,"5min":6.7709999999999999,"15min":5.7949999999999999},"max":{"1min":84.561000000000007,"5min":325.14499999999998,"15min":846.35400000000004},"last":21.030999999999999},{"interface":"front","average":{"1min":23.334,"5min":19.262,"15min":32.069000000000003},"min":{"1min":6.9509999999999996,"5min":5.9969999999999999,"15min":5.5490000000000004},"max":{"1min":168.458,"5min":235.749,"15min":334.87900000000002},"last":9.8610000000000007}]},{"osd":4,"last update":"Fri Feb 9 08:34:56 2024","interfaces":[{"interface":"back","average":{"1min":28.73,"5min":23.553999999999998,"15min":29.974},"min":{"1min":10.797000000000001,"5min":10.058999999999999,"15min":7.7110000000000003},"max":{"1min":92.694999999999993,"5min":254.77799999999999,"15min":423.28199999999998},"last":21.850000000000001},{"interface":"front","average":{"1min":29.489999999999998,"5min":25.640999999999998,"15min":32.055999999999997},"min":{"1min":15.862,"5min":12.321999999999999,"15min":12.132999999999999},"max":{"1min":91.143000000000001,"5min":253.941,"15min":297.73399999999998},"last":22.940000000000001}]},{"osd":5,"last update":"Fri Feb 9 08:34:56 2024","interfaces":[{"interface":"back","average":{"1min":21.995000000000001,"5min":18.247,"15min":28.542000000000002},"min":{"1min":6.5010000000000003,"5min":6.5010000000000003,"15min":6.1870000000000003},"max":{"1min":145.33500000000001,"5min":150.24799999999999,"15min":319.279},"last":10.976000000000001},{"interface":"front","average":{"1min":23.859999999999999,"5min":23.346,"15min":33.639000000000003},"min":{"1min":9.2219999999999995,"5min":6.21,"15min":6.21},"max":{"1min":86.998000000000005,"5min":283.18900000000002,"15min":314.74299999999999},"last":14.068}]},{"osd":6,"last update":"Fri Feb 9 08:34:56 2024","interfaces":[{"interface":"back","average":{"1min":36.523000000000003,"5min":24.001000000000001,"15min":35.146999999999998},"min":{"1min":15.282999999999999,"5min":12.33,"15min":9.859},"max":{"1min":151.12100000000001,"5min":151.12100000000001,"15min":301.05099999999999},"last":23.997},{"interface":"front","average":{"1min":35.552,"5min":25.722999999999999,"15min":35.530000000000001},"min":{"1min":17.172000000000001,"5min":13.566000000000001,"15min":13.298},"max":{"1min":122.627,"5min":122.627,"15min":273.30500000000001},"last":24.684000000000001}]},{"osd":7,"last update":"Fri Feb 9 08:34:34 2024","interfaces":[{"interface":"back","average":{"1min":15.26,"5min":13.488,"15min":26.422999999999998},"min":{"1min":7.3300000000000001,"5min":7.3300000000000001,"15min":6.3849999999999998},"max":{"1min":86.403000000000006,"5min":88.838999999999999,"15min":303.416},"last":11.648999999999999},{"interface":"front","average":{"1min":19.038,"5min":16.216000000000001,"15min":30.358000000000001},"min":{"1min":8.7520000000000007,"5min":8.2449999999999992,"15min":7.7999999999999998},"max":{"1min":107.05,"5min":107.05,"15min":498.34300000000002},"last":14.467000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509818,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66996,"kb_used_data":3884,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94304844,"statfs":{"total":96636764160,"available":96568160256,"internally_reserved":0,"allocated":3977216,"data_stored":1617060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Feb 9 08:34:30 2024","interfaces":[{"interface":"back","average":{"1min":13.795,"5min":19.091000000000001,"15min":26.939},"min":{"1min":5.9130000000000003,"5min":4.306,"15min":4.306},"max":{"1min":45.713000000000001,"5min":119.645,"15min":305.28699999999998},"last":16.600999999999999},{"interface":"front","average":{"1min":25.221,"5min":25.786999999999999,"15min":37.503999999999998},"min":{"1min":7.8170000000000002,"5min":6.3170000000000002,"15min":6.3170000000000002},"max":{"1min":213.21299999999999,"5min":229.71100000000001,"15min":409.27699999999999},"last":19.93}]},{"osd":2,"last update":"Fri Feb 9 08:34:57 2024","interfaces":[{"interface":"back","average":{"1min":19.652999999999999,"5min":16.780000000000001,"15min":22.919},"min":{"1min":5.2270000000000003,"5min":5.2270000000000003,"15min":4.7439999999999998},"max":{"1min":77.718000000000004,"5min":169.529,"15min":391.44600000000003},"last":14.170999999999999},{"interface":"front","average":{"1min":23.157,"5min":19.033999999999999,"15min":25.393999999999998},"min":{"1min":6.2249999999999996,"5min":4.5469999999999997,"15min":4.5469999999999997},"max":{"1min":164.23699999999999,"5min":184.84299999999999,"15min":312.03899999999999},"last":12.481}]},{"osd":3,"last update":"Fri Feb 9 08:34:40 2024","interfaces":[{"interface":"back","average":{"1min":20.146999999999998,"5min":23.992999999999999,"15min":39.951999999999998},"min":{"1min":9.1579999999999995,"5min":9.1579999999999995,"15min":8.391},"max":{"1min":65.817999999999998,"5min":188.982,"15min":464.74900000000002},"last":17.905000000000001},{"interface":"front","average":{"1min":24.324999999999999,"5min":29.202000000000002,"15min":46.600000000000001},"min":{"1min":14.225,"5min":11.369999999999999,"15min":10.288},"max":{"1min":66.498999999999995,"5min":191.452,"15min":472.88},"last":22.827000000000002}]},{"osd":4,"last update":"Fri Feb 9 08:34:40 2024","interfaces":[{"interface":"back","average":{"1min":30.094000000000001,"5min":26.760999999999999,"15min":42.034999999999997},"min":{"1min":12.295999999999999,"5min":10.787000000000001,"15min":6.9569999999999999},"max":{"1min":213.91499999999999,"5min":213.91499999999999,"15min":544.02800000000002},"last":21.539000000000001},{"interface":"front","average":{"1min":16.696999999999999,"5min":19.814,"15min":31.989000000000001},"min":{"1min":6.5010000000000003,"5min":6.5010000000000003,"15min":5.8869999999999996},"max":{"1min":93.179000000000002,"5min":206.73400000000001,"15min":377.84300000000002},"last":10.284000000000001}]},{"osd":5,"last update":"Fri Feb 9 08:34:10 2024","interfaces":[{"interface":"back","average":{"1min":17.556999999999999,"5min":37.707999999999998,"15min":39.712000000000003},"min":{"1min":14.488,"5min":11.706,"15min":7.0730000000000004},"max":{"1min":21.827000000000002,"5min":363.94499999999999,"15min":432.82999999999998},"last":24.369},{"interface":"front","average":{"1min":11.15,"5min":28.911999999999999,"15min":41.231999999999999},"min":{"1min":7.3319999999999999,"5min":6.532,"15min":6.532},"max":{"1min":15.500999999999999,"5min":327.69499999999999,"15min":357.50999999999999},"last":11.428000000000001}]},{"osd":6,"last update":"Fri Feb 9 08:34:30 2024","interfaces":[{"interface":"back","average":{"1min":13.712999999999999,"5min":24.167000000000002,"15min":37.954000000000001},"min":{"1min":7.2910000000000004,"5min":7.2910000000000004,"15min":6.399},"max":{"1min":36.033999999999999,"5min":156.667,"15min":544.94200000000001},"last":14.932},{"interface":"front","average":{"1min":16.936,"5min":21.940000000000001,"15min":39.573999999999998},"min":{"1min":10.241,"5min":7.8369999999999997,"15min":7.8369999999999997},"max":{"1min":42.064999999999998,"5min":179.739,"15min":556.30200000000002},"last":19.041}]},{"osd":7,"last update":"Fri Feb 9 08:34:05 2024","interfaces":[{"interface":"back","average":{"1min":18.141999999999999,"5min":31.879999999999999,"15min":39.683999999999997},"min":{"1min":13.984,"5min":13.481,"15min":12.752000000000001},"max":{"1min":22.928000000000001,"5min":195.91499999999999,"15min":376.91800000000001},"last":25.686},{"interface":"front","average":{"1min":13.333,"5min":24.809999999999999,"15min":28.041},"min":{"1min":8.516,"5min":7.3310000000000004,"15min":7.0880000000000001},"max":{"1min":19.937999999999999,"5min":204.74199999999999,"15min":342.79300000000001},"last":13.579000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575230,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":75708,"kb_used_data":4272,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94296132,"statfs":{"total":96636764160,"available":96559239168,"internally_reserved":0,"allocated":4374528,"data_stored":2014895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 9 08:34:12 2024","interfaces":[{"interface":"back","average":{"1min":8.1720000000000006,"5min":15.773999999999999,"15min":23.449000000000002},"min":{"1min":4.9909999999999997,"5min":4.5490000000000004,"15min":4.4509999999999996},"max":{"1min":16.233000000000001,"5min":146.63499999999999,"15min":403.41699999999997},"last":6.9420000000000002},{"interface":"front","average":{"1min":11.595000000000001,"5min":16.646000000000001,"15min":23.884},"min":{"1min":5.1130000000000004,"5min":4.7370000000000001,"15min":4.391},"max":{"1min":21.962,"5min":194.32300000000001,"15min":279.5},"last":7.8140000000000001}]},{"osd":1,"last update":"Fri Feb 9 08:34:52 2024","interfaces":[{"interface":"back","average":{"1min":25.527999999999999,"5min":25.521999999999998,"15min":24.611999999999998},"min":{"1min":5.5220000000000002,"5min":5.5220000000000002,"15min":5.4550000000000001},"max":{"1min":163.779,"5min":303.23500000000001,"15min":303.23500000000001},"last":9.8620000000000001},{"interface":"front","average":{"1min":32.500999999999998,"5min":34.232999999999997,"15min":30.094999999999999},"min":{"1min":9.5809999999999995,"5min":7.3390000000000004,"15min":6.7709999999999999},"max":{"1min":166.93700000000001,"5min":294.35000000000002,"15min":294.35000000000002},"last":15.9}]},{"osd":2,"last update":"Fri Feb 9 08:34:32 2024","interfaces":[{"interface":"back","average":{"1min":25.158999999999999,"5min":24.327000000000002,"15min":28.507000000000001},"min":{"1min":7.7759999999999998,"5min":6.415,"15min":6.415},"max":{"1min":174.41999999999999,"5min":287.077,"15min":364.81400000000002},"last":14.470000000000001},{"interface":"front","average":{"1min":18.797999999999998,"5min":20.239999999999998,"15min":25.591999999999999},"min":{"1min":7.3109999999999999,"5min":7.3109999999999999,"15min":6.5540000000000003},"max":{"1min":128.667,"5min":176.416,"15min":339.12700000000001},"last":8.7080000000000002}]},{"osd":3,"last update":"Fri Feb 9 08:34:32 2024","interfaces":[{"interface":"back","average":{"1min":29.274999999999999,"5min":27.763000000000002,"15min":34.323999999999998},"min":{"1min":8.1790000000000003,"5min":7.1130000000000004,"15min":7.1130000000000004},"max":{"1min":212.745,"5min":282.11000000000001,"15min":342.459},"last":16.501000000000001},{"interface":"front","average":{"1min":24.997,"5min":25.640000000000001,"15min":31.324999999999999},"min":{"1min":7.7409999999999997,"5min":7.234,"15min":6.7409999999999997},"max":{"1min":162.99600000000001,"5min":277.74700000000001,"15min":323.46899999999999},"last":18.526}]},{"osd":4,"last update":"Fri Feb 9 08:34:32 2024","interfaces":[{"interface":"back","average":{"1min":23.001999999999999,"5min":24.670000000000002,"15min":29.638000000000002},"min":{"1min":8.2539999999999996,"5min":7.0880000000000001,"15min":7.0880000000000001},"max":{"1min":188.62700000000001,"5min":223.655,"15min":336.74000000000001},"last":12.451000000000001},{"interface":"front","average":{"1min":23.012,"5min":22.286000000000001,"15min":28.931999999999999},"min":{"1min":8.3960000000000008,"5min":8.0030000000000001,"15min":7.4550000000000001},"max":{"1min":189.79499999999999,"5min":189.79499999999999,"15min":334.48500000000001},"last":21.306999999999999}]},{"osd":6,"last update":"Fri Feb 9 08:34:03 2024","interfaces":[{"interface":"back","average":{"1min":16.231000000000002,"5min":21.498999999999999,"15min":30.524999999999999},"min":{"1min":11.324999999999999,"5min":8.2799999999999994,"15min":7.742},"max":{"1min":24.632999999999999,"5min":144.80699999999999,"15min":320.85500000000002},"last":20.428000000000001},{"interface":"front","average":{"1min":18.751999999999999,"5min":24.975000000000001,"15min":33.936},"min":{"1min":12.034000000000001,"5min":11.550000000000001,"15min":10.789},"max":{"1min":25.568000000000001,"5min":188.28700000000001,"15min":411.56599999999997},"last":22.219999999999999}]},{"osd":7,"last update":"Fri Feb 9 08:34:03 2024","interfaces":[{"interface":"back","average":{"1min":14.823,"5min":23.667999999999999,"15min":27.585999999999999},"min":{"1min":8.2599999999999998,"5min":7.3650000000000002,"15min":7.3650000000000002},"max":{"1min":20.978000000000002,"5min":202.65100000000001,"15min":300.56200000000001},"last":13.167},{"interface":"front","average":{"1min":16.170000000000002,"5min":26.033000000000001,"15min":29.986999999999998},"min":{"1min":10.564,"5min":10.087999999999999,"15min":9.2189999999999994},"max":{"1min":23.199999999999999,"5min":187.536,"15min":194.726},"last":17.149000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-09T08:35:03.489 INFO:tasks.ceph:pgid 11.1a last_scrub_stamp 2024-02-09T08:04:11.529462+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=4, tm_sec=11, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=34, tm_sec=54, tm_wday=4, tm_yday=40, tm_isdst=0) 2024-02-09T08:35:03.489 INFO:tasks.ceph:pgid 11.19 last_scrub_stamp 2024-02-09T08:04:11.529462+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=4, tm_sec=11, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=34, tm_sec=54, tm_wday=4, tm_yday=40, tm_isdst=0) 2024-02-09T08:35:03.489 INFO:tasks.ceph:pgid 11.18 last_scrub_stamp 2024-02-09T08:04:11.529462+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=4, tm_sec=11, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=34, tm_sec=54, tm_wday=4, tm_yday=40, tm_isdst=0) 2024-02-09T08:35:03.489 INFO:tasks.ceph:pgid 11.7 last_scrub_stamp 2024-02-09T08:04:11.529462+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=4, tm_sec=11, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=34, tm_sec=54, tm_wday=4, tm_yday=40, tm_isdst=0) 2024-02-09T08:35:03.489 INFO:tasks.ceph:pgid 11.6 last_scrub_stamp 2024-02-09T08:04:11.529462+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=4, tm_sec=11, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=34, tm_sec=54, tm_wday=4, tm_yday=40, tm_isdst=0) 2024-02-09T08:35:03.489 INFO:tasks.ceph:pgid 11.5 last_scrub_stamp 2024-02-09T08:04:11.529462+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=4, tm_sec=11, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=34, tm_sec=54, tm_wday=4, tm_yday=40, tm_isdst=0) 2024-02-09T08:35:03.489 INFO:tasks.ceph:pgid 11.3 last_scrub_stamp 2024-02-09T08:04:11.529462+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=4, tm_sec=11, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=34, tm_sec=54, tm_wday=4, tm_yday=40, tm_isdst=0) 2024-02-09T08:35:03.490 INFO:tasks.ceph:pgid 11.2 last_scrub_stamp 2024-02-09T08:04:11.529462+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=4, tm_sec=11, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=34, tm_sec=54, tm_wday=4, tm_yday=40, tm_isdst=0) 2024-02-09T08:35:03.490 INFO:tasks.ceph:pgid 11.0 last_scrub_stamp 2024-02-09T08:04:11.529462+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=4, tm_sec=11, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=34, tm_sec=54, tm_wday=4, tm_yday=40, tm_isdst=0) 2024-02-09T08:35:03.490 INFO:tasks.ceph:pgid 11.a last_scrub_stamp 2024-02-09T08:04:11.529462+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=4, tm_sec=11, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=34, tm_sec=54, tm_wday=4, tm_yday=40, tm_isdst=0) 2024-02-09T08:35:03.490 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-02-09T08:03:10.689497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=3, tm_sec=10, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=34, tm_sec=54, tm_wday=4, tm_yday=40, tm_isdst=0) 2024-02-09T08:35:03.490 INFO:tasks.ceph:pgid 11.9 last_scrub_stamp 2024-02-09T08:04:11.529462+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=4, tm_sec=11, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=34, tm_sec=54, tm_wday=4, tm_yday=40, tm_isdst=0) 2024-02-09T08:35:03.490 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-02-09T08:03:10.689497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=3, tm_sec=10, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=34, tm_sec=54, tm_wday=4, tm_yday=40, tm_isdst=0) 2024-02-09T08:35:03.490 INFO:tasks.ceph:pgid 11.8 last_scrub_stamp 2024-02-09T08:04:11.529462+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=4, tm_sec=11, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=34, tm_sec=54, tm_wday=4, tm_yday=40, tm_isdst=0) 2024-02-09T08:35:03.490 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-02-09T08:03:10.689497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=3, tm_sec=10, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=34, tm_sec=54, tm_wday=4, tm_yday=40, tm_isdst=0) 2024-02-09T08:35:03.490 INFO:tasks.ceph:pgid 11.b last_scrub_stamp 2024-02-09T08:04:11.529462+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=4, tm_sec=11, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=34, tm_sec=54, tm_wday=4, tm_yday=40, tm_isdst=0) 2024-02-09T08:35:03.490 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-02-09T08:03:10.689497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=3, tm_sec=10, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=34, tm_sec=54, tm_wday=4, tm_yday=40, tm_isdst=0) 2024-02-09T08:35:03.491 INFO:tasks.ceph:pgid 11.d last_scrub_stamp 2024-02-09T08:04:11.529462+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=4, tm_sec=11, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=34, tm_sec=54, tm_wday=4, tm_yday=40, tm_isdst=0) 2024-02-09T08:35:03.491 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-02-09T08:03:10.689497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=3, tm_sec=10, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=34, tm_sec=54, tm_wday=4, tm_yday=40, tm_isdst=0) 2024-02-09T08:35:03.491 INFO:tasks.ceph:pgid 11.c last_scrub_stamp 2024-02-09T08:04:11.529462+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=4, tm_sec=11, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=34, tm_sec=54, tm_wday=4, tm_yday=40, tm_isdst=0) 2024-02-09T08:35:03.491 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-02-09T08:03:10.689497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=3, tm_sec=10, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=34, tm_sec=54, tm_wday=4, tm_yday=40, tm_isdst=0) 2024-02-09T08:35:03.491 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-02-09T08:03:10.689497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=3, tm_sec=10, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=34, tm_sec=54, tm_wday=4, tm_yday=40, tm_isdst=0) 2024-02-09T08:35:03.491 INFO:tasks.ceph:pgid 11.e last_scrub_stamp 2024-02-09T08:04:11.529462+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=4, tm_sec=11, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=34, tm_sec=54, tm_wday=4, tm_yday=40, tm_isdst=0) 2024-02-09T08:35:03.491 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-02-09T08:03:10.689497+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=3, tm_sec=10, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=34, tm_sec=54, tm_wday=4, tm_yday=40, tm_isdst=0) 2024-02-09T08:35:03.491 INFO:tasks.ceph:pgid 11.1d last_scrub_stamp 2024-02-09T08:04:11.529462+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=4, tm_sec=11, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=34, tm_sec=54, tm_wday=4, tm_yday=40, tm_isdst=0) 2024-02-09T08:35:03.491 INFO:tasks.ceph:pgid 11.1e last_scrub_stamp 2024-02-09T08:04:11.529462+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=4, tm_sec=11, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=34, tm_sec=54, tm_wday=4, tm_yday=40, tm_isdst=0) 2024-02-09T08:35:03.492 INFO:tasks.ceph:pgid 11.1f last_scrub_stamp 2024-02-09T08:04:11.529462+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=4, tm_sec=11, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=34, tm_sec=54, tm_wday=4, tm_yday=40, tm_isdst=0) 2024-02-09T08:35:03.492 INFO:tasks.ceph:pgid 11.10 last_scrub_stamp 2024-02-09T08:04:11.529462+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=4, tm_sec=11, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=34, tm_sec=54, tm_wday=4, tm_yday=40, tm_isdst=0) 2024-02-09T08:35:03.492 INFO:tasks.ceph:pgid 11.11 last_scrub_stamp 2024-02-09T08:04:11.529462+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=4, tm_sec=11, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=34, tm_sec=54, tm_wday=4, tm_yday=40, tm_isdst=0) 2024-02-09T08:35:03.492 INFO:tasks.ceph:pgid 11.13 last_scrub_stamp 2024-02-09T08:04:11.529462+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=4, tm_sec=11, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=34, tm_sec=54, tm_wday=4, tm_yday=40, tm_isdst=0) 2024-02-09T08:35:03.492 INFO:tasks.ceph:pgid 11.14 last_scrub_stamp 2024-02-09T08:04:11.529462+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=4, tm_sec=11, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=34, tm_sec=54, tm_wday=4, tm_yday=40, tm_isdst=0) 2024-02-09T08:35:03.492 INFO:tasks.ceph:pgid 11.15 last_scrub_stamp 2024-02-09T08:04:11.529462+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=4, tm_sec=11, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=34, tm_sec=54, tm_wday=4, tm_yday=40, tm_isdst=0) 2024-02-09T08:35:03.492 INFO:tasks.ceph:pgid 11.16 last_scrub_stamp 2024-02-09T08:04:11.529462+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=4, tm_sec=11, tm_wday=4, tm_yday=40, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=9, tm_hour=8, tm_min=34, tm_sec=54, tm_wday=4, tm_yday=40, tm_isdst=0) 2024-02-09T08:35:03.492 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-09T08:35:05.857 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:33:15.263 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:05.859 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:33:15.266 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:05.875 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:33:15.282 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:05.907 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:33:15.314 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:05.908 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:33:15.305 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:05.909 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:33:15.315 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:05.910 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:33:15.307 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:05.924 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:33:15.327 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:05.924 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:33:15.318 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:10.993 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:33:20.399 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:10.994 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:33:20.401 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:11.004 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:33:20.411 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:11.034 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:33:20.431 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:11.036 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:33:20.432 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:11.041 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:33:20.447 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:11.043 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:33:20.449 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:11.046 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:33:20.443 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:11.057 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:33:20.464 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:23.494 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-09T08:35:23.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.593+0000 7f09473e0640 10 monclient: get_monmap_and_config 2024-02-09T08:35:23.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.593+0000 7f09473e0640 10 monclient: build_initial_monmap 2024-02-09T08:35:23.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.593+0000 7f09473e0640 10 monclient: monmap: 2024-02-09T08:35:23.596 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:35:23.596 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:35:23.596 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:35:23.594497+0000 2024-02-09T08:35:23.596 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:35:23.594497+0000 2024-02-09T08:35:23.596 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:35:23.596 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:23.596 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:35:23.596 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:35:23.596 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:35:23.597 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:35:23.597 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:35:23.597 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:23.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.594+0000 7f09473e0640 1 Processor -- start 2024-02-09T08:35:23.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.594+0000 7f09473e0640 1 -- start start 2024-02-09T08:35:23.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.594+0000 7f09473e0640 10 monclient: init 2024-02-09T08:35:23.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.594+0000 7f09473e0640 10 monclient: _reopen_session rank -1 2024-02-09T08:35:23.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.594+0000 7f09473e0640 10 monclient: _add_conns ranks=[1,2,0,3,4] 2024-02-09T08:35:23.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.594+0000 7f09473e0640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f09400af3f0 addr v1:172.21.15.103:6789/0 2024-02-09T08:35:23.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.594+0000 7f09473e0640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f09400acfd0 0x7f09400ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:23.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.594+0000 7f09473e0640 10 monclient(hunting): picked mon.noname-b con 0x7f09400acfd0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:35:23.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.594+0000 7f09473e0640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f094013bc70 addr v1:172.21.15.62:6789/0 2024-02-09T08:35:23.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.594+0000 7f09473e0640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0940142630 con 0x7f094013bc70 2024-02-09T08:35:23.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.594+0000 7f09473e0640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09400acbb0 con 0x7f09400af3f0 2024-02-09T08:35:23.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.594+0000 7f09473e0640 10 monclient(hunting): start opening mon connection 2024-02-09T08:35:23.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.594+0000 7f09473e0640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09400af7d0 con 0x7f09400acfd0 2024-02-09T08:35:23.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.594+0000 7f09473e0640 10 monclient(hunting): _renew_subs 2024-02-09T08:35:23.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.594+0000 7f09473e0640 10 monclient(hunting): authenticate will time out at 3366.955141s 2024-02-09T08:35:23.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.595+0000 7f094497b640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f09400acfd0 0x7f09400ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:35:23.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.595+0000 7f094597d640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f094013bc70 0x7f09401492b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:57052/0 (socket says 172.21.15.62:57052) 2024-02-09T08:35:23.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.595+0000 7f094597d640 1 -- 172.21.15.62:0/173360890 learned_addr learned my addr 172.21.15.62:0/173360890 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-09T08:35:23.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.595+0000 7f094497b640 10 monclient(hunting): get_auth_request con 0x7f09400acfd0 auth_method 0 2024-02-09T08:35:23.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.595+0000 7f094497b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:35:23.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.595+0000 7f094497b640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:35:23.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.595+0000 7f094497b640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:35:23.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.596+0000 7f094497b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:35:23.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.596+0000 7f094497b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:35:23.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.596+0000 7f094497b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:35:23.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.598+0000 7f094497b640 10 monclient(hunting): handle_auth_done global_id 18656 payload 274 2024-02-09T08:35:23.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.598+0000 7f094497b640 1 -- 172.21.15.62:0/173360890 >> v1:172.21.15.103:6789/0 conn(0x7f09400af3f0 legacy=0x7f0940141f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:23.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.598+0000 7f094497b640 1 -- 172.21.15.62:0/173360890 >> v1:172.21.15.62:6789/0 conn(0x7f094013bc70 legacy=0x7f09401492b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:23.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.598+0000 7f094497b640 10 monclient: _finish_hunting 0 2024-02-09T08:35:23.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.598+0000 7f094497b640 1 monclient: found mon.noname-b 2024-02-09T08:35:23.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.598+0000 7f094497b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:35:23.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.598+0000 7f094497b640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.62:3301/0 2024-02-09T08:35:23.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.598+0000 7f094497b640 1 -- 172.21.15.62:0/173360890 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09400ad490 con 0x7f09400acfd0 2024-02-09T08:35:23.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.600+0000 7f094497b640 1 --2- 172.21.15.62:0/173360890 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f09400acfd0 0x7f09400ad9b0 secure :-1 s=READY pgs=3200 cs=0 l=1 rev1=1 crypto rx=0x7f093c0097d0 tx=0x7f093c02b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98682def5da13d9b server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:35:23.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.604+0000 7f0933fff640 1 -- 172.21.15.62:0/173360890 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093c031800 con 0x7f09400acfd0 2024-02-09T08:35:23.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.604+0000 7f0933fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:35:23.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.604+0000 7f0933fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:35:23.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.604+0000 7f0933fff640 10 monclient: dump: 2024-02-09T08:35:23.607 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:35:23.607 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:35:23.607 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:23.607 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:23.607 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:35:23.608 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:23.608 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:35:23.608 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:35:23.608 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:35:23.608 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:23.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.604+0000 7f0933fff640 10 monclient: _finish_auth 0 2024-02-09T08:35:23.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.604+0000 7f0933fff640 10 monclient: _check_auth_tickets 2024-02-09T08:35:23.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.604+0000 7f0933fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:35:23.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.604+0000 7f0933fff640 1 -- 172.21.15.62:0/173360890 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f093c031960 con 0x7f09400acfd0 2024-02-09T08:35:23.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.604+0000 7f0933fff640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:35:23.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.604+0000 7f0933fff640 1 -- 172.21.15.62:0/173360890 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093c031cf0 con 0x7f09400acfd0 2024-02-09T08:35:23.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.604+0000 7f09473e0640 5 monclient: authenticate success, global_id 18656 2024-02-09T08:35:23.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.604+0000 7f09473e0640 10 monclient: get_monmap_and_config success 2024-02-09T08:35:23.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.604+0000 7f09473e0640 4 set_mon_vals no callback set 2024-02-09T08:35:23.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.604+0000 7f0933fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:35:23.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.604+0000 7f0933fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-09T08:35:23.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.604+0000 7f0933fff640 10 monclient: dump: 2024-02-09T08:35:23.609 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:35:23.609 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:35:23.609 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:23.609 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:23.609 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:35:23.609 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:23.609 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:35:23.609 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:35:23.609 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:35:23.609 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:23.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.604+0000 7f09473e0640 10 monclient: shutdown 2024-02-09T08:35:23.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.604+0000 7f09473e0640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:35:23.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.604+0000 7f09473e0640 1 -- 172.21.15.62:0/173360890 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f09400acfd0 msgr2=0x7f09400ad9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:23.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.604+0000 7f09473e0640 1 --2- 172.21.15.62:0/173360890 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f09400acfd0 0x7f09400ad9b0 secure :-1 s=READY pgs=3200 cs=0 l=1 rev1=1 crypto rx=0x7f093c0097d0 tx=0x7f093c02b8a0 comp rx=0 tx=0).stop 2024-02-09T08:35:23.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.604+0000 7f09473e0640 1 -- 172.21.15.62:0/173360890 shutdown_connections 2024-02-09T08:35:23.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.604+0000 7f09473e0640 1 --2- 172.21.15.62:0/173360890 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f09400acfd0 0x7f09400ad9b0 unknown :-1 s=CLOSED pgs=3200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:23.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.604+0000 7f09473e0640 1 -- 172.21.15.62:0/173360890 >> 172.21.15.62:0/173360890 conn(0x7f09400b3ef0 msgr2=0x7f09400b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:35:23.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.605+0000 7f09473e0640 1 -- 172.21.15.62:0/173360890 shutdown_connections 2024-02-09T08:35:23.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.605+0000 7f09473e0640 1 -- 172.21.15.62:0/173360890 wait complete. 2024-02-09T08:35:23.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.605+0000 7f09473e0640 10 monclient: build_initial_monmap 2024-02-09T08:35:23.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.605+0000 7f09473e0640 10 monclient: monmap: 2024-02-09T08:35:23.613 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:35:23.613 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:35:23.613 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:35:23.613 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:35:23.614 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:35:23.614 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:23.614 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:35:23.614 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:35:23.614 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:35:23.614 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:23.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.605+0000 7f09473e0640 1 librados: starting msgr at 2024-02-09T08:35:23.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.605+0000 7f09473e0640 1 librados: starting objecter 2024-02-09T08:35:23.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.606+0000 7f09473e0640 1 Processor -- start 2024-02-09T08:35:23.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.606+0000 7f09473e0640 1 -- start start 2024-02-09T08:35:23.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.606+0000 7f09473e0640 1 librados: setting wanted keys 2024-02-09T08:35:23.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.606+0000 7f09473e0640 1 librados: calling monclient init 2024-02-09T08:35:23.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.606+0000 7f09473e0640 10 monclient: init 2024-02-09T08:35:23.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.606+0000 7f09473e0640 10 monclient: _reopen_session rank -1 2024-02-09T08:35:23.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.606+0000 7f09473e0640 10 monclient: _add_conns ranks=[2,0,1] 2024-02-09T08:35:23.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.606+0000 7f09473e0640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f09400acfd0 0x7f0940140950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:23.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.606+0000 7f09473e0640 10 monclient(hunting): picked mon.noname-c con 0x7f09400acfd0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:35:23.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.606+0000 7f09473e0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09400af3f0 0x7f0940131f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:23.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.606+0000 7f09473e0640 10 monclient(hunting): picked mon.noname-a con 0x7f09400af3f0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:35:23.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.606+0000 7f09473e0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f094013bc70 0x7f09401324d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:23.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.606+0000 7f09473e0640 10 monclient(hunting): picked mon.noname-b con 0x7f094013bc70 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:35:23.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.606+0000 7f09473e0640 10 monclient(hunting): start opening mon connection 2024-02-09T08:35:23.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.606+0000 7f09473e0640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094013cd40 con 0x7f09400af3f0 2024-02-09T08:35:23.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.606+0000 7f09473e0640 10 monclient(hunting): start opening mon connection 2024-02-09T08:35:23.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.606+0000 7f09473e0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0940132ab0 con 0x7f094013bc70 2024-02-09T08:35:23.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.606+0000 7f09473e0640 10 monclient(hunting): start opening mon connection 2024-02-09T08:35:23.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.606+0000 7f09473e0640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0940141300 con 0x7f09400acfd0 2024-02-09T08:35:23.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.606+0000 7f09473e0640 10 monclient(hunting): _renew_subs 2024-02-09T08:35:23.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.606+0000 7f09473e0640 10 monclient(hunting): authenticate will time out at 3366.966938s 2024-02-09T08:35:23.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.607+0000 7f094517c640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f09400acfd0 0x7f0940140950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:35:23.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.607+0000 7f094497b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09400af3f0 0x7f0940131f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:35:23.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.607+0000 7f094597d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f094013bc70 0x7f09401324d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:35:23.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.607+0000 7f094517c640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f09400acfd0 0x7f0940140950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:53556/0 (socket says 172.21.15.62:53556) 2024-02-09T08:35:23.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.607+0000 7f094517c640 1 -- 172.21.15.62:0/2390025999 learned_addr learned my addr 172.21.15.62:0/2390025999 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:35:23.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.607+0000 7f094517c640 10 monclient(hunting): get_auth_request con 0x7f09400acfd0 auth_method 0 2024-02-09T08:35:23.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.607+0000 7f094517c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:35:23.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.607+0000 7f094517c640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:35:23.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.607+0000 7f094517c640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:35:23.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.607+0000 7f094497b640 10 monclient(hunting): get_auth_request con 0x7f09400af3f0 auth_method 0 2024-02-09T08:35:23.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.607+0000 7f094497b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:35:23.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.607+0000 7f094497b640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:35:23.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.607+0000 7f094497b640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:35:23.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.607+0000 7f094597d640 10 monclient(hunting): get_auth_request con 0x7f094013bc70 auth_method 0 2024-02-09T08:35:23.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.607+0000 7f094597d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:35:23.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.607+0000 7f094597d640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:35:23.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.607+0000 7f094597d640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:35:23.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.608+0000 7f094517c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:35:23.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.608+0000 7f094517c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:35:23.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.608+0000 7f094517c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:35:23.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.608+0000 7f094497b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:35:23.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.608+0000 7f094497b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:35:23.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.608+0000 7f094497b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:35:23.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.608+0000 7f094597d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:35:23.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.608+0000 7f094597d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:35:23.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.608+0000 7f094597d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:35:23.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.610+0000 7f094517c640 10 monclient(hunting): handle_auth_done global_id 18659 payload 824 2024-02-09T08:35:23.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.610+0000 7f094517c640 1 -- 172.21.15.62:0/2390025999 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f094013bc70 msgr2=0x7f09401324d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:23.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.610+0000 7f094517c640 1 --2- 172.21.15.62:0/2390025999 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f094013bc70 0x7f09401324d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:23.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.610+0000 7f094517c640 1 -- 172.21.15.62:0/2390025999 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09400af3f0 msgr2=0x7f0940131f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:23.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.610+0000 7f094517c640 1 --2- 172.21.15.62:0/2390025999 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09400af3f0 0x7f0940131f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:23.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.610+0000 7f094517c640 10 monclient: _finish_hunting 0 2024-02-09T08:35:23.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.610+0000 7f094517c640 1 monclient: found mon.noname-c 2024-02-09T08:35:23.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.610+0000 7f094517c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:35:23.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.610+0000 7f094517c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-02-09T08:35:23.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.610+0000 7f094517c640 1 -- 172.21.15.62:0/2390025999 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f093c009400 con 0x7f09400acfd0 2024-02-09T08:35:23.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.613+0000 7f094517c640 1 --2- 172.21.15.62:0/2390025999 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f09400acfd0 0x7f0940140950 secure :-1 s=READY pgs=3201 cs=0 l=1 rev1=1 crypto rx=0x7f093400c450 tx=0x7f093400c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:35:23.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.613+0000 7f0931ffb640 10 client.?.objecter ms_handle_connect 0x7f09400acfd0 2024-02-09T08:35:23.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.613+0000 7f0931ffb640 10 client.?.objecter resend_mon_ops 2024-02-09T08:35:23.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.616+0000 7f0931ffb640 1 -- 172.21.15.62:0/2390025999 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09340052d0 con 0x7f09400acfd0 2024-02-09T08:35:23.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.616+0000 7f0931ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:35:23.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.616+0000 7f0931ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-09T08:35:23.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.616+0000 7f0931ffb640 10 monclient: dump: 2024-02-09T08:35:23.620 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:35:23.620 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:35:23.620 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:23.620 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:23.620 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:35:23.620 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:23.620 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:35:23.620 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:35:23.621 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:35:23.621 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:23.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.616+0000 7f0931ffb640 10 monclient: _finish_auth 0 2024-02-09T08:35:23.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.616+0000 7f0931ffb640 10 monclient: _check_auth_tickets 2024-02-09T08:35:23.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.616+0000 7f0931ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:35:23.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.616+0000 7f0931ffb640 1 -- 172.21.15.62:0/2390025999 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0934005430 con 0x7f09400acfd0 2024-02-09T08:35:23.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.616+0000 7f0931ffb640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:35:23.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.616+0000 7f0931ffb640 1 -- 172.21.15.62:0/2390025999 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0934012870 con 0x7f09400acfd0 2024-02-09T08:35:23.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.616+0000 7f09473e0640 5 monclient: authenticate success, global_id 18659 2024-02-09T08:35:23.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.616+0000 7f09473e0640 10 monclient: _renew_subs 2024-02-09T08:35:23.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.616+0000 7f09473e0640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:35:23.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.616+0000 7f09473e0640 1 -- 172.21.15.62:0/2390025999 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f094013fdd0 con 0x7f09400acfd0 2024-02-09T08:35:23.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.616+0000 7f0931ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:35:23.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.616+0000 7f09337fe640 4 set_mon_vals no callback set 2024-02-09T08:35:23.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.616+0000 7f0931ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-09T08:35:23.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.616+0000 7f0931ffb640 10 monclient: dump: 2024-02-09T08:35:23.622 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:35:23.622 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:35:23.622 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:23.622 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:23.622 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:35:23.622 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:23.622 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:35:23.622 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:35:23.622 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:35:23.622 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:23.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.616+0000 7f09473e0640 10 client.18659.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:35:23.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.616+0000 7f09473e0640 10 monclient: _renew_subs 2024-02-09T08:35:23.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.616+0000 7f09473e0640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:35:23.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.616+0000 7f09473e0640 1 -- 172.21.15.62:0/2390025999 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0940141070 con 0x7f09400acfd0 2024-02-09T08:35:23.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.616+0000 7f09473e0640 1 librados: init done 2024-02-09T08:35:23.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.617+0000 7f09473e0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:35:23.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.617+0000 7f09473e0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:35:23.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.617+0000 7f09473e0640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-02-09T08:35:23.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.617+0000 7f09473e0640 1 -- 172.21.15.62:0/2390025999 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f094004ef90 con 0x7f09400acfd0 2024-02-09T08:35:23.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.637+0000 7f0931ffb640 1 -- 172.21.15.62:0/2390025999 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f09340129d0 con 0x7f09400acfd0 2024-02-09T08:35:23.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.638+0000 7f0931ffb640 1 --2- 172.21.15.62:0/2390025999 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f092406d1a0 0x7f092406f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:23.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.638+0000 7f094497b640 1 --2- 172.21.15.62:0/2390025999 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f092406d1a0 0x7f092406f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:35:23.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.639+0000 7f094497b640 10 monclient: get_auth_request con 0x7f092406d1a0 auth_method 0 2024-02-09T08:35:23.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.639+0000 7f094497b640 1 --2- 172.21.15.62:0/2390025999 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f092406d1a0 0x7f092406f660 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f093c036000 tx=0x7f093c03c040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:35:23.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.639+0000 7f0931ffb640 10 client.18659.objecter ms_handle_connect 0x7f092406d1a0 2024-02-09T08:35:23.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.907+0000 7f0931ffb640 1 -- 172.21.15.62:0/2390025999 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(1270..1270 src has 1199..1270) v4 ==== 6381+0+0 (secure 0 0 0) 0x7f0934058f20 con 0x7f09400acfd0 2024-02-09T08:35:23.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.907+0000 7f0931ffb640 10 client.18659.objecter ms_dispatch 0x7f0940000b90 osd_map(1270..1270 src has 1199..1270) v4 2024-02-09T08:35:23.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.907+0000 7f0931ffb640 3 client.18659.objecter handle_osd_map got epochs [1270,1270] > 0 2024-02-09T08:35:23.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.907+0000 7f0931ffb640 3 client.18659.objecter handle_osd_map decoding full epoch 1270 2024-02-09T08:35:23.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.907+0000 7f0931ffb640 20 client.18659.objecter dump_active .. 0 homeless 2024-02-09T08:35:23.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.907+0000 7f0931ffb640 1 -- 172.21.15.62:0/2390025999 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f09340551c0 con 0x7f09400acfd0 2024-02-09T08:35:23.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.907+0000 7f0931ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:35:23.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:23.907+0000 7f0931ffb640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:35:24.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.091+0000 7f09473e0640 1 -- 172.21.15.62:0/2390025999 --> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f094013ceb0 con 0x7f092406d1a0 2024-02-09T08:35:24.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.096+0000 7f0931ffb640 1 -- 172.21.15.62:0/2390025999 <== mgr.4109 v2:172.21.15.103:6800/2270392189 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+151817 (secure 0 0 0) 0x7f094013ceb0 con 0x7f092406d1a0 2024-02-09T08:35:24.100 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-09T08:35:24.101 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-02-09T08:35:24.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.100+0000 7f09473e0640 10 librados: watch_flush enter 2024-02-09T08:35:24.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.100+0000 7f09473e0640 10 librados: watch_flush exit 2024-02-09T08:35:24.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.100+0000 7f09473e0640 20 client.18659.objecter shutdown clearing up homeless session... 2024-02-09T08:35:24.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.100+0000 7f09473e0640 10 client.18659.objecter successfully canceled tick 2024-02-09T08:35:24.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.100+0000 7f09473e0640 1 -- 172.21.15.62:0/2390025999 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f092406d1a0 msgr2=0x7f092406f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:24.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.100+0000 7f09473e0640 1 --2- 172.21.15.62:0/2390025999 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f092406d1a0 0x7f092406f660 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f093c036000 tx=0x7f093c03c040 comp rx=0 tx=0).stop 2024-02-09T08:35:24.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.100+0000 7f09473e0640 10 monclient: shutdown 2024-02-09T08:35:24.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.100+0000 7f09473e0640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:35:24.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.100+0000 7f09473e0640 1 -- 172.21.15.62:0/2390025999 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f09400acfd0 msgr2=0x7f0940140950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:24.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.100+0000 7f09473e0640 1 --2- 172.21.15.62:0/2390025999 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f09400acfd0 0x7f0940140950 secure :-1 s=READY pgs=3201 cs=0 l=1 rev1=1 crypto rx=0x7f093400c450 tx=0x7f093400c910 comp rx=0 tx=0).stop 2024-02-09T08:35:24.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.100+0000 7f09473e0640 1 -- 172.21.15.62:0/2390025999 shutdown_connections 2024-02-09T08:35:24.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.100+0000 7f09473e0640 1 --2- 172.21.15.62:0/2390025999 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f092406d1a0 0x7f092406f660 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:24.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.100+0000 7f09473e0640 1 --2- 172.21.15.62:0/2390025999 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f094013bc70 0x7f09401324d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:24.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.100+0000 7f09473e0640 1 --2- 172.21.15.62:0/2390025999 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09400af3f0 0x7f0940131f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:24.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.100+0000 7f09473e0640 1 --2- 172.21.15.62:0/2390025999 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f09400acfd0 0x7f0940140950 unknown :-1 s=CLOSED pgs=3201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:24.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.100+0000 7f09473e0640 1 -- 172.21.15.62:0/2390025999 >> 172.21.15.62:0/2390025999 conn(0x7f09400b3ef0 msgr2=0x7f0940069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:35:24.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.100+0000 7f09473e0640 1 -- 172.21.15.62:0/2390025999 shutdown_connections 2024-02-09T08:35:24.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.100+0000 7f09473e0640 1 -- 172.21.15.62:0/2390025999 wait complete. 2024-02-09T08:35:24.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.100+0000 7f09473e0640 1 librados: shutdown 2024-02-09T08:35:24.115 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":2248,"stamp":"2024-02-09T08:35:22.525915+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459285,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":88,"num_write":120,"num_write_kb":1379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":86,"ondisk_log_size":86,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":565848,"kb_used_data":31832,"kb_used_omap":12,"kb_used_meta":533939,"kb_avail":754408872,"statfs":{"total":773094113280,"available":772514684928,"internally_reserved":0,"allocated":32595968,"data_stored":13732130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":546754096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003069"},"pg_stats":[{"pgid":"11.1b","version":"0'0","reported_seq":2426,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:34:59.623762+0000","last_change":"2024-02-09T08:34:59.624583+0000","last_active":"2024-02-09T08:34:59.623762+0000","last_peered":"2024-02-09T08:34:59.623762+0000","last_clean":"2024-02-09T08:34:59.623762+0000","last_became_active":"2024-02-09T08:04:33.521240+0000","last_became_peered":"2024-02-09T08:04:33.521240+0000","last_unstale":"2024-02-09T08:34:59.623762+0000","last_undegraded":"2024-02-09T08:34:59.623762+0000","last_fullsized":"2024-02-09T08:34:59.623762+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:34:59.622292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:34:59.622292+0000","last_clean_scrub_stamp":"2024-02-09T08:34:59.622292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T14:37:48.847958+0000","scrub_duration":91,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":2442,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:35:04.489940+0000","last_change":"2024-02-09T08:35:04.490727+0000","last_active":"2024-02-09T08:35:04.489940+0000","last_peered":"2024-02-09T08:35:04.489940+0000","last_clean":"2024-02-09T08:35:04.489940+0000","last_became_active":"2024-02-09T08:04:40.657553+0000","last_became_peered":"2024-02-09T08:04:40.657553+0000","last_unstale":"2024-02-09T08:35:04.489940+0000","last_undegraded":"2024-02-09T08:35:04.489940+0000","last_fullsized":"2024-02-09T08:35:04.489940+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:35:04.488526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:35:04.488526+0000","last_clean_scrub_stamp":"2024-02-09T08:35:04.488526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T12:16:22.043008+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":2439,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:35:02.958452+0000","last_change":"2024-02-09T08:35:02.959214+0000","last_active":"2024-02-09T08:35:02.958452+0000","last_peered":"2024-02-09T08:35:02.958452+0000","last_clean":"2024-02-09T08:35:02.958452+0000","last_became_active":"2024-02-09T08:04:36.596835+0000","last_became_peered":"2024-02-09T08:04:36.596835+0000","last_unstale":"2024-02-09T08:35:02.958452+0000","last_undegraded":"2024-02-09T08:35:02.958452+0000","last_fullsized":"2024-02-09T08:35:02.958452+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:35:02.956951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:35:02.956951+0000","last_clean_scrub_stamp":"2024-02-09T08:35:02.956951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T11:05:23.149228+0000","scrub_duration":46,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":2445,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:35:04.250551+0000","last_change":"2024-02-09T08:35:04.251316+0000","last_active":"2024-02-09T08:35:04.250551+0000","last_peered":"2024-02-09T08:35:04.250551+0000","last_clean":"2024-02-09T08:35:04.250551+0000","last_became_active":"2024-02-09T08:05:00.783372+0000","last_became_peered":"2024-02-09T08:05:00.783372+0000","last_unstale":"2024-02-09T08:35:04.250551+0000","last_undegraded":"2024-02-09T08:35:04.250551+0000","last_fullsized":"2024-02-09T08:35:04.250551+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:35:04.249121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:35:04.249121+0000","last_clean_scrub_stamp":"2024-02-09T08:35:04.249121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T15:45:29.577572+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":2420,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:34:59.992376+0000","last_change":"2024-02-09T08:34:59.993155+0000","last_active":"2024-02-09T08:34:59.992376+0000","last_peered":"2024-02-09T08:34:59.992376+0000","last_clean":"2024-02-09T08:34:59.992376+0000","last_became_active":"2024-02-09T08:04:29.124225+0000","last_became_peered":"2024-02-09T08:04:29.124225+0000","last_unstale":"2024-02-09T08:34:59.992376+0000","last_undegraded":"2024-02-09T08:34:59.992376+0000","last_fullsized":"2024-02-09T08:34:59.992376+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:34:59.990880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:34:59.990880+0000","last_clean_scrub_stamp":"2024-02-09T08:34:59.990880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T11:25:26.215059+0000","scrub_duration":89,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":2452,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:35:05.361352+0000","last_change":"2024-02-09T08:35:05.362123+0000","last_active":"2024-02-09T08:35:05.361352+0000","last_peered":"2024-02-09T08:35:05.361352+0000","last_clean":"2024-02-09T08:35:05.361352+0000","last_became_active":"2024-02-09T08:04:39.743089+0000","last_became_peered":"2024-02-09T08:04:39.743089+0000","last_unstale":"2024-02-09T08:35:05.361352+0000","last_undegraded":"2024-02-09T08:35:05.361352+0000","last_fullsized":"2024-02-09T08:35:05.361352+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:35:05.359829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:35:05.359829+0000","last_clean_scrub_stamp":"2024-02-09T08:35:05.359829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T16:23:30.162037+0000","scrub_duration":58,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":2417,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:35:02.960737+0000","last_change":"2024-02-09T08:35:02.961675+0000","last_active":"2024-02-09T08:35:02.960737+0000","last_peered":"2024-02-09T08:35:02.960737+0000","last_clean":"2024-02-09T08:35:02.960737+0000","last_became_active":"2024-02-09T08:05:03.159711+0000","last_became_peered":"2024-02-09T08:05:03.159711+0000","last_unstale":"2024-02-09T08:35:02.960737+0000","last_undegraded":"2024-02-09T08:35:02.960737+0000","last_fullsized":"2024-02-09T08:35:02.960737+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:35:02.958357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:35:02.958357+0000","last_clean_scrub_stamp":"2024-02-09T08:35:02.958357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T11:15:21.423109+0000","scrub_duration":79,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":2420,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:35:00.723757+0000","last_change":"2024-02-09T08:35:00.724608+0000","last_active":"2024-02-09T08:35:00.723757+0000","last_peered":"2024-02-09T08:35:00.723757+0000","last_clean":"2024-02-09T08:35:00.723757+0000","last_became_active":"2024-02-09T08:04:30.066772+0000","last_became_peered":"2024-02-09T08:04:30.066772+0000","last_unstale":"2024-02-09T08:35:00.723757+0000","last_undegraded":"2024-02-09T08:35:00.723757+0000","last_fullsized":"2024-02-09T08:35:00.723757+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:35:00.721467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:35:00.721467+0000","last_clean_scrub_stamp":"2024-02-09T08:35:00.721467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T16:59:42.583966+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":2444,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:35:05.503024+0000","last_change":"2024-02-09T08:35:05.503806+0000","last_active":"2024-02-09T08:35:05.503024+0000","last_peered":"2024-02-09T08:35:05.503024+0000","last_clean":"2024-02-09T08:35:05.503024+0000","last_became_active":"2024-02-09T08:04:53.127636+0000","last_became_peered":"2024-02-09T08:04:53.127636+0000","last_unstale":"2024-02-09T08:35:05.503024+0000","last_undegraded":"2024-02-09T08:35:05.503024+0000","last_fullsized":"2024-02-09T08:35:05.503024+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:35:05.501549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:35:05.501549+0000","last_clean_scrub_stamp":"2024-02-09T08:35:05.501549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T18:22:09.535051+0000","scrub_duration":68,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":2449,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:35:06.370813+0000","last_change":"2024-02-09T08:35:06.371550+0000","last_active":"2024-02-09T08:35:06.370813+0000","last_peered":"2024-02-09T08:35:06.370813+0000","last_clean":"2024-02-09T08:35:06.370813+0000","last_became_active":"2024-02-09T08:04:56.548820+0000","last_became_peered":"2024-02-09T08:04:56.548820+0000","last_unstale":"2024-02-09T08:35:06.370813+0000","last_undegraded":"2024-02-09T08:35:06.370813+0000","last_fullsized":"2024-02-09T08:35:06.370813+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:35:06.369320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:35:06.369320+0000","last_clean_scrub_stamp":"2024-02-09T08:35:06.369320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T10:46:43.148378+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1","version":"1270'8","reported_seq":2435,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:34:58.729416+0000","last_change":"2024-02-09T08:34:58.729416+0000","last_active":"2024-02-09T08:34:58.729416+0000","last_peered":"2024-02-09T08:34:58.729416+0000","last_clean":"2024-02-09T08:34:58.729416+0000","last_became_active":"2024-02-09T08:04:23.166119+0000","last_became_peered":"2024-02-09T08:04:23.166119+0000","last_unstale":"2024-02-09T08:34:58.729416+0000","last_undegraded":"2024-02-09T08:34:58.729416+0000","last_fullsized":"2024-02-09T08:34:58.729416+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"1270'8","last_scrub_stamp":"2024-02-09T08:34:58.726806+0000","last_deep_scrub":"1270'8","last_deep_scrub_stamp":"2024-02-09T08:34:58.726806+0000","last_clean_scrub_stamp":"2024-02-09T08:34:58.726806+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T19:42:15.856674+0000","scrub_duration":83,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":2448,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:35:05.205560+0000","last_change":"2024-02-09T08:35:05.206288+0000","last_active":"2024-02-09T08:35:05.205560+0000","last_peered":"2024-02-09T08:35:05.205560+0000","last_clean":"2024-02-09T08:35:05.205560+0000","last_became_active":"2024-02-09T08:05:03.857816+0000","last_became_peered":"2024-02-09T08:05:03.857816+0000","last_unstale":"2024-02-09T08:35:05.205560+0000","last_undegraded":"2024-02-09T08:35:05.205560+0000","last_fullsized":"2024-02-09T08:35:05.205560+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:35:05.204107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:35:05.204107+0000","last_clean_scrub_stamp":"2024-02-09T08:35:05.204107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T12:24:51.804672+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":2452,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:35:03.329360+0000","last_change":"2024-02-09T08:35:03.330118+0000","last_active":"2024-02-09T08:35:03.329360+0000","last_peered":"2024-02-09T08:35:03.329360+0000","last_clean":"2024-02-09T08:35:03.329360+0000","last_became_active":"2024-02-09T08:04:23.007209+0000","last_became_peered":"2024-02-09T08:04:23.007209+0000","last_unstale":"2024-02-09T08:35:03.329360+0000","last_undegraded":"2024-02-09T08:35:03.329360+0000","last_fullsized":"2024-02-09T08:35:03.329360+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:35:03.327833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:35:03.327833+0000","last_clean_scrub_stamp":"2024-02-09T08:35:03.327833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T17:45:45.558282+0000","scrub_duration":77,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"1270'78","reported_seq":2557,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:34:57.943144+0000","last_change":"2024-02-09T08:34:57.943144+0000","last_active":"2024-02-09T08:34:57.943144+0000","last_peered":"2024-02-09T08:34:57.943144+0000","last_clean":"2024-02-09T08:34:57.943144+0000","last_became_active":"2024-02-09T08:02:58.754736+0000","last_became_peered":"2024-02-09T08:02:58.754736+0000","last_unstale":"2024-02-09T08:34:57.943144+0000","last_undegraded":"2024-02-09T08:34:57.943144+0000","last_fullsized":"2024-02-09T08:34:57.943144+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"1270'78","last_scrub_stamp":"2024-02-09T08:34:57.940443+0000","last_deep_scrub":"1270'78","last_deep_scrub_stamp":"2024-02-09T08:34:57.940443+0000","last_clean_scrub_stamp":"2024-02-09T08:34:57.940443+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T10:18:06.983561+0000","scrub_duration":110,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":2457,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:35:03.504823+0000","last_change":"2024-02-09T08:35:03.505635+0000","last_active":"2024-02-09T08:35:03.504823+0000","last_peered":"2024-02-09T08:35:03.504823+0000","last_clean":"2024-02-09T08:35:03.504823+0000","last_became_active":"2024-02-09T08:03:12.934488+0000","last_became_peered":"2024-02-09T08:03:12.934488+0000","last_unstale":"2024-02-09T08:35:03.504823+0000","last_undegraded":"2024-02-09T08:35:03.504823+0000","last_fullsized":"2024-02-09T08:35:03.504823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:35:03.503317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:35:03.503317+0000","last_clean_scrub_stamp":"2024-02-09T08:35:03.503317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T09:16:29.495346+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":2441,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:35:01.950215+0000","last_change":"2024-02-09T08:35:01.950946+0000","last_active":"2024-02-09T08:35:01.950215+0000","last_peered":"2024-02-09T08:35:01.950215+0000","last_clean":"2024-02-09T08:35:01.950215+0000","last_became_active":"2024-02-09T08:04:34.763206+0000","last_became_peered":"2024-02-09T08:04:34.763206+0000","last_unstale":"2024-02-09T08:35:01.950215+0000","last_undegraded":"2024-02-09T08:35:01.950215+0000","last_fullsized":"2024-02-09T08:35:01.950215+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:35:01.948779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:35:01.948779+0000","last_clean_scrub_stamp":"2024-02-09T08:35:01.948779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T10:23:02.267223+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2457,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:34:59.388959+0000","last_change":"2024-02-09T08:34:59.390205+0000","last_active":"2024-02-09T08:34:59.388959+0000","last_peered":"2024-02-09T08:34:59.388959+0000","last_clean":"2024-02-09T08:34:59.388959+0000","last_became_active":"2024-02-09T08:03:12.210217+0000","last_became_peered":"2024-02-09T08:03:12.210217+0000","last_unstale":"2024-02-09T08:34:59.388959+0000","last_undegraded":"2024-02-09T08:34:59.388959+0000","last_fullsized":"2024-02-09T08:34:59.388959+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:34:59.386699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:34:59.386699+0000","last_clean_scrub_stamp":"2024-02-09T08:34:59.386699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T17:12:53.115171+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":2447,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:35:02.474801+0000","last_change":"2024-02-09T08:35:02.479273+0000","last_active":"2024-02-09T08:35:02.474801+0000","last_peered":"2024-02-09T08:35:02.474801+0000","last_clean":"2024-02-09T08:35:02.474801+0000","last_became_active":"2024-02-09T08:04:28.937638+0000","last_became_peered":"2024-02-09T08:04:28.937638+0000","last_unstale":"2024-02-09T08:35:02.474801+0000","last_undegraded":"2024-02-09T08:35:02.474801+0000","last_fullsized":"2024-02-09T08:35:02.474801+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:35:02.470282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:35:02.470282+0000","last_clean_scrub_stamp":"2024-02-09T08:35:02.470282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T11:04:07.464938+0000","scrub_duration":200,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2470,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:35:02.962668+0000","last_change":"2024-02-09T08:35:02.963438+0000","last_active":"2024-02-09T08:35:02.962668+0000","last_peered":"2024-02-09T08:35:02.962668+0000","last_clean":"2024-02-09T08:35:02.962668+0000","last_became_active":"2024-02-09T08:03:12.197237+0000","last_became_peered":"2024-02-09T08:03:12.197237+0000","last_unstale":"2024-02-09T08:35:02.962668+0000","last_undegraded":"2024-02-09T08:35:02.962668+0000","last_fullsized":"2024-02-09T08:35:02.962668+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:35:02.961164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:35:02.961164+0000","last_clean_scrub_stamp":"2024-02-09T08:35:02.961164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T16:09:59.713178+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":2446,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:35:03.342347+0000","last_change":"2024-02-09T08:35:03.343387+0000","last_active":"2024-02-09T08:35:03.342347+0000","last_peered":"2024-02-09T08:35:03.342347+0000","last_clean":"2024-02-09T08:35:03.342347+0000","last_became_active":"2024-02-09T08:04:32.135773+0000","last_became_peered":"2024-02-09T08:04:32.135773+0000","last_unstale":"2024-02-09T08:35:03.342347+0000","last_undegraded":"2024-02-09T08:35:03.342347+0000","last_fullsized":"2024-02-09T08:35:03.342347+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:35:03.340886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:35:03.340886+0000","last_clean_scrub_stamp":"2024-02-09T08:35:03.340886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T10:14:14.280427+0000","scrub_duration":92,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":2457,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:35:01.434222+0000","last_change":"2024-02-09T08:35:01.435020+0000","last_active":"2024-02-09T08:35:01.434222+0000","last_peered":"2024-02-09T08:35:01.434222+0000","last_clean":"2024-02-09T08:35:01.434222+0000","last_became_active":"2024-02-09T08:03:12.535306+0000","last_became_peered":"2024-02-09T08:03:12.535306+0000","last_unstale":"2024-02-09T08:35:01.434222+0000","last_undegraded":"2024-02-09T08:35:01.434222+0000","last_fullsized":"2024-02-09T08:35:01.434222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:35:01.430078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:35:01.430078+0000","last_clean_scrub_stamp":"2024-02-09T08:35:01.430078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T12:09:41.236969+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":2456,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:35:07.041378+0000","last_change":"2024-02-09T08:35:07.042098+0000","last_active":"2024-02-09T08:35:07.041378+0000","last_peered":"2024-02-09T08:35:07.041378+0000","last_clean":"2024-02-09T08:35:07.041378+0000","last_became_active":"2024-02-09T08:04:35.117349+0000","last_became_peered":"2024-02-09T08:04:35.117349+0000","last_unstale":"2024-02-09T08:35:07.041378+0000","last_undegraded":"2024-02-09T08:35:07.041378+0000","last_fullsized":"2024-02-09T08:35:07.041378+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:35:07.039913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:35:07.039913+0000","last_clean_scrub_stamp":"2024-02-09T08:35:07.039913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T16:04:35.011513+0000","scrub_duration":56,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2465,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:35:01.216971+0000","last_change":"2024-02-09T08:35:01.217730+0000","last_active":"2024-02-09T08:35:01.216971+0000","last_peered":"2024-02-09T08:35:01.216971+0000","last_clean":"2024-02-09T08:35:01.216971+0000","last_became_active":"2024-02-09T08:03:12.568245+0000","last_became_peered":"2024-02-09T08:03:12.568245+0000","last_unstale":"2024-02-09T08:35:01.216971+0000","last_undegraded":"2024-02-09T08:35:01.216971+0000","last_fullsized":"2024-02-09T08:35:01.216971+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:35:01.215496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:35:01.215496+0000","last_clean_scrub_stamp":"2024-02-09T08:35:01.215496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T10:51:19.274441+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":2456,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:35:06.012202+0000","last_change":"2024-02-09T08:35:06.012927+0000","last_active":"2024-02-09T08:35:06.012202+0000","last_peered":"2024-02-09T08:35:06.012202+0000","last_clean":"2024-02-09T08:35:06.012202+0000","last_became_active":"2024-02-09T08:04:21.984625+0000","last_became_peered":"2024-02-09T08:04:21.984625+0000","last_unstale":"2024-02-09T08:35:06.012202+0000","last_undegraded":"2024-02-09T08:35:06.012202+0000","last_fullsized":"2024-02-09T08:35:06.012202+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:35:06.010786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:35:06.010786+0000","last_clean_scrub_stamp":"2024-02-09T08:35:06.010786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T16:28:01.342245+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2457,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:35:00.385492+0000","last_change":"2024-02-09T08:35:00.386287+0000","last_active":"2024-02-09T08:35:00.385492+0000","last_peered":"2024-02-09T08:35:00.385492+0000","last_clean":"2024-02-09T08:35:00.385492+0000","last_became_active":"2024-02-09T08:03:12.385148+0000","last_became_peered":"2024-02-09T08:03:12.385148+0000","last_unstale":"2024-02-09T08:35:00.385492+0000","last_undegraded":"2024-02-09T08:35:00.385492+0000","last_fullsized":"2024-02-09T08:35:00.385492+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:35:00.381431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:35:00.381431+0000","last_clean_scrub_stamp":"2024-02-09T08:35:00.381431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T12:14:46.808807+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":2419,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:34:57.729346+0000","last_change":"2024-02-09T08:34:57.730200+0000","last_active":"2024-02-09T08:34:57.729346+0000","last_peered":"2024-02-09T08:34:57.729346+0000","last_clean":"2024-02-09T08:34:57.729346+0000","last_became_active":"2024-02-09T08:04:22.589664+0000","last_became_peered":"2024-02-09T08:04:22.589664+0000","last_unstale":"2024-02-09T08:34:57.729346+0000","last_undegraded":"2024-02-09T08:34:57.729346+0000","last_fullsized":"2024-02-09T08:34:57.729346+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:34:57.727751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:34:57.727751+0000","last_clean_scrub_stamp":"2024-02-09T08:34:57.727751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T11:27:15.363778+0000","scrub_duration":92,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2461,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:35:00.887652+0000","last_change":"2024-02-09T08:35:00.888414+0000","last_active":"2024-02-09T08:35:00.887652+0000","last_peered":"2024-02-09T08:35:00.887652+0000","last_clean":"2024-02-09T08:35:00.887652+0000","last_became_active":"2024-02-09T08:03:12.943786+0000","last_became_peered":"2024-02-09T08:03:12.943786+0000","last_unstale":"2024-02-09T08:35:00.887652+0000","last_undegraded":"2024-02-09T08:35:00.887652+0000","last_fullsized":"2024-02-09T08:35:00.887652+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:35:00.885961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:35:00.885961+0000","last_clean_scrub_stamp":"2024-02-09T08:35:00.885961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T10:01:51.089708+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":2410,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:35:01.775016+0000","last_change":"2024-02-09T08:35:01.775851+0000","last_active":"2024-02-09T08:35:01.775016+0000","last_peered":"2024-02-09T08:35:01.775016+0000","last_clean":"2024-02-09T08:35:01.775016+0000","last_became_active":"2024-02-09T08:04:47.720072+0000","last_became_peered":"2024-02-09T08:04:47.720072+0000","last_unstale":"2024-02-09T08:35:01.775016+0000","last_undegraded":"2024-02-09T08:35:01.775016+0000","last_fullsized":"2024-02-09T08:35:01.775016+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:35:01.773451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:35:01.773451+0000","last_clean_scrub_stamp":"2024-02-09T08:35:01.773451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T14:12:42.764831+0000","scrub_duration":54,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2454,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:35:02.458439+0000","last_change":"2024-02-09T08:35:02.459217+0000","last_active":"2024-02-09T08:35:02.458439+0000","last_peered":"2024-02-09T08:35:02.458439+0000","last_clean":"2024-02-09T08:35:02.458439+0000","last_became_active":"2024-02-09T08:03:12.920012+0000","last_became_peered":"2024-02-09T08:03:12.920012+0000","last_unstale":"2024-02-09T08:35:02.458439+0000","last_undegraded":"2024-02-09T08:35:02.458439+0000","last_fullsized":"2024-02-09T08:35:02.458439+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:35:02.456960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:35:02.456960+0000","last_clean_scrub_stamp":"2024-02-09T08:35:02.456960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T15:31:37.608864+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":2427,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:35:00.563867+0000","last_change":"2024-02-09T08:35:00.564680+0000","last_active":"2024-02-09T08:35:00.563867+0000","last_peered":"2024-02-09T08:35:00.563867+0000","last_clean":"2024-02-09T08:35:00.563867+0000","last_became_active":"2024-02-09T08:04:33.638587+0000","last_became_peered":"2024-02-09T08:04:33.638587+0000","last_unstale":"2024-02-09T08:35:00.563867+0000","last_undegraded":"2024-02-09T08:35:00.563867+0000","last_fullsized":"2024-02-09T08:35:00.563867+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:35:00.562428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:35:00.562428+0000","last_clean_scrub_stamp":"2024-02-09T08:35:00.562428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T18:19:25.096855+0000","scrub_duration":37,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":2414,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:35:00.928278+0000","last_change":"2024-02-09T08:35:00.929073+0000","last_active":"2024-02-09T08:35:00.928278+0000","last_peered":"2024-02-09T08:35:00.928278+0000","last_clean":"2024-02-09T08:35:00.928278+0000","last_became_active":"2024-02-09T08:04:31.384824+0000","last_became_peered":"2024-02-09T08:04:31.384824+0000","last_unstale":"2024-02-09T08:35:00.928278+0000","last_undegraded":"2024-02-09T08:35:00.928278+0000","last_fullsized":"2024-02-09T08:35:00.928278+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:35:00.926694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:35:00.926694+0000","last_clean_scrub_stamp":"2024-02-09T08:35:00.926694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T11:32:06.487331+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":2445,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:35:07.469501+0000","last_change":"2024-02-09T08:35:07.470288+0000","last_active":"2024-02-09T08:35:07.469501+0000","last_peered":"2024-02-09T08:35:07.469501+0000","last_clean":"2024-02-09T08:35:07.469501+0000","last_became_active":"2024-02-09T08:04:53.837629+0000","last_became_peered":"2024-02-09T08:04:53.837629+0000","last_unstale":"2024-02-09T08:35:07.469501+0000","last_undegraded":"2024-02-09T08:35:07.469501+0000","last_fullsized":"2024-02-09T08:35:07.469501+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:35:07.467751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:35:07.467751+0000","last_clean_scrub_stamp":"2024-02-09T08:35:07.467751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T11:53:48.992110+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":2457,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:35:05.036216+0000","last_change":"2024-02-09T08:35:05.036936+0000","last_active":"2024-02-09T08:35:05.036216+0000","last_peered":"2024-02-09T08:35:05.036216+0000","last_clean":"2024-02-09T08:35:05.036216+0000","last_became_active":"2024-02-09T08:04:21.282606+0000","last_became_peered":"2024-02-09T08:04:21.282606+0000","last_unstale":"2024-02-09T08:35:05.036216+0000","last_undegraded":"2024-02-09T08:35:05.036216+0000","last_fullsized":"2024-02-09T08:35:05.036216+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:35:05.034829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:35:05.034829+0000","last_clean_scrub_stamp":"2024-02-09T08:35:05.034829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T14:23:47.755572+0000","scrub_duration":76,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":2452,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:35:02.274590+0000","last_change":"2024-02-09T08:35:02.275344+0000","last_active":"2024-02-09T08:35:02.274590+0000","last_peered":"2024-02-09T08:35:02.274590+0000","last_clean":"2024-02-09T08:35:02.274590+0000","last_became_active":"2024-02-09T08:04:21.467958+0000","last_became_peered":"2024-02-09T08:04:21.467958+0000","last_unstale":"2024-02-09T08:35:02.274590+0000","last_undegraded":"2024-02-09T08:35:02.274590+0000","last_fullsized":"2024-02-09T08:35:02.274590+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:35:02.273152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:35:02.273152+0000","last_clean_scrub_stamp":"2024-02-09T08:35:02.273152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T13:54:12.809199+0000","scrub_duration":45,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":2456,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:35:03.983706+0000","last_change":"2024-02-09T08:35:03.984442+0000","last_active":"2024-02-09T08:35:03.983706+0000","last_peered":"2024-02-09T08:35:03.983706+0000","last_clean":"2024-02-09T08:35:03.983706+0000","last_became_active":"2024-02-09T08:04:20.679487+0000","last_became_peered":"2024-02-09T08:04:20.679487+0000","last_unstale":"2024-02-09T08:35:03.983706+0000","last_undegraded":"2024-02-09T08:35:03.983706+0000","last_fullsized":"2024-02-09T08:35:03.983706+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:35:03.982217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:35:03.982217+0000","last_clean_scrub_stamp":"2024-02-09T08:35:03.982217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T12:59:01.687308+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":2426,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:34:58.791569+0000","last_change":"2024-02-09T08:34:58.796393+0000","last_active":"2024-02-09T08:34:58.791569+0000","last_peered":"2024-02-09T08:34:58.791569+0000","last_clean":"2024-02-09T08:34:58.791569+0000","last_became_active":"2024-02-09T08:04:31.595670+0000","last_became_peered":"2024-02-09T08:04:31.595670+0000","last_unstale":"2024-02-09T08:34:58.791569+0000","last_undegraded":"2024-02-09T08:34:58.791569+0000","last_fullsized":"2024-02-09T08:34:58.791569+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:34:58.787397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:34:58.787397+0000","last_clean_scrub_stamp":"2024-02-09T08:34:58.787397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T18:36:55.987207+0000","scrub_duration":234,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":2425,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:35:02.047197+0000","last_change":"2024-02-09T08:35:02.048550+0000","last_active":"2024-02-09T08:35:02.047197+0000","last_peered":"2024-02-09T08:35:02.047197+0000","last_clean":"2024-02-09T08:35:02.047197+0000","last_became_active":"2024-02-09T08:04:41.259580+0000","last_became_peered":"2024-02-09T08:04:41.259580+0000","last_unstale":"2024-02-09T08:35:02.047197+0000","last_undegraded":"2024-02-09T08:35:02.047197+0000","last_fullsized":"2024-02-09T08:35:02.047197+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:35:02.044709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:35:02.044709+0000","last_clean_scrub_stamp":"2024-02-09T08:35:02.044709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T15:03:01.861116+0000","scrub_duration":127,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":2443,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:35:06.472958+0000","last_change":"2024-02-09T08:35:06.473751+0000","last_active":"2024-02-09T08:35:06.472958+0000","last_peered":"2024-02-09T08:35:06.472958+0000","last_clean":"2024-02-09T08:35:06.472958+0000","last_became_active":"2024-02-09T08:04:53.248695+0000","last_became_peered":"2024-02-09T08:04:53.248695+0000","last_unstale":"2024-02-09T08:35:06.472958+0000","last_undegraded":"2024-02-09T08:35:06.472958+0000","last_fullsized":"2024-02-09T08:35:06.472958+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:35:06.471431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:35:06.471431+0000","last_clean_scrub_stamp":"2024-02-09T08:35:06.471431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T17:13:32.730646+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":2450,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:35:04.372642+0000","last_change":"2024-02-09T08:35:04.373354+0000","last_active":"2024-02-09T08:35:04.372642+0000","last_peered":"2024-02-09T08:35:04.372642+0000","last_clean":"2024-02-09T08:35:04.372642+0000","last_became_active":"2024-02-09T08:04:39.726089+0000","last_became_peered":"2024-02-09T08:04:39.726089+0000","last_unstale":"2024-02-09T08:35:04.372642+0000","last_undegraded":"2024-02-09T08:35:04.372642+0000","last_fullsized":"2024-02-09T08:35:04.372642+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:35:04.371147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:35:04.371147+0000","last_clean_scrub_stamp":"2024-02-09T08:35:04.371147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T19:48:36.800830+0000","scrub_duration":85,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":2419,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:34:58.969252+0000","last_change":"2024-02-09T08:34:58.970032+0000","last_active":"2024-02-09T08:34:58.969252+0000","last_peered":"2024-02-09T08:34:58.969252+0000","last_clean":"2024-02-09T08:34:58.969252+0000","last_became_active":"2024-02-09T08:04:18.174506+0000","last_became_peered":"2024-02-09T08:04:18.174506+0000","last_unstale":"2024-02-09T08:34:58.969252+0000","last_undegraded":"2024-02-09T08:34:58.969252+0000","last_fullsized":"2024-02-09T08:34:58.969252+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:34:58.967676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:34:58.967676+0000","last_clean_scrub_stamp":"2024-02-09T08:34:58.967676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T14:24:29.944484+0000","scrub_duration":89,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":2420,"reported_epoch":1270,"state":"active+clean","last_fresh":"2024-02-09T08:34:59.766402+0000","last_change":"2024-02-09T08:34:59.767234+0000","last_active":"2024-02-09T08:34:59.766402+0000","last_peered":"2024-02-09T08:34:59.766402+0000","last_clean":"2024-02-09T08:34:59.766402+0000","last_became_active":"2024-02-09T08:04:23.899068+0000","last_became_peered":"2024-02-09T08:04:23.899068+0000","last_unstale":"2024-02-09T08:34:59.766402+0000","last_undegraded":"2024-02-09T08:34:59.766402+0000","last_fullsized":"2024-02-09T08:34:59.766402+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-09T08:34:59.764882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-09T08:34:59.764882+0000","last_clean_scrub_stamp":"2024-02-09T08:34:59.764882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-10T09:20:40.588138+0000","scrub_duration":92,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":21,"seq":90194313600,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71152,"kb_used_data":3880,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94300688,"statfs":{"total":96636764160,"available":96563904512,"internally_reserved":0,"allocated":3973120,"data_stored":1617055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68876743},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 9 08:34:53 2024","interfaces":[{"interface":"back","average":{"1min":24.666,"5min":21.817,"15min":34.436999999999998},"min":{"1min":5.2300000000000004,"5min":4.3630000000000004,"15min":4.3630000000000004},"max":{"1min":143.453,"5min":177.68199999999999,"15min":435.74099999999999},"last":9.2620000000000005},{"interface":"front","average":{"1min":18.814,"5min":18.297000000000001,"15min":31.661999999999999},"min":{"1min":4.9489999999999998,"5min":4.5599999999999996,"15min":4.5140000000000002},"max":{"1min":137.261,"5min":157.96600000000001,"15min":530.76499999999999},"last":18.704999999999998}]},{"osd":1,"last update":"Fri Feb 9 08:34:40 2024","interfaces":[{"interface":"back","average":{"1min":23.754000000000001,"5min":27.858000000000001,"15min":41.049999999999997},"min":{"1min":10.205,"5min":8.8209999999999997,"15min":6.3339999999999996},"max":{"1min":133.12,"5min":220.53999999999999,"15min":367.85500000000002},"last":11.252000000000001},{"interface":"front","average":{"1min":16.032,"5min":22.309999999999999,"15min":33.643000000000001},"min":{"1min":7.2750000000000004,"5min":4.9809999999999999,"15min":4.9809999999999999},"max":{"1min":88.522000000000006,"5min":190.19399999999999,"15min":328.70400000000001},"last":8.0440000000000005}]},{"osd":2,"last update":"Fri Feb 9 08:34:36 2024","interfaces":[{"interface":"back","average":{"1min":20.32,"5min":21.036999999999999,"15min":30.809999999999999},"min":{"1min":7.79,"5min":7.5300000000000002,"15min":6.8380000000000001},"max":{"1min":109.685,"5min":154.72399999999999,"15min":296.97199999999998},"last":15.225},{"interface":"front","average":{"1min":28.870000000000001,"5min":27.794,"15min":39.774999999999999},"min":{"1min":11.637,"5min":8.6769999999999996,"15min":8.6769999999999996},"max":{"1min":197.815,"5min":197.815,"15min":307.27800000000002},"last":9.9459999999999997}]},{"osd":4,"last update":"Fri Feb 9 08:34:49 2024","interfaces":[{"interface":"back","average":{"1min":26.966000000000001,"5min":27.829000000000001,"15min":41.098999999999997},"min":{"1min":11.055999999999999,"5min":9.0449999999999999,"15min":7.1340000000000003},"max":{"1min":170.048,"5min":206.846,"15min":590.62699999999995},"last":10.66},{"interface":"front","average":{"1min":22.779,"5min":25.157,"15min":36.898000000000003},"min":{"1min":8.5090000000000003,"5min":8.3049999999999997,"15min":8.3049999999999997},"max":{"1min":135.785,"5min":199.39099999999999,"15min":360.63799999999998},"last":15.853999999999999}]},{"osd":5,"last update":"Fri Feb 9 08:34:19 2024","interfaces":[{"interface":"back","average":{"1min":9.4120000000000008,"5min":27.838999999999999,"15min":38.497999999999998},"min":{"1min":6.3940000000000001,"5min":6.3940000000000001,"15min":6.3179999999999996},"max":{"1min":14.587999999999999,"5min":287.38499999999999,"15min":593.90599999999995},"last":8.3829999999999991},{"interface":"front","average":{"1min":15.715,"5min":37.125,"15min":46.695},"min":{"1min":10.574999999999999,"5min":10.532999999999999,"15min":7.7590000000000003},"max":{"1min":21.821000000000002,"5min":296.96100000000001,"15min":595.14099999999996},"last":11.894}]},{"osd":6,"last update":"Fri Feb 9 08:34:49 2024","interfaces":[{"interface":"back","average":{"1min":21.231000000000002,"5min":24.145,"15min":38.218000000000004},"min":{"1min":7.9770000000000003,"5min":6.585,"15min":6.585},"max":{"1min":141.916,"5min":161.392,"15min":466.93099999999998},"last":17.155000000000001},{"interface":"front","average":{"1min":26.686,"5min":27.655999999999999,"15min":40.771999999999998},"min":{"1min":13.359,"5min":9.4870000000000001,"15min":7.5599999999999996},"max":{"1min":156.434,"5min":168.48500000000001,"15min":713.92999999999995},"last":16.466999999999999}]},{"osd":7,"last update":"Fri Feb 9 08:34:53 2024","interfaces":[{"interface":"back","average":{"1min":30.736999999999998,"5min":33.331000000000003,"15min":46.25},"min":{"1min":12.933999999999999,"5min":9.6359999999999992,"15min":8.3849999999999998},"max":{"1min":191.77199999999999,"5min":209.655,"15min":591.36599999999999},"last":12.51},{"interface":"front","average":{"1min":32.095999999999997,"5min":35.481999999999999,"15min":49.152000000000001},"min":{"1min":13.523999999999999,"5min":13.031000000000001,"15min":11.82},"max":{"1min":192.63300000000001,"5min":245.21600000000001,"15min":815.34000000000003},"last":14.279999999999999}]}]},{"osd":4,"up_from":20,"seq":85899346303,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66992,"kb_used_data":3880,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94304848,"statfs":{"total":96636764160,"available":96568164352,"internally_reserved":0,"allocated":3973120,"data_stored":1617055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 9 08:34:44 2024","interfaces":[{"interface":"back","average":{"1min":10.693,"5min":17.425000000000001,"15min":22.245000000000001},"min":{"1min":4.7210000000000001,"5min":4.7210000000000001,"15min":4.1289999999999996},"max":{"1min":26.428999999999998,"5min":230.53100000000001,"15min":436.31999999999999},"last":12.423},{"interface":"front","average":{"1min":11.77,"5min":14.401999999999999,"15min":20.047999999999998},"min":{"1min":5.7830000000000004,"5min":5.4669999999999996,"15min":4.6539999999999999},"max":{"1min":72.087000000000003,"5min":122.212,"15min":313.82600000000002},"last":10.536}]},{"osd":1,"last update":"Fri Feb 9 08:34:44 2024","interfaces":[{"interface":"back","average":{"1min":13.816000000000001,"5min":16.184999999999999,"15min":22.974},"min":{"1min":7.6779999999999999,"5min":7.1020000000000003,"15min":5.2560000000000002},"max":{"1min":42.305,"5min":181.512,"15min":267.11399999999998},"last":8.3000000000000007},{"interface":"front","average":{"1min":17.181999999999999,"5min":24.428999999999998,"15min":27.335000000000001},"min":{"1min":9.5890000000000004,"5min":7.0650000000000004,"15min":5.282},"max":{"1min":41.612000000000002,"5min":450.27100000000002,"15min":450.27100000000002},"last":21.363}]},{"osd":2,"last update":"Fri Feb 9 08:34:44 2024","interfaces":[{"interface":"back","average":{"1min":14.859999999999999,"5min":18.300000000000001,"15min":24.43},"min":{"1min":6.4489999999999998,"5min":6.3209999999999997,"15min":6.1159999999999997},"max":{"1min":62.048000000000002,"5min":133.65600000000001,"15min":380.56599999999997},"last":9.3529999999999998},{"interface":"front","average":{"1min":18.081,"5min":21.329000000000001,"15min":28.344999999999999},"min":{"1min":7.6710000000000003,"5min":6.7039999999999997,"15min":6.7039999999999997},"max":{"1min":149.84800000000001,"5min":150.18100000000001,"15min":328.28100000000001},"last":13.933}]},{"osd":3,"last update":"Fri Feb 9 08:34:45 2024","interfaces":[{"interface":"back","average":{"1min":16.779,"5min":20.786000000000001,"15min":33.490000000000002},"min":{"1min":7.3289999999999997,"5min":6.8360000000000003,"15min":6.8360000000000003},"max":{"1min":115.795,"5min":147.76900000000001,"15min":957.68299999999999},"last":14.907},{"interface":"front","average":{"1min":20.568999999999999,"5min":23.959,"15min":35.015000000000001},"min":{"1min":9.9320000000000004,"5min":8.4870000000000001,"15min":6.7359999999999998},"max":{"1min":151.346,"5min":203.74700000000001,"15min":1190.1980000000001},"last":18.693999999999999}]},{"osd":5,"last update":"Fri Feb 9 08:34:44 2024","interfaces":[{"interface":"back","average":{"1min":24.512,"5min":17.521000000000001,"15min":25.984999999999999},"min":{"1min":6.2759999999999998,"5min":6.2759999999999998,"15min":6.2759999999999998},"max":{"1min":305.34100000000001,"5min":305.34100000000001,"15min":375.72000000000003},"last":12.803000000000001},{"interface":"front","average":{"1min":21.675999999999998,"5min":22.166,"15min":26.899000000000001},"min":{"1min":10.917999999999999,"5min":10.558,"15min":6.585},"max":{"1min":128.261,"5min":141.596,"15min":429.53500000000003},"last":19.611999999999998}]},{"osd":6,"last update":"Fri Feb 9 08:34:44 2024","interfaces":[{"interface":"back","average":{"1min":24.588000000000001,"5min":25.984999999999999,"15min":30.030999999999999},"min":{"1min":12.113,"5min":11.869999999999999,"15min":8.4760000000000009},"max":{"1min":100.815,"5min":205.577,"15min":300.27100000000002},"last":20.501000000000001},{"interface":"front","average":{"1min":35.454999999999998,"5min":24.370000000000001,"15min":29.376999999999999},"min":{"1min":8.0079999999999991,"5min":7.0389999999999997,"15min":7.0389999999999997},"max":{"1min":378.00099999999998,"5min":378.00099999999998,"15min":378.00099999999998},"last":15.606999999999999}]},{"osd":7,"last update":"Fri Feb 9 08:34:44 2024","interfaces":[{"interface":"back","average":{"1min":18.373999999999999,"5min":18.158999999999999,"15min":27.742000000000001},"min":{"1min":8.9670000000000005,"5min":6.2039999999999997,"15min":6.2039999999999997},"max":{"1min":93.730000000000004,"5min":93.730000000000004,"15min":349.47500000000002},"last":16.317},{"interface":"front","average":{"1min":21.815000000000001,"5min":19.652999999999999,"15min":28.613},"min":{"1min":9.1069999999999993,"5min":9.0739999999999998,"15min":9.0739999999999998},"max":{"1min":130.899,"5min":130.899,"15min":381.80399999999997},"last":17.648}]}]},{"osd":1,"up_from":16,"seq":68719477118,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71548,"kb_used_data":4276,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94300292,"statfs":{"total":96636764160,"available":96563499008,"internally_reserved":0,"allocated":4378624,"data_stored":2014900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 9 08:35:05 2024","interfaces":[{"interface":"back","average":{"1min":26.359000000000002,"5min":23.187000000000001,"15min":21.478999999999999},"min":{"1min":6.4109999999999996,"5min":5.532,"15min":4.431},"max":{"1min":179.12,"5min":206.726,"15min":212.11199999999999},"last":9.8049999999999997},{"interface":"front","average":{"1min":39.162999999999997,"5min":30.170999999999999,"15min":27.114000000000001},"min":{"1min":10.736000000000001,"5min":8.2560000000000002,"15min":4.8849999999999998},"max":{"1min":182.208,"5min":232.68199999999999,"15min":468.82799999999997},"last":13.163}]},{"osd":2,"last update":"Fri Feb 9 08:34:31 2024","interfaces":[{"interface":"back","average":{"1min":33.371000000000002,"5min":24.713999999999999,"15min":24.129000000000001},"min":{"1min":9.1159999999999997,"5min":6.2510000000000003,"15min":5.2809999999999997},"max":{"1min":202.48500000000001,"5min":202.48500000000001,"15min":264.06400000000002},"last":11.151},{"interface":"front","average":{"1min":32.582999999999998,"5min":27.651,"15min":30.681000000000001},"min":{"1min":9.7490000000000006,"5min":7.8879999999999999,"15min":7.5179999999999998},"max":{"1min":164.06299999999999,"5min":181.94900000000001,"15min":417.31599999999997},"last":11.795999999999999}]},{"osd":3,"last update":"Fri Feb 9 08:34:31 2024","interfaces":[{"interface":"back","average":{"1min":21.018000000000001,"5min":25.486000000000001,"15min":30.059000000000001},"min":{"1min":8.2370000000000001,"5min":6.2460000000000004,"15min":6.2460000000000004},"max":{"1min":146.39099999999999,"5min":237.40799999999999,"15min":421.22300000000001},"last":10.409000000000001},{"interface":"front","average":{"1min":23.954000000000001,"5min":29.001999999999999,"15min":32.527000000000001},"min":{"1min":9.7919999999999998,"5min":9.6479999999999997,"15min":8.5730000000000004},"max":{"1min":150.655,"5min":251.86199999999999,"15min":434.92500000000001},"last":13.805}]},{"osd":4,"last update":"Fri Feb 9 08:34:52 2024","interfaces":[{"interface":"back","average":{"1min":36.454999999999998,"5min":24.324999999999999,"15min":23.346},"min":{"1min":6.468,"5min":6.468,"15min":6.468},"max":{"1min":171.54400000000001,"5min":171.54400000000001,"15min":171.54400000000001},"last":16.553999999999998},{"interface":"front","average":{"1min":28.584,"5min":19.079000000000001,"15min":21.050999999999998},"min":{"1min":6.5110000000000001,"5min":5.6890000000000001,"15min":5.6890000000000001},"max":{"1min":168.749,"5min":168.749,"15min":179.363},"last":7.1399999999999997}]},{"osd":5,"last update":"Fri Feb 9 08:35:05 2024","interfaces":[{"interface":"back","average":{"1min":29.606000000000002,"5min":22.123000000000001,"15min":27.376000000000001},"min":{"1min":8.1419999999999995,"5min":6.3220000000000001,"15min":6.3220000000000001},"max":{"1min":194.309,"5min":194.309,"15min":455.44299999999998},"last":8.9619999999999997},{"interface":"front","average":{"1min":30.689,"5min":24.513999999999999,"15min":30.071999999999999},"min":{"1min":8.6199999999999992,"5min":8.0899999999999999,"15min":8.0899999999999999},"max":{"1min":186.53800000000001,"5min":186.53800000000001,"15min":469.512},"last":18.698}]},{"osd":6,"last update":"Fri Feb 9 08:34:31 2024","interfaces":[{"interface":"back","average":{"1min":26.119,"5min":25.067,"15min":28.399000000000001},"min":{"1min":10.398999999999999,"5min":9.6460000000000008,"15min":8.1270000000000007},"max":{"1min":175.44,"5min":175.44,"15min":345.596},"last":12.456},{"interface":"front","average":{"1min":28.597000000000001,"5min":28.733000000000001,"15min":30.506},"min":{"1min":12.433,"5min":11.949,"15min":7.7160000000000002},"max":{"1min":176.929,"5min":176.929,"15min":423.88400000000001},"last":17.216999999999999}]},{"osd":7,"last update":"Fri Feb 9 08:34:31 2024","interfaces":[{"interface":"back","average":{"1min":27.841999999999999,"5min":27.408999999999999,"15min":30.664000000000001},"min":{"1min":11.976000000000001,"5min":11.976000000000001,"15min":9.1010000000000009},"max":{"1min":128.32599999999999,"5min":159.02600000000001,"15min":418.42500000000001},"last":15.920999999999999},{"interface":"front","average":{"1min":27.018999999999998,"5min":28.265000000000001,"15min":30.824000000000002},"min":{"1min":13.486000000000001,"5min":12.634,"15min":8.8149999999999995},"max":{"1min":130.70599999999999,"5min":161.59999999999999,"15min":377.685},"last":17.914999999999999}]}]},{"osd":7,"up_from":15,"seq":64424509829,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71152,"kb_used_data":3880,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94300688,"statfs":{"total":96636764160,"available":96563904512,"internally_reserved":0,"allocated":3973120,"data_stored":1617055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":68876746},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 9 08:35:01 2024","interfaces":[{"interface":"back","average":{"1min":20.501999999999999,"5min":19.914000000000001,"15min":19.274000000000001},"min":{"1min":4.7439999999999998,"5min":4.3600000000000003,"15min":4.3600000000000003},"max":{"1min":145.61799999999999,"5min":312.15699999999998,"15min":312.15699999999998},"last":6.4569999999999999},{"interface":"front","average":{"1min":18.420000000000002,"5min":20.728999999999999,"15min":20.725000000000001},"min":{"1min":6.0270000000000001,"5min":4.5410000000000004,"15min":4.0830000000000002},"max":{"1min":127.39700000000001,"5min":315.53399999999999,"15min":315.53399999999999},"last":9.6999999999999993}]},{"osd":1,"last update":"Fri Feb 9 08:34:48 2024","interfaces":[{"interface":"back","average":{"1min":16.395,"5min":21.608000000000001,"15min":33.338999999999999},"min":{"1min":6.5149999999999997,"5min":5.859,"15min":4.5279999999999996},"max":{"1min":76.780000000000001,"5min":277.971,"15min":1551.0129999999999},"last":9.0790000000000006},{"interface":"front","average":{"1min":19.09,"5min":23.619,"15min":31.817},"min":{"1min":9.5350000000000001,"5min":5.5709999999999997,"15min":5.5709999999999997},"max":{"1min":75.843999999999994,"5min":318.48500000000001,"15min":1189.5050000000001},"last":15.788}]},{"osd":2,"last update":"Fri Feb 9 08:35:01 2024","interfaces":[{"interface":"back","average":{"1min":33.542000000000002,"5min":26.085999999999999,"15min":23.984999999999999},"min":{"1min":6.7080000000000002,"5min":5.7249999999999996,"15min":5.7249999999999996},"max":{"1min":196.00200000000001,"5min":309.161,"15min":309.161},"last":7.3949999999999996},{"interface":"front","average":{"1min":36.555999999999997,"5min":28.542000000000002,"15min":26.382999999999999},"min":{"1min":8.0670000000000002,"5min":6.9539999999999997,"15min":6.9050000000000002},"max":{"1min":186.31100000000001,"5min":333.91399999999999,"15min":333.91399999999999},"last":17.510000000000002}]},{"osd":3,"last update":"Fri Feb 9 08:35:15 2024","interfaces":[{"interface":"back","average":{"1min":14.657,"5min":26.611999999999998,"15min":31.536000000000001},"min":{"1min":7.2450000000000001,"5min":6.516,"15min":6.516},"max":{"1min":34.085000000000001,"5min":310.67399999999998,"15min":429.62799999999999},"last":8.1189999999999998},{"interface":"front","average":{"1min":16.199000000000002,"5min":26.324000000000002,"15min":35.451999999999998},"min":{"1min":10.367000000000001,"5min":6.3680000000000003,"15min":6.3680000000000003},"max":{"1min":32.097000000000001,"5min":317.71699999999998,"15min":485.76100000000002},"last":14.885999999999999}]},{"osd":4,"last update":"Fri Feb 9 08:34:48 2024","interfaces":[{"interface":"back","average":{"1min":17.018999999999998,"5min":30.007000000000001,"15min":29.927},"min":{"1min":7.8369999999999997,"5min":7.7869999999999999,"15min":7.7869999999999999},"max":{"1min":47.853999999999999,"5min":324.089,"15min":345.54300000000001},"last":10.451000000000001},{"interface":"front","average":{"1min":19.475999999999999,"5min":32.319000000000003,"15min":31.989999999999998},"min":{"1min":10.106,"5min":10.106,"15min":10.106},"max":{"1min":49.270000000000003,"5min":316.80399999999997,"15min":316.80399999999997},"last":12.393000000000001}]},{"osd":5,"last update":"Fri Feb 9 08:35:01 2024","interfaces":[{"interface":"back","average":{"1min":40.719000000000001,"5min":30.523,"15min":27.393999999999998},"min":{"1min":8.0790000000000006,"5min":6.6689999999999996,"15min":6.1459999999999999},"max":{"1min":238.01400000000001,"5min":333.00700000000001,"15min":333.00700000000001},"last":16.552},{"interface":"front","average":{"1min":32.722000000000001,"5min":32.274000000000001,"15min":27.937000000000001},"min":{"1min":9.2680000000000007,"5min":7.508,"15min":6.3499999999999996},"max":{"1min":135.202,"5min":352.358,"15min":352.358},"last":19.332999999999998}]},{"osd":6,"last update":"Fri Feb 9 08:35:01 2024","interfaces":[{"interface":"back","average":{"1min":43.994,"5min":31.199000000000002,"15min":29.141999999999999},"min":{"1min":10.817,"5min":7.2240000000000002,"15min":6.8879999999999999},"max":{"1min":306.78500000000003,"5min":338.29000000000002,"15min":338.29000000000002},"last":18.242999999999999},{"interface":"front","average":{"1min":46.667000000000002,"5min":33.759999999999998,"15min":33.655999999999999},"min":{"1min":13.721,"5min":12.204000000000001,"15min":9.3729999999999993},"max":{"1min":309,"5min":349.34500000000003,"15min":349.34500000000003},"last":20.352}]}]},{"osd":6,"up_from":15,"seq":64424509828,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71152,"kb_used_data":3880,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94300688,"statfs":{"total":96636764160,"available":96563904512,"internally_reserved":0,"allocated":3973120,"data_stored":1617055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 9 08:35:04 2024","interfaces":[{"interface":"back","average":{"1min":20.972999999999999,"5min":18.149999999999999,"15min":23.965},"min":{"1min":4.8029999999999999,"5min":4.2380000000000004,"15min":4.1589999999999998},"max":{"1min":132.018,"5min":132.018,"15min":318.44400000000002},"last":10.477},{"interface":"front","average":{"1min":24.724,"5min":21.725999999999999,"15min":27.613},"min":{"1min":5.4340000000000002,"5min":4.6589999999999998,"15min":4.6589999999999998},"max":{"1min":183.55500000000001,"5min":190.51400000000001,"15min":340.25599999999997},"last":12.720000000000001}]},{"osd":1,"last update":"Fri Feb 9 08:35:09 2024","interfaces":[{"interface":"back","average":{"1min":31.753,"5min":27.001000000000001,"15min":28.675999999999998},"min":{"1min":6.4269999999999996,"5min":5.9960000000000004,"15min":5.093},"max":{"1min":230.69399999999999,"5min":230.69399999999999,"15min":664.64300000000003},"last":8.5020000000000007},{"interface":"front","average":{"1min":32.889000000000003,"5min":30.571999999999999,"15min":28.268999999999998},"min":{"1min":8.9369999999999994,"5min":7.1449999999999996,"15min":6.5780000000000003},"max":{"1min":211.42099999999999,"5min":258.34500000000003,"15min":320.73399999999998},"last":11.143000000000001}]},{"osd":2,"last update":"Fri Feb 9 08:35:04 2024","interfaces":[{"interface":"back","average":{"1min":33.170000000000002,"5min":27.603999999999999,"15min":29.539999999999999},"min":{"1min":8.6699999999999999,"5min":6.7300000000000004,"15min":6.7300000000000004},"max":{"1min":208.298,"5min":290.71600000000001,"15min":290.71600000000001},"last":15.44},{"interface":"front","average":{"1min":29.494,"5min":26.640999999999998,"15min":28.669},"min":{"1min":7.3680000000000003,"5min":7.2320000000000002,"15min":6.6719999999999997},"max":{"1min":184.251,"5min":286.08699999999999,"15min":286.08699999999999},"last":19.434999999999999}]},{"osd":3,"last update":"Fri Feb 9 08:35:09 2024","interfaces":[{"interface":"back","average":{"1min":37.886000000000003,"5min":29.494,"15min":33.774000000000001},"min":{"1min":11.288,"5min":9.1270000000000007,"15min":7.5209999999999999},"max":{"1min":195.16800000000001,"5min":214.75899999999999,"15min":400.87099999999998},"last":7.4109999999999996},{"interface":"front","average":{"1min":25.181999999999999,"5min":25.646999999999998,"15min":35.933999999999997},"min":{"1min":8.9019999999999992,"5min":6.4420000000000002,"15min":6.4420000000000002},"max":{"1min":169.161,"5min":257.88400000000001,"15min":401.97300000000001},"last":13.442}]},{"osd":4,"last update":"Fri Feb 9 08:34:42 2024","interfaces":[{"interface":"back","average":{"1min":27.59,"5min":28.632999999999999,"15min":29.07},"min":{"1min":11.359,"5min":8.8100000000000005,"15min":6.9800000000000004},"max":{"1min":193.97499999999999,"5min":243.23599999999999,"15min":339.286},"last":18.536999999999999},{"interface":"front","average":{"1min":30.446000000000002,"5min":34.627000000000002,"15min":35.954000000000001},"min":{"1min":14.337999999999999,"5min":11.573,"15min":10.298999999999999},"max":{"1min":198.60400000000001,"5min":243.86600000000001,"15min":402.19099999999997},"last":21.239000000000001}]},{"osd":5,"last update":"Fri Feb 9 08:35:04 2024","interfaces":[{"interface":"back","average":{"1min":26.033999999999999,"5min":23.140999999999998,"15min":25.562000000000001},"min":{"1min":8.0459999999999994,"5min":7.1340000000000003,"15min":6.0170000000000003},"max":{"1min":129.87799999999999,"5min":178.73400000000001,"15min":395.89999999999998},"last":14.648},{"interface":"front","average":{"1min":35.085999999999999,"5min":32.530000000000001,"15min":34.645000000000003},"min":{"1min":13.641,"5min":11.002000000000001,"15min":8.1449999999999996},"max":{"1min":197.953,"5min":224.886,"15min":665.33799999999997},"last":20.335000000000001}]},{"osd":7,"last update":"Fri Feb 9 08:34:55 2024","interfaces":[{"interface":"back","average":{"1min":20.887,"5min":23.414999999999999,"15min":27.416},"min":{"1min":8.8010000000000002,"5min":7.9889999999999999,"15min":7.9429999999999996},"max":{"1min":80.307000000000002,"5min":264.161,"15min":326.23200000000003},"last":16.207999999999998},{"interface":"front","average":{"1min":23.617000000000001,"5min":27.332999999999998,"15min":30.577000000000002},"min":{"1min":12.741,"5min":10.56,"15min":8.7810000000000006},"max":{"1min":83.254000000000005,"5min":242.25299999999999,"15min":315.09199999999998},"last":17.507000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509824,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71152,"kb_used_data":3880,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94300688,"statfs":{"total":96636764160,"available":96563904512,"internally_reserved":0,"allocated":3973120,"data_stored":1617055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 9 08:34:56 2024","interfaces":[{"interface":"back","average":{"1min":16.405000000000001,"5min":16.681000000000001,"15min":22.327000000000002},"min":{"1min":8.9139999999999997,"5min":5.6719999999999997,"15min":4.1859999999999999},"max":{"1min":57.972999999999999,"5min":236.542,"15min":236.542},"last":10.856},{"interface":"front","average":{"1min":19.302,"5min":19.050000000000001,"15min":26.498999999999999},"min":{"1min":6.952,"5min":6.8529999999999998,"15min":5.0830000000000002},"max":{"1min":66.572000000000003,"5min":237.27000000000001,"15min":258.41800000000001},"last":12.718999999999999}]},{"osd":1,"last update":"Fri Feb 9 08:34:34 2024","interfaces":[{"interface":"back","average":{"1min":19.222999999999999,"5min":13.205,"15min":27.302},"min":{"1min":5.681,"5min":5.2800000000000002,"15min":5.2080000000000002},"max":{"1min":170.83000000000001,"5min":170.83000000000001,"15min":752.81500000000005},"last":7.9699999999999998},{"interface":"front","average":{"1min":26.896999999999998,"5min":23.623999999999999,"15min":36.237000000000002},"min":{"1min":9.7539999999999996,"5min":9.5890000000000004,"15min":6.8819999999999997},"max":{"1min":169.58099999999999,"5min":202.91,"15min":752.245},"last":12.093}]},{"osd":3,"last update":"Fri Feb 9 08:34:56 2024","interfaces":[{"interface":"back","average":{"1min":28.867000000000001,"5min":29.812999999999999,"15min":37.604999999999997},"min":{"1min":11.935,"5min":6.7709999999999999,"15min":5.7949999999999999},"max":{"1min":84.561000000000007,"5min":325.14499999999998,"15min":846.35400000000004},"last":11.448},{"interface":"front","average":{"1min":23.334,"5min":19.262,"15min":32.069000000000003},"min":{"1min":6.9509999999999996,"5min":5.9969999999999999,"15min":5.5490000000000004},"max":{"1min":168.458,"5min":235.749,"15min":334.87900000000002},"last":9.5969999999999995}]},{"osd":4,"last update":"Fri Feb 9 08:34:56 2024","interfaces":[{"interface":"back","average":{"1min":28.73,"5min":23.553999999999998,"15min":29.974},"min":{"1min":10.797000000000001,"5min":10.058999999999999,"15min":7.7110000000000003},"max":{"1min":92.694999999999993,"5min":254.77799999999999,"15min":423.28199999999998},"last":13.329000000000001},{"interface":"front","average":{"1min":29.489999999999998,"5min":25.640999999999998,"15min":32.055999999999997},"min":{"1min":15.862,"5min":12.321999999999999,"15min":12.132999999999999},"max":{"1min":91.143000000000001,"5min":253.941,"15min":297.73399999999998},"last":13.926}]},{"osd":5,"last update":"Fri Feb 9 08:34:56 2024","interfaces":[{"interface":"back","average":{"1min":21.995000000000001,"5min":18.247,"15min":28.542000000000002},"min":{"1min":6.5010000000000003,"5min":6.5010000000000003,"15min":6.1870000000000003},"max":{"1min":145.33500000000001,"5min":150.24799999999999,"15min":319.279},"last":15.956},{"interface":"front","average":{"1min":23.859999999999999,"5min":23.346,"15min":33.639000000000003},"min":{"1min":9.2219999999999995,"5min":6.21,"15min":6.21},"max":{"1min":86.998000000000005,"5min":283.18900000000002,"15min":314.74299999999999},"last":16.741}]},{"osd":6,"last update":"Fri Feb 9 08:34:56 2024","interfaces":[{"interface":"back","average":{"1min":36.523000000000003,"5min":24.001000000000001,"15min":35.146999999999998},"min":{"1min":15.282999999999999,"5min":12.33,"15min":9.859},"max":{"1min":151.12100000000001,"5min":151.12100000000001,"15min":301.05099999999999},"last":14.548},{"interface":"front","average":{"1min":35.552,"5min":25.722999999999999,"15min":35.530000000000001},"min":{"1min":17.172000000000001,"5min":13.566000000000001,"15min":13.298},"max":{"1min":122.627,"5min":122.627,"15min":273.30500000000001},"last":15.228999999999999}]},{"osd":7,"last update":"Fri Feb 9 08:34:34 2024","interfaces":[{"interface":"back","average":{"1min":15.26,"5min":13.488,"15min":26.422999999999998},"min":{"1min":7.3300000000000001,"5min":7.3300000000000001,"15min":6.3849999999999998},"max":{"1min":86.403000000000006,"5min":88.838999999999999,"15min":303.416},"last":6.8369999999999997},{"interface":"front","average":{"1min":19.038,"5min":16.216000000000001,"15min":30.358000000000001},"min":{"1min":8.7520000000000007,"5min":8.2449999999999992,"15min":7.7999999999999998},"max":{"1min":107.05,"5min":107.05,"15min":498.34300000000002},"last":19.369}]}]},{"osd":0,"up_from":15,"seq":64424509822,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66996,"kb_used_data":3884,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94304844,"statfs":{"total":96636764160,"available":96568160256,"internally_reserved":0,"allocated":3977216,"data_stored":1617060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Feb 9 08:34:30 2024","interfaces":[{"interface":"back","average":{"1min":13.795,"5min":19.091000000000001,"15min":26.939},"min":{"1min":5.9130000000000003,"5min":4.306,"15min":4.306},"max":{"1min":45.713000000000001,"5min":119.645,"15min":305.28699999999998},"last":11.952},{"interface":"front","average":{"1min":25.221,"5min":25.786999999999999,"15min":37.503999999999998},"min":{"1min":7.8170000000000002,"5min":6.3170000000000002,"15min":6.3170000000000002},"max":{"1min":213.21299999999999,"5min":229.71100000000001,"15min":409.27699999999999},"last":13.964}]},{"osd":2,"last update":"Fri Feb 9 08:34:57 2024","interfaces":[{"interface":"back","average":{"1min":19.652999999999999,"5min":16.780000000000001,"15min":22.919},"min":{"1min":5.2270000000000003,"5min":5.2270000000000003,"15min":4.7439999999999998},"max":{"1min":77.718000000000004,"5min":169.529,"15min":391.44600000000003},"last":8.3230000000000004},{"interface":"front","average":{"1min":23.157,"5min":19.033999999999999,"15min":25.393999999999998},"min":{"1min":6.2249999999999996,"5min":4.5469999999999997,"15min":4.5469999999999997},"max":{"1min":164.23699999999999,"5min":184.84299999999999,"15min":312.03899999999999},"last":20.350000000000001}]},{"osd":3,"last update":"Fri Feb 9 08:34:40 2024","interfaces":[{"interface":"back","average":{"1min":20.146999999999998,"5min":23.992999999999999,"15min":39.951999999999998},"min":{"1min":9.1579999999999995,"5min":9.1579999999999995,"15min":8.391},"max":{"1min":65.817999999999998,"5min":188.982,"15min":464.74900000000002},"last":12.609999999999999},{"interface":"front","average":{"1min":24.324999999999999,"5min":29.202000000000002,"15min":46.600000000000001},"min":{"1min":14.225,"5min":11.369999999999999,"15min":10.288},"max":{"1min":66.498999999999995,"5min":191.452,"15min":472.88},"last":14.635}]},{"osd":4,"last update":"Fri Feb 9 08:34:40 2024","interfaces":[{"interface":"back","average":{"1min":30.094000000000001,"5min":26.760999999999999,"15min":42.034999999999997},"min":{"1min":12.295999999999999,"5min":10.787000000000001,"15min":6.9569999999999999},"max":{"1min":213.91499999999999,"5min":213.91499999999999,"15min":544.02800000000002},"last":13.272},{"interface":"front","average":{"1min":16.696999999999999,"5min":19.814,"15min":31.989000000000001},"min":{"1min":6.5010000000000003,"5min":6.5010000000000003,"15min":5.8869999999999996},"max":{"1min":93.179000000000002,"5min":206.73400000000001,"15min":377.84300000000002},"last":10.009}]},{"osd":5,"last update":"Fri Feb 9 08:35:11 2024","interfaces":[{"interface":"back","average":{"1min":28.399000000000001,"5min":29.940999999999999,"15min":38.590000000000003},"min":{"1min":14.615,"5min":11.706,"15min":7.0730000000000004},"max":{"1min":91.935000000000002,"5min":226.21899999999999,"15min":432.82999999999998},"last":15.305999999999999},{"interface":"front","average":{"1min":20.922000000000001,"5min":23.463000000000001,"15min":37.927999999999997},"min":{"1min":7.3819999999999997,"5min":7.3319999999999999,"15min":6.532},"max":{"1min":82.441000000000003,"5min":327.69499999999999,"15min":357.50999999999999},"last":11.199999999999999}]},{"osd":6,"last update":"Fri Feb 9 08:34:30 2024","interfaces":[{"interface":"back","average":{"1min":13.712999999999999,"5min":24.167000000000002,"15min":37.954000000000001},"min":{"1min":7.2910000000000004,"5min":7.2910000000000004,"15min":6.399},"max":{"1min":36.033999999999999,"5min":156.667,"15min":544.94200000000001},"last":19.454999999999998},{"interface":"front","average":{"1min":16.936,"5min":21.940000000000001,"15min":39.573999999999998},"min":{"1min":10.241,"5min":7.8369999999999997,"15min":7.8369999999999997},"max":{"1min":42.064999999999998,"5min":179.739,"15min":556.30200000000002},"last":21.306000000000001}]},{"osd":7,"last update":"Fri Feb 9 08:35:08 2024","interfaces":[{"interface":"back","average":{"1min":30.603000000000002,"5min":28.748000000000001,"15min":37.82},"min":{"1min":16.003,"5min":13.481,"15min":12.752000000000001},"max":{"1min":148.934,"5min":167.09,"15min":376.91800000000001},"last":16.943999999999999},{"interface":"front","average":{"1min":26.693999999999999,"5min":22.244,"15min":27.352},"min":{"1min":8.3000000000000007,"5min":7.3310000000000004,"15min":7.0880000000000001},"max":{"1min":216.143,"5min":216.143,"15min":342.79300000000001},"last":16.152999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575234,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":75704,"kb_used_data":4272,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94296136,"statfs":{"total":96636764160,"available":96559243264,"internally_reserved":0,"allocated":4374528,"data_stored":2014895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 9 08:35:15 2024","interfaces":[{"interface":"back","average":{"1min":25.231999999999999,"5min":17.602,"15min":23.251000000000001},"min":{"1min":4.5049999999999999,"5min":4.5049999999999999,"15min":4.4509999999999996},"max":{"1min":158.76599999999999,"5min":158.76599999999999,"15min":403.41699999999997},"last":10.06},{"interface":"front","average":{"1min":24.241,"5min":19.076000000000001,"15min":22.736000000000001},"min":{"1min":5.1390000000000002,"5min":5.1130000000000004,"15min":4.6029999999999998},"max":{"1min":140.036,"5min":194.32300000000001,"15min":279.5},"last":10.702}]},{"osd":1,"last update":"Fri Feb 9 08:34:52 2024","interfaces":[{"interface":"back","average":{"1min":25.527999999999999,"5min":25.521999999999998,"15min":24.611999999999998},"min":{"1min":5.5220000000000002,"5min":5.5220000000000002,"15min":5.4550000000000001},"max":{"1min":163.779,"5min":303.23500000000001,"15min":303.23500000000001},"last":13.471},{"interface":"front","average":{"1min":32.500999999999998,"5min":34.232999999999997,"15min":30.094999999999999},"min":{"1min":9.5809999999999995,"5min":7.3390000000000004,"15min":6.7709999999999999},"max":{"1min":166.93700000000001,"5min":294.35000000000002,"15min":294.35000000000002},"last":17.748000000000001}]},{"osd":2,"last update":"Fri Feb 9 08:34:32 2024","interfaces":[{"interface":"back","average":{"1min":25.158999999999999,"5min":24.327000000000002,"15min":28.507000000000001},"min":{"1min":7.7759999999999998,"5min":6.415,"15min":6.415},"max":{"1min":174.41999999999999,"5min":287.077,"15min":364.81400000000002},"last":18.597000000000001},{"interface":"front","average":{"1min":18.797999999999998,"5min":20.239999999999998,"15min":25.591999999999999},"min":{"1min":7.3109999999999999,"5min":7.3109999999999999,"15min":6.5540000000000003},"max":{"1min":128.667,"5min":176.416,"15min":339.12700000000001},"last":7.4509999999999996}]},{"osd":3,"last update":"Fri Feb 9 08:34:32 2024","interfaces":[{"interface":"back","average":{"1min":29.274999999999999,"5min":27.763000000000002,"15min":34.323999999999998},"min":{"1min":8.1790000000000003,"5min":7.1130000000000004,"15min":7.1130000000000004},"max":{"1min":212.745,"5min":282.11000000000001,"15min":342.459},"last":19.411000000000001},{"interface":"front","average":{"1min":24.997,"5min":25.640000000000001,"15min":31.324999999999999},"min":{"1min":7.7409999999999997,"5min":7.234,"15min":6.7409999999999997},"max":{"1min":162.99600000000001,"5min":277.74700000000001,"15min":323.46899999999999},"last":12.000999999999999}]},{"osd":4,"last update":"Fri Feb 9 08:34:32 2024","interfaces":[{"interface":"back","average":{"1min":23.001999999999999,"5min":24.670000000000002,"15min":29.638000000000002},"min":{"1min":8.2539999999999996,"5min":7.0880000000000001,"15min":7.0880000000000001},"max":{"1min":188.62700000000001,"5min":223.655,"15min":336.74000000000001},"last":8.8499999999999996},{"interface":"front","average":{"1min":23.012,"5min":22.286000000000001,"15min":28.931999999999999},"min":{"1min":8.3960000000000008,"5min":8.0030000000000001,"15min":7.4550000000000001},"max":{"1min":189.79499999999999,"5min":189.79499999999999,"15min":334.48500000000001},"last":12.814}]},{"osd":6,"last update":"Fri Feb 9 08:35:04 2024","interfaces":[{"interface":"back","average":{"1min":40.363,"5min":25.657,"15min":30.567},"min":{"1min":9.7210000000000001,"5min":8.2799999999999994,"15min":7.742},"max":{"1min":210.52099999999999,"5min":210.52099999999999,"15min":320.85500000000002},"last":14.196999999999999},{"interface":"front","average":{"1min":43.682000000000002,"5min":28.727,"15min":34.481999999999999},"min":{"1min":13.500999999999999,"5min":11.550000000000001,"15min":10.997999999999999},"max":{"1min":232.71700000000001,"5min":232.71700000000001,"15min":411.56599999999997},"last":15.731999999999999}]},{"osd":7,"last update":"Fri Feb 9 08:35:04 2024","interfaces":[{"interface":"back","average":{"1min":35.814999999999998,"5min":27.623999999999999,"15min":28.596},"min":{"1min":11.302,"5min":8.2599999999999998,"15min":7.3650000000000002},"max":{"1min":162.09899999999999,"5min":202.65100000000001,"15min":300.56200000000001},"last":16.789000000000001},{"interface":"front","average":{"1min":40.113999999999997,"5min":30.280999999999999,"15min":31.036999999999999},"min":{"1min":8.7720000000000002,"5min":8.7720000000000002,"15min":8.7720000000000002},"max":{"1min":218.59200000000001,"5min":218.59200000000001,"15min":218.59200000000001},"last":20.391999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-09T08:35:24.119 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-02-09T08:35:24.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.221+0000 7f600a6de640 10 monclient: get_monmap_and_config 2024-02-09T08:35:24.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.221+0000 7f600a6de640 10 monclient: build_initial_monmap 2024-02-09T08:35:24.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.221+0000 7f600a6de640 10 monclient: monmap: 2024-02-09T08:35:24.224 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:35:24.224 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:35:24.224 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:35:24.222305+0000 2024-02-09T08:35:24.224 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:35:24.222305+0000 2024-02-09T08:35:24.224 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:35:24.224 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:24.224 INFO:teuthology.orchestra.run.smithi062.stderr:0: v1:172.21.15.62:6789/0 mon.noname-a-legacy 2024-02-09T08:35:24.224 INFO:teuthology.orchestra.run.smithi062.stderr:1: v1:172.21.15.103:6789/0 mon.noname-c-legacy 2024-02-09T08:35:24.224 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-b 2024-02-09T08:35:24.225 INFO:teuthology.orchestra.run.smithi062.stderr:3: v2:172.21.15.62:3300/0 mon.noname-a 2024-02-09T08:35:24.225 INFO:teuthology.orchestra.run.smithi062.stderr:4: v2:172.21.15.103:3300/0 mon.noname-c 2024-02-09T08:35:24.225 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:24.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.221+0000 7f600a6de640 1 Processor -- start 2024-02-09T08:35:24.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.222+0000 7f600a6de640 1 -- start start 2024-02-09T08:35:24.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.222+0000 7f600a6de640 10 monclient: init 2024-02-09T08:35:24.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.222+0000 7f600a6de640 10 monclient: _reopen_session rank -1 2024-02-09T08:35:24.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.222+0000 7f600a6de640 10 monclient: _add_conns ranks=[0,1,4,2,3] 2024-02-09T08:35:24.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.222+0000 7f600a6de640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f600406be10 addr v1:172.21.15.62:6789/0 2024-02-09T08:35:24.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.222+0000 7f600a6de640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f60040b44c0 addr v1:172.21.15.103:6789/0 2024-02-09T08:35:24.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.222+0000 7f600a6de640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f600413ff40 0x7f6004145a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:24.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.222+0000 7f600a6de640 10 monclient(hunting): picked mon.noname-c con 0x7f600413ff40 addr v2:172.21.15.103:3300/0 2024-02-09T08:35:24.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.222+0000 7f600a6de640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60040a9e90 con 0x7f600406be10 2024-02-09T08:35:24.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.222+0000 7f600a6de640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6004145f90 con 0x7f60040b44c0 2024-02-09T08:35:24.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.222+0000 7f600a6de640 10 monclient(hunting): start opening mon connection 2024-02-09T08:35:24.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.222+0000 7f600a6de640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f600406c1f0 con 0x7f600413ff40 2024-02-09T08:35:24.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.222+0000 7f600a6de640 10 monclient(hunting): _renew_subs 2024-02-09T08:35:24.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.222+0000 7f600a6de640 10 monclient(hunting): authenticate will time out at 3367.582854s 2024-02-09T08:35:24.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.223+0000 7f6008c7b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f600413ff40 0x7f6004145a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:35:24.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.223+0000 7f6008c7b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f600413ff40 0x7f6004145a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.62:49356/0 (socket says 172.21.15.62:49356) 2024-02-09T08:35:24.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.223+0000 7f6008c7b640 1 -- 172.21.15.62:0/718256068 learned_addr learned my addr 172.21.15.62:0/718256068 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:35:24.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.223+0000 7f6008c7b640 10 monclient(hunting): get_auth_request con 0x7f600413ff40 auth_method 0 2024-02-09T08:35:24.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.223+0000 7f6008c7b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:35:24.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.223+0000 7f6008c7b640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:35:24.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.223+0000 7f6008c7b640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:35:24.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.224+0000 7f6008c7b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:35:24.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.224+0000 7f6008c7b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:35:24.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.224+0000 7f6008c7b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:35:24.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.226+0000 7f6008c7b640 10 monclient(hunting): handle_auth_done global_id 22393 payload 274 2024-02-09T08:35:24.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.226+0000 7f6008c7b640 1 -- 172.21.15.62:0/718256068 >> v1:172.21.15.103:6789/0 conn(0x7f60040b44c0 legacy=0x7f600413f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-09T08:35:24.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.226+0000 7f6008c7b640 1 -- 172.21.15.62:0/718256068 >> v1:172.21.15.62:6789/0 conn(0x7f600406be10 legacy=0x7f60040a9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:24.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.226+0000 7f6008c7b640 10 monclient: _finish_hunting 0 2024-02-09T08:35:24.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.226+0000 7f6008c7b640 1 monclient: found mon.noname-c 2024-02-09T08:35:24.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.226+0000 7f6008c7b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:35:24.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.226+0000 7f6008c7b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.103:3300/0 2024-02-09T08:35:24.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.226+0000 7f6008c7b640 1 -- 172.21.15.62:0/718256068 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6004146120 con 0x7f600413ff40 2024-02-09T08:35:24.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.229+0000 7f6008c7b640 1 --2- 172.21.15.62:0/718256068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f600413ff40 0x7f6004145a50 secure :-1 s=READY pgs=5683 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc009e80 tx=0x7f5ffc02bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70b7c0249c71f3ea server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:35:24.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.233+0000 7f6002ffd640 1 -- 172.21.15.62:0/718256068 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ffc02ca70 con 0x7f600413ff40 2024-02-09T08:35:24.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.233+0000 7f6002ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:35:24.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.233+0000 7f6002ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-09T08:35:24.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.233+0000 7f6002ffd640 10 monclient: dump: 2024-02-09T08:35:24.235 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:35:24.235 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:35:24.236 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:24.236 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:24.236 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:35:24.236 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:24.236 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:35:24.236 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:35:24.236 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:35:24.236 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:24.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.233+0000 7f6002ffd640 10 monclient: _finish_auth 0 2024-02-09T08:35:24.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.233+0000 7f6002ffd640 10 monclient: _check_auth_tickets 2024-02-09T08:35:24.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.233+0000 7f6002ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:35:24.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.233+0000 7f6002ffd640 1 -- 172.21.15.62:0/718256068 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ffc02cbd0 con 0x7f600413ff40 2024-02-09T08:35:24.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.233+0000 7f6002ffd640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:35:24.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.233+0000 7f6002ffd640 1 -- 172.21.15.62:0/718256068 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ffc0343f0 con 0x7f600413ff40 2024-02-09T08:35:24.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.233+0000 7f600a6de640 5 monclient: authenticate success, global_id 22393 2024-02-09T08:35:24.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.233+0000 7f600a6de640 10 monclient: get_monmap_and_config success 2024-02-09T08:35:24.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.233+0000 7f600a6de640 4 set_mon_vals no callback set 2024-02-09T08:35:24.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.233+0000 7f6002ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:35:24.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.233+0000 7f6002ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:35:24.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.233+0000 7f6002ffd640 10 monclient: dump: 2024-02-09T08:35:24.237 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:35:24.237 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:35:24.237 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:24.237 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:24.237 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:35:24.237 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:24.237 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:35:24.237 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:35:24.238 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:35:24.238 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:24.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.233+0000 7f600a6de640 10 monclient: shutdown 2024-02-09T08:35:24.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.233+0000 7f600a6de640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:35:24.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.233+0000 7f600a6de640 1 -- 172.21.15.62:0/718256068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f600413ff40 msgr2=0x7f6004145a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:24.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.233+0000 7f600a6de640 1 --2- 172.21.15.62:0/718256068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f600413ff40 0x7f6004145a50 secure :-1 s=READY pgs=5683 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc009e80 tx=0x7f5ffc02bed0 comp rx=0 tx=0).stop 2024-02-09T08:35:24.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.233+0000 7f600a6de640 1 -- 172.21.15.62:0/718256068 shutdown_connections 2024-02-09T08:35:24.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.233+0000 7f600a6de640 1 --2- 172.21.15.62:0/718256068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f600413ff40 0x7f6004145a50 unknown :-1 s=CLOSED pgs=5683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:24.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.233+0000 7f600a6de640 1 -- 172.21.15.62:0/718256068 >> 172.21.15.62:0/718256068 conn(0x7f60040b8070 msgr2=0x7f60040b8480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:35:24.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.233+0000 7f600a6de640 1 -- 172.21.15.62:0/718256068 shutdown_connections 2024-02-09T08:35:24.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.233+0000 7f600a6de640 1 -- 172.21.15.62:0/718256068 wait complete. 2024-02-09T08:35:24.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.234+0000 7f600a6de640 10 monclient: build_initial_monmap 2024-02-09T08:35:24.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.234+0000 7f600a6de640 10 monclient: monmap: 2024-02-09T08:35:24.242 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 0 2024-02-09T08:35:24.242 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-09T08:35:24.242 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 0.000000 2024-02-09T08:35:24.242 INFO:teuthology.orchestra.run.smithi062.stderr:created 0.000000 2024-02-09T08:35:24.242 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 0 (unknown) 2024-02-09T08:35:24.242 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:24.242 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-02-09T08:35:24.242 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-b 2024-02-09T08:35:24.242 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-02-09T08:35:24.242 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:24.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.234+0000 7f600a6de640 1 librados: starting msgr at 2024-02-09T08:35:24.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.234+0000 7f600a6de640 1 librados: starting objecter 2024-02-09T08:35:24.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.234+0000 7f600a6de640 1 Processor -- start 2024-02-09T08:35:24.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.235+0000 7f600a6de640 1 -- start start 2024-02-09T08:35:24.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.235+0000 7f600a6de640 1 librados: setting wanted keys 2024-02-09T08:35:24.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.235+0000 7f600a6de640 1 librados: calling monclient init 2024-02-09T08:35:24.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.235+0000 7f600a6de640 10 monclient: init 2024-02-09T08:35:24.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.235+0000 7f600a6de640 10 monclient: _reopen_session rank -1 2024-02-09T08:35:24.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.235+0000 7f600a6de640 10 monclient: _add_conns ranks=[0,1,2] 2024-02-09T08:35:24.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.235+0000 7f600a6de640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f600406be10 0x7f6004142830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:24.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.235+0000 7f600a6de640 10 monclient(hunting): picked mon.noname-a con 0x7f600406be10 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-02-09T08:35:24.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.235+0000 7f600a6de640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60040b44c0 0x7f60041387a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:24.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.235+0000 7f600a6de640 10 monclient(hunting): picked mon.noname-b con 0x7f60040b44c0 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-09T08:35:24.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.235+0000 7f600a6de640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f600413ff40 0x7f6004136a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:24.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.235+0000 7f600a6de640 10 monclient(hunting): picked mon.noname-c con 0x7f600413ff40 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-09T08:35:24.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.235+0000 7f600a6de640 10 monclient(hunting): start opening mon connection 2024-02-09T08:35:24.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.235+0000 7f600a6de640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6004138ce0 con 0x7f600406be10 2024-02-09T08:35:24.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.235+0000 7f600a6de640 10 monclient(hunting): start opening mon connection 2024-02-09T08:35:24.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.235+0000 7f600a6de640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60041380a0 con 0x7f60040b44c0 2024-02-09T08:35:24.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.235+0000 7f600a6de640 10 monclient(hunting): start opening mon connection 2024-02-09T08:35:24.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.235+0000 7f600a6de640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6004138380 con 0x7f600413ff40 2024-02-09T08:35:24.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.235+0000 7f600a6de640 10 monclient(hunting): _renew_subs 2024-02-09T08:35:24.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.235+0000 7f600a6de640 10 monclient(hunting): authenticate will time out at 3367.595971s 2024-02-09T08:35:24.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.236+0000 7f6003fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f600406be10 0x7f6004142830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:35:24.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.236+0000 7f60037fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60040b44c0 0x7f60041387a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:35:24.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.236+0000 7f6008c7b640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f600413ff40 0x7f6004136a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:35:24.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.236+0000 7f6003fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f600406be10 0x7f6004142830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33624/0 (socket says 172.21.15.62:33624) 2024-02-09T08:35:24.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.236+0000 7f60037fe640 10 monclient(hunting): get_auth_request con 0x7f60040b44c0 auth_method 0 2024-02-09T08:35:24.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.236+0000 7f6003fff640 1 -- 172.21.15.62:0/1888131609 learned_addr learned my addr 172.21.15.62:0/1888131609 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-02-09T08:35:24.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.236+0000 7f60037fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:35:24.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.236+0000 7f60037fe640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:35:24.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.236+0000 7f60037fe640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:35:24.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.236+0000 7f6003fff640 10 monclient(hunting): get_auth_request con 0x7f600406be10 auth_method 0 2024-02-09T08:35:24.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.236+0000 7f6003fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:35:24.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.236+0000 7f6003fff640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:35:24.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.236+0000 7f6003fff640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:35:24.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.236+0000 7f6008c7b640 10 monclient(hunting): get_auth_request con 0x7f600413ff40 auth_method 0 2024-02-09T08:35:24.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.236+0000 7f6008c7b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-09T08:35:24.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.236+0000 7f6008c7b640 10 monclient(hunting): _init_auth method 2 2024-02-09T08:35:24.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.236+0000 7f6008c7b640 10 monclient(hunting): _init_auth creating new auth 2024-02-09T08:35:24.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.237+0000 7f60037fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:35:24.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.237+0000 7f60037fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:35:24.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.237+0000 7f60037fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:35:24.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.237+0000 7f6003fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:35:24.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.237+0000 7f6003fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:35:24.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.237+0000 7f6003fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:35:24.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.237+0000 7f6008c7b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-09T08:35:24.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.237+0000 7f6008c7b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-09T08:35:24.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.237+0000 7f6008c7b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-09T08:35:24.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.239+0000 7f60037fe640 10 monclient(hunting): handle_auth_done global_id 22396 payload 824 2024-02-09T08:35:24.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.239+0000 7f60037fe640 1 -- 172.21.15.62:0/1888131609 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f600413ff40 msgr2=0x7f6004136a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:24.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.239+0000 7f60037fe640 1 --2- 172.21.15.62:0/1888131609 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f600413ff40 0x7f6004136a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:24.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.239+0000 7f60037fe640 1 -- 172.21.15.62:0/1888131609 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f600406be10 msgr2=0x7f6004142830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:24.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.239+0000 7f60037fe640 1 --2- 172.21.15.62:0/1888131609 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f600406be10 0x7f6004142830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:24.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.239+0000 7f60037fe640 10 monclient: _finish_hunting 0 2024-02-09T08:35:24.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.239+0000 7f60037fe640 1 monclient: found mon.noname-b 2024-02-09T08:35:24.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.239+0000 7f60037fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-02-09T08:35:24.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.239+0000 7f60037fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.103:3300/0 2024-02-09T08:35:24.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.239+0000 7f60037fe640 1 -- 172.21.15.62:0/1888131609 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ffc009b30 con 0x7f60040b44c0 2024-02-09T08:35:24.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.242+0000 7f60037fe640 1 --2- 172.21.15.62:0/1888131609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60040b44c0 0x7f60041387a0 secure :-1 s=READY pgs=5684 cs=0 l=1 rev1=1 crypto rx=0x7f5ff800c410 tx=0x7f5ff800c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:35:24.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.242+0000 7f6000ff9640 10 client.?.objecter ms_handle_connect 0x7f60040b44c0 2024-02-09T08:35:24.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.242+0000 7f6000ff9640 10 client.?.objecter resend_mon_ops 2024-02-09T08:35:24.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.244+0000 7f6000ff9640 1 -- 172.21.15.62:0/1888131609 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff80035f0 con 0x7f60040b44c0 2024-02-09T08:35:24.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.244+0000 7f6000ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:35:24.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.244+0000 7f6000ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-02-09T08:35:24.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.244+0000 7f6000ff9640 10 monclient: dump: 2024-02-09T08:35:24.249 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:35:24.249 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:35:24.249 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:24.249 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:24.249 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:35:24.249 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:24.249 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:35:24.249 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:35:24.249 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:35:24.249 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:24.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.244+0000 7f6000ff9640 10 monclient: _finish_auth 0 2024-02-09T08:35:24.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.244+0000 7f6000ff9640 10 monclient: _check_auth_tickets 2024-02-09T08:35:24.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.244+0000 7f6000ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-02-09T08:35:24.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.244+0000 7f600a6de640 5 monclient: authenticate success, global_id 22396 2024-02-09T08:35:24.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.244+0000 7f600a6de640 10 monclient: _renew_subs 2024-02-09T08:35:24.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.244+0000 7f600a6de640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:35:24.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.244+0000 7f600a6de640 1 -- 172.21.15.62:0/1888131609 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60041364b0 con 0x7f60040b44c0 2024-02-09T08:35:24.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.244+0000 7f600a6de640 10 client.22396.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-02-09T08:35:24.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.244+0000 7f600a6de640 10 monclient: _renew_subs 2024-02-09T08:35:24.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.244+0000 7f600a6de640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:35:24.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.244+0000 7f600a6de640 1 -- 172.21.15.62:0/1888131609 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6004135af0 con 0x7f60040b44c0 2024-02-09T08:35:24.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.244+0000 7f600a6de640 1 librados: init done 2024-02-09T08:35:24.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.245+0000 7f600a6de640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-02-09T08:35:24.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.245+0000 7f600a6de640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:35:24.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.245+0000 7f600a6de640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:35:24.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.245+0000 7f600a6de640 1 -- 172.21.15.62:0/1888131609 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6004067fa0 con 0x7f60040b44c0 2024-02-09T08:35:24.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.493+0000 7f6000ff9640 1 -- 172.21.15.62:0/1888131609 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff8007030 con 0x7f60040b44c0 2024-02-09T08:35:24.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.493+0000 7f6000ff9640 10 monclient: handle_config config(0 keys) v1 2024-02-09T08:35:24.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.493+0000 7f6000ff9640 1 -- 172.21.15.62:0/1888131609 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff8007440 con 0x7f60040b44c0 2024-02-09T08:35:24.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.493+0000 7f6000ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-09T08:35:24.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.493+0000 7f6000ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-02-09T08:35:24.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.493+0000 7f6000ff9640 10 monclient: dump: 2024-02-09T08:35:24.496 INFO:teuthology.orchestra.run.smithi062.stderr:epoch 1 2024-02-09T08:35:24.496 INFO:teuthology.orchestra.run.smithi062.stderr:fsid 981c5564-eb76-49a1-80ab-97c7647bc34a 2024-02-09T08:35:24.496 INFO:teuthology.orchestra.run.smithi062.stderr:last_changed 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:24.496 INFO:teuthology.orchestra.run.smithi062.stderr:created 2024-02-09T08:01:17.685844+0000 2024-02-09T08:35:24.496 INFO:teuthology.orchestra.run.smithi062.stderr:min_mon_release 19 (squid) 2024-02-09T08:35:24.497 INFO:teuthology.orchestra.run.smithi062.stderr:election_strategy: 1 2024-02-09T08:35:24.497 INFO:teuthology.orchestra.run.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-09T08:35:24.497 INFO:teuthology.orchestra.run.smithi062.stderr:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-02-09T08:35:24.497 INFO:teuthology.orchestra.run.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-02-09T08:35:24.497 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:35:24.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.493+0000 7f6001ffb640 4 set_mon_vals no callback set 2024-02-09T08:35:24.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.494+0000 7f6000ff9640 1 -- 172.21.15.62:0/1888131609 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f5ff8006790 con 0x7f60040b44c0 2024-02-09T08:35:24.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.494+0000 7f6000ff9640 1 --2- 172.21.15.62:0/1888131609 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f5ff006d1a0 0x7f5ff006f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-09T08:35:24.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.494+0000 7f6003fff640 1 --2- 172.21.15.62:0/1888131609 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f5ff006d1a0 0x7f5ff006f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-09T08:35:24.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.494+0000 7f6003fff640 10 monclient: get_auth_request con 0x7f5ff006d1a0 auth_method 0 2024-02-09T08:35:24.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.495+0000 7f6003fff640 1 --2- 172.21.15.62:0/1888131609 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f5ff006d1a0 0x7f5ff006f660 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5ff4001840 tx=0x7f5ff4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-09T08:35:24.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.495+0000 7f6000ff9640 10 client.22396.objecter ms_handle_connect 0x7f5ff006d1a0 2024-02-09T08:35:24.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.496+0000 7f6000ff9640 1 -- 172.21.15.62:0/1888131609 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(1270..1270 src has 1199..1270) v4 ==== 6381+0+0 (secure 0 0 0) 0x7f5ff8058480 con 0x7f60040b44c0 2024-02-09T08:35:24.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.496+0000 7f6000ff9640 10 client.22396.objecter ms_dispatch 0x7f6004000b90 osd_map(1270..1270 src has 1199..1270) v4 2024-02-09T08:35:24.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.496+0000 7f6000ff9640 3 client.22396.objecter handle_osd_map got epochs [1270,1270] > 0 2024-02-09T08:35:24.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.496+0000 7f6000ff9640 3 client.22396.objecter handle_osd_map decoding full epoch 1270 2024-02-09T08:35:24.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.496+0000 7f6000ff9640 20 client.22396.objecter dump_active .. 0 homeless 2024-02-09T08:35:24.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.506+0000 7f6000ff9640 1 -- 172.21.15.62:0/1888131609 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5ff8054720 con 0x7f60040b44c0 2024-02-09T08:35:24.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.506+0000 7f6000ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-02-09T08:35:24.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.506+0000 7f6000ff9640 10 monclient: _finish_command 1 = system:0 2024-02-09T08:35:24.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.690+0000 7f600a6de640 10 start_mon_command cmd=[{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2024-02-09T08:35:24.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.691+0000 7f600a6de640 10 monclient: _send_command 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2024-02-09T08:35:24.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.691+0000 7f600a6de640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.103:3300/0 2024-02-09T08:35:24.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.691+0000 7f600a6de640 1 -- 172.21.15.62:0/1888131609 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f6004135d90 con 0x7f60040b44c0 2024-02-09T08:35:24.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.867+0000 7f6000ff9640 1 -- 172.21.15.62:0/1888131609 <== mon.1 v2:172.21.15.103:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5ff8054720 con 0x7f60040b44c0 2024-02-09T08:35:24.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.867+0000 7f6000ff9640 10 monclient: handle_config config(1 keys) v1 2024-02-09T08:35:24.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.867+0000 7f6001ffb640 4 set_mon_vals no callback set 2024-02-09T08:35:24.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.867+0000 7f6001ffb640 10 set_mon_vals mon_health_to_clog = false 2024-02-09T08:35:24.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.867+0000 7f6000ff9640 1 -- 172.21.15.62:0/1888131609 <== mon.1 v2:172.21.15.103:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v4)=0 v4) v1 ==== 123+0+0 (secure 0 0 0) 0x7f5ff80170c0 con 0x7f60040b44c0 2024-02-09T08:35:24.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.867+0000 7f6000ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2024-02-09T08:35:24.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.867+0000 7f6000ff9640 10 monclient: _finish_command 2 = system:0 2024-02-09T08:35:24.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.869+0000 7f600a6de640 10 librados: watch_flush enter 2024-02-09T08:35:24.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.869+0000 7f600a6de640 10 librados: watch_flush exit 2024-02-09T08:35:24.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.869+0000 7f600a6de640 20 client.22396.objecter shutdown clearing up homeless session... 2024-02-09T08:35:24.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.869+0000 7f600a6de640 10 client.22396.objecter successfully canceled tick 2024-02-09T08:35:24.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.869+0000 7f600a6de640 1 -- 172.21.15.62:0/1888131609 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f5ff006d1a0 msgr2=0x7f5ff006f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:24.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.869+0000 7f600a6de640 1 --2- 172.21.15.62:0/1888131609 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f5ff006d1a0 0x7f5ff006f660 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5ff4001840 tx=0x7f5ff4009040 comp rx=0 tx=0).stop 2024-02-09T08:35:24.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.869+0000 7f600a6de640 10 monclient: shutdown 2024-02-09T08:35:24.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.869+0000 7f600a6de640 20 monclient: shutdown discarding 0 pending message(s) 2024-02-09T08:35:24.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.869+0000 7f600a6de640 1 -- 172.21.15.62:0/1888131609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60040b44c0 msgr2=0x7f60041387a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-09T08:35:24.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.869+0000 7f600a6de640 1 --2- 172.21.15.62:0/1888131609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60040b44c0 0x7f60041387a0 secure :-1 s=READY pgs=5684 cs=0 l=1 rev1=1 crypto rx=0x7f5ff800c410 tx=0x7f5ff800c810 comp rx=0 tx=0).stop 2024-02-09T08:35:24.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.869+0000 7f600a6de640 1 -- 172.21.15.62:0/1888131609 shutdown_connections 2024-02-09T08:35:24.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.869+0000 7f600a6de640 1 --2- 172.21.15.62:0/1888131609 >> [v2:172.21.15.103:6800/2270392189,v1:172.21.15.103:6801/2270392189] conn(0x7f5ff006d1a0 0x7f5ff006f660 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:24.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.869+0000 7f600a6de640 1 --2- 172.21.15.62:0/1888131609 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f600413ff40 0x7f6004136a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:24.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.869+0000 7f600a6de640 1 --2- 172.21.15.62:0/1888131609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60040b44c0 0x7f60041387a0 unknown :-1 s=CLOSED pgs=5684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:24.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.869+0000 7f600a6de640 1 --2- 172.21.15.62:0/1888131609 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f600406be10 0x7f6004142830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-09T08:35:24.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.869+0000 7f600a6de640 1 -- 172.21.15.62:0/1888131609 >> 172.21.15.62:0/1888131609 conn(0x7f60040b8070 msgr2=0x7f600413f600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-09T08:35:24.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.870+0000 7f600a6de640 1 -- 172.21.15.62:0/1888131609 shutdown_connections 2024-02-09T08:35:24.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.870+0000 7f600a6de640 1 -- 172.21.15.62:0/1888131609 wait complete. 2024-02-09T08:35:24.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-09T08:35:24.870+0000 7f600a6de640 1 librados: shutdown 2024-02-09T08:35:24.885 INFO:teuthology.misc:Shutting down mds daemons... 2024-02-09T08:35:24.885 INFO:teuthology.misc:Shutting down osd daemons... 2024-02-09T08:35:24.885 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-02-09T08:35:24.885 INFO:teuthology.orchestra.run:waiting for 300 2024-02-09T08:35:24.898 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:35:24.887+0000 b678640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 0 (PID: 35326) UID: 0 2024-02-09T08:35:24.901 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-02-09T08:35:24.888+0000 b678640 -1 osd.0 1270 *** Got signal Terminated *** 2024-02-09T08:35:25.999 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:33:35.405 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:26.051 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:33:35.447 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:26.054 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:33:35.461 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:26.057 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:33:35.454 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:26.073 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:33:35.469 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:26.082 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:33:35.489 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:26.113 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:33:35.519 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:26.114 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:33:35.521 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:26.130 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:33:35.537 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:30.581 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-02-09T08:35:30.986 INFO:tasks.ceph.osd.0:Stopped 2024-02-09T08:35:30.987 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-02-09T08:35:30.987 INFO:teuthology.orchestra.run:waiting for 300 2024-02-09T08:35:31.005 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:35:30.989+0000 b678640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.1.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 1 (PID: 35324) UID: 0 2024-02-09T08:35:31.006 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-02-09T08:35:30.993+0000 b678640 -1 osd.1 1274 *** Got signal Terminated *** 2024-02-09T08:35:35.959 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:33:45.365 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:35.961 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:33:45.368 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:35.975 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:33:45.382 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:36.010 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:33:45.406 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:36.011 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:33:45.417 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:36.011 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:33:45.407 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:36.014 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:33:45.421 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:36.026 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:33:45.423 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:36.029 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:33:45.436 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:36.691 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-02-09T08:35:36.691 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-02-09T08:35:37.089 INFO:tasks.ceph.osd.1:Stopped 2024-02-09T08:35:37.090 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-02-09T08:35:37.090 INFO:teuthology.orchestra.run:waiting for 300 2024-02-09T08:35:37.103 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:35:37.092+0000 b678640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.2.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 2 (PID: 35328) UID: 0 2024-02-09T08:35:37.103 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-02-09T08:35:37.093+0000 b678640 -1 osd.2 1276 *** Got signal Terminated *** 2024-02-09T08:35:40.969 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:33:50.375 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:40.971 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:33:50.378 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:40.987 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:33:50.394 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:41.021 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:33:50.417 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:41.022 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:33:50.419 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:41.026 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:33:50.432 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:41.027 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:33:50.434 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:41.032 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:33:50.429 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:41.038 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:33:50.445 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:42.698 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-02-09T08:35:42.699 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-02-09T08:35:43.191 INFO:tasks.ceph.osd.2:Stopped 2024-02-09T08:35:43.192 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-02-09T08:35:43.192 INFO:teuthology.orchestra.run:waiting for 300 2024-02-09T08:35:43.206 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:35:43.195+0000 b678640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.3.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 3 (PID: 35330) UID: 0 2024-02-09T08:35:43.206 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-02-09T08:35:43.196+0000 b678640 -1 osd.3 1278 *** Got signal Terminated *** 2024-02-09T08:35:48.605 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-02-09T08:35:48.605 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-02-09T08:35:49.293 INFO:tasks.ceph.osd.3:Stopped 2024-02-09T08:35:49.293 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-02-09T08:35:49.293 INFO:teuthology.orchestra.run:waiting for 300 2024-02-09T08:35:49.307 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:35:49.296+0000 b678640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.4.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 4 (PID: 35338) UID: 0 2024-02-09T08:35:49.309 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-02-09T08:35:49.297+0000 b678640 -1 osd.4 1280 *** Got signal Terminated *** 2024-02-09T08:35:54.411 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-02-09T08:35:54.412 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-02-09T08:35:55.394 INFO:tasks.ceph.osd.4:Stopped 2024-02-09T08:35:55.395 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-02-09T08:35:55.395 INFO:teuthology.orchestra.run:waiting for 300 2024-02-09T08:35:55.408 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-02-09T08:35:55.398+0000 b678640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.5.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 5 (PID: 35341) UID: 0 2024-02-09T08:35:55.411 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-02-09T08:35:55.399+0000 b678640 -1 osd.5 1282 *** Got signal Terminated *** 2024-02-09T08:35:56.015 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:34:05.422 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:56.020 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:34:05.426 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:56.050 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:34:05.457 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:56.059 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:34:05.456 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:56.062 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:34:05.459 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:56.081 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:34:05.487 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:56.081 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:34:05.478 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:56.085 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:34:05.491 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:35:56.102 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:34:05.509 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:36:00.221 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-02-09T08:36:16.060 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:34:25.466 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:36:16.064 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:34:25.471 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:36:16.080 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:34:25.487 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:36:16.112 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:34:25.509 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:36:16.114 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:34:25.510 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:36:16.116 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:34:25.523 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:36:16.118 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:34:25.524 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:36:16.133 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:34:25.540 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:36:16.136 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:34:25.533 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:36:21.072 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:34:30.479 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:36:21.077 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:34:30.483 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:36:21.086 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:34:30.493 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:36:21.121 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:34:30.518 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:36:21.122 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:34:30.519 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:36:21.123 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:34:30.530 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:36:21.128 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:34:30.534 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:36:21.135 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:34:30.532 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:36:21.137 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:34:30.544 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:36:41.135 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:34:50.541 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:36:41.137 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:34:50.544 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:36:41.152 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:34:50.558 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:36:41.184 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:34:50.581 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:36:41.185 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:34:50.582 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:36:41.188 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:34:50.595 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:36:41.191 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:34:50.598 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:36:41.199 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:34:50.596 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:36:41.205 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:34:50.612 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:01.189 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:35:10.595 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:01.196 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:35:10.602 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:01.217 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:35:10.624 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:01.242 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:35:10.638 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:01.244 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:35:10.641 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:01.248 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:35:10.655 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:01.255 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:35:10.662 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:01.261 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:35:10.658 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:01.273 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:35:10.680 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:16.229 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:35:25.636 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:16.233 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:35:25.640 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:16.248 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:35:25.655 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:16.278 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:35:25.675 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:16.280 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:35:25.677 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:16.285 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:35:25.692 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:16.287 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:35:25.693 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:16.295 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:35:25.692 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:16.303 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:35:25.710 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:21.247 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:35:30.654 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:21.249 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:35:30.656 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:21.263 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:35:30.670 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:21.292 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:35:30.688 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:21.296 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:35:30.692 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:21.298 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:35:30.705 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:21.306 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:35:30.703 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:21.306 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:35:30.713 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:21.319 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:35:30.726 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:32.898 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:35:42.305 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:32.902 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:35:42.309 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:32.921 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:35:42.327 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:32.954 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:35:42.350 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:32.955 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:35:42.352 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:32.958 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:35:42.364 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:32.959 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:35:42.366 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:32.974 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:35:42.371 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:32.979 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:35:42.386 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:36.386 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:35:45.793 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:36.391 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:35:45.798 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:36.433 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:35:45.830 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:36.447 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:35:45.854 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:36.455 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:35:45.852 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:36.461 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:35:45.867 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:36.474 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:35:45.871 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:36.486 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:35:45.893 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:36.497 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:35:45.903 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:38.833 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-02-09T08:37:39.122 INFO:tasks.ceph.osd.5:Stopped 2024-02-09T08:37:39.122 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-02-09T08:37:39.122 INFO:teuthology.orchestra.run:waiting for 300 2024-02-09T08:37:39.135 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-02-09T08:37:39.124+0000 b678640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.6.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 6 (PID: 35343) UID: 0 2024-02-09T08:37:39.135 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-02-09T08:37:39.126+0000 b678640 -1 osd.6 1284 *** Got signal Terminated *** 2024-02-09T08:37:41.378 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:35:50.784 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:41.380 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:35:50.787 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:41.394 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:35:50.801 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:41.427 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:35:50.823 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:41.430 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:35:50.826 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:41.431 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:35:50.838 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:41.432 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:35:50.839 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:41.443 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:35:50.840 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:41.446 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:35:50.853 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:44.540 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-02-09T08:37:56.413 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:36:05.819 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:56.415 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:36:05.821 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:56.429 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:36:05.836 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:56.462 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:36:05.859 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:56.464 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:36:05.861 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:56.468 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:36:05.875 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:56.469 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:36:05.876 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:56.478 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:36:05.875 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:37:56.484 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:36:05.891 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:01.428 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:36:10.835 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:01.432 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:36:10.838 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:01.446 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:36:10.852 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:01.479 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:36:10.876 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:01.480 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:36:10.877 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:01.490 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:36:10.887 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:01.496 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:36:10.903 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:01.499 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:36:10.905 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:01.510 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:36:10.916 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:16.484 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:36:25.890 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:16.506 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:36:25.913 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:16.520 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:36:25.927 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:16.533 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:36:25.930 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:16.536 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:36:25.933 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:16.537 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:36:25.944 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:16.544 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:36:25.950 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:16.552 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:36:25.949 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:16.558 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:36:25.965 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:21.524 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:36:30.930 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:21.525 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:36:30.932 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:21.536 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:36:30.943 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:21.566 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:36:30.962 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:21.568 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:36:30.964 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:21.573 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:36:30.980 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:21.577 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:36:30.984 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:21.580 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:36:30.977 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:21.591 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:36:30.998 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:36.560 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:36:45.966 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:36.578 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:36:45.985 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:36.594 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:36:46.001 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:36.624 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:36:46.031 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:36.630 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:36:46.036 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:36.630 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:36:46.027 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:36.632 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:36:46.029 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:36.645 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:36:46.052 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:36.646 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:36:46.043 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:41.576 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:36:50.983 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:41.579 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:36:50.986 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:41.595 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:36:51.001 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:41.626 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:36:51.023 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:41.629 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:36:51.025 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:41.634 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:36:51.040 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:41.635 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:36:51.042 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:41.639 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:36:51.036 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:41.647 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:36:51.054 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:56.636 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:37:06.042 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:56.637 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:37:06.044 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:56.651 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:37:06.058 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:56.686 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:37:06.092 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:56.687 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:37:06.083 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:56.687 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:37:06.094 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:56.688 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:37:06.085 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:56.702 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:37:06.099 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:38:56.709 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:37:06.116 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:39:00.369 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:00.362+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:01.375 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:01.371+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:01.636 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:37:11.042 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:39:01.637 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:37:11.044 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:39:01.648 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:37:11.054 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:39:01.679 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:37:11.076 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:39:01.680 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:37:11.077 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:39:01.685 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:37:11.092 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:39:01.686 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:37:11.093 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:39:01.690 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:37:11.087 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:39:01.697 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:37:11.104 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:39:02.420 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:02.417+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:03.396 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:03.392+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:04.443 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:04.435+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:05.461 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:05.458+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:06.467 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:06.464+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:07.511 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:07.507+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:08.505 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:08.502+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:09.544 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:09.539+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:10.594 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:10.590+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:11.619 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:11.617+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:12.596 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:12.593+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:13.610 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:13.608+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:14.648 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:14.645+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:15.655 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:15.651+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:16.641 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:16.638+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:16.687 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:37:26.093 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:39:16.691 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:37:26.098 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:39:16.706 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:37:26.112 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:39:16.743 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:37:26.150 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:39:16.746 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:37:26.142 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:39:16.746 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:37:26.153 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:39:16.747 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:37:26.144 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:39:16.760 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:37:26.167 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:39:16.761 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:37:26.158 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:39:17.619 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:17.617+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:18.574 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:18.571+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:19.614 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:19.611+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:20.606 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:20.603+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:21.623 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:21.621+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:21.700 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:37:31.107 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:39:21.705 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:37:31.111 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:39:21.716 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:37:31.123 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:39:21.749 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:37:31.145 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:39:21.751 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:37:31.148 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:39:21.753 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:37:31.160 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:39:21.756 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:37:31.163 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:39:21.762 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:37:31.159 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:39:21.767 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:37:31.174 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:39:22.673 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:22.670+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:23.687 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:23.684+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:24.682 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:24.680+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:25.669 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:25.667+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:26.669 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:26.667+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:27.711 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:27.708+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:28.756 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:28.752+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:29.729 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:29.726+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:30.692 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:30.689+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:31.727 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:31.724+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:32.759 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:32.756+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:33.750 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:33.747+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:34.800 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:34.796+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:35.761 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:35.758+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:36.804 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:36.800+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:37.813 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:37.810+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:38.775 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:38.771+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:39.770 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:39.766+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:40.796 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:40.792+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:41.758 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:37:51.165 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:39:41.759 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:37:51.166 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:39:41.777 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:37:51.184 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:39:41.797 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:41.793+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:41.810 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:37:51.207 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:39:41.811 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:37:51.208 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:39:41.812 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:37:51.219 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:39:41.814 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:37:51.221 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:39:41.827 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:37:51.223 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:39:41.831 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:37:51.238 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:39:42.840 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:42.837+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:43.857 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:43.854+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:44.885 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:44.881+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:45.899 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:45.895+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:46.776 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:37:56.183 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:39:46.777 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:37:56.184 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:39:46.788 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:37:56.194 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:39:46.822 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:37:56.218 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:39:46.823 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:37:56.220 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:39:46.825 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:37:56.231 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:39:46.826 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:37:56.233 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:39:46.833 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:37:56.230 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:39:46.836 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:37:56.243 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:39:46.873 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:46.869+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:47.894 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:47.890+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:48.870 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:48.865+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:49.853 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:49.850+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:50.817 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:50.812+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:51.842 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:51.838+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:52.866 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:52.863+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:53.870 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:53.866+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:54.873 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:54.870+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:55.896 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:55.893+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:56.873 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:56.869+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:57.925 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:57.921+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:58.943 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:58.938+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:39:59.938 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:39:59.934+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:00.933 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:00.929+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:01.902 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:38:11.308 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:01.905 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:38:11.312 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:01.923 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:01.918+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:01.924 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:38:11.331 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:01.956 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:38:11.352 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:01.957 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:38:11.353 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:01.972 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:38:11.368 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:01.973 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:38:11.379 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:01.974 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:38:11.381 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:01.990 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:38:11.396 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:02.921 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:02.917+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:03.963 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:03.960+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:04.956 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:04.953+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:05.921 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:05.919+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:06.904 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:06.899+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:06.922 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:38:16.328 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:06.927 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:38:16.333 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:06.941 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:38:16.348 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:06.968 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:38:16.365 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:06.977 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:38:16.383 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:06.980 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:38:16.387 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:06.985 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:38:16.382 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:06.992 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:38:16.399 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:06.997 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:38:16.394 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:07.860 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:07.858+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:08.862 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:08.859+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:09.896 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:09.893+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:10.871 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:10.869+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:11.875 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:11.872+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:12.887 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:12.885+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:13.844 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:13.841+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:14.798 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:14.796+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:15.757 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:15.754+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:16.774 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:16.771+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:17.743 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:17.741+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:18.721 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:18.718+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:19.693 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:19.690+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:20.719 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:20.716+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:21.725 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:21.722+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:21.962 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:38:31.359 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:21.964 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:38:31.370 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:21.966 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:38:31.363 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:21.966 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:38:31.373 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:21.982 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:38:31.378 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:21.984 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:38:31.391 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:22.038 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:38:31.445 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:22.039 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:38:31.446 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:22.062 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:38:31.469 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:22.694 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:22.691+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:23.659 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:23.655+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:24.656 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:24.652+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:25.613 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:25.610+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:26.567 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:26.564+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:26.974 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:38:36.380 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:26.977 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:38:36.384 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:26.988 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:38:36.395 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:27.025 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:38:36.421 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:27.026 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:38:36.423 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:27.027 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:38:36.434 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:27.028 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:38:36.435 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:27.037 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:38:36.433 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:27.039 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:38:36.446 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:27.544 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:27.540+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:28.526 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:28.520+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:29.491 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:29.486+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:30.485 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:30.480+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:31.447 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:31.443+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:32.497 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:32.492+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:33.472 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:33.467+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:34.511 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:34.508+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:35.480 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:35.475+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:36.475 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:36.472+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:37.448 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:37.444+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:38.418 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:38.414+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:39.383 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:39.379+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:40.390 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:40.386+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:41.401 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:41.397+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:42.021 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:38:51.428 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:42.022 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:38:51.429 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:42.038 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:38:51.444 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:42.070 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:38:51.467 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:42.071 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:38:51.468 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:42.073 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:38:51.479 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:42.074 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:38:51.481 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:42.086 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:38:51.482 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:42.088 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:38:51.495 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:42.425 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:42.420+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:43.454 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:43.451+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:44.499 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:44.495+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:45.504 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:45.501+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:46.504 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:46.501+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:47.035 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:38:56.442 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:47.037 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:38:56.444 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:47.048 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:38:56.455 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:47.083 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:38:56.479 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:47.085 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:38:56.482 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:47.095 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:38:56.492 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:47.102 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:38:56.509 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:47.105 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:38:56.512 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:47.115 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:38:56.522 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:40:47.463 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:47.460+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:48.438 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:48.434+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:49.394 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:49.390+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:50.385 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:50.381+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:51.405 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:51.401+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:52.431 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:52.427+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:53.398 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:53.394+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:54.371 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:54.368+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:55.347 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:55.344+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:56.388 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:56.385+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:57.407 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:57.405+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:58.393 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:58.390+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:40:59.392 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:40:59.389+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:41:00.418 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:41:00.415+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:41:01.400 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:41:01.395+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:41:02.077 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:39:11.483 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:02.081 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:39:11.488 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:02.103 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:39:11.509 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:02.127 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:39:11.524 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:02.130 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:39:11.527 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:02.137 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:39:11.544 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:02.139 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:39:11.546 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:02.145 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:39:11.541 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:02.153 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:39:11.559 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:02.411 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:41:02.409+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:41:03.385 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:41:03.381+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:41:04.363 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:41:04.359+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:41:05.385 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:41:05.382+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:41:06.354 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:41:06.351+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:41:07.089 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:39:16.496 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:07.094 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:39:16.501 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:07.109 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:39:16.516 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:07.138 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:39:16.534 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:07.139 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:39:16.535 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:07.143 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:39:16.550 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:07.147 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:39:16.553 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:07.149 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:39:16.546 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:07.157 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:39:16.564 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:07.358 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:41:07.356+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:41:08.333 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:41:08.330+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:41:09.327 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:41:09.323+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:41:10.314 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:41:10.311+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:41:11.363 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:41:11.360+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:41:12.369 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:41:12.367+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:41:13.387 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:41:13.384+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:41:14.396 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:41:14.392+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:41:15.350 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:41:15.346+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:41:16.375 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:41:16.372+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:41:17.390 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:41:17.387+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:41:18.319 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:39:27.726 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:18.321 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:39:27.728 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:18.340 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:39:27.747 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:18.351 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:41:18.348+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:41:18.371 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:39:27.768 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:18.373 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:39:27.769 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:18.375 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:39:27.782 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:18.376 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:39:27.783 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:18.389 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:39:27.785 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:18.393 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:39:27.799 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:19.374 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:41:19.369+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:41:20.364 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:41:20.360+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:41:21.382 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:41:21.378+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:41:22.132 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:39:31.539 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:22.135 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:39:31.541 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:22.145 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:39:31.551 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:22.153 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:39:31.549 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:22.156 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:39:31.562 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:22.156 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:39:31.551 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:22.157 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:39:31.564 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:22.165 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:39:31.561 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:22.168 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:39:31.574 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:22.421 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:41:22.416+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:41:23.433 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:41:23.428+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:41:24.469 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:41:24.466+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:41:25.433 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:41:25.429+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:41:26.416 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:41:26.411+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:41:27.151 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:39:36.558 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:27.155 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:39:36.562 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:27.169 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:39:36.576 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:27.199 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:39:36.596 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:27.203 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:39:36.600 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:27.204 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:39:36.611 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:27.207 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:39:36.614 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:27.213 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:39:36.610 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:27.219 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:39:36.626 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:27.368 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:41:27.364+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:41:28.409 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:41:28.405+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:41:29.385 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:41:29.381+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:41:30.426 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:41:30.422+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:41:31.397 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:41:31.393+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:41:32.425 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:41:32.421+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:41:33.405 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:41:33.400+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:41:34.414 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:41:34.410+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:41:35.367 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:41:35.363+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:41:36.346 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:41:36.342+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:41:37.320 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:41:37.316+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:41:38.358 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:41:38.354+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:41:39.403 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:41:39.399+0000 ec49640 -1 osd.7 1284 heartbeat_check: no reply from 172.21.15.103:6830 osd.6 since back 2024-02-09T08:37:36.457533+0000 front 2024-02-09T08:37:36.459675+0000 (oldest deadline 2024-02-09T08:38:59.955229+0000) 2024-02-09T08:41:42.188 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:39:51.594 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:42.192 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:39:51.599 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:42.207 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:39:51.614 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:42.237 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:39:51.633 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:42.238 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:39:51.635 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:42.241 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:39:51.648 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:42.243 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:39:51.649 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:42.253 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:39:51.649 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:42.258 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:39:51.665 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:43.186 INFO:tasks.ceph.osd.6:Stopped 2024-02-09T08:41:43.186 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-02-09T08:41:43.186 INFO:teuthology.orchestra.run:waiting for 300 2024-02-09T08:41:43.199 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:41:43.188+0000 b678640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.7.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 7 (PID: 35345) UID: 0 2024-02-09T08:41:43.200 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-02-09T08:41:43.189+0000 b678640 -1 osd.7 1284 *** Got signal Terminated *** 2024-02-09T08:41:47.208 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:39:56.614 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:47.211 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:39:56.618 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:47.227 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:39:56.634 35021== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:47.260 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:39:56.657 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:47.264 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:39:56.661 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:47.273 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:39:56.680 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:47.277 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:39:56.674 34743== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:47.278 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:39:56.685 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:47.289 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:39:56.696 35024== Warning: unimplemented fcntl command: 1036 2024-02-09T08:41:49.288 INFO:tasks.ceph.osd.7:Stopped 2024-02-09T08:41:49.288 INFO:teuthology.misc:Shutting down mgr daemons... 2024-02-09T08:41:49.289 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-02-09T08:41:49.289 INFO:teuthology.orchestra.run:waiting for 300 2024-02-09T08:41:49.316 INFO:tasks.ceph.mgr.y:Stopped 2024-02-09T08:41:49.316 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-02-09T08:41:49.316 INFO:teuthology.orchestra.run:waiting for 300 2024-02-09T08:41:49.317 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-02-09T08:41:49.316+0000 7fa0f4df7640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-mgr -f --cluster ceph -i x (PID: 34741) UID: 0 2024-02-09T08:41:49.317 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-02-09T08:41:49.316+0000 7fa0f4df7640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-02-09T08:41:49.347 INFO:tasks.ceph.mgr.x:Stopped 2024-02-09T08:41:49.347 INFO:teuthology.misc:Shutting down mon daemons... 2024-02-09T08:41:49.347 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-02-09T08:41:49.347 INFO:teuthology.orchestra.run:waiting for 300 2024-02-09T08:41:49.380 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:41:49.358+0000 a178640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a (PID: 34995) UID: 0 2024-02-09T08:41:49.389 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-02-09T08:41:49.393 INFO:tasks.ceph.mon.a.smithi062.stderr:2024-02-09T08:41:49.360+0000 a178640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-02-09T08:41:50.004 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:39:59.411 35021== 2024-02-09T08:41:50.004 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:39:59.411 35021== Exit program on first error (--exit-on-first-error=yes) 2024-02-09T08:41:50.029 INFO:tasks.ceph.mon.a.smithi062.stderr:daemon-helper: command failed with exit status 42 2024-02-09T08:41:54.592 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-02-09T08:41:54.592 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-02-09T08:41:55.448 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-02-09T08:41:55.449 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi062 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a" 2024-02-09T08:41:55.450 INFO:tasks.ceph.mon.a:Stopped 2024-02-09T08:41:55.450 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-02-09T08:41:55.450 INFO:teuthology.orchestra.run:waiting for 300 2024-02-09T08:41:55.467 INFO:tasks.ceph.mon.c.smithi062.stderr:2024-02-09T08:41:55.453+0000 a178640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c (PID: 34997) UID: 0 2024-02-09T08:41:55.467 INFO:tasks.ceph.mon.c.smithi062.stderr:2024-02-09T08:41:55.454+0000 a178640 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2024-02-09T08:41:56.292 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:40:05.699 35024== 2024-02-09T08:41:56.293 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:40:05.699 35024== Exit program on first error (--exit-on-first-error=yes) 2024-02-09T08:41:56.312 INFO:tasks.ceph.mon.c.smithi062.stderr:daemon-helper: command failed with exit status 42 2024-02-09T08:41:59.694 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-02-09T08:41:59.694 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-02-09T08:42:01.552 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-02-09T08:42:01.552 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi062 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c" 2024-02-09T08:42:01.552 INFO:tasks.ceph.mon.c:Stopped 2024-02-09T08:42:01.553 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-02-09T08:42:01.553 INFO:teuthology.orchestra.run:waiting for 300 2024-02-09T08:42:01.569 INFO:tasks.ceph.mon.b.smithi103.stderr:2024-02-09T08:42:01.555+0000 a178640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b (PID: 34739) UID: 0 2024-02-09T08:42:01.569 INFO:tasks.ceph.mon.b.smithi103.stderr:2024-02-09T08:42:01.557+0000 a178640 -1 mon.b@1(probing) e1 *** Got Signal Terminated *** 2024-02-09T08:42:02.290 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:40:11.687 34743== 2024-02-09T08:42:02.291 INFO:tasks.ceph.mon.b.smithi103.stderr:==00:00:40:11.687 34743== Exit program on first error (--exit-on-first-error=yes) 2024-02-09T08:42:02.313 INFO:tasks.ceph.mon.b.smithi103.stderr:daemon-helper: command failed with exit status 42 2024-02-09T08:42:04.695 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-02-09T08:42:04.695 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-02-09T08:42:07.655 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-02-09T08:42:07.655 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi103 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b" 2024-02-09T08:42:07.655 INFO:tasks.ceph.mon.b:Stopped 2024-02-09T08:42:07.656 INFO:tasks.ceph:Checking cluster log for badness... 2024-02-09T08:42:07.656 DEBUG:teuthology.orchestra.run.smithi062:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'reached quota' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(OBJECT_MISPLACED\)' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | egrep -v '\(PG_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'slow request' | head -n 1 2024-02-09T08:42:07.695 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi062.front.sepia.ceph.com 2024-02-09T08:42:07.695 DEBUG:teuthology.orchestra.run.smithi062:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-02-09T08:42:07.856 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi062.front.sepia.ceph.com 2024-02-09T08:42:07.856 DEBUG:teuthology.orchestra.run.smithi062:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-02-09T08:42:07.938 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi062.front.sepia.ceph.com 2024-02-09T08:42:07.938 DEBUG:teuthology.orchestra.run.smithi062:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-02-09T08:42:08.015 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi062.front.sepia.ceph.com 2024-02-09T08:42:08.015 DEBUG:teuthology.orchestra.run.smithi062:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-02-09T08:42:08.079 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi103.front.sepia.ceph.com 2024-02-09T08:42:08.080 DEBUG:teuthology.orchestra.run.smithi103:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-02-09T08:42:08.215 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi103.front.sepia.ceph.com 2024-02-09T08:42:08.215 DEBUG:teuthology.orchestra.run.smithi103:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-02-09T08:42:08.279 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi103.front.sepia.ceph.com 2024-02-09T08:42:08.280 DEBUG:teuthology.orchestra.run.smithi103:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-02-09T08:42:08.336 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi103.front.sepia.ceph.com 2024-02-09T08:42:08.336 DEBUG:teuthology.orchestra.run.smithi103:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-02-09T08:42:08.404 INFO:tasks.ceph:Archiving mon data... 2024-02-09T08:42:08.405 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2024-02-09_00:15:46-rados-wip-yuri2-testing-2024-02-08-0727-distro-default-smithi/7553275/data/mon.a.tgz 2024-02-09T08:42:08.406 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2024-02-09T08:42:08.422 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.87JiPcxD7g 2024-02-09T08:42:08.422 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.87JiPcxD7g 2024-02-09T08:42:08.585 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.87JiPcxD7g 2024-02-09T08:42:08.670 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.87JiPcxD7g is 459KB 2024-02-09T08:42:08.739 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.87JiPcxD7g 2024-02-09T08:42:08.753 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2024-02-09_00:15:46-rados-wip-yuri2-testing-2024-02-08-0727-distro-default-smithi/7553275/data/mon.c.tgz 2024-02-09T08:42:08.753 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2024-02-09T08:42:08.807 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.vPxkVlkz0Y 2024-02-09T08:42:08.807 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.vPxkVlkz0Y 2024-02-09T08:42:08.952 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.vPxkVlkz0Y 2024-02-09T08:42:09.035 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.vPxkVlkz0Y is 459KB 2024-02-09T08:42:09.132 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.vPxkVlkz0Y 2024-02-09T08:42:09.146 DEBUG:teuthology.misc:Transferring archived files from smithi103:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2024-02-09_00:15:46-rados-wip-yuri2-testing-2024-02-08-0727-distro-default-smithi/7553275/data/mon.b.tgz 2024-02-09T08:42:09.146 DEBUG:teuthology.orchestra.run.smithi103:> mktemp 2024-02-09T08:42:09.164 INFO:teuthology.orchestra.run.smithi103.stdout:/tmp/tmp.0JcpLkqLLt 2024-02-09T08:42:09.164 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.0JcpLkqLLt 2024-02-09T08:42:09.351 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 0666 /tmp/tmp.0JcpLkqLLt 2024-02-09T08:42:09.436 DEBUG:teuthology.orchestra.remote:smithi103:/tmp/tmp.0JcpLkqLLt is 459KB 2024-02-09T08:42:09.534 DEBUG:teuthology.orchestra.run.smithi103:> rm -fr /tmp/tmp.0JcpLkqLLt 2024-02-09T08:42:09.549 INFO:tasks.ceph:Cleaning ceph cluster... 2024-02-09T08:42:09.549 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-02-09T08:42:09.552 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-02-09T08:42:09.741 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-02-09T08:42:09.924 DEBUG:tasks.ceph:valgrind exception message: valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun 2024-02-09T08:42:10.160 INFO:tasks.ceph:Archiving crash dumps... 2024-02-09T08:42:10.162 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-02-09_00:15:46-rados-wip-yuri2-testing-2024-02-08-0727-distro-default-smithi/7553275/remote/smithi062/crash 2024-02-09T08:42:10.164 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-02-09T08:42:10.191 DEBUG:teuthology.misc:Transferring archived files from smithi103:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-02-09_00:15:46-rados-wip-yuri2-testing-2024-02-08-0727-distro-default-smithi/7553275/remote/smithi103/crash 2024-02-09T08:42:10.192 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-02-09T08:42:10.218 INFO:tasks.ceph:Compressing logs... 2024-02-09T08:42:10.218 DEBUG:teuthology.orchestra.run.smithi062:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-09T08:42:10.235 DEBUG:teuthology.orchestra.run.smithi103:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-09T08:42:10.259 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40305.log 2024-02-09T08:42:10.259 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41731.log 2024-02-09T08:42:10.314 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-02-09T08:42:10.314 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.7.log 2024-02-09T08:42:10.314 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.5.log 2024-02-09T08:42:10.314 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/valgrind/osd.7.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.6.log 2024-02-09T08:42:10.315 INFO:teuthology.orchestra.run.smithi103.stderr: 63.9% -- replaced with /var/log/ceph/valgrind/osd.7.log.gz 2024-02-09T08:42:10.315 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/valgrind/osd.5.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.b.log 2024-02-09T08:42:10.315 INFO:teuthology.orchestra.run.smithi103.stderr: 64.0% -- replaced with /var/log/ceph/valgrind/osd.5.log.gz 2024-02-09T08:42:10.315 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.4.log 2024-02-09T08:42:10.315 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/valgrind/osd.6.log: /var/log/ceph/valgrind/mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35101.log 2024-02-09T08:42:10.315 INFO:teuthology.orchestra.run.smithi103.stderr: 63.9% -- replaced with /var/log/ceph/valgrind/osd.6.log.gz 2024-02-09T08:42:10.315 INFO:teuthology.orchestra.run.smithi103.stderr: 69.6% -- replaced with /var/log/ceph/valgrind/mon.b.log.gz 2024-02-09T08:42:10.315 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/valgrind/osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-02-09T08:42:10.315 INFO:teuthology.orchestra.run.smithi103.stderr: 63.9% -- replaced with /var/log/ceph/valgrind/osd.4.log.gz 2024-02-09T08:42:10.315 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35101.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-02-09T08:42:10.315 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-02-09T08:42:10.315 INFO:teuthology.orchestra.run.smithi103.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.35101.log.gz 2024-02-09T08:42:10.315 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-02-09T08:42:10.316 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34977.log 2024-02-09T08:42:10.316 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-osd.7.log: /var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35148.log 2024-02-09T08:42:10.316 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35057.log 2024-02-09T08:42:10.316 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35148.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-02-09T08:42:10.316 INFO:teuthology.orchestra.run.smithi103.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.34977.log.gz 2024-02-09T08:42:10.316 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35057.log: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34897.log 2024-02-09T08:42:10.316 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35148.log.gz 2024-02-09T08:42:10.316 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-mgr.x.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.35057.log.gz 2024-02-09T08:42:10.316 INFO:teuthology.orchestra.run.smithi103.stderr: 92.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-02-09T08:42:10.316 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-02-09T08:42:10.316 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35188.log 2024-02-09T08:42:10.316 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35017.log 2024-02-09T08:42:10.316 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34897.log.gz 2024-02-09T08:42:10.316 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35188.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-02-09T08:42:10.317 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35017.log: 88.5% 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35017.log.gz 2024-02-09T08:42:10.317 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35188.log.gz 2024-02-09T08:42:10.317 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34937.log 2024-02-09T08:42:10.317 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.admin.34937.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34937.log.gz 2024-02-09T08:42:10.320 INFO:teuthology.orchestra.run.smithi103.stderr: 87.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-02-09T08:42:10.320 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.40305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41351.log 2024-02-09T08:42:10.320 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.41731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41723.log 2024-02-09T08:42:10.320 INFO:teuthology.orchestra.run.smithi062.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40305.log.gz 2024-02-09T08:42:10.320 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.41351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104813.log 2024-02-09T08:42:10.320 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.41723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39132.log 2024-02-09T08:42:10.320 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.104813.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-02-09T08:42:10.320 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.39132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109256.log 2024-02-09T08:42:10.320 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41681.log 2024-02-09T08:42:10.320 INFO:teuthology.orchestra.run.smithi062.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39132.log.gz/var/log/ceph/ceph-client.admin.109256.log: 2024-02-09T08:42:10.321 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108584.log 2024-02-09T08:42:10.321 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.41681.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.109256.log.gz 2024-02-09T08:42:10.321 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108836.log 2024-02-09T08:42:10.321 INFO:teuthology.orchestra.run.smithi062.stderr:gzip 86.8% -- replaced with /var/log/ceph/ceph-client.admin.41681.log.gz 2024-02-09T08:42:10.321 INFO:teuthology.orchestra.run.smithi062.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.108374.log 2024-02-09T08:42:10.321 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.108836.log: /var/log/ceph/ceph-client.admin.108584.log: gzip -5 --verbose -- 91.2% -- replaced with /var/log/ceph/ceph-client.admin.104813.log.gz 2024-02-09T08:42:10.321 INFO:teuthology.orchestra.run.smithi062.stderr: /var/log/ceph/ceph-client.admin.35355.log 2024-02-09T08:42:10.321 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.108374.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.41731.log.gz 87.9% 2024-02-09T08:42:10.321 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.108836.log.gz 2024-02-09T08:42:10.321 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41231.log 2024-02-09T08:42:10.321 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.35355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41096.log 2024-02-09T08:42:10.321 INFO:teuthology.orchestra.run.smithi062.stderr: 87.6% 87.9% -- replaced with /var/log/ceph/ceph-client.admin.108584.log.gz 2024-02-09T08:42:10.321 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.108374.log.gz 2024-02-09T08:42:10.321 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.41231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40943.log 2024-02-09T08:42:10.321 INFO:teuthology.orchestra.run.smithi062.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35355.log.gz 2024-02-09T08:42:10.322 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.41096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41584.log 2024-02-09T08:42:10.322 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.40943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42057.log 2024-02-09T08:42:10.322 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.41584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90807.log 2024-02-09T08:42:10.322 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.42057.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.41584.log.gz 2024-02-09T08:42:10.322 INFO:teuthology.orchestra.run.smithi062.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.41723.log.gz 2024-02-09T08:42:10.322 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108458.log 2024-02-09T08:42:10.322 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.90807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90810.log 2024-02-09T08:42:10.322 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.108458.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.108458.log.gz 2024-02-09T08:42:10.322 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40466.log 2024-02-09T08:42:10.322 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.90810.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.90807.log.gz 2024-02-09T08:42:10.322 INFO:teuthology.orchestra.run.smithi062.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.41351.log.gz 2024-02-09T08:42:10.322 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108626.log 2024-02-09T08:42:10.322 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.40466.log: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.42057.log.gz 2024-02-09T08:42:10.322 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40306.log 2024-02-09T08:42:10.322 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.108626.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40466.log.gzgzip 2024-02-09T08:42:10.322 INFO:teuthology.orchestra.run.smithi062.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.57034.log 2024-02-09T08:42:10.322 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41793.log 88.7% -- replaced with /var/log/ceph/ceph-client.admin.108626.log.gz 2024-02-09T08:42:10.323 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:42:10.323 INFO:teuthology.orchestra.run.smithi062.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.90810.log.gz 2024-02-09T08:42:10.323 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.57034.log: /var/log/ceph/ceph-client.admin.40306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39627.log 2024-02-09T08:42:10.323 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.41793.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.c.log 2024-02-09T08:42:10.323 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.39627.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.40306.log.gz 2024-02-09T08:42:10.323 INFO:teuthology.orchestra.run.smithi062.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.41231.log.gzgzip -5 --verbose -- /var/log/ceph/valgrind/osd.2.log 2024-02-09T08:42:10.323 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:42:10.323 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/valgrind/mon.c.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39627.log.gz 2024-02-09T08:42:10.323 INFO:teuthology.orchestra.run.smithi062.stderr: 69.6% -- replaced with /var/log/ceph/valgrind/mon.c.log.gz 2024-02-09T08:42:10.323 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.0.log 2024-02-09T08:42:10.323 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/valgrind/osd.2.log: gzip 64.0% -- replaced with /var/log/ceph/valgrind/osd.2.log.gz 2024-02-09T08:42:10.323 INFO:teuthology.orchestra.run.smithi062.stderr: -5 --verbose -- /var/log/ceph/valgrind/osd.1.log 2024-02-09T08:42:10.323 INFO:teuthology.orchestra.run.smithi062.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.57034.log.gz 2024-02-09T08:42:10.323 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/valgrind/osd.0.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.a.log 2024-02-09T08:42:10.323 INFO:teuthology.orchestra.run.smithi062.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.41793.log.gz 2024-02-09T08:42:10.323 INFO:teuthology.orchestra.run.smithi062.stderr: 64.0% -- replaced with /var/log/ceph/valgrind/osd.0.log.gz 2024-02-09T08:42:10.324 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/valgrind/osd.1.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.3.log 2024-02-09T08:42:10.324 INFO:teuthology.orchestra.run.smithi062.stderr: 64.0% -- replaced with /var/log/ceph/valgrind/osd.1.log.gz 2024-02-09T08:42:10.324 INFO:teuthology.orchestra.run.smithi062.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.40943.log.gz 2024-02-09T08:42:10.324 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/valgrind/mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41330.log 2024-02-09T08:42:10.324 INFO:teuthology.orchestra.run.smithi062.stderr: 69.6% -- replaced with /var/log/ceph/valgrind/mon.a.log.gz 2024-02-09T08:42:10.324 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37355.log 2024-02-09T08:42:10.324 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/valgrind/osd.3.log: 63.9% -- replaced with /var/log/ceph/valgrind/osd.3.log.gz 2024-02-09T08:42:10.324 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.41330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109046.log 2024-02-09T08:42:10.324 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.37355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40416.log 2024-02-09T08:42:10.324 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.109046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40266.log 2024-02-09T08:42:10.324 INFO:teuthology.orchestra.run.smithi062.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37355.log.gz 2024-02-09T08:42:10.324 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.40416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108710.log 2024-02-09T08:42:10.324 INFO:teuthology.orchestra.run.smithi062.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.109046.log.gz 2024-02-09T08:42:10.324 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.40266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38879.log 2024-02-09T08:42:10.324 INFO:teuthology.orchestra.run.smithi062.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40416.log.gz 2024-02-09T08:42:10.325 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.108710.log: gzip -5 --verbose 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40266.log.gz 2024-02-09T08:42:10.325 INFO:teuthology.orchestra.run.smithi062.stderr: -- /var/log/ceph/ceph-client.admin.104814.log 2024-02-09T08:42:10.325 INFO:teuthology.orchestra.run.smithi062.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.108710.log.gz 2024-02-09T08:42:10.325 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.38879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39720.log 2024-02-09T08:42:10.325 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.104814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39391.log 2024-02-09T08:42:10.325 INFO:teuthology.orchestra.run.smithi062.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38879.log.gz 2024-02-09T08:42:10.325 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.39720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39392.log 2024-02-09T08:42:10.325 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.39391.log: gzip -5 87.0% -- replaced with /var/log/ceph/ceph-client.admin.39720.log.gz 2024-02-09T08:42:10.325 INFO:teuthology.orchestra.run.smithi062.stderr: --verbose -- /var/log/ceph/ceph-client.admin.42037.log 2024-02-09T08:42:10.325 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.39392.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39391.log.gz 2024-02-09T08:42:10.325 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39683.log 2024-02-09T08:42:10.325 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.42037.log: gzip -5 --verbose 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39392.log.gz 2024-02-09T08:42:10.325 INFO:teuthology.orchestra.run.smithi062.stderr: -- /var/log/ceph/ceph-client.admin.41792.log 2024-02-09T08:42:10.325 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.39683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40931.log 2024-02-09T08:42:10.325 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.41792.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39683.log.gz 2024-02-09T08:42:10.325 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108500.log 2024-02-09T08:42:10.326 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.40931.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.104814.log.gz 2024-02-09T08:42:10.326 INFO:teuthology.orchestra.run.smithi062.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.42037.log.gz 2024-02-09T08:42:10.326 INFO:teuthology.orchestra.run.smithi062.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.41330.log.gz 2024-02-09T08:42:10.326 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41770.log 2024-02-09T08:42:10.326 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.108500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40894.log 2024-02-09T08:42:10.326 INFO:teuthology.orchestra.run.smithi062.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.41792.log.gz 2024-02-09T08:42:10.326 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.41770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35515.log 2024-02-09T08:42:10.326 INFO:teuthology.orchestra.run.smithi062.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.108500.log.gz 2024-02-09T08:42:10.326 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.40894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90811.log 2024-02-09T08:42:10.326 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.35515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35378.log 2024-02-09T08:42:10.326 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.90811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41092.log 2024-02-09T08:42:10.326 INFO:teuthology.orchestra.run.smithi062.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35515.log.gz 2024-02-09T08:42:10.326 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.35378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39622.log 2024-02-09T08:42:10.326 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.41092.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35378.log.gz 2024-02-09T08:42:10.326 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38994.log 2024-02-09T08:42:10.327 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.39622.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39622.log.gz 2024-02-09T08:42:10.327 INFO:teuthology.orchestra.run.smithi062.stderr: 92.1% 90.9% -- replaced with /var/log/ceph/ceph-client.admin.40931.log.gz 2024-02-09T08:42:10.327 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.90811.log.gz 2024-02-09T08:42:10.327 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-02-09T08:42:10.327 INFO:teuthology.orchestra.run.smithi062.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.41770.log.gz 2024-02-09T08:42:10.327 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.38994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42092.log 2024-02-09T08:42:10.327 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5/var/log/ceph/ceph.audit.log: --verbose -- /var/log/ceph/ceph-client.admin.108542.log 2024-02-09T08:42:10.327 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.42092.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38994.log.gz 2024-02-09T08:42:10.327 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40602.log 2024-02-09T08:42:10.327 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.108542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35037.log 2024-02-09T08:42:10.327 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.40602.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.108542.log.gz 2024-02-09T08:42:10.327 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42071.log 2024-02-09T08:42:10.327 INFO:teuthology.orchestra.run.smithi062.stderr: 88.0%/var/log/ceph/ceph-client.admin.35037.log: -- replaced with /var/log/ceph/ceph-client.admin.40602.log.gz 2024-02-09T08:42:10.327 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39792.log 2024-02-09T08:42:10.327 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.42071.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.35037.log.gz 2024-02-09T08:42:10.328 INFO:teuthology.orchestra.run.smithi062.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.41092.log.gz 2024-02-09T08:42:10.328 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108962.log 2024-02-09T08:42:10.328 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.39792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108794.log 2024-02-09T08:42:10.328 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.108962.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39792.log.gz 2024-02-09T08:42:10.328 INFO:teuthology.orchestra.run.smithi062.stderr: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57032.log 2024-02-09T08:42:10.328 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.108962.log.gz 2024-02-09T08:42:10.328 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.108794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39174.log 2024-02-09T08:42:10.328 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.57032.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.108794.log.gz 2024-02-09T08:42:10.328 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42054.log 2024-02-09T08:42:10.328 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.39174.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39174.log.gz 2024-02-09T08:42:10.328 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108132.log 2024-02-09T08:42:10.328 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.42054.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.57032.log.gz 2024-02-09T08:42:10.328 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41131.log 2024-02-09T08:42:10.328 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.108132.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.108132.log.gz 2024-02-09T08:42:10.328 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40983.log 2024-02-09T08:42:10.329 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.41131.log: 95.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-02-09T08:42:10.329 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40099.log 2024-02-09T08:42:10.329 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.40983.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.42071.log.gz 2024-02-09T08:42:10.329 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109214.log 2024-02-09T08:42:10.329 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.40099.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40099.log.gz 2024-02-09T08:42:10.329 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109172.log 2024-02-09T08:42:10.329 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.109214.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.109214.log.gz 2024-02-09T08:42:10.329 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73084.log 2024-02-09T08:42:10.329 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.109172.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.109172.log.gz 2024-02-09T08:42:10.329 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42014.log 2024-02-09T08:42:10.329 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.73084.log: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.41131.log.gz 2024-02-09T08:42:10.329 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-02-09T08:42:10.329 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.42014.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.73084.log.gz 2024-02-09T08:42:10.329 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40968.log 2024-02-09T08:42:10.332 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-osd.1.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.42054.log.gz 2024-02-09T08:42:10.332 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41072.log 2024-02-09T08:42:10.332 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.40968.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.40894.log.gz 2024-02-09T08:42:10.332 INFO:teuthology.orchestra.run.smithi062.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.40968.log.gz 2024-02-09T08:42:10.333 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41900.log 2024-02-09T08:42:10.333 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.41072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39388.log 2024-02-09T08:42:10.333 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.41900.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.41900.log.gz 2024-02-09T08:42:10.333 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41242.log 2024-02-09T08:42:10.333 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.39388.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39388.log.gz 2024-02-09T08:42:10.333 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41528.log 2024-02-09T08:42:10.343 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.41242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109004.log 2024-02-09T08:42:10.347 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.41528.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.42092.log.gz 2024-02-09T08:42:10.352 INFO:teuthology.orchestra.run.smithi062.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.41528.log.gz 2024-02-09T08:42:10.352 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109088.log 2024-02-09T08:42:10.352 INFO:teuthology.orchestra.run.smithi062.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.41242.log.gz 2024-02-09T08:42:10.352 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.109004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41552.log 2024-02-09T08:42:10.352 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.109088.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.109004.log.gz 2024-02-09T08:42:10.352 INFO:teuthology.orchestra.run.smithi062.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.109088.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41275.log 2024-02-09T08:42:10.352 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:42:10.352 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108416.log 2024-02-09T08:42:10.360 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.41552.log: /var/log/ceph/ceph-client.admin.41275.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.41275.log.gz 2024-02-09T08:42:10.360 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39930.log 2024-02-09T08:42:10.361 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.108416.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.108416.log.gz 2024-02-09T08:42:10.361 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39991.log 2024-02-09T08:42:10.362 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.39930.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39930.log.gz 2024-02-09T08:42:10.362 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41827.log 2024-02-09T08:42:10.364 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.39991.log: 87.6% 93.0% -- replaced with /var/log/ceph/ceph-client.admin.41552.log.gz 2024-02-09T08:42:10.364 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39991.log.gz 2024-02-09T08:42:10.364 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-02-09T08:42:10.364 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.41827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39216.log 2024-02-09T08:42:10.370 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-osd.3.log: 96.8% -- replaced with /var/log/ceph/ceph-client.admin.42014.log.gz 2024-02-09T08:42:10.373 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39397.log 2024-02-09T08:42:10.374 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.39216.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39216.log.gz 2024-02-09T08:42:10.380 INFO:teuthology.orchestra.run.smithi062.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.40983.log.gz 2024-02-09T08:42:10.388 INFO:teuthology.orchestra.run.smithi062.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.41827.log.gz 2024-02-09T08:42:10.388 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41854.log 2024-02-09T08:42:10.391 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.39397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41722.log 2024-02-09T08:42:10.391 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.41854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38930.log 2024-02-09T08:42:10.391 INFO:teuthology.orchestra.run.smithi062.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39397.log.gz 2024-02-09T08:42:10.391 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.41722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39712.log 2024-02-09T08:42:10.392 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.38930.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38930.log.gz 2024-02-09T08:42:10.392 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41995.log 2024-02-09T08:42:10.393 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.39712.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39712.log.gz 2024-02-09T08:42:10.393 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39596.log 2024-02-09T08:42:10.394 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.41995.log: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.41854.log.gz 2024-02-09T08:42:10.405 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41880.log 2024-02-09T08:42:10.406 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.39596.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.39596.log.gz 2024-02-09T08:42:10.406 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73085.log 2024-02-09T08:42:10.412 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.41880.log: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.41722.log.gz 2024-02-09T08:42:10.413 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39743.log 2024-02-09T08:42:10.418 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.73085.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.73085.log.gz 2024-02-09T08:42:10.418 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39950.log 2024-02-09T08:42:10.418 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.39743.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39743.log.gz 2024-02-09T08:42:10.418 INFO:teuthology.orchestra.run.smithi062.stderr: 94.5% -- replaced with /var/log/ceph/ceph-client.admin.41072.log.gz 2024-02-09T08:42:10.418 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40040.log 2024-02-09T08:42:10.420 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.39950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40188.log 2024-02-09T08:42:10.420 INFO:teuthology.orchestra.run.smithi062.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39950.log.gz 2024-02-09T08:42:10.420 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.40040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39398.log 2024-02-09T08:42:10.420 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.40188.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.40040.log.gz 2024-02-09T08:42:10.420 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84414.log 2024-02-09T08:42:10.421 INFO:teuthology.orchestra.run.smithi062.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.40188.log.gz 2024-02-09T08:42:10.421 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.39398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41536.log 2024-02-09T08:42:10.423 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.84414.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39398.log.gz 2024-02-09T08:42:10.423 INFO:teuthology.orchestra.run.smithi062.stderr: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-02-09T08:42:10.423 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.84414.log.gz/var/log/ceph/ceph-client.admin.41536.log: 2024-02-09T08:42:10.423 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36390.log 2024-02-09T08:42:10.427 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-mgr.y.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.41995.log.gz 2024-02-09T08:42:10.428 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41051.log 2024-02-09T08:42:10.429 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.36390.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36390.log.gz 2024-02-09T08:42:10.429 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109130.log 2024-02-09T08:42:10.441 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.41051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39394.log 2024-02-09T08:42:10.442 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.109130.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.109130.log.gz 2024-02-09T08:42:10.446 INFO:teuthology.orchestra.run.smithi062.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.41880.log.gz 2024-02-09T08:42:10.453 INFO:teuthology.orchestra.run.smithi062.stderr: 94.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-02-09T08:42:10.455 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41498.log 2024-02-09T08:42:10.455 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.39394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90808.log 2024-02-09T08:42:10.455 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.41498.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39394.log.gz 2024-02-09T08:42:10.455 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40518.log 2024-02-09T08:42:10.458 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.90808.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.90808.log.gz 2024-02-09T08:42:10.458 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-02-09T08:42:10.460 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.40518.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40518.log.gz 2024-02-09T08:42:10.460 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41315.log 2024-02-09T08:42:10.465 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-osd.0.log: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.41498.log.gz 2024-02-09T08:42:10.466 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41727.log 2024-02-09T08:42:10.474 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.41315.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.41315.log.gz 2024-02-09T08:42:10.474 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108878.log 2024-02-09T08:42:10.480 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.41727.log: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.41536.log.gz 2024-02-09T08:42:10.481 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41533.log 2024-02-09T08:42:10.482 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.108878.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.108878.log.gz 2024-02-09T08:42:10.483 INFO:teuthology.orchestra.run.smithi062.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.41727.log.gz 2024-02-09T08:42:10.483 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40166.log 2024-02-09T08:42:10.483 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.41533.log: -- /var/log/ceph/ceph.log 2024-02-09T08:42:10.484 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.40166.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40166.log.gz 2024-02-09T08:42:10.484 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73083.log 2024-02-09T08:42:10.491 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.41533.log.gz 2024-02-09T08:42:10.492 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40350.log 2024-02-09T08:42:10.496 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.73083.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.73083.log.gz 2024-02-09T08:42:10.496 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40915.log 2024-02-09T08:42:10.498 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.40350.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40350.log.gz 2024-02-09T08:42:10.498 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-02-09T08:42:10.501 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.40915.log: 93.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-02-09T08:42:10.511 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104812.log 2024-02-09T08:42:10.524 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84415.log 2024-02-09T08:42:10.528 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.104812.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.104812.log.gz 2024-02-09T08:42:10.541 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39395.log 2024-02-09T08:42:10.544 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.84415.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.84415.log.gz 2024-02-09T08:42:10.548 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.29186.log 2024-02-09T08:42:10.562 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.39395.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39395.log.gz 2024-02-09T08:42:10.563 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108920.log 2024-02-09T08:42:10.563 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph.tmp-client.admin.29186.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.29186.log.gz 2024-02-09T08:42:10.568 INFO:teuthology.orchestra.run.smithi062.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.40915.log.gz 2024-02-09T08:42:10.569 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84413.log 2024-02-09T08:42:10.570 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.108920.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.108920.log.gz 2024-02-09T08:42:10.570 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41426.log 2024-02-09T08:42:10.574 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.84413.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.84413.log.gz 2024-02-09T08:42:10.574 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39396.log 2024-02-09T08:42:10.587 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.41426.log: 91.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40560.log 2024-02-09T08:42:10.589 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.39396.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39396.log.gz 2024-02-09T08:42:10.589 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41426.log.gz 2024-02-09T08:42:10.589 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39050.log 2024-02-09T08:42:10.590 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.40560.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40560.log.gz 2024-02-09T08:42:10.590 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40100.log 2024-02-09T08:42:10.592 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.39050.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39050.log.gz 2024-02-09T08:42:10.592 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108668.log 2024-02-09T08:42:10.593 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.40100.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40100.log.gz 2024-02-09T08:42:10.593 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39090.log 2024-02-09T08:42:10.595 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.108668.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.108668.log.gz 2024-02-09T08:42:10.595 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90809.log 2024-02-09T08:42:10.596 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.39090.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39090.log.gz 2024-02-09T08:42:10.596 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41894.log 2024-02-09T08:42:10.601 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.90809.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.90809.log.gz 2024-02-09T08:42:10.601 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108752.log 2024-02-09T08:42:10.614 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.41894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108131.log 2024-02-09T08:42:10.615 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.108752.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.108752.log.gz 2024-02-09T08:42:10.617 INFO:teuthology.orchestra.run.smithi062.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.41894.log.gz 2024-02-09T08:42:10.618 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109296.log 2024-02-09T08:42:10.622 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.108131.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.108131.log.gz 2024-02-09T08:42:10.622 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38654.log 2024-02-09T08:42:10.623 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.109296.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.109296.log.gz 2024-02-09T08:42:10.624 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57033.log 2024-02-09T08:42:10.624 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.38654.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38654.log.gz 2024-02-09T08:42:10.625 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41176.log 2024-02-09T08:42:10.628 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.57033.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.57033.log.gz 2024-02-09T08:42:10.629 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-02-09T08:42:10.635 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.41176.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.41176.log.gz 2024-02-09T08:42:10.806 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-mon.c.log: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.41096.log.gz 2024-02-09T08:42:10.807 INFO:teuthology.orchestra.run.smithi103.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-02-09T08:42:11.938 INFO:teuthology.orchestra.run.smithi062.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.41051.log.gz 2024-02-09T08:42:12.134 INFO:teuthology.orchestra.run.smithi103.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-02-09T08:42:12.864 INFO:teuthology.orchestra.run.smithi062.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-02-09T08:42:14.505 INFO:teuthology.orchestra.run.smithi062.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-02-09T08:42:17.794 INFO:teuthology.orchestra.run.smithi103.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-02-09T08:42:18.693 INFO:teuthology.orchestra.run.smithi103.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-02-09T08:42:19.134 INFO:teuthology.orchestra.run.smithi103.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-02-09T08:42:19.305 INFO:teuthology.orchestra.run.smithi103.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-02-09T08:42:19.307 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-09T08:42:19.307 INFO:teuthology.orchestra.run.smithi103.stderr:real 0m9.027s 2024-02-09T08:42:19.307 INFO:teuthology.orchestra.run.smithi103.stderr:user 0m34.909s 2024-02-09T08:42:19.307 INFO:teuthology.orchestra.run.smithi103.stderr:sys 0m1.170s 2024-02-09T08:42:19.552 INFO:teuthology.orchestra.run.smithi062.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-02-09T08:42:19.604 INFO:teuthology.orchestra.run.smithi062.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-02-09T08:42:20.009 INFO:teuthology.orchestra.run.smithi062.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-02-09T08:42:20.152 INFO:teuthology.orchestra.run.smithi062.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-02-09T08:42:20.154 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-09T08:42:20.154 INFO:teuthology.orchestra.run.smithi062.stderr:real 0m9.907s 2024-02-09T08:42:20.154 INFO:teuthology.orchestra.run.smithi062.stderr:user 0m45.620s 2024-02-09T08:42:20.154 INFO:teuthology.orchestra.run.smithi062.stderr:sys 0m1.541s 2024-02-09T08:42:20.155 INFO:tasks.ceph:Archiving logs... 2024-02-09T08:42:20.155 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-02-09_00:15:46-rados-wip-yuri2-testing-2024-02-08-0727-distro-default-smithi/7553275/remote/smithi062/log 2024-02-09T08:42:20.156 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-09T08:42:26.104 DEBUG:teuthology.misc:Transferring archived files from smithi103:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-02-09_00:15:46-rados-wip-yuri2-testing-2024-02-08-0727-distro-default-smithi/7553275/remote/smithi103/log 2024-02-09T08:42:26.105 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-09T08:42:31.173 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_0089f33ec7e39da1a9e0f281bf62a5b44e1951f6/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_0089f33ec7e39da1a9e0f281bf62a5b44e1951f6/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_0089f33ec7e39da1a9e0f281bf62a5b44e1951f6/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun 2024-02-09T08:42:31.175 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-02-09T08:42:31.184 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_0089f33ec7e39da1a9e0f281bf62a5b44e1951f6/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_0089f33ec7e39da1a9e0f281bf62a5b44e1951f6/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_0089f33ec7e39da1a9e0f281bf62a5b44e1951f6/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun 2024-02-09T08:42:31.184 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-02-09T08:42:31.185 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-09T08:42:31.187 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-09T08:42:31.273 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-02-09T08:42:31.283 INFO:teuthology.task.clock:Checking final clock skew... 2024-02-09T08:42:31.284 DEBUG:teuthology.orchestra.run.smithi062:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-09T08:42:31.286 DEBUG:teuthology.orchestra.run.smithi103:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-09T08:42:31.300 INFO:teuthology.orchestra.run.smithi062.stderr:bash: line 1: ntpq: command not found 2024-02-09T08:42:31.302 INFO:teuthology.orchestra.run.smithi103.stderr:bash: line 1: ntpq: command not found 2024-02-09T08:42:31.304 INFO:teuthology.orchestra.run.smithi062.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-09T08:42:31.304 INFO:teuthology.orchestra.run.smithi062.stdout:=============================================================================== 2024-02-09T08:42:31.304 INFO:teuthology.orchestra.run.smithi062.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 1 -941us[ -941us] +/- 85ms 2024-02-09T08:42:31.304 INFO:teuthology.orchestra.run.smithi062.stdout:^* hv02.front.sepia.ceph.com 3 6 377 63 -312us[ -290us] +/- 49ms 2024-02-09T08:42:31.304 INFO:teuthology.orchestra.run.smithi062.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 3 +1570us[+1570us] +/- 86ms 2024-02-09T08:42:31.304 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-02-09T08:42:31.307 INFO:teuthology.orchestra.run.smithi103.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-09T08:42:31.307 INFO:teuthology.orchestra.run.smithi103.stdout:=============================================================================== 2024-02-09T08:42:31.307 INFO:teuthology.orchestra.run.smithi103.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 2 -1018us[-1013us] +/- 85ms 2024-02-09T08:42:31.307 INFO:teuthology.orchestra.run.smithi103.stdout:^* hv02.front.sepia.ceph.com 3 7 377 1 -342us[ -338us] +/- 50ms 2024-02-09T08:42:31.308 INFO:teuthology.orchestra.run.smithi103.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 4 +1494us[+1498us] +/- 86ms 2024-02-09T08:42:31.308 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-02-09T08:42:31.308 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-02-09T08:42:31.319 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-02-09T08:42:31.319 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-02-09T08:42:31.362 DEBUG:teuthology.orchestra.run.smithi062:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-09T08:42:31.435 DEBUG:teuthology.orchestra.run.smithi103:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-09T08:42:31.507 DEBUG:teuthology.orchestra.run.smithi062:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-09T08:42:31.538 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-09T08:42:31.538 DEBUG:teuthology.orchestra.run.smithi103:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-09T08:42:31.572 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-09T08:42:31.572 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-02-09T08:42:31.584 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-02-09T08:42:31.638 INFO:teuthology.task.internal:Duration was 3471.387962 seconds 2024-02-09T08:42:31.638 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-02-09T08:42:31.685 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-02-09T08:42:31.685 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-09T08:42:31.688 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-09T08:42:31.732 INFO:teuthology.orchestra.run.smithi062.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-09T08:42:31.732 INFO:teuthology.orchestra.run.smithi103.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-09T08:42:32.246 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-02-09T08:42:32.246 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi062.front.sepia.ceph.com 2024-02-09T08:42:32.246 DEBUG:teuthology.orchestra.run.smithi062:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-09T08:42:32.268 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi103.front.sepia.ceph.com 2024-02-09T08:42:32.268 DEBUG:teuthology.orchestra.run.smithi103:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-09T08:42:32.298 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-02-09T08:42:32.299 DEBUG:teuthology.orchestra.run.smithi062:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-09T08:42:32.311 DEBUG:teuthology.orchestra.run.smithi103:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-09T08:42:32.369 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-02-09T08:42:32.369 DEBUG:teuthology.orchestra.run.smithi062:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-09T08:42:32.384 DEBUG:teuthology.orchestra.run.smithi103:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-09T08:42:32.512 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-02-09T08:42:32.522 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-02-09T08:42:32.523 DEBUG:teuthology.orchestra.run.smithi062:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-09T08:42:32.550 DEBUG:teuthology.orchestra.run.smithi103:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-09T08:42:32.578 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-02-09T08:42:32.588 DEBUG:teuthology.orchestra.run.smithi062:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-09T08:42:32.595 DEBUG:teuthology.orchestra.run.smithi103:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-09T08:42:32.616 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern = core 2024-02-09T08:42:32.643 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern = core 2024-02-09T08:42:32.671 DEBUG:teuthology.orchestra.run.smithi062:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-09T08:42:32.686 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-09T08:42:32.687 DEBUG:teuthology.orchestra.run.smithi103:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-09T08:42:32.726 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-09T08:42:32.726 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-02-09T08:42:32.736 INFO:teuthology.task.internal:Transferring archived files... 2024-02-09T08:42:32.737 DEBUG:teuthology.misc:Transferring archived files from smithi062:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-02-09_00:15:46-rados-wip-yuri2-testing-2024-02-08-0727-distro-default-smithi/7553275/remote/smithi062 2024-02-09T08:42:32.738 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-09T08:42:32.793 DEBUG:teuthology.misc:Transferring archived files from smithi103:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-02-09_00:15:46-rados-wip-yuri2-testing-2024-02-08-0727-distro-default-smithi/7553275/remote/smithi103 2024-02-09T08:42:32.793 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-09T08:42:32.828 INFO:teuthology.task.internal:Removing archive directory... 2024-02-09T08:42:32.829 DEBUG:teuthology.orchestra.run.smithi062:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-09T08:42:32.831 DEBUG:teuthology.orchestra.run.smithi103:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-09T08:42:32.878 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-02-09T08:42:32.891 INFO:teuthology.task.internal:Not uploading archives. 2024-02-09T08:42:32.891 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-02-09T08:42:32.962 INFO:teuthology.task.internal:Tidying up after the test... 2024-02-09T08:42:32.962 DEBUG:teuthology.orchestra.run.smithi062:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-09T08:42:32.964 DEBUG:teuthology.orchestra.run.smithi103:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-09T08:42:32.976 INFO:teuthology.orchestra.run.smithi062.stdout: 265807 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 9 08:42 /home/ubuntu/cephtest 2024-02-09T08:42:32.979 INFO:teuthology.orchestra.run.smithi103.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 9 08:42 /home/ubuntu/cephtest 2024-02-09T08:42:32.980 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-02-09T08:42:33.004 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-02-09T08:42:33.056 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: Exception: valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun 2024-02-09T08:42:33.056 INFO:teuthology.nuke:Checking targets against current locks 2024-02-09T08:42:33.084 DEBUG:teuthology.nuke:shortname: smithi062 2024-02-09T08:42:33.084 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-09T08:42:33.110 DEBUG:teuthology.nuke:shortname: smithi103 2024-02-09T08:42:33.110 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-09T08:42:33.113 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-09_00:15:46-rados-wip-yuri2-testing-2024-02-08-0727-distro-default-smithi/7553275', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-09 07:34:09.163873', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAhTwqhJJJycTelWYyHioxLcOZaijtvo91ZWyeIZH2roP0Z5mXpO5wFEEzVJusAXqkxtvan3OatqrN/S3EgMnlM='} 2024-02-09T08:42:33.134 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi103.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-09_00:15:46-rados-wip-yuri2-testing-2024-02-08-0727-distro-default-smithi/7553275', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-09 07:34:09.165090', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHC5JilHHP1xcqOPDFLRQETYuFAlpEWmBmSeVD1yvz/xk66Zegel9L9JuyOngn02Xa2iak8K3yFMbjcDp7OW4KA='} 2024-02-09T08:42:33.164 INFO:teuthology.orchestra.console.smithi062:Power off 2024-02-09T08:42:33.164 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-09T08:42:33.186 DEBUG:teuthology.orchestra.console.smithi062:power off output: Chassis Power Control: Down/Off 2024-02-09T08:42:33.186 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-09T08:42:33.208 INFO:teuthology.orchestra.console.smithi103:Power off 2024-02-09T08:42:33.208 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-09T08:42:33.221 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on 2024-02-09T08:42:33.235 DEBUG:teuthology.orchestra.console.smithi103:power off output: Chassis Power Control: Down/Off 2024-02-09T08:42:33.235 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-09T08:42:33.258 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2024-02-09T08:42:37.223 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-09T08:42:37.259 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-09T08:42:37.333 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on 2024-02-09T08:42:37.368 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2024-02-09T08:42:41.336 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-09T08:42:41.369 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-09T08:42:41.446 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off 2024-02-09T08:42:41.478 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2024-02-09T08:42:41.547 INFO:teuthology.orchestra.console.smithi062:Power off completed 2024-02-09T08:42:41.580 INFO:teuthology.orchestra.console.smithi103:Power off completed 2024-02-09T08:42:41.684 INFO:teuthology.run:Summary data: description: rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} duration: 3471.3879618644714 failure_reason: 'valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun' flavor: default owner: scheduled_yuriw@teuthology status: fail success: false 2024-02-09T08:42:41.685 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-09T08:42:41.763 INFO:teuthology.run:FAIL